GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
VertexResearch
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
VertexResearch
Model Tree
VertexResearch/Vertex-0.6-100M-8192-ctx-Base
Input Modalities
Output Modalities
Supported Functionality
| Parameters | 96.75M (tied embeddings) |
| Architecture | Qwen3-based transformer |
| Context length | 8192 (RoPE theta 1M) |
| Chat format | ChatML (`< |
| Tool calling | <tool_call> JSON blocks, system-prompt function definitions |
| EOS | </s> (2) and `< |
python
from transformers import AutoTokenizer, AutoModelForCausalLMrepo = "VertexResearch/Vertex-0.6-100M-8192-Instruct"tok = AutoTokenizer.from_pretrained(repo)model = AutoModelForCausalLM.from_pretrained(repo)msgs = [{"role": "user", "content": "Who are you?"}]text = tok.apply_chat_template(msgs, add_generation_prompt=True, tokenize=False)ids = tok(text, return_tensors="pt", add_special_tokens=False).input_idsout = model.generate(ids, max_new_tokens=100, eos_token_id=[2, 6])print(tok.decode(out[0, ids.shape[1]:], skip_special_tokens=True))
For tool calling, put function definitions in the system prompt; the model emits
<tool_call>{"name": ..., "arguments": ...}</tool_call> and consumes results in
<tool_response> blocks.
SFT with TRL on top of Vertex-0.6-100M-8192-ctx-Base: 2 epochs, lr 3e-4 cosine, bf16, max length 2048. Final eval loss 1.466.
These models are not the most coherent yet and need more tuning: expect rambling, repetition, and inconsistent answers, especially over longer generations.
97M parameters: fluent chat and working tool-call syntax, but frequent factual errors, shallow reasoning, and rambling explanations. Not for production use. Knowledge cutoff ~April 2024.