GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
budget-internalization-iclr2027
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
budget-internalization-iclr2027
Model Tree
Qwen/Qwen3.5-4B
Input Modalities
Output Modalities
Supported Functionality
| Base model | Qwen/Qwen3.5-4B |
| Algorithm | GRPO (leave-one-out baseline, group reward normalization, token-level loss). Responses that hit the budget are truncated and scored as-is. The token budget is stated to the model inside its reasoning, right after the opening <think> tag. |
Generation budget (max_new_tokens) | 4,096 |
| Data | DeepScaleR (math), 3 epochs max |
| Batch | 32 prompts × 8 rollouts per step |
| Optimizer | Adam, cosine LR schedule, peak LR 5e-7, 10 warmup steps |
| Steps | 210 |
| Reward | binary answer correctness (\boxed{} extraction) |
| Weights dtype | BF16 |
Prompts are DeepScaleR problems with a statement of the 4,096-token budget placed inside its reasoning, right after the opening <think> tag, rendered with the base model's chat template.
python
from transformers import AutoModelForCausalLM, AutoTokenizer repo = "budget-internalization-iclr2027/qwen3.5-4b-4k-grpo-budget-after-think-epictuna-s210"tok = AutoTokenizer.from_pretrained(repo)model = AutoModelForCausalLM.from_pretrained(repo, torch_dtype="auto", device_map="auto")With vLLM: vllm serve budget-internalization-iclr2027/qwen3.5-4b-4k-grpo-budget-after-think-epictuna-s210
Inherits the license of the base model (Qwen/Qwen3.5-4B).