GLM-5.2 is live. #1 throughput on OpenRouter, pay-per-token on FriendliAI. Try it today ➜
surogate
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
surogate
Model Tree
Input Modalities
Output Modalities
Supported Functionality
| Benchmark | Surogate-3.5-9B |
|---|---|
| Romanian text quality | |
| Invented word forms / 1k ↓ | 1.051 |
| English leakage / 1k ↓ | 1.016 |
| Missing diacritics / 1k ↓ | 0.193 |
| Knowledge & STEM | |
| RO thinking ARC + MMLU | 83.42 |
| RO thinking ARC | 93.06 |
| RO thinking MMLU | 75.61 |
| MMLU-Pro | ~81.7 |
| MMLU-Redux | ~90.2 |
| GPQA Diamond | ~80.9 |
| SuperGPQA | ~57.6 |
| Instruction following | |
| RO IFEval prompt / instruction strict | 45.37 / 68.72 |
| EN IFEval prompt / instruction strict | 72.46 / 80.34 |
| IFEval | ~79.6 |
| IFBench | ~56.1 |
| MultiChallenge | ~47.4 |
| Math & reasoning | |
| RO GSM8K direct / thinking strict | 75.42 / 73.98 |
| EN GSM8K strict | 91.89 |
| HMMT Feb 25 / Nov 25 | ~82.4 / ~82.1 |
| PolyMATH | ~56.7 |
| Coding & agents | |
| LiveCodeBench v6 | ~64.9 |
| BFCL-V4 | ~65.4 |
| TAU2-Bench | ~78.3 |
| Long context | |
| LongBench v2 | ~54.6 |
| Multilingual & translation | |
| Translation EN to RO / RO to EN (chrF2) | 57.27 / 64.67 |
| WMT24++ | ~71.9 |
| MMMLU | ~80.4 |
| MMLU-ProX | ~75.5 |
| INCLUDE | ~74.8 |
| Global PIQA | ~82.4 |
Plain values are direct measurements. Values marked ~ are estimates derived
from the source foundation model's published results and measured capability
retention.
With enable_thinking=True, the reasoning trace follows the prompt language.
Romanian prompt: Un tren parcurge 180 km în 3 ore. Care este viteza sa medie?
text
<think>Viteza medie este distanța împărțită la timp: 180 km / 3 h = 60 km/h.</think>Viteza medie este 60 km/h.
English prompt: A train travels 180 km in 3 hours. What is its average speed?
text
<think>Average speed is distance divided by time: 180 km / 3 h = 60 km/h.</think>The average speed is 60 km/h.
python
from transformers import AutoModelForImageTextToText, AutoProcessormodel_id = "surogate/Surogate-3.5-9B"processor = AutoProcessor.from_pretrained(model_id)model = AutoModelForImageTextToText.from_pretrained(model_id,device_map="auto",dtype="auto",)messages = [{"role": "user", "content": "Explică pe scurt de ce cerul este albastru."}]inputs = processor.apply_chat_template(messages,tokenize=True,add_generation_prompt=True,enable_thinking=False,return_tensors="pt",return_dict=True,).to(model.device)output = model.generate(**inputs, max_new_tokens=512)answer = processor.decode(output[0][inputs.input_ids.shape[1]:],skip_special_tokens=False,)print(answer)
Set enable_thinking=True for an explicit Romanian reasoning trace. The
shipped sampling defaults are temperature 0.6, top-p 0.95, and top-k 20.
The model was trained using our high-performance Surogate Trainer
Use is subject to the repository's license terms.
Contact us at sales@invergent.ai