GLM-5.2 is live. #1 throughput on OpenRouter, pay-per-token on FriendliAI. Try it today ➜
ProCreations
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
ProCreations
Model Tree
ProCreations/grug-v1.1-qwen-3.8-27b
Input Modalities
Output Modalities
Supported Functionality
| metric | Qwen3.8 native head | after grug tuning |
|---|---|---|
| t+2 agreement with verifier | 90.04% | 95.37% |
| gold top-1 | 85.50% | 88.20% |
| eval loss | 0.3802 | 0.1649 |
disagree rate go from 1-in-10 to 1-in-21. old grug v1 mtp sit at 89.3%.
honest part: native head was already 90.0% before any training. grug not rescue broken head — grug sharpen already-good head. and gold top-1 go up too (85.5 -> 88.2), so head get genuinely better at real token, not just better at copying verifier mistake.
also honest: 95.37% is top-1 agreement with the verifier on grug spans — the quantity that decide whether a speculative draft get accepted. it is NOT a measured wall-clock speedup. real tok/s depend on your engine, batch size and draft length.
mtp.* module move.full receipt in mtp_training.json.
engine that know Qwen3.8 MTP (vLLM, sglang) pick head up from config.json
(mtp_num_hidden_layers: 1) and model-mtp.safetensors.
bash
vllm serve ProCreations/grug-v1.1-qwen-3.8-27b-mtp \--speculative-config '{"method":"qwen3_next_mtp","num_speculative_tokens":2}' \--reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder
plain transformers ignore mtp.* and just run the normal model — safe, only no
speedup.
GGUF with draft head: ProCreations/grug-v1.1-qwen-3.8-27b-mtp-gguf. no draft head, smaller: ProCreations/grug-v1.1-qwen-3.8-27b-gguf.
benchmark score, effort table and chart live on the main card — this variant score identical, it is the same verified weight.
apache-2.0.