GLM-5.2 is live. #1 throughput on OpenRouter, pay-per-token on FriendliAI. Try it today ➜
ProCreations
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
ProCreations
Model Tree
ProCreations/grug-v1.1-qwen-3.8-27b-mtp
Input Modalities
Output Modalities
Supported Functionality
bash
vllm serve ProCreations/grug-v1.1-qwen-3.8-27b-mtp-awq-int4 --max-model-len 32768 \--reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder \--speculative-config '{"method":"qwen3_next_mtp","num_speculative_tokens":2}'
The MTP shard is explicitly present in model.safetensors.index.json, and mtp.* is excluded
from the packed quantization scheme so vLLM loads its BF16 weights instead of looking for
weight_packed tensors.