GLM-5.2 is live. #1 throughput on OpenRouter, pay-per-token on FriendliAI. Try it today ➜
ressl
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
ressl
Model Tree
OrionLLM/GRM-2.6-Plus
Input Modalities
Output Modalities
Supported Functionality
ModelOpt NVFP4_DEFAULT_CFGnvidia-modelopt via mtq.quantize and export_hf_checkpoint.512 samples from cnn_dailymail, sequence length 512,
batch size 2.Use a recent vLLM build with ModelOpt quantization support on NVIDIA Blackwell:
bash
vllm serve rressl/GRM-2.6-Plus-NVFP4 \--quantization modelopt \--max-model-len 262144 \--gpu-memory-utilization 0.90 \--kv-cache-dtype fp8 \--attention-backend flashinfer \--enable-auto-tool-choice \--tool-call-parser qwen3_coder \--reasoning-parser qwen3 \--trust-remote-code
NVFP4 requires Blackwell-class NVIDIA hardware for the fast path.