GLM-5.2 is live. #1 throughput on OpenRouter, pay-per-token on FriendliAI. Try it today ➜
amd
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
amd
Model Tree
Qwen/Qwen3.5-397B-A17B-FP8
Input Modalities
Output Modalities
Supported Functionality
The model was evaluated on GSM8K benchmarks.
The GSM8K result was obtained using the lm-evaluation-harness framework, based on the Docker image rocm/vllm-dev:nightly_main_20260603.
Install the lm-eval (Version: 0.4.12) in container first.
markdown
pip install lm-eval[api]
markdown
export VLLM_ALLOW_LONG_MAX_MODEL_LEN=1export CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7lm_eval --model vllm--model_args pretrained=amd/Qwen3.5-397B-A17B-NVFP4,tensor_parallel_size=8,max_model_len=262144,gpu_memory_utilization=0.90,max_gen_toks=2048,trust_remote_code=True,reasoning_parser=qwen3 \--tasks gsm8k \--num_fewshot 5 \--batch_size auto
Modifications Copyright(c) 2026 Advanced Micro Devices, Inc. All rights reserved.