Evaluation
The model was evaluated on GSM8K benchmarks.
Accuracy
Reproduction
The GSM8K results were obtained using the lm-evaluation-harness framework, based on the Docker image vllm/vllm-openai-rocm:nightly-44fe2a392b71d52a8d72faf2f8278834379482c9, with vLLM pre-installed inside the image and apply this pr #54566.
pip install lm-eval[api] export VLLM_ROCM_USE_AITER=1export VLLM_ROCM_USE_AITER_FP8BMM=0export VLLM_ROCM_USE_AITER_FP4BMM=0 lm_eval --model vllm \ --model_args "pretrained=amd/GLM-5.3-Quark-MXFP4,tensor_parallel_size=4,dtype=auto,quantization=quark,max_model_len=32768,trust_remote_code=True,max_num_seqs=32" \ --tasks gsm8k \ --batch_size auto
License
Modifications Copyright(c) 2026 Advanced Micro Devices, Inc. All rights reserved.