Evaluation
The model was evaluated on gsm8k benchmarks using the vllm framework.
Accuracy
Reproduction
The GSM8K result was obtained using the lm-evaluation-harness framework, based on the Docker image rocm/vllm-dev:nightly_main_20260603.
Install the lm-eval (Version: 0.4.12) in container first.
pip install lm-evalpip install lm-eval[api]
Launching server
vllm serve \ --model amd/MiniMax-M2.7-NVFP4 \ --trust-remote-code \ --host 0.0.0.0 \ --port 8011 \ --tensor-parallel-size 4 \ --enable-auto-tool-choice \ --tool-call-parser minimax_m2 \ --reasoning-parser minimax_m2_append_think
Evaluating model in a new terminal
python3 vllm/tests/evals/gsm8k/gsm8k_eval.py --host http://0.0.0.0 --port 8011
License
Modifications Copyright(c) 2026 Advanced Micro Devices, Inc. All rights reserved.