Evaluation
Table with columns: Benchmark, Problems × draws, Output cap, BF16 (71.9 GB), QDA W4A4 (24.1 GB), NVIDIA NVFP4 (23.4 GB), RedHatAI NVFP4 (25.0 GB), unsloth NVFP4 (23.6 GB)| Benchmark | Problems × draws | Output cap | BF16 (71.9 GB) | QDA W4A4 (24.1 GB) | NVIDIA NVFP4 (23.4 GB) | RedHatAI NVFP4 (25.0 GB) | unsloth NVFP4 (23.6 GB) |
|---|
| AIME 2025 | 30 × 32 | 81,920 | 89.3 | 89.8 | 89.4 | 88.5 | 89.0 |
| HMMT Feb 2026 | 33 × 32 | 81,920 | 81.8 | 80.2 | 79.1 | 74.8 | 77.9 |
| GPQA-Diamond | 198 × 16 | 81,920 | 86.0 | 84.9 | 85.0 | 83.7 | 84.5 |
| IFBench | 300 × 16 | 81,920 | 67.6 | 66.0 | 66.6 | 66.2 | 67.9 |
| MMLU-Pro | 12,032 × 1 | 32,768 | 85.2 | 85.0 | 84.9 | 84.1 | 84.9 |
| LiveCodeBench | 454 × 4 | 81,920 | 81.8 | 80.8 | 81.4 | 80.1 | 81.0 |
| Average | | | 81.9 | 81.1 | 81.1 | 79.6 | 80.9 |
Thinking mode, pass@1 averaged over the draws; sampling temperature 1.0, top-p 0.95, top-k 20. Same problems, seeds, sampling and output caps for every model.
Usage
FP4 runs natively on NVIDIA Blackwell GPUs (B200, GB300, RTX PRO 6000). Evaluated with vLLM 0.33.0 on GB300.
vllm serve qda-lab/QDA-Qwen3.6-35B-A3B-W4A4
How it was made
The routed experts and the remaining decoder linears are NVFP4: E2M1 weights with one E4M3 scale per 16 inputs
and an FP32 tensor scale, activations quantized the same way at run time. The linear-attention in_proj_qkv,
in_proj_z and out_proj, and lm_head, are FP8 W8A8 (per-channel weights, dynamic per-token activations).
The self-attention projections, the shared experts, the Gated DeltaNet gates, the routers, the embeddings and
the vision tower stay in BF16. Weights were quantized with GPTQ; the recipe was chosen by QDA's automated
search under a fixed size budget.
Reproduce
Install QDA 0.1.0 (Linux, an NVIDIA GPU and uv):
git clone https://github.com/humanfia/qda.git && cd qdauv venv -p 3.12 --managed-python && . .venv/bin/activateuv pip install -c constraints.txt "./packages/qda-quant[hf,gguf]" "./packages/qda-kl[vllm]" ./packages/qda-agent
Then:
hf download qda-lab/qda-recipe-inputs --repo-type dataset --include "QDA-Qwen3.6-35B-A3B-W4A4/*" --local-dir inputscd inputs/QDA-Qwen3.6-35B-A3B-W4A4qda build qwen3.6-35b-a3b-w4a4-nvfp4.yaml --set out=QDA-Qwen3.6-35B-A3B-W4A4-rebuild --set "devices=[0]"
Needs QDA 0.1.0 and one Blackwell GPU. Original model: Qwen/Qwen3.6-35B-A3B@995ad96eacd98c81ed38be0c5b274b04031597b0, the revision the recipe builds from. On a GB300, a rebuild from this recipe was byte-identical to this checkpoint. A rebuild on one GB300 takes about 9 min.
License
Apache-2.0, the same as the base model.
Citation
QDA: Closed-Loop LLM Quantization Design with Agents
@article{li2026qda, title = {QDA: Closed-Loop LLM Quantization Design with Agents}, author = {Li, Xingyang and Zhao, Tianlang and Han, Song and Zhu, Ligeng}, journal = {arXiv preprint arXiv:2611.23388}, year = {2026}}