vLLM
vllm serve zyhang1998/qwen3.5-397b-a17b-mlsbench-syn-rl-rewardfix-step104 \
--tensor-parallel-size 8 \
--dtype bfloat16 \
--reasoning-parser qwen3 \
--speculative-config '{"method":"mtp","num_speculative_tokens":2}'
Training and merge summary
- Base:
Qwen/Qwen3.5-397B-A17B
- Training checkpoint: reward-fix LoRA step 104 (final step; two epochs)
- Precision: BF16
- LoRA rank / alpha: 32 / 64
- Dense-score tie-break weight: 0.001
- Merged LoRA targets: 2,013
- Nonzero LoRA target deltas: 360
- Weight tensors: 2,924
- Weight shards: 94
- Final training reward mean: 0.55315
- Final 64-trajectory validation reward mean: 0.64234
- Final validation valid submissions: 62/64
Important quality note
The checkpoint and validation artifacts completed successfully, but the
post-run policy-consistency gate did not pass. At step 104,
training/rollout_probs_diff_mean was 0.96975,
training/rollout_probs_diff_max was 1.0, and the reported rollout/training
KL was 60.1778. Treat this as an experimental research checkpoint and verify
behavior on the target workload before deployment.
For the base architecture, intended use, limitations, and license terms, see
the Qwen3.5-397B-A17B model card.