How it was made
A slice of ISTA-DASLab/Kimi-K2.5-P48NVFP4-MoESQ: the REAP-kept experts' tensors are copied byte-for-byte (paired-4:8 sparse storage), renumbered in order, and the router rows / score-correction bias are sliced; 192 of 384 experts removed per layer. Nothing is recompressed, so the MoE-SQ compression never saw the pruned model. Kept indices from REAP (llm-compressor 0.13.0, mixed calibration, 512 × 4096) are in reap_kept_experts.jsonl.
Notes:
- Stage 1 and the slicing ran on 8× NVIDIA B300 (SM103).
Serving
Same stack as the other MoE-SQ / REAP Kimi checkpoints: vLLM v0.30.0 with the MoE-SQ patch
(IST-DASLab/MoESQ, integrations/vllm/install.sh). Multimodal paths are untested; all evaluations are text-only.
License and attribution
Base model moonshotai/Kimi-K2.5 under a Modified MIT License
(see LICENSE, which applies to this checkpoint); upstream notices in THIRD_PARTY_NOTICES.md.
REAP is due to Cerebras Research; the implementation used is llm-compressor's REAPPruningModifier.