GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
Jeethu
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
Jeethu
Model Tree
XiaomiMiMo/MiMo-V2.6-Distill-Qwen-9B
Input Modalities
Output Modalities
Supported Functionality
Pairwise Rotation Quantization for Efficient Reasoning LLM Inference
ParoQuant is the state-of-the-art INT4 quantization for LLMs. It closes the accuracy gap with FP16 while running at near-AWQ speed. Supports NVIDIA GPUs (vLLM, Transformers) and Apple Silicon (MLX). For more information, see https://github.com/z-lab/paroquant.
Jeethu/MiMo-V2.6-Distill-Qwen-9B-PARO is a 4-bit XiaomiMiMo/MiMo-V2.6-Distill-Qwen-9B quantized with ParoQuant.