GLM-5.2 is live. #1 throughput on OpenRouter, pay-per-token on FriendliAI. Try it today ➜
nachikethreddyy
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
nachikethreddyy
Model Tree
Base
Qwen/Qwen3-8B
Quantized
this model
Input Modalities
Text
Output Modalities
Text
Supported Functionality
Dedicated Endpoints
Container
| Variant | Size | Format | Best For |
|---|---|---|---|
| Full Precision (BF16) | 16.39 GB | Safetensors | Maximum quality, research |
| Q8 Quantized | 8.8 GB | Safetensors | Balanced speed/quality |
| GGUF F16 | 15.3 GB | GGUF | Ollama, llama.cpp, LM Studio |
bash
ollama run nachikethreddyy/qwen3.5-8b-distilled-GGUF:F16
bash
# Installbrew install llama.cpp# Runllama-cli -hf nachikethreddyy/qwen3.5-8b-distilled-GGUF:F16
nachikethreddyy/qwen3.5-8b-distilled-GGUFpython
from transformers import AutoModelForCausalLM, AutoTokenizermodel = AutoModelForCausalLM.from_pretrained("nachikethreddyy/qwen3.5-8b-distilled-GGUF",device_map="auto")
Apache 2.0 (inherited from Qwen/Qwen3-8B)
For MLX/Apple Silicon: See qwen3.5-8b-distilled-MLX