GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
positron-ai
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
positron-ai
Model Tree
Qwen/Qwen3.5-27B
Input Modalities
Output Modalities
Supported Functionality
Use this artifact when you need a GPTQ 4-bit build of Qwen/Qwen3.5-27B built by Positron AI.
For general-purpose GPU inference, compare against the original model and other quantized formats before deployment.
| Field | Value |
|---|---|
| Base model | Qwen/Qwen3.5-27B |
| Published artifact | positron-ai/Qwen_Qwen3.5-27B-ingest-best-gptq_proj |
| Quantization method | GPTQ |
| Quantization format | gptq |
| Source precision | n/a |
| Target runtime | n/a |
| Hardware target | n/a |
| Release date | 2026-10-07 |
| License | apache-2.0 |
| Field | Value |
|---|---|
| Weight precision | 4-bit |
| Activation precision | not quantized |
| Bits | 4 |
| Group size | 64 |
| Symmetric quantization | true |
| Activation ordering / desc_act | false |
| Damp percent | 0.05 |
| Calibration dataset | Universal mixed-domain set |
| Calibration samples | 512 |
This card intentionally reports no performance or quality metrics (no KL-divergence, accuracy, or perplexity figures). Validation results are tracked internally by Positron AI.
This artifact was produced by Positron AI from Qwen/Qwen3.5-27B. The original model license and usage restrictions continue to apply.
| Calibration sequence length | 8192 |
| MoE experts per token | n/a |
| Quantization toolchain | GPTQModel 7.3.4, transformers 5.11.0, torch 2.9.1, CUDA 12.8 |