GLM-5.2 is live. #1 throughput on OpenRouter, pay-per-token on FriendliAI. Try it today ➜
addansee2
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
addansee2
Model Tree
google/gemma-3-4b-it-qat-q4_0-unquantized
Input Modalities
Output Modalities
Supported Functionality
| Parameter | Value |
|---|---|
| direction_index | per layer |
| attn.o_proj.max_weight | 1.27 |
| attn.o_proj.max_weight_position | 32.22 |
| attn.o_proj.min_weight | 1.04 |
| attn.o_proj.min_weight_distance | 18.63 |
| mlp.down_proj.max_weight | 1.29 |
| mlp.down_proj.max_weight_position | 20.41 |
| mlp.down_proj.min_weight | 0.92 |
| mlp.down_proj.min_weight_distance | 9.75 |
| Metric | This model | Original model (google/gemma-3-4b-it-qat-q4_0-unquantized) |
|---|---|---|
| KL divergence | 0.4659 | 0 (by definition) |
| Refusals | 3/100 | 97/100 |
Model Page: Gemma
[!Note] This repository corresponds to the 4B instruction-tuned version of the Gemma 3 model using Quantization Aware Training (QAT).
The checkpoint in this repository is unquantized, please make sure to quantize with Q4_0 with your favorite tool
Thanks to QAT, the model is able to preserve similar quality as
bfloat16while significantly reducing the memory requirements to load the model.