GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
notSnix
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
notSnix
Model Tree
Qwen/Qwen3.8-27B
Input Modalities
Output Modalities
Supported Functionality
| teacher | this model | |
|---|---|---|
| params (LM body) | 27.4B | 24.4B |
| memory (batch 96, 4k+4k) | 97.5 GiB | 92.5 GiB |
| lm loss | 2.265 | 2.668 |
| token acc top-1 | 0.688 | 0.655 |
| token acc top-5 | 0.877 | 0.850 |
| token acc top-10 | 0.907 | 0.883 |
FFN-only, v1 scope. Both mixer kinds (Gated DeltaNet linear_attn and full self_attn) are the
teacher's, unchanged. Vision tower carried through unchanged. MTP head dropped. Per-layer FFN
intermediate size chosen by MIP from {4352, 8704, 13056, 17408}:
text
block_0: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_1: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_2: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_3: attention kv_heads_4 ffn intermediate_17408block_4: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_5: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_6: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_7: attention kv_heads_4 ffn intermediate_17408block_8: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_9: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_10: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_11: attention kv_heads_4 ffn intermediate_17408block_12: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_13: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_14: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_15: attention kv_heads_4 ffn intermediate_17408block_16: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_17: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_18: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_19: attention kv_heads_4 ffn intermediate_17408block_20: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_21: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_22: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_23: attention kv_heads_4 ffn intermediate_17408block_24: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_25: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_26: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_27: attention kv_heads_4 ffn intermediate_17408block_28: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_29: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_30: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_31: attention kv_heads_4 ffn intermediate_17408block_32: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_33: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_34: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_35: attention kv_heads_4 ffn intermediate_17408block_36: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_37: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_38: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_39: attention kv_heads_4 ffn intermediate_17408block_40: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_41: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_42: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_43: attention kv_heads_4 ffn intermediate_13056block_44: mamba num_heads_48 head_dim_128 ffn intermediate_13056block_45: mamba num_heads_48 head_dim_128 ffn intermediate_13056block_46: mamba num_heads_48 head_dim_128 ffn intermediate_8704block_47: attention kv_heads_4 ffn intermediate_8704block_48: mamba num_heads_48 head_dim_128 ffn intermediate_8704block_49: mamba num_heads_48 head_dim_128 ffn intermediate_8704block_50: mamba num_heads_48 head_dim_128 ffn intermediate_8704block_51: attention kv_heads_4 ffn intermediate_13056block_52: mamba num_heads_48 head_dim_128 ffn intermediate_8704block_53: mamba num_heads_48 head_dim_128 ffn intermediate_8704block_54: mamba num_heads_48 head_dim_128 ffn intermediate_13056block_55: attention kv_heads_4 ffn intermediate_8704block_56: mamba num_heads_48 head_dim_128 ffn intermediate_8704block_57: mamba num_heads_48 head_dim_128 ffn intermediate_8704block_58: mamba num_heads_48 head_dim_128 ffn intermediate_8704block_59: attention kv_heads_4 ffn intermediate_4352block_60: mamba num_heads_48 head_dim_128 ffn intermediate_4352block_61: mamba num_heads_48 head_dim_128 ffn intermediate_4352block_62: mamba num_heads_48 head_dim_128 ffn intermediate_8704block_63: attention kv_heads_4 ffn intermediate_8704AnyModel subblock-safetensors (subblocks_safetensors/ + model.safetensors.index.json) with
block_configs in config.json. Load with NVIDIA Model-Optimizer's puzzletron tooling
(modelopt.torch.puzzletron) using the qwen3_5 descriptor. Requires transformers >= 5.8 and the
qwen3_5 descriptor patch (see the companion data repo notSnix/Qwen3.8-27B-Puzzletron-data).
block_0: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_1: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_2: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_3: attention kv_heads_4 ffn intermediate_17408block_4: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_5: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_6: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_7: attention kv_heads_4 ffn intermediate_17408block_8: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_9: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_10: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_11: attention kv_heads_4 ffn intermediate_17408block_12: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_13: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_14: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_15: attention kv_heads_4 ffn intermediate_17408block_16: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_17: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_18: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_19: attention kv_heads_4 ffn intermediate_17408block_20: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_21: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_22: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_23: attention kv_heads_4 ffn intermediate_17408block_24: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_25: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_26: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_27: attention kv_heads_4 ffn intermediate_17408block_28: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_29: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_30: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_31: attention kv_heads_4 ffn intermediate_17408block_32: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_33: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_34: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_35: attention kv_heads_4 ffn intermediate_17408block_36: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_37: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_38: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_39: attention kv_heads_4 ffn intermediate_17408block_40: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_41: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_42: mamba num_heads_48 head_dim_128 ffn intermediate_17408block_43: attention kv_heads_4 ffn intermediate_13056block_44: mamba num_heads_48 head_dim_128 ffn intermediate_13056block_45: mamba num_heads_48 head_dim_128 ffn intermediate_13056block_46: mamba num_heads_48 head_dim_128 ffn intermediate_8704block_47: attention kv_heads_4 ffn intermediate_8704block_48: mamba num_heads_48 head_dim_128 ffn intermediate_8704block_49: mamba num_heads_48 head_dim_128 ffn intermediate_8704block_50: mamba num_heads_48 head_dim_128 ffn intermediate_8704block_51: attention kv_heads_4 ffn intermediate_13056block_52: mamba num_heads_48 head_dim_128 ffn intermediate_8704block_53: mamba num_heads_48 head_dim_128 ffn intermediate_8704block_54: mamba num_heads_48 head_dim_128 ffn intermediate_13056block_55: attention kv_heads_4 ffn intermediate_8704block_56: mamba num_heads_48 head_dim_128 ffn intermediate_8704block_57: mamba num_heads_48 head_dim_128 ffn intermediate_8704block_58: mamba num_heads_48 head_dim_128 ffn intermediate_8704block_59: attention kv_heads_4 ffn intermediate_4352block_60: mamba num_heads_48 head_dim_128 ffn intermediate_4352block_61: mamba num_heads_48 head_dim_128 ffn intermediate_4352block_62: mamba num_heads_48 head_dim_128 ffn intermediate_8704block_63: attention kv_heads_4 ffn intermediate_8704