GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
ganscs
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
ganscs
Model Tree
Qwen/Qwen3-8B-Base
Input Modalities
Output Modalities
Supported Functionality
49e3418fbbbca6ecbdf9608b4d22e5a407081db4.1586e45fc7c3f7d5e601dc454ba7e15884a2f1df.embed_tokens and lm_head weights replace the original endpoints.Adapters were trained with a 4-bit base. This export merges them into the original BF16 base revision using PEFT's safe merge operation. The training-time validation score above is not a new evaluation of this BF16 export.
Every adapter tensor was consumed; all output tensors are finite and match the
Transformers architecture's names and shapes. The model loaded locally without
PEFT adapters and produced finite logits and a short greedy generation.
merge_manifest.json records source hashes, merge details and output checksums;
validation.json records the smoke test. training_manifest.json preserves
the source experiment settings. This is a weights-only export, without optimizer state.
python
import torchfrom transformers import AutoModelForCausalLM, AutoTokenizermodel_id = "ganscs/Qwen3-8b-qwen-h100-20260909-CPT-merged-step-750"tokenizer = AutoTokenizer.from_pretrained(model_id)model = AutoModelForCausalLM.from_pretrained(model_id, dtype=torch.bfloat16, device_map="auto")