GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
ibrahimhka
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
ibrahimhka
Model Tree
Qwen/Qwen3-8B
Input Modalities
Output Modalities
Supported Functionality
The adapter is applied on top of a Qwen3-8B base GGUF (e.g. Qwen/Qwen3-8B-GGUF):
CLI approach:
bash
llama-cli -m qwen3-8b.gguf --lora lora-qwen3-8b.gguf (...other args)Server mode:
bash
llama-server -m qwen3-8b.gguf --lora lora-qwen3-8b.gguf (...other args)For comprehensive server configuration guidance, consult the official llama.cpp repository documentation.
The original PEFT adapter (adapter_model.safetensors) is also included for use with
transformers / unsloth on top of the base model. See the
GitHub repository for the
training and inference code.