GLM-5.2 is live. #1 throughput on OpenRouter, pay-per-token on FriendliAI. Try it today ➜
ibrahimhka
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
ibrahimhka
Model Tree
Base
Qwen/Qwen3-8B
Adapter
this model
Input Modalities
Text
Output Modalities
Text
Supported Functionality
Dedicated Endpoints
Container
The adapter is applied on top of a Qwen3-8B base GGUF (e.g. Qwen/Qwen3-8B-GGUF):
CLI approach:
bash
llama-cli -m qwen3-8b.gguf --lora lora-qwen3-8b.gguf (...other args)
Server mode:
bash
llama-server -m qwen3-8b.gguf --lora lora-qwen3-8b.gguf (...other args)
For comprehensive server configuration guidance, consult the official llama.cpp repository documentation.
The original PEFT adapter (adapter_model.safetensors) is also included for use with
transformers / unsloth on top of the base model. See the
GitHub repository for the
training and inference code.