GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
desva0
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
desva0
Model Tree
Qwen/Qwen3.8-27B
Input Modalities
Output Modalities
Supported Functionality
Qwen3_5ForConditionalGeneration.pack-quantized format:
num_bits: 4, type: int, symmetric: true, group_size: 128,
strategy: groupignore),
so image understanding is preserved.bash
vllm serve <path-or-repo>/Qwen3.8-27B-Uncensored-W4A16 \--host 0.0.0.0 --port 8000 \--served-model-name qwen3.8-27b \--gpu-memory-utilization 0.90 \--max-model-len 32768 \--enable-auto-tool-choice --tool-call-parser hermes
Then hit the OpenAI-compatible endpoint at http://localhost:8000/v1. Adjust
--max-model-len to trade context length against KV-cache memory on a 24 GB
card. A recent vLLM with compressed-tensors support is required.
Apache-2.0, inherited from the upstream abliterated build. See the bundled
LICENSE. You must retain the license and attribution when redistributing.
This is an uncensored / abliterated model: its built-in refusal behaviour has been removed, so it will attempt requests an aligned model would decline. You are responsible for how you deploy it, for any guardrails you add, and for compliance with the laws and platform rules that apply to you.