GLM-5.2 is live. #1 throughput on OpenRouter, pay-per-token on FriendliAI. Try it today ➜
KIEFERSA
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
KIEFERSA
Model Tree
KIEFERSA/Sophea-Titan-1
Input Modalities
Output Modalities
Supported Functionality
Measured through the vLLM decode path (greedy, non-thinking), vs the bf16 base:
The 4-bit weight quantization costs ≈2.3 pt on General Greek benchmarks (concentrated in Greek-knowledge benchmarks), while English retention is nearly intact (−0.9 pt) and generation stays degeneration-free. This is the size/quality trade for a 4-bit footprint; the FP8 build is lossless if you can afford ~30 GB.
Serve with vLLM (compressed-tensors NVFP4 → Marlin FP4 kernel):
bash
vllm serve KIEFERSA/Sophea-Titan-1-NVFP4 --served-model-name sophea-titan-1-nvfp4 --trust-remote-code \--enable-auto-tool-choice --tool-call-parser qwen3_coder \--reasoning-parser qwen3
Recommended sampling (instruct / non-thinking): temperature=0.7, top_p=0.80, top_k=20, min_p=0.0, presence_penalty=1.5, repetition_penalty=1.0.
python
from openai import OpenAIclient = OpenAI(base_url="http://localhost:8000/v1", api_key="EMPTY")resp = client.chat.completions.create(model="sophea-titan-1-nvfp4",messages=[{"role": "user", "content": "Ποια είναι η πρωτεύουσα της Ελλάδας;"}],temperature=0,extra_body={"chat_template_kwargs": {"enable_thinking": False}}, # required: non-thinking)print(resp.choices[0].message.content)
Inherits the Qwen3.6-27B base-model license. Verify base-model terms before use.