GLM-5.2 is live. #1 throughput on OpenRouter, pay-per-token on FriendliAI. Try it today ➜
born2bewild
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
born2bewild
Model Tree
Qwen/Qwen3.8-27B
Input Modalities
Output Modalities
Supported Functionality
Qwen/Qwen3.8-27B.compressed-tensors (pack-quantized).syvai/qwen3.8-27b-3090-fast-variant.syvai/Qwen3.8-27B-DFlash2-W4A16.The fast variant keeps the GatedDeltaNet recurrence-control projections in BF16 and
uses the companion's optimized INT4 MTP/lm-head tensors plus INT8 token embeddings.
The vision tower remains higher precision. This repository contains all model shards,
configuration, tokenizer, MTP extra tensors, and mtp_draft_vocab_ids.pt required by
from_pretrained(); it is not an official Qwen release.
This checkpoint is intended for vLLM with the DFlash2 backport and the Qwen3.8 compressed-tensors support. The Club3090 DFLASH15 profile uses:
SPEC_N=15, lookup-augmented DFlash2, and single-stream serving;GPU_MEMORY_UTILIZATION=0.85 on WSL2/PCIe rigs.The DFlash2 drafter is a separate checkpoint and is not embedded in this repository.
On one 2x RTX 3090 WSL2 rig, the target plus DFLASH15 measured approximately 105.94 narrative and 188.06 code decode tokens/s, with a validated 244,320-token ceiling. These are rig-specific measurements, not a universal performance claim. The exact launcher, patch pins, benchmark logs, and caveats are maintained in the Club3090 PR.
Apache-2.0. Redistribution must preserve this notice and the upstream Qwen and AutoRound attributions. Quantization and serving artifacts are provided as-is; please validate quality and hardware compatibility for your workload.