Preyazz

Qwen3.8-27B-NVFP4

README

License: apache-2.0

Details

Base model: Qwen/Qwen3.8-27B. Dense 27B, native vision-language, Gated-DeltaNet hybrid with MTP.
Method: weight-only NVFP4, group size 16 (compressed-tensors).
Target runtime: vLLM on Blackwell-class GPUs.
Relation to base: quantization only. No weights were trained or fine-tuned.

Usage

bash
vllm serve Preyazz/Qwen3.8-27B-NVFP4 --trust-remote-code

Provenance and license

This repository redistributes a quantized copy of Qwen/Qwen3.8-27B. All model capabilities, credit, and the governing license belong to the Qwen team, and the base model's license applies to this quantized derivative. See the original model card for full model documentation, intended use, and limitations.

Provided as-is, without warranty.

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Model Details

Model Provider

Preyazz

Model Tree

Base

Qwen/Qwen3.8-27B

Quantized

this model

Input Modalities

TextImageVideo

Output Modalities

Text

Supported Functionality