Qwen3.8-27B-Uncensored NVFP4 for 1Cat-vLLM
An MLP-only NVFP4 W4A4 PTQ build of
orcarouter/Qwen3.8-27B-Uncensored,
in the compressed-tensors nvfp4-pack-quantized layout used by
1CatAI/1Cat-vLLM.
- 192/192 MLP linears (
gate_proj, up_proj, down_proj): NVFP4 W4A4, group size 16
- Self-attention and Gated DeltaNet projections: BF16. Full-linear NVFP4 PTQ of those layers collapsed generation on 1Cat-vLLM.
lm_head, token embeddings, vision tower, and MTP tensors: BF16
- Calibration: 256 UltraChat samples, maximum sequence length 2,048
- LLM Compressor revision:
c8676edd2f6cddd0be2427f034825ca0d476fa72
This is post-training quantization, not QUASAR quantization-aware training.
See quantization-audit.json and calibration.json.
The source model has substantially reduced safety alignment. Use it only for
lawful, controlled purposes and add suitable safeguards before deployment.