quant-mind

Huihui-Qwen3-VL-8B-Instruct-abliterated-AWQ-int4

README

License: apache-2.0

bash

vllm serve quant-mind/Huihui-Qwen3-VL-8B-Instruct-abliterated-AWQ-int4 --quantization compressed-tensors --max-model-len 8192

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Model Details

Model Provider

quant-mind

Model Tree

Base

huihui-ai/Huihui-Qwen3-VL-8B-Instruct-abliterated

Quantized

this model

Input Modalities

TextImage

Output Modalities

Text

Supported Functionality

Dedicated Endpoints