hudsonai-app

Qwen3.5-9B-4bit

README

License: apache-2.0

Use with mlx

bash
pip install -U mlx-vlm

bash
python -m mlx_vlm.generate --model mlx-community/Qwen3.5-9B-4bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Model Details

Model Provider

hudsonai-app

Model Tree

Base

Qwen/Qwen3.5-9B-Base

Quantized

this model

Input Modalities

TextImageVideo

Output Modalities

Text

Supported Functionality

Dedicated Endpoints

Explore FriendliAI today

Get started Talk to an engineer