wabibito

Onyx-Ministral-3-3B-4bit

README

License: apache-2.0

Use with mlx

bash

pip install -U mlx-vlm

bash

python -m mlx_vlm.generate --model mlx-community/Ministral-3-3B-Instruct-2512-4bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Model Details

Model Provider

wabibito

Model Tree

Base

mistralai/Ministral-3-3B-Base-2512

Quantized

this model

Input Modalities

Text

Output Modalities

Text

Supported Functionality

Dedicated Endpoints

Explore FriendliAI today

Get started Talk to an engineer