Dedicated Endpoints
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Get help setting up a custom Dedicated Endpoints.
Talk with our engineer to get a quote for reserved GPU instances with discounts.
README
License: apache-2.0Use with mlx
bash
pip install -U mlx-vlm
bash
python -m mlx_vlm.generate --model mlx-community/Qwen3.5-122B-A10B-oQ4-MTP --max-tokens 100 --temperature 0.0 --draft-tokens 4 --prompt "Describe this image." --image <path_to_image>
oMLX - LLM inference, M3 Max, 128GB Memery
Model provider
mlx-community
Model tree
Base
this model
Modalities
Input
Video, Text, Image
Output
Text
Pricing
Dedicated Endpoints
View detailsSupported Functionality
Model APIs
Dedicated Endpoints
Container
More information