mlx-community
Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated-5bit-msq
Dedicated Endpoints
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Get help setting up a custom Dedicated Endpoints.
Talk with our engineer to get a quote for reserved GPU instances with discounts.
README
License: apache-2.0Details
- Type: Vision (VLM)
- Average: 5.01 bits per weight
- Method: MLX Smart Quantize (MSQ)
Model provider
mlx-community
Model tree
Base
google/gemma-4-12B-it-qat-q4_0-unquantized
Quantized
this model
Modalities
Input
Video, Audio, Text, Image
Output
Text
Pricing
Dedicated Endpoints
View detailsSupported Functionality
Model APIs
Dedicated Endpoints
Container
More information