shawon
llama3.1_8B_16bit-mlx-4Bit
Available on FriendliAI
Dedicated Endpoints
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
shawon
Model Tree
Base
shawon/llama3.1_8B_16bit
Quantized
this model
Input Modalities
Text
Output Modalities
Text
Supported Functionality
Dedicated Endpoints