davisrbr
Meta-Llama-3-8B-Instruct-AQLM-2Bit-1x16-r8_bs4
Available on FriendliAI
Dedicated Endpoints
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Container
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
davisrbr
Model Tree
Base
ISTA-DASLab/Meta-Llama-3-8B-Instruct-AQLM-2Bit-1x16
Adapter
this modelInput Modalities
Text
Output Modalities
Text
Supported Functionality
Dedicated EndpointsContainer