HF1BitLLM
Llama3-8B-1.58-Sigmoid-k100-10B-tokens
Available on FriendliAI
Dedicated Endpoints
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Container
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
HF1BitLLM
Model Tree
Base
meta-llama/Meta-Llama-3-8B-Instruct
Quantized
this modelInput Modalities
Text
Output Modalities
Text
Supported Functionality
Dedicated EndpointsContainer