RedHatAI
Sparse-Llama-3.1-8B-tldr-2of4-FP8-dynamic
Available on FriendliAI
Dedicated Endpoints
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
RedHatAI
Model Tree
Base
RedHatAI/Sparse-Llama-3.1-8B-tldr-2of4
Quantized
this model
Input Modalities
Text
Output Modalities
Text
Supported Functionality
Dedicated Endpoints