DeepSeek-R1-Distill-Llama-70B_EXL2_5.5bpw_h6

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Run this model inference with full control and performance in your environment.