requantized_llama_3.2_1b_q6_k

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Run this model inference with full control and performance in your environment.