llama3-8b-apiq-w2a16g64

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Run this model inference with full control and performance in your environment.