Dedicated inference at scale

Run inference with unmatched speed and reliability at scale

“EXAONE models run incredibly fast on FriendliAI’s inference platform, and users are highly satisfied with the performance. With FriendliAI’s support, customers have been able to shorten the time required to test and evaluate EXAONE by several weeks. This has enabled them to integrate EXAONE into their services more quickly, accelerating adoption and driving real business impact.”

Clayton Park, AI Business Team Lead, LG AI Research

Benefits

Production-scale performance and reliability

Dedicated Endpoints allow you to deploy and run models fast, reliably, cost-efficiently at scale.

Maximize inference speed

Unlock low latency and high throughput with our optimized inference stack through our proprietary technology.

Run inference reliably

Ensure 99.99% uptime with our geo-distributed, multi-cloud infrastructure, engineered for reliability at scale.

Scale smarter, spend less

Slash costs with our purpose-built inference stack and scale seamlessly to handle fluctuating traffic.

Deploy the way you need

Serverless

The simplest way to run inference

Start instantly—no configuration needed
Use free built-in tools
Pay per token or GPU time

On Demand

Dedicated GPU instances

Guarantee performance
Supports custom and 500K+ open-source models
Pay for GPU time

Enterprise Reserved

Reserved GPU instances with discounts

Reserve GPUs for 1+ months
Access exclusive features
Discounted upfront payment

Features

The complete inference solution

Speed, reliability, scaling, deployment, and enterprise support. Everything you need to run inference at scale.

Blazing-fast inference

Deliver unmatched speed and throughput with our stack using custom kernels, caching, quantization, speculative decoding, and routing.

Always-on reliability

Guarantee uptime through resilient multi-cloud architecture, automated failover and recovery.

Effortless autoscaling

Scale inference dynamically across GPUs, instantly right-sizing capacity to match demand.

Powerful model tooling

Track performance, usage, and logs in real time, and perform live model updates without disruption.

Simple, optimized deployment

Deploy your models easily in an optimized way, with quantization and speculative decoding ready out of the box.

Enterprise-grade support

Get dedicated engineering, compliance, and VPC support in our SOC 2–compliant environment.

Read our docs

Access the model you want

Access the world’s largest collection of 503,141 models through seamless Hugging Face integration. From text generation to computer vision, launch any model with a single click.

Find your model

LLM

medgemma-1.5-4b-it

google

LLM

OptiMind-SFT

microsoft

Multimodal

Qwen3-VL-Embedding-8B

Qwen

Computer Vision

Qwen3-VL-2B-Instruct

Qwen

	VRAM / GPU	$ / hour (billed per second)
On-demand NVIDIA B200	192GB	$8.9
On-demand NVIDIA H200	141GB	$4.5
On-demand NVIDIA H100	80GB	$3.9
On-demand NVIDIA A100	80GB	$2.9
Enterprise reserved

Dedicated inference at scale

Production-scale performance and reliability

Maximize inference speed

Run inference reliably

Scale smarter, spend less

Deploy the way you need

Serverless

On Demand

Enterprise Reserved

The complete inference solution

Blazing-fast inference

Always-on reliability

Effortless autoscaling

Powerful model tooling

Simple, optimized deployment

Enterprise-grade support

Access the model you want

medgemma-1.5-4b-it

OptiMind-SFT

Qwen3-VL-Embedding-8B

Qwen3-VL-2B-Instruct

Voxtral-Mini-3B-2507

Nanonets-OCR2-3B

distil-large-v3.5

MultilingualSTT

whisper-large-v3

whisper-base

GLM-4.7-Flash

translategemma-27b-it

NuMarkdown-8B-Thinking

LightOnOCR-1B-1025

DeepSeek-OCR

Qwen2.5-VL-3B-Instruct

distil-large-v3

Qwen3-VL-Reranker-8B

Qwen2.5-VL-7B-Instruct

Dolphin-v2

Nanonets-OCR-s

Soprano-1.1-80M

UI-TARS-1.5-7B

MiniCPM-V-4_5

52Hz-small-fr-v2

kotoba-whisper-v2.2

Rex-Omni

translategemma-12b-it

UI-TARS-7B-DPO

Qwen3-VL-30B-A3B-Instruct

Qwen3-VL-Embedding-2B

MiniCPM-o-2_6

Qwen3-VL-8B-Instruct

VideoChat-R1_5

DASD-4B-Thinking

GLM-4.7

translategemma-4b-it

Qwen3-VL-Reranker-2B

Phi-4-multimodal-instruct

LightOnOCR-2-1B

Orchestrator-8B

Qwen2-Audio-7B-Instruct

granite-docling-258M

SocioReasoner-3B

Qwen2.5-VL-72B-Instruct

GLM-4.6

Llama-4-Scout-17B-16E-Instruct

Cosmos-Reason1-7B

BUD-E-Whisper

Stable-DiffCoder-8B-Instruct

whisper-large

Voxtral-Small-24B-2507

K-EXAONE-236B-A23B

olmOCR-2-7B-1025-FP8

whisper-large-v3-turbo

MiniCPM-V-2_6

LightOnOCR-2-1B-bbox

Have a custom or fine-tuned model?

Pricing

Explore FriendliAI today