Pricing


Friendli Serverless Endpoints

Fast and affordable API for open-source LLMs and LMMs

Free trial

Sign up

Sign up and get $5 in free trial credits!

Basic

Sign up

Featured highlights

checkInference models in Chat, Language, Image, etc.

Pricing details

Model code

Price per unit

Llama-2-13B-Chat

$0.2/1M tokens

Llama-2-70B-Chat

$0.8/1M tokens

Mistral-7B-Instruct-v0.2

$0.18/1M tokens

Mixtral-8x7B-Instruct-v0.1

$0.4/1M tokens

Gemma-7B-Instruct

$0.18/1M tokens

Stable-Diffusion-v1.5

$0.0005/10 steps


Friendli Dedicated Endpoints

Run custom LLMs on autopilot with Friendli Dedicated Endpoints

Basic

Sign up

Featured highlights

checkRun custom LLMs on autopilot with Friendli Dedicated Endpoints
checkBilled monthly

Pricing details

Friendli on A10G

$1.1 per hour

Friendli on A100 40GB

$4 per hour

Friendli on A100 80GB

$5 per hour

Enterprise

Contact Sales

Featured highlights

checkCustom pricing
checkDedicated support

Friendli Container

Serve LLMs in your private environment

Trial

Sign up

Enjoy a four-week free trial of Friendli Container to serve your LLM in your development environment.

Enterprise

Contact Sales

Featured highlights

checkContact us to use Friendli Engine in your production services.