Fast and affordable API
for open-source LLMs and LMMs:
Friendli Serverless Endpoints


SUPPORTED MODELS

MIXTRAL 8X7B INSTRUCT V0.1

META LLAMA 3 8B INSTRUCT

META LLAMA 3 70B INSTRUCT

STABLE DIFFUSION V1 5

Stay tuned for new model support

PRICING

Free trial

Sign up

Sign up and get $5 in free trial credits!

Basic

Sign up

Featured highlights

checkInference models in Chat, Language, Image, etc.

Pricing details

Model code

Price per unit

Mixtral-8x7B-Instruct-v0.1

$0.4/1M tokens

Meta-Llama-3-8B-Instruct

$0.1/1M tokens

Meta-Llama-3-70B-Instruct

$0.8/1M tokens

stable-diffusion-v1-5

$0.0005/10 steps