Skip to main content

Documentation Index

Fetch the complete documentation index at: https://friendli.ai/docs/llms.txt

Use this file to discover all available pages before exploring further.

You can use LiteLLM to interact with FriendliAI. This makes migration of existing applications already using LiteLLM particularly easy.

​
How to use

Before you start, ensure you’ve already obtained the API_KEY from the Friendli Suite > Personal Settings > API Keys. Add friendliai prefix to your endpoint name for the model parameter.

​
Chat completion

We provide usage examples for each type of endpoint. Choose the one that best suits your needs. You can specify one of the available models for the serverless endpoints. 
import os
from litellm import completion

os.environ['API_KEY'] = "YOUR_API_KEY"

response = completion(
    model="friendliai/meta-llama-3.3-70b-instruct",
    messages=[
        {"role": "user", "content": "hello from litellm"}
    ],
)
print(response)

​
Chat completion - Streaming

import os
from litellm import completion

os.environ['API_KEY'] = "YOUR_API_KEY"

response = completion(
    model="friendliai/meta-llama-3.3-70b-instruct",
    messages=[
        {"role": "user", "content": "hello from litellm"}
    ],
    stream=True
)

for chunk in response:
    print(chunk)
Last modified on April 29, 2026