> ## Documentation Index
> Fetch the complete documentation index at: https://friendli.ai/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# LiteLLM

> Use LiteLLM with FriendliAI to call Model APIs, Dedicated Endpoints, and fine-tuned endpoints. Includes setup, model selection, and streaming examples.

You can use [**LiteLLM**](https://github.com/BerriAI/litellm) to interact with FriendliAI. If you already use LiteLLM, you can migrate your existing applications with minimal changes.

## How to Use

Before you start, get your `FRIENDLIAI_API_KEY` from [Friendli Suite > Personal Settings > API Keys](https://friendli.ai/suite/~/setting/keys). Then add the `friendliai` prefix to your endpoint name in the `model` parameter.

### Chat Completion

Choose the example for your endpoint type. For Model APIs, you can specify one of the [available models](https://friendli.ai/models?products=SERVERLESS).

<CodeGroup>
  ```python Model APIs theme={null}
  import os
  from litellm import completion

  os.environ['FRIENDLIAI_API_KEY'] = "YOUR_API_KEY"

  response = completion(
      model="friendliai/zai-org/GLM-5.2",
      messages=[
          {"role": "user", "content": "hello from litellm"}
      ],
  )
  print(response)
  ```

  ```python Dedicated Endpoints theme={null}
  import os
  from litellm import completion

  os.environ['FRIENDLIAI_API_KEY'] = "YOUR_API_KEY"
  os.environ['FRIENDLI_API_BASE'] = "https://api.friendli.ai/dedicated/v1"

  response = completion(
      model="friendliai/YOUR_ENDPOINT_ID",
      messages=[
          {"role": "user", "content": "hello from litellm"}
      ],
  )
  print(response)
  ```

  ```python Fine-tuned Dedicated Endpoints theme={null}
  import os
  from litellm import completion

  os.environ['FRIENDLIAI_API_KEY'] = "YOUR_API_KEY"
  os.environ['FRIENDLI_API_BASE'] = "https://api.friendli.ai/dedicated/v1"

  response = completion(
      model="friendliai/YOUR_ENDPOINT_ID:YOUR_ADAPTER_ROUTE",
      messages=[
          {"role": "user", "content": "hello from litellm"}
      ],
  )
  print(response)
  ```
</CodeGroup>

### Chat Completion - Streaming

<CodeGroup>
  ```python Model APIs theme={null}
  import os
  from litellm import completion

  os.environ['FRIENDLIAI_API_KEY'] = "YOUR_API_KEY"

  response = completion(
      model="friendliai/zai-org/GLM-5.2",
      messages=[
          {"role": "user", "content": "hello from litellm"}
      ],
      stream=True
  )

  for chunk in response:
      print(chunk)
  ```

  ```python Dedicated Endpoints theme={null}
  import os
  from litellm import completion

  os.environ['FRIENDLIAI_API_KEY'] = "YOUR_API_KEY"
  os.environ['FRIENDLI_API_BASE'] = "https://api.friendli.ai/dedicated/v1"

  response = completion(
      model="friendliai/YOUR_ENDPOINT_ID",
      messages=[
          {"role": "user", "content": "hello from litellm"}
      ],
      stream=True
  )

  for chunk in response:
      print(chunk)
  ```

  ```python Fine-tuned Dedicated Endpoints theme={null}
  import os
  from litellm import completion

  os.environ['FRIENDLIAI_API_KEY'] = "YOUR_API_KEY"
  os.environ['FRIENDLI_API_BASE'] = "https://api.friendli.ai/dedicated/v1"

  response = completion(
      model="friendliai/YOUR_ENDPOINT_ID:YOUR_ADAPTER_ROUTE",
      messages=[
          {"role": "user", "content": "hello from litellm"}
      ],
      stream=True
  )

  for chunk in response:
      print(chunk)
  ```
</CodeGroup>