Skip to main content
Friendli Model APIs, Dedicated Endpoints, and Container are OpenAI-compatible.
Existing applications can migrate with minimal effort, still using the official OpenAI SDKs.

Specify the Base URL and API Key

Initialize the OpenAI client using Friendli’s base URL and your Personal API key.
  • Model APIs: https://api.friendli.ai/serverless/v1.
  • Dedicated Endpoints: https://api.friendli.ai/dedicated/v1.
  • Container: your own container’s URL (e.g., http://HOST:PORT/v1).
Get your Personal API key in Friendli Suite > Personal Settings > API Keys.

Usage

Choose any model available on Friendli Model APIs, Dedicated Endpoints, or Container.

Completions API

Generate text completions using a simple prompt-based approach.

Chat Completions API

Generate chat completions using a conversational message-based approach.

Streaming Mode

Receive responses in real-time, enabling better user experience for long responses.
Last modified on July 13, 2026