Skip to main content

Documentation Index

Fetch the complete documentation index at: https://friendli.ai/docs/llms.txt

Use this file to discover all available pages before exploring further.

Represents a streamed chunk of a chat completions response returned by model, based on the provided input. 
data: {
  "id": "chatcmpl-4b71d12c86d94e719c7e3984a7bb7941",
  "model": "(endpoint-id)",
  "object": "chat.completion.chunk",
  "choices": [
    {
      "index": 0,
      "delta": { "role": "assistant", "content": "This" },
      "finish_reason": null,
      "logprobs": null
    }
  ],
  "usage": null,
  "created": 1726294381
}

data: {
  "id": "chatcmpl-4b71d12c86d94e719c7e3984a7bb7941",
  "model": "(endpoint-id)",
  "object": "chat.completion.chunk",
  "choices": [
    {
      "index": 0,
      "delta": { "content": " is" },
      "finish_reason": null,
      "logprobs": null
    }
  ],
  "usage": null,
  "created": 1726294381
}

...

data: {
  "id": "chatcmpl-4b71d12c86d94e719c7e3984a7bb7941",
  "model": "(endpoint-id)",
  "object": "chat.completion.chunk",
  "choices": [
    {
      "index": 0,
      "delta": {},
      "finish_reason": "stop",
      "logprobs": null
    }
  ],
  "usage": null,
  "created": 1726294383
}

data: {
  "id": "chatcmpl-4b71d12c86d94e719c7e3984a7bb7941",
  "model": "(endpoint-id)",
  "object": "chat.completion.chunk",
  "choices": [],
  "usage": {
    "prompt_tokens": 8,
    "completion_tokens": 4,
    "total_tokens": 12
  },
  "created": 1726294402
}

data: [DONE]
​
id
string
required
A unique ID of the chat completion.
​
object
string
required
The object type, which is always set to chat.completion.chunk.
​
model
string
required
The model to generate the completion. For dedicated endpoints, it returns the endpoint id.
​
choices
object[]
required
​
usage
object | null
​
created
integer
required
The Unix timestamp (in seconds) for when the token sampled.
Last modified on April 13, 2026