​
Inference

Chat completions

Discover how to generate text through interactive conversations.

Completions

Learn how to generate text.

Tokenization

Explore the process of breaking down text into smaller tokens for machine processing.

Detokenization

Learn how to reconstruct tokenized text back into its original, human-readable form.

Image generations (Beta)

Learn how to generate images.

​
Endpoint (Beta)

List endpoints

List Dedicated Endpoint deployments.

Retrieve an endpoint specification

Given an endpoint ID, return its specification.

Retrieve endpoint versions

Given an endpoint ID, return its version history.

Retrieve an endpoint status

Given an endpoint ID, return its current status.

Create an endpoint with Hugging Face model

Create a Dedicated Endpoint deployment for a Hugging Face model.

Create endpoint from W&B artifact

Create an endpoint from Weights & Biases artifact.

Update an endpoint with new configuration

Update a Dedicated Endpoint deployment with new configuration.

Terminate an endpoint

Terminate an endpoint.

Restart an endpoint

Restart a failed or terminated Dedicated Endpoint.

Sleep an endpoint

Put a Dedicated Endpoint to sleep mode.

Wake up an endpoint

Wake up a sleeping Dedicated Endpoint.

Delete an endpoint

Delete an endpoint.