PUT
/
dedicated
/
beta
/
endpoint
/
{endpoint_id}
curl --request PUT \
  --url https://api.friendli.ai/dedicated/beta/endpoint/{endpoint_id} \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '{
  "advanced": {
    "tokenizer_add_special_tokens": true,
    "tokenizer_skip_special_tokens": true,
    "enable_content_logging": true,
    "max_batch_size": 256,
    "max_input_length": 123,
    "max_token_count": 2560
  },
  "autoscalingPolicy": {
    "cooldownPeriod": 300,
    "maxReplica": 1,
    "minReplica": 0
  },
  "hfModelRepo": "<string>",
  "hfModelRepoRevision": "<string>",
  "instanceOptionId": "<string>",
  "name": "<string>",
  "newVersionComment": "<string>",
  "simplescale": {
    "replicas": 2
  }
}'
{
  "name": "endpoint-name",
  "gpuType": "NVIDIA H100",
  "numGpu": 1,
  "instanceId": "instance-id",
  "projectId": "project-id",
  "creatorId": "creator-id",
  "teamId": "team-id",
  "autoscalingMin": 0,
  "autoscalingMax": 1,
  "autoscalingCooldown": 300,
  "maxBatchSize": 10,
  "maxInputLength": 1024,
  "tokenizerSkipSpecialTokens": true,
  "tokenizerAddSpecialTokens": true,
  "currReplicaCnt": 1,
  "desiredReplicaCnt": 1,
  "updatedReplicaCnt": 1
}

To request successfully, it is mandatory to enter a Friendli Token (e.g. flp_XXX) value in the Bearer Token field. Refer to the authentication section on our introduction page to learn how to acquire this variable and visit here to generate your token.

This API is currently in Beta. While we strive to provide a stable and reliable experience, this feature is still under active development. As a result, you may encounter unexpected behavior or limitations. We encourage you to provide feedback to help us improve the feature before its official release.

Authorizations

​
Authorization
string
header
required

When using Friendli Suite API for inference requests, you need to provide a Friendli Token for authentication and authorization purposes.

For more detailed information, please refer here.

Headers

​
X-Friendli-Team
string | null

ID of team to run requests as (optional parameter).

Path Parameters

​
endpoint_id
string
required

The ID of the endpoint

Body

application/json

Dedicated endpoint update request.

Response

200
application/json
Successfully updated the endpoint specification.

Dedicated endpoint specification.