Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more
Container

Run this model inference with full control and performance in your environment.

Learn more

Get help setting up a custom Dedicated Endpoints.

Talk with our engineer to get a quote for reserved GPU instances with discounts.

README

Merge Details

Merge Method

This model was merged using the Linear merge method using /root/sn120/model_path1 as a base.

Models Merged

The following models were included in the merge:

  • /root/sn120/model_path2

Configuration

The following YAML configuration was used to produce this model:

yaml

# Linear merge: prexpert (80%) + nntoan209 (20%)
merge_method: linear
dtype: bfloat16
base_model: /root/sn120/model_path1
parameters:
normalize: true
models:
- model: /root/sn120/model_path1
parameters:
weight: 0.80
- model: /root/sn120/model_path2
parameters:
weight: 0.20

Model provider

longertime

Model tree

Base

this model

Modalities

Input

Text

Output

Text

Pricing

Dedicated Endpoints

View details

Supported Functionality

Model APIs

Dedicated Endpoints

Container

More information

Explore FriendliAI today