Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more
Container

Run this model inference with full control and performance in your environment.

Learn more

Get help setting up a custom Dedicated Endpoints.

Talk with our engineer to get a quote for reserved GPU instances with discounts.

README

License: apache-2.0

Merge Details

Merge Method

This model was merged using the SCE merge method using MuXodious/Mistral-Nemo-Instruct-2407-absolute-heresy as a base.

Models Merged

The following models were included in the merge:

  • MuXodious/Mistral-Nemo-Instruct-2407-absolute-heresy
  • Retreatcost/Evertide-RX-12B
  • yamatazen/Aurora-SCE-12B
  • Vortex5/Elysian-Sunrise-12B
  • Vortex5/Mythic-Fabulist-12B
  • Vortex5/Prototype-X-12b

Configuration

The following YAML configuration was used to produce this model:

yaml
architecture: MistralForCausalLM
base_model: B:\12B\MuXodious--Mistral-Nemo-Instruct-2407-absolute-heresy
models:
  - model: B:\12B\Retreatcost--Evertide-RX-12B
  - model: B:\12B\yamatazen--Aurora-SCE-12B
  - model: B:\12B\Vortex5--Elysian-Sunrise-12B
  - model: B:\12B\Vortex5--Mythic-Fabulist-12B
  - model: B:\12B\Vortex5--Prototype-X-12b
merge_method: sce
dtype: float32
out_dtype: bfloat16
parameters:
  normalize: true
  select_topk: 0.5
tokenizer:
  source: union
chat_template: auto

Model provider

DarkArtsForge

Model tree

Base

Vortex5/Prototype-X-12b

Base

Retreatcost/Evertide-RX-12B

Base

Vortex5/Elysian-Sunrise-12B

Base

Vortex5/Mythic-Fabulist-12B

Base

MuXodious/Mistral-Nemo-Instruct-2407-absolute-heresy

Base

yamatazen/Aurora-SCE-12B

Merged

this model

Modalities

Input

Text

Output

Text

Pricing

Dedicated Endpoints

View details

Supported Functionality

Model APIs

Dedicated Endpoints

Container

More information

Model card

Explore FriendliAI today

Get startedTalk to an engineer