OccultAI

MN-Nazgul-12B-v1

Deploy Dedicated

README

License: apache-2.0

🔀 Merge Details

Merge Method

This model was merged using the della merge method using Retreatcost/Mistral-Nemo-Base-2407-ChatML as a base.

The merge should be fully uncensored and have no refusals, although it may struggle with longer context.

Models Merged

The following models were included in the merge:

DarkArtsForge/MN-Raven-12B-v1
IggyLux/MN-VelvetCafe-RP-12B-V2
OccultAI/MN-Morpheus-12B-v1
Retreatcost/Mistral-Nemo-Base-2407-ChatML
shrugging-shoulders/Amberlight-Lux-12B
WokeAI/Tankie-DPE-12B-SFT-v2

⚙️ Configuration

The following YAML configuration was used to produce this model:

yaml
architecture: MistralForCausalLM
models:
  - model: B:\12B\MN-Morpheus-12B-v1_epoch2
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.2
        - filter: "embed_tokens"
          value: 0.2
        - value: 0.4
      density: 0.9
      epsilon: 0.09
  - model: B:\12B\IggyLux--MN-VelvetCafe-RP-12B-V2
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.2
        - filter: "embed_tokens"
          value: 0.2
        - value: 0.4
      density: 0.9
      epsilon: 0.09
  - model: A:\LLM\.cache\13B\WokeAI--Tankie-DPE-12B-SFT-v2
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.2
        - filter: "embed_tokens"
          value: 0.2
        - value: 0.4
      density: 0.9
      epsilon: 0.09
  - model: B:\12B\MN-Raven-12B-v1
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.2
        - filter: "embed_tokens"
          value: 0.2
        - value: 0.4
      density: 0.9
      epsilon: 0.09
  - model: B:\12B\shrugging-shoulders--Amberlight-Lux-12B
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.2
        - filter: "embed_tokens"
          value: 0.2
        - value: 0.4
      density: 0.9
      epsilon: 0.09
merge_method: della
base_model: B:\12B\Retreatcost--Mistral-Nemo-Base-2407-ChatML
parameters:
  lambda: 1.0
  normalize: false
  int8_mask: false
  rescale: true
dtype: float32
out_dtype: bfloat16
tokenizer:
  source: B:\12B\shrugging-shoulders--Amberlight-Lux-12B
chat_template: "chatml"
name: 🐉 MN Nazgul 12B v1

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Container

Run this model inference with full control and performance in your environment.

Learn more

Model Details

Model Provider

OccultAI

Model Tree

Base

shrugging-shoulders/Amberlight-Lux-12B

Base

WokeAI/Tankie-DPE-12B-SFT-v2

Base

Retreatcost/Mistral-Nemo-Base-2407-ChatML

Base

DarkArtsForge/MN-Raven-12B-v1

Base

IggyLux/MN-VelvetCafe-RP-12B-V2

Merged

this model

Input Modalities

Text

Output Modalities

Text

Supported Functionality

Dedicated EndpointsContainer

Explore FriendliAI today

Get started Talk to an engineer

README

License: apache-2.0

🔀 Merge Details

Merge Method

This model was merged using the della merge method using Retreatcost/Mistral-Nemo-Base-2407-ChatML as a base.

The merge should be fully uncensored and have no refusals, although it may struggle with longer context.

Models Merged

The following models were included in the merge:

DarkArtsForge/MN-Raven-12B-v1
IggyLux/MN-VelvetCafe-RP-12B-V2
OccultAI/MN-Morpheus-12B-v1
Retreatcost/Mistral-Nemo-Base-2407-ChatML
shrugging-shoulders/Amberlight-Lux-12B
WokeAI/Tankie-DPE-12B-SFT-v2

⚙️ Configuration

The following YAML configuration was used to produce this model:

yaml
architecture: MistralForCausalLM
models:
  - model: B:\12B\MN-Morpheus-12B-v1_epoch2
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.2
        - filter: "embed_tokens"
          value: 0.2
        - value: 0.4
      density: 0.9
      epsilon: 0.09
  - model: B:\12B\IggyLux--MN-VelvetCafe-RP-12B-V2
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.2
        - filter: "embed_tokens"
          value: 0.2
        - value: 0.4
      density: 0.9
      epsilon: 0.09
  - model: A:\LLM\.cache\13B\WokeAI--Tankie-DPE-12B-SFT-v2
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.2
        - filter: "embed_tokens"
          value: 0.2
        - value: 0.4
      density: 0.9
      epsilon: 0.09
  - model: B:\12B\MN-Raven-12B-v1
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.2
        - filter: "embed_tokens"
          value: 0.2
        - value: 0.4
      density: 0.9
      epsilon: 0.09
  - model: B:\12B\shrugging-shoulders--Amberlight-Lux-12B
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.2
        - filter: "embed_tokens"
          value: 0.2
        - value: 0.4
      density: 0.9
      epsilon: 0.09
merge_method: della
base_model: B:\12B\Retreatcost--Mistral-Nemo-Base-2407-ChatML
parameters:
  lambda: 1.0
  normalize: false
  int8_mask: false
  rescale: true
dtype: float32
out_dtype: bfloat16
tokenizer:
  source: B:\12B\shrugging-shoulders--Amberlight-Lux-12B
chat_template: "chatml"
name: 🐉 MN Nazgul 12B v1