DarkArtsForge

Morbid-Miasma-24B

Deploy Dedicated

README

License: apache-2.0

Merge Details

Merge Methods

This model was merged using the della merge method using mistralai/Magistral-Small-2509 as a base.

Models Merged

The following models were included in the merge:

mistralai/Magistral-Small-2509
Casual-Autopsy/Maginum-Cydoms-24B
DarkArtsForge/Asmodeus-24B-v1
DarkArtsForge/Asmodeus-24B-v2
DarkArtsForge/Magistaroth-24B-v1
DarkArtsForge/Morax-24B-v2
DarkArtsForge/Paimon-24B-v3
DarkArtsForge/Zepar-24B-v1
Naphula/GhostFace-24B-v1
Naphula/Slimaki-Tavern-24B-v1.3
Naphula/Slimaki-24B-v1.2
Naphula/Slimaki-24B-v1
sophosympatheia/Magistry-24B-v1.0
TheDrummer/Precog-24B-v1

Configuration

yaml
architecture: MistralForCausalLM
models:
  - model: B:\24B\DarkArtsForge--Asmodeus-24B-v1
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.5
      epsilon: 0.25
  - model: B:\24B\DarkArtsForge--Asmodeus-24B-v2
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.5
      epsilon: 0.25
  - model: B:\24B\Morax-24B-v2
    parameters:
      weight:
        - filter: "lm_head"
          value: 1.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.75
      epsilon: 0.25
  - model: B:\24B\DarkArtsForge--Paimon-24B-v3
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.75
      epsilon: 0.25
  - model: B:\24B\DarkArtsForge--Zepar-24B-v1
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.75
      epsilon: 0.25
  - model: B:\24B\DarkArtsForge--Magistaroth-24B-v1
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.75
      epsilon: 0.25
  - model: B:\24B\!models--Casual-Autopsy--Maginum-Cydoms-24B
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.5
      epsilon: 0.25
  - model: B:\24B\Naphula--GhostFace-24B-v1
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.75
      epsilon: 0.25
  - model: B:\24B\Naphula--Slimaki-Tavern-24B-v1.3
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.75
      epsilon: 0.25
  - model: B:\24B\Naphula--Slimaki-24B-v1.2
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.75
      epsilon: 0.25
  - model: B:\24B\Naphula--Slimaki-24B-v1
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.75
      epsilon: 0.25
  - model:  B:\24B\sophosympatheia--Magistry-24B-v1.0
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.5
      epsilon: 0.25
  - model: B:\24B\!models--TheDrummer--Precog-24B-v1
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.9
      epsilon: 0.09
merge_method: della
base_model: A:\LLM\.cache\24B\!models--mistralai--Magistral-Small-2509\textonly
parameters:
  lambda: 1.0
  normalize: false
  int8_mask: false
  rescale: true
dtype: float32
out_dtype: bfloat16
tokenizer:
  source: base
chat_template: auto
name: ☠️ Morbid Miasma 24B

Audit

bat
[DELLA Audit] Layer: model.layers.33.mlp.down_proj.weight | Lambda=1.00
  [BASE] textonly                                          
  !models--Casual-Autopsy--Maginum-Cydoms-24B       : ███                                                  6.5% (W:0.12 D:0.50 N:2.59 E:0.25)
  !models--TheDrummer--Precog-24B-v1                :                                                      0.9% (W:0.12 D:0.90 N:0.37 E:0.09)
  DarkArtsForge--Asmodeus-24B-v1                    : ███████                                             15.5% (W:0.12 D:0.50 N:6.16 E:0.25)
  DarkArtsForge--Asmodeus-24B-v2                    : ██████                                              13.5% (W:0.12 D:0.50 N:5.37 E:0.25)
  DarkArtsForge--Magistaroth-24B-v1                 :                                                      0.8% (W:0.12 D:0.75 N:0.34 E:0.25)
  DarkArtsForge--Paimon-24B-v3                      : ████████                                            16.5% (W:0.12 D:0.75 N:6.56 E:0.25)
  DarkArtsForge--Zepar-24B-v1                       : ███                                                  6.4% (W:0.12 D:0.75 N:2.55 E:0.25)
  Morax-24B-v2                                      : ██                                                   4.8% (W:0.12 D:0.75 N:1.91 E:0.25)
  Naphula--GhostFace-24B-v1                         : ██                                                   5.3% (W:0.12 D:0.75 N:2.10 E:0.25)
  Naphula--Slimaki-24B-v1                           : ████                                                 8.3% (W:0.12 D:0.75 N:3.31 E:0.25)
  Naphula--Slimaki-24B-v1.2                         : ████                                                 8.8% (W:0.12 D:0.75 N:3.52 E:0.25)
  Naphula--Slimaki-Tavern-24B-v1.3                  : ███                                                  7.0% (W:0.12 D:0.75 N:2.77 E:0.25)
  sophosympatheia--Magistry-24B-v1.0                : ██                                                   5.6% (W:0.12 D:0.50 N:2.24 E:0.25)

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Container

Run this model inference with full control and performance in your environment.

Learn more

Model Details

Model Provider

DarkArtsForge

Model Tree

Base

Naphula/Slimaki-24B-v1

Base

Casual-Autopsy/Maginum-Cydoms-24B

Base

DarkArtsForge/Asmodeus-24B-v2

Base

DarkArtsForge/Zepar-24B-v1

Base

Naphula/Slimaki-Tavern-24B-v1.3

Base

mistralai/Magistral-Small-2509

Base

TheDrummer/Precog-24B-v1

Base

Naphula/Slimaki-24B-v1.2

Base

DarkArtsForge/Asmodeus-24B-v1

Base

sophosympatheia/Magistry-24B-v1.0

Base

DarkArtsForge/Paimon-24B-v3

Base

Naphula/GhostFace-24B-v1

Base

DarkArtsForge/Magistaroth-24B-v1

Base

DarkArtsForge/Morax-24B-v2

Merged

this model

Input Modalities

Text

Output Modalities

Text

Supported Functionality

Dedicated EndpointsContainer

Merge Details

Merge Methods

This model was merged using the della merge method using mistralai/Magistral-Small-2509 as a base.

Models Merged

The following models were included in the merge:

mistralai/Magistral-Small-2509
Casual-Autopsy/Maginum-Cydoms-24B
DarkArtsForge/Asmodeus-24B-v1
DarkArtsForge/Asmodeus-24B-v2
DarkArtsForge/Magistaroth-24B-v1
DarkArtsForge/Morax-24B-v2
DarkArtsForge/Paimon-24B-v3
DarkArtsForge/Zepar-24B-v1
Naphula/GhostFace-24B-v1
Naphula/Slimaki-Tavern-24B-v1.3
Naphula/Slimaki-24B-v1.2
Naphula/Slimaki-24B-v1
sophosympatheia/Magistry-24B-v1.0
TheDrummer/Precog-24B-v1

Configuration

yaml
architecture: MistralForCausalLM
models:
  - model: B:\24B\DarkArtsForge--Asmodeus-24B-v1
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.5
      epsilon: 0.25
  - model: B:\24B\DarkArtsForge--Asmodeus-24B-v2
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.5
      epsilon: 0.25
  - model: B:\24B\Morax-24B-v2
    parameters:
      weight:
        - filter: "lm_head"
          value: 1.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.75
      epsilon: 0.25
  - model: B:\24B\DarkArtsForge--Paimon-24B-v3
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.75
      epsilon: 0.25
  - model: B:\24B\DarkArtsForge--Zepar-24B-v1
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.75
      epsilon: 0.25
  - model: B:\24B\DarkArtsForge--Magistaroth-24B-v1
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.75
      epsilon: 0.25
  - model: B:\24B\!models--Casual-Autopsy--Maginum-Cydoms-24B
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.5
      epsilon: 0.25
  - model: B:\24B\Naphula--GhostFace-24B-v1
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.75
      epsilon: 0.25
  - model: B:\24B\Naphula--Slimaki-Tavern-24B-v1.3
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.75
      epsilon: 0.25
  - model: B:\24B\Naphula--Slimaki-24B-v1.2
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.75
      epsilon: 0.25
  - model: B:\24B\Naphula--Slimaki-24B-v1
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.75
      epsilon: 0.25
  - model:  B:\24B\sophosympatheia--Magistry-24B-v1.0
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.5
      epsilon: 0.25
  - model: B:\24B\!models--TheDrummer--Precog-24B-v1
    parameters:
      weight:
        - filter: "lm_head"
          value: 0.0
        - filter: "embed_tokens"
          value: 0.0
        - value: 0.125
      density: 0.9
      epsilon: 0.09
merge_method: della
base_model: A:\LLM\.cache\24B\!models--mistralai--Magistral-Small-2509\textonly
parameters:
  lambda: 1.0
  normalize: false
  int8_mask: false
  rescale: true
dtype: float32
out_dtype: bfloat16
tokenizer:
  source: base
chat_template: auto
name: ☠️ Morbid Miasma 24B

Audit

bat
[DELLA Audit] Layer: model.layers.33.mlp.down_proj.weight | Lambda=1.00
  [BASE] textonly                                          
  !models--Casual-Autopsy--Maginum-Cydoms-24B       : ███                                                  6.5% (W:0.12 D:0.50 N:2.59 E:0.25)
  !models--TheDrummer--Precog-24B-v1                :                                                      0.9% (W:0.12 D:0.90 N:0.37 E:0.09)
  DarkArtsForge--Asmodeus-24B-v1                    : ███████                                             15.5% (W:0.12 D:0.50 N:6.16 E:0.25)
  DarkArtsForge--Asmodeus-24B-v2                    : ██████                                              13.5% (W:0.12 D:0.50 N:5.37 E:0.25)
  DarkArtsForge--Magistaroth-24B-v1                 :                                                      0.8% (W:0.12 D:0.75 N:0.34 E:0.25)
  DarkArtsForge--Paimon-24B-v3                      : ████████                                            16.5% (W:0.12 D:0.75 N:6.56 E:0.25)
  DarkArtsForge--Zepar-24B-v1                       : ███                                                  6.4% (W:0.12 D:0.75 N:2.55 E:0.25)
  Morax-24B-v2                                      : ██                                                   4.8% (W:0.12 D:0.75 N:1.91 E:0.25)
  Naphula--GhostFace-24B-v1                         : ██                                                   5.3% (W:0.12 D:0.75 N:2.10 E:0.25)
  Naphula--Slimaki-24B-v1                           : ████                                                 8.3% (W:0.12 D:0.75 N:3.31 E:0.25)
  Naphula--Slimaki-24B-v1.2                         : ████                                                 8.8% (W:0.12 D:0.75 N:3.52 E:0.25)
  Naphula--Slimaki-Tavern-24B-v1.3                  : ███                                                  7.0% (W:0.12 D:0.75 N:2.77 E:0.25)
  sophosympatheia--Magistry-24B-v1.0                : ██                                                   5.6% (W:0.12 D:0.50 N:2.24 E:0.25)

Morbid-Miasma-24B

README

Merge Details

Merge Methods

Models Merged

Configuration

Audit

Explore FriendliAI today

README

Merge Details

Merge Methods

Models Merged

Configuration

Audit