WasamiKirua

Hexis-Aurora-12B

Deploy Dedicated

README

Merge Details

Merge Method

This model was merged using the Linear merge method.

Models Merged

The following models were included in the merge:

FallenMerick/MN-Violet-Lotus-12B
/intermediates-aurora/vesper

Configuration

The following YAML configuration was used to produce this model:

yaml
chat_template: mistral
dtype: bfloat16
merge_method: linear
modules:
  default:
    slices:
    - sources:
      - layer_range: [0, 40]
        model: /intermediates-aurora/vesper
        parameters:
          weight: 0.8
      - layer_range: [0, 40]
        model: FallenMerick/MN-Violet-Lotus-12B
        parameters:
          weight: 0.2
parameters:
  normalize: 1.0
tokenizer:
  source: mistralai/Mistral-Nemo-Instruct-2407