📜 Merge Log 26B-A4B
Merge Method
This model was merged using the MoE DELLA merge method using Naphula/Goetia-26B-A4B-v1.7 as a base.
Models Merged
The following models were included in the merge:
Note: Kitchoon v4 was tested along with Dark Craving v0.2 and v0.3, but merges with those versions produced lower Q0 bench scores than v3 + v0.1.
architecture: Gemma4ForConditionalGenerationbase_model: B:/26B/Naphula--Goetia-26B-A4B-v1.7models: - model: B:/26B/Gemory-26B-A4B-SOMPOA parameters: weight: - filter: "lm_head" value: 0.25 - filter: "o_proj" value: 0.5 - filter: "mlp" value: 0.2 - filter: "embed_tokens" value: 0.2 - value: 0.2 density: 1.0 epsilon: 0.09 - model: B:/26B/ReadyArt--Wicked-Stuff-26B-A4B-v3.0-Final parameters: weight: - filter: "lm_head" value: 0.25 - filter: "o_proj" value: 0.5 - filter: "mlp" value: 0.2 - filter: "embed_tokens" value: 0.2 - value: 0.2 density: 1.0 epsilon: 0.09 - model: B:/26B/SubMaroon--Kitchoon-V3-26B-A4B parameters: weight: - filter: "lm_head" value: 0.25 - filter: "o_proj" value: 0.5 - filter: "mlp" value: 0.2 - filter: "embed_tokens" value: 0.2 - value: 0.2 density: 1.0 epsilon: 0.09 - model: B:/26B/Ozili--Gemma-4-Vain-26B-A4B-Q8_0 parameters: weight: - filter: "lm_head" value: 0.0 - filter: "o_proj" value: 0.5 - filter: "mlp" value: 0.2 - filter: "embed_tokens" value: 0.2 - value: 0.2 density: 1.0 epsilon: 0.09 - model: B:/26B/ReadyArt--Dark-Craving-26B-A4B-v0.1 parameters: weight: - filter: "lm_head" value: 0.25 - filter: "o_proj" value: 0.5 - filter: "mlp" value: 0.2 - filter: "embed_tokens" value: 0.2 - value: 0.2 density: 1.0 epsilon: 0.09merge_method: moe_dellaparameters: lambda: 1.0 # normalize: true # deprecated normalize_weights: false normalize_router: true int8_mask: false rescale: true router_strategy: della # average # random_init blend_experts: truedtype: float32out_dtype: bfloat16tokenizer: source: unionchat_template: auto
📜 Merge Log 31B
Merge Method
This model was merged using the KARCHER merge method.
Models Merged
The following models were included in the merge:
architecture: Gemma4ForConditionalGenerationmodels: - model: B:/31B/DavidAU--gemma-4-31B-it-Grand-Horror-X-INTENSE-HERETIC-UNCENSORED-Thinking - model: B:/31B/MRockatansky--Gemma-4-31B-Storymaxxed3merge_method: karcherparameters: max_iter: 30 tol: 1.0e-9dtype: float32out_dtype: bfloat16tokenizer: source: unionchat_template: auto