Merge Details
Merge Method
This model was merged using the aura merge method.
Aura is an experimental method with a live heatmap visualizer. This model took 10 hours to merge using graph_v18.py
Models Merged
The following models were included in the merge:
- Gandalf69/Adversary-26B-A4B-v0
- TheDrummer/Orion-26B-A4B-v1.1
- Gryphe/Pantheon-Reasoning-26B-A4B-1.1-V2
- electroglyph/gemma4-26b-fiction-bf16
Configuration
The following YAML configuration was used to produce this model:
architecture: Gemma4ForConditionalGenerationmodels: - model: B:\26B\electroglyph--gemma4-26b-fiction-bf16 parameters: weight: 1.0 density: 0.90 epsilon: 0.09 pinocchio: false - model: B:\26B\Gryphe--Pantheon-Reasoning-26B-A4B-1.1-V2 parameters: weight: 1.0 density: 0.90 epsilon: 0.09 pinocchio: false - model: B:\26B\Gandalf69--Adversary-26B-A4B-v0 parameters: weight: 1.0 density: 0.90 epsilon: 0.09 pinocchio: true - model: B:\26B\TheDrummer--Orion-26B-A4B-v1.1 parameters: weight: 1.0 density: 0.90 epsilon: 0.09 pinocchio: falsemerge_method: auraparameters: eta: 1.2 tol: 1.0e-9 max_iter: 32 kappa: 0.65 mu: 0.5 theta: 0.94 optimization_mode: "pareto" phi: 2.0 alpha: 0.4 kappa: 0.65 jl_projs: 4 halley_strength: 0.20 halley_period: 76 scalar_gravity: 0.05 aura_shift: true omega: 0.08 momentum: 0.25 patience: 64 sharp: 0.55 voice: 0.35 density: 0.90 epsilon: 0.09 rescale: true int8_mask: false normalize_weights: false normalize_router: true router_strategy: "della" blend_experts: true auto_pad: true skip_on_mismatch: true verbose_logging: true resume_path: "B:/mergekit-new/Aura_Cache" enable_qliphoth: true pinocchio_lambda: 0.65 inverse_pinocchio: false dynamic_pareto_pinocchio: true qliphoth_gamma: 0.40 qliphoth_lambda_enslaved: 0.15 qliphoth_svd_rank: 4 qliphoth_preserve_ratio: 0.70 save_layer_heatmaps: true audit_image_dir: "B:/mergekit-new/Aura_Heatmaps" gap_jumper: 0.75 enable_qhe: true qhe_levels: 16 qhe_intensity: 0.15 qhe_crossover: 0.15dtype: float32out_dtype: bfloat16tokenizer: source: unionchat_template: autoname: 🧿 Aura Prototype 26B-A4B