llmfan46

Gemma-4-Harmonia-31B-it-uncensored-heretic

Deploy Dedicated

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Get help setting up a custom Dedicated Endpoints.

Talk with our engineer to get a quote for reserved GPU instances with discounts.

README

❤️ Support My Work

Creating these models takes significant time, work and compute. If you find them useful consider supporting me:

image/png

Table with columns: Platform, Link, What you get
Platform	Link	What you get
🎉 Patreon	Monthly support	Priority model requests
☕ Ko-fi	One-time tip	My eternal gratitude

Your help will motivate me and would go into further improving my workflow and coverings fees for storage, compute and may even help uncensoring bigger model with rental Cloud GPUs.

This is a decensored version of virtuous7373/Gemma-4-Harmonia-31B, made using Heretic v1.2.0 with the Arbitrary-Rank Ablation (ARA) method

Abliteration parameters

Table with columns: Parameter, Value
Parameter	Value
start_layer_index	14
end_layer_index	55
preserve_good_behavior_weight	0.7754
steer_bad_behavior_weight	0.0001
overcorrect_relative_weight	0.9765
neighbor_count	14

Targeted components

attn.o_proj

Performance

Table with columns: Metric, This model, Original model (Gemma-4-Harmonia-31B)
Metric	This model	Original model (Gemma-4-Harmonia-31B)
KL divergence	0.0047	0 (by definition)
Refusals	✅ 9/100	❌ 97/100

Lower refusals indicate fewer content restrictions, while lower KL divergence indicates more closeness to the original model's baseline. Higher refusals cause more rejections, objections, pushbacks, lecturing, censorship, softening and deflections.

MMLU test results:

Original:

============================================================

Total questions: 7021
Correct: 6014
Accuracy: 0.8566 (85.66%)
Parse failures: 22

============================================================

Tested subject scores:

professional_law: 0.7592 (596/785)
moral_scenarios: 0.8394 (371/442)
miscellaneous: 0.9243 (354/383)
professional_psychology: 0.8797 (278/316)
high_school_psychology: 0.9593 (259/270)
high_school_macroeconomics: 0.9137 (180/197)
elementary_mathematics: 0.9239 (170/184)
moral_disputes: 0.8678 (151/174)
prehistory: 0.9128 (157/172)
philosophy: 0.8553 (136/159)
high_school_biology: 0.9605 (146/152)
professional_accounting: 0.7902 (113/143)
clinical_knowledge: 0.8929 (125/140)
high_school_microeconomics: 0.9632 (131/136)
nutrition: 0.8815 (119/135)
professional_medicine: 0.9104 (122/134)

Heretic:

============================================================

Total questions: 7021
Correct: 5936
Accuracy: 0.8455 (84.55%)
Parse failures: 17

============================================================

Tested subject scores:

professional_law: 0.7121 (559/785)
moral_scenarios: 0.8281 (366/442)
miscellaneous: 0.9191 (352/383)
professional_psychology: 0.8703 (275/316)
high_school_psychology: 0.9593 (259/270)
high_school_macroeconomics: 0.9188 (181/197)
elementary_mathematics: 0.9348 (172/184)
moral_disputes: 0.8448 (147/174)
prehistory: 0.9128 (157/172)
philosophy: 0.8113 (129/159)
high_school_biology: 0.9605 (146/152)
professional_accounting: 0.7902 (113/143)
clinical_knowledge: 0.8786 (123/140)
high_school_microeconomics: 0.9559 (130/136)
nutrition: 0.8815 (119/135)
professional_medicine: 0.9030 (121/134)

MMLU - Massive Multitask Language Understanding, multiple-choice questions across 57 subjects (math, history, law, medicine, etc.).

GGUF Version

GGUF quantizations available here llmfan46/Gemma-4-Harmonia-31B-it-uncensored-heretic-GGUF.

Harmonious Synthesis

Multi-Stage Fusion Protocol

Methodological Innovations

Model Lineage & Ingredients

Merge Blueprint

yaml
name: clever-basename

merge_method: nullspace
base_model: ./gemma-4-31B-base

models:
  - model: ./Gemma4-GarnetV2-31B
    parameters:
      weight: 1.0

parameters:
  protect_base: true
  nr: 256

tokenizer:
  source: base
chat_template: auto

dtype: float32
out_dtype: bfloat16
---
name: clever-intname
merge_method: cabs

base_model: ./clever-basename

models:
  - model: ./clever-basename

  - model: ./G4-MeroMero-31B-uncensored-heretic
    parameters:
      weight: 0.6
      n_val: 16
      m_val: 32
  - model: ./Gemma-4-Gembrain-31B-heretic
    parameters:
      weight: 0.4
      n_val: 11
      m_val: 33

default_n_val: 8
default_m_val: 32

pruning_order:
  - ./G4-MeroMero-31B-uncensored-heretic
  - ./Gemma-4-Gembrain-31B-heretic

dtype: float32
out_dtype: bfloat16

tokenizer:
  source: union

chat_template: auto
---
name: Harmonia

merge_method: actmat

base_model: ./gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic

models:
  - model: ./gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic
  - model: ./LatitudeGames-Equinox-31B
    parameters:
      weight: 1
  - model: ./clever-intname
    parameters:
      weight: 1
  - model: ./Fabled-Gemma4-31B
    parameters:
      weight: 1

parameters:
  epsilon: 1e-6

tokenizer:
  source: "union"

dtype: bfloat16
out_dtype: bfloat16

chat_template: auto

Symphony Contributors

Model provider

llmfan46

Model tree

Base

llmfan46/Gemma-4-Gembrain-31B-it-uncensored-heretic

Base

Lambent/Fabled-Gemma4-31B

Base

ConicCat/Gemma4-GarnetV2-31B

Base

llmfan46/G4-MeroMero-31B-uncensored-heretic

Base

llmfan46/gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic

Base

google/gemma-4-31B

Base

google/gemma-4-31B-it

Base

LatitudeGames/Equinox-31B

Merged

this model

Modalities

Input

Text, Image

Output

Text

Pricing

Dedicated Endpoints

View details

Supported Functionality

Model APIs

Dedicated Endpoints

Container

More information

Model card

❤️ Support My Work

Creating these models takes significant time, work and compute. If you find them useful consider supporting me:

image/png

Table with columns: Platform, Link, What you get
Platform	Link	What you get
🎉 Patreon	Monthly support	Priority model requests
☕ Ko-fi	One-time tip	My eternal gratitude

Your help will motivate me and would go into further improving my workflow and coverings fees for storage, compute and may even help uncensoring bigger model with rental Cloud GPUs.

This is a decensored version of virtuous7373/Gemma-4-Harmonia-31B, made using Heretic v1.2.0 with the Arbitrary-Rank Ablation (ARA) method

Abliteration parameters

Table with columns: Parameter, Value
Parameter	Value
start_layer_index	14
end_layer_index	55
preserve_good_behavior_weight	0.7754
steer_bad_behavior_weight	0.0001
overcorrect_relative_weight	0.9765
neighbor_count	14

Targeted components

attn.o_proj

Performance

Table with columns: Metric, This model, Original model (Gemma-4-Harmonia-31B)
Metric	This model	Original model (Gemma-4-Harmonia-31B)
KL divergence	0.0047	0 (by definition)
Refusals	✅ 9/100	❌ 97/100

MMLU test results:

Original:

============================================================

Total questions: 7021
Correct: 6014
Accuracy: 0.8566 (85.66%)
Parse failures: 22

============================================================

Tested subject scores:

professional_law: 0.7592 (596/785)
moral_scenarios: 0.8394 (371/442)
miscellaneous: 0.9243 (354/383)
professional_psychology: 0.8797 (278/316)
high_school_psychology: 0.9593 (259/270)
high_school_macroeconomics: 0.9137 (180/197)
elementary_mathematics: 0.9239 (170/184)
moral_disputes: 0.8678 (151/174)
prehistory: 0.9128 (157/172)
philosophy: 0.8553 (136/159)
high_school_biology: 0.9605 (146/152)
professional_accounting: 0.7902 (113/143)
clinical_knowledge: 0.8929 (125/140)
high_school_microeconomics: 0.9632 (131/136)
nutrition: 0.8815 (119/135)
professional_medicine: 0.9104 (122/134)

Heretic:

============================================================

Total questions: 7021
Correct: 5936
Accuracy: 0.8455 (84.55%)
Parse failures: 17

============================================================

Tested subject scores:

professional_law: 0.7121 (559/785)
moral_scenarios: 0.8281 (366/442)
miscellaneous: 0.9191 (352/383)
professional_psychology: 0.8703 (275/316)
high_school_psychology: 0.9593 (259/270)
high_school_macroeconomics: 0.9188 (181/197)
elementary_mathematics: 0.9348 (172/184)
moral_disputes: 0.8448 (147/174)
prehistory: 0.9128 (157/172)
philosophy: 0.8113 (129/159)
high_school_biology: 0.9605 (146/152)
professional_accounting: 0.7902 (113/143)
clinical_knowledge: 0.8786 (123/140)
high_school_microeconomics: 0.9559 (130/136)
nutrition: 0.8815 (119/135)
professional_medicine: 0.9030 (121/134)

MMLU - Massive Multitask Language Understanding, multiple-choice questions across 57 subjects (math, history, law, medicine, etc.).

GGUF Version

GGUF quantizations available here llmfan46/Gemma-4-Harmonia-31B-it-uncensored-heretic-GGUF.

Harmonious Synthesis

Multi-Stage Fusion Protocol

Methodological Innovations

Model Lineage & Ingredients

Merge Blueprint

yaml
name: clever-basename

merge_method: nullspace
base_model: ./gemma-4-31B-base

models:
  - model: ./Gemma4-GarnetV2-31B
    parameters:
      weight: 1.0

parameters:
  protect_base: true
  nr: 256

tokenizer:
  source: base
chat_template: auto

dtype: float32
out_dtype: bfloat16
---
name: clever-intname
merge_method: cabs

base_model: ./clever-basename

models:
  - model: ./clever-basename

  - model: ./G4-MeroMero-31B-uncensored-heretic
    parameters:
      weight: 0.6
      n_val: 16
      m_val: 32
  - model: ./Gemma-4-Gembrain-31B-heretic
    parameters:
      weight: 0.4
      n_val: 11
      m_val: 33

default_n_val: 8
default_m_val: 32

pruning_order:
  - ./G4-MeroMero-31B-uncensored-heretic
  - ./Gemma-4-Gembrain-31B-heretic

dtype: float32
out_dtype: bfloat16

tokenizer:
  source: union

chat_template: auto
---
name: Harmonia

merge_method: actmat

base_model: ./gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic

models:
  - model: ./gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic
  - model: ./LatitudeGames-Equinox-31B
    parameters:
      weight: 1
  - model: ./clever-intname
    parameters:
      weight: 1
  - model: ./Fabled-Gemma4-31B
    parameters:
      weight: 1

parameters:
  epsilon: 1e-6

tokenizer:
  source: "union"

dtype: bfloat16
out_dtype: bfloat16

chat_template: auto

Symphony Contributors

Gemma-4-Harmonia-31B-it-uncensored-heretic

Get help setting up a custom Dedicated Endpoints.

❤️ Support My Work

This is a decensored version of virtuous7373/Gemma-4-Harmonia-31B, made using Heretic v1.2.0 with the Arbitrary-Rank Ablation (ARA) method

Abliteration parameters

Targeted components

Performance

MMLU test results:

GGUF Version

Explore FriendliAI today

❤️ Support My Work

This is a decensored version of virtuous7373/Gemma-4-Harmonia-31B, made using Heretic v1.2.0 with the Arbitrary-Rank Ablation (ARA) method

Abliteration parameters

Targeted components

Performance

MMLU test results:

GGUF Version