Mitchins

gemma-4-26B-A4B-it-qat-q4_0-unquantized-uncensored-heretic

README

License: apache-2.0

Method & provenance

Abliteration kernel (direction index + per-component weight kernels over 30 layers) was optimized on the stock google/gemma-4-26B-A4B-it base: 200-trial Optuna study, Pareto-optimal trial selected to minimize KL divergence at maximum refusal suppression.
The kernel was then transferred to the QAT-unquantized base, with residual directions recomputed on that base (mean per-layer direction cosine vs stock: 0.973, ~0.976 in the ablated layer band — same refusal circuit, so the transfer is faithful).
Ablation applied to attention out-projections (LoRA-merged), dense MLP down-projections (LoRA-merged), and all 128 fused MoE expert down-projections per layer (ablation baked into the 3D fused weights — see reproduce/reproduce.json for exact parameters).

Evaluation

Table with columns: Metric, QAT base (no ablation), This model
Metric	QAT base (no ablation)	This model
Refusal-keyword rate, worst-case "harmful" set (lower = less refusing)	100/100	24/100
KL divergence from base (harmless prompts, lower = less damage)	0	0.078
ARC-Challenge (chat MCQ)	93.86%	94.11%
Adult/romance creative-writing compliance (10-prompt suite)	9/10	10/10

Reference points on the stock (non-QAT) base with the same kernel: ARC-C 96.67% (stock unmodified: 96.76%), HellaSwag chat-MCQ 87.0% (stock: 87.9%), IFEval prompt-strict 88.5% / loose 90.8%, KL 0.090, refusal keywords 18/100. The ~3 pt ARC gap between QAT and stock bases is attributable to QAT training itself, not the abliteration (93.86 → 94.11 across ablation on the QAT base).

KL divergence 0.078 is well below the ~0.5 level generally associated with noticeable capability damage.

Intended use

A local creative-writing and analysis assistant for adult romance / adult-entertainment authorship, and general-purpose LAN workhorse duty. The residual keyword rate above is dominated by worst-case malicious-instruction prompts, not adult content, where compliance is effectively complete.

Released under Apache 2.0 (inherited from the base model). Provided as-is, no warranty; you are responsible for how you use it.

Reproducing

See reproduce/ for the exact Heretic parameters (JSON), dependency snapshot, and SHA256SUMS of the weight shards. The abliteration was run with a patched Heretic (Gemma-4 fused-expert support + low-RAM sequential loading); parameter semantics are unchanged.

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Container

Run this model inference with full control and performance in your environment.

Learn more

Model Details

Model Provider

Mitchins

Model Tree

Base

google/gemma-4-26B-A4B-it

Fine-tuned

this model

Input Modalities

TextImage

Output Modalities

Text

Supported Functionality

Dedicated EndpointsContainer

Explore FriendliAI today

Get started Talk to an engineer