ApolloRaines

Pythia-1.4B-jBlaze-Reasoning

README

License: apache-2.0

What changed

jBlaze applies behavioral modifications directly to model weight matrices. This produces targeted changes in the model's decision behavior without retraining. The reasoning-enhanced version applies two complementary behavioral modifications across all 24 transformer layers.

No fine-tuning. No LoRA. No gradient descent. No additional training data.

Benchmark results

Evaluated on a 100-question held-out reasoning benchmark across 5 categories. These questions were never used during the configuration search. Evaluation uses logit-level multiple-choice scoring (the same methodology as MMLU).

Table with columns: Model, Overall, Logic, Math, Sequences, Verbal, Causal, Perplexity
Model	Overall	Logic	Math	Sequences	Verbal	Causal	Perplexity
Raw Pythia 1.4B	11%	15%	10%	10%	10%	10%	--
DNP base (before reasoning edits)	7%	20%	10%	5%	0%	0%	2.64
jBlaze Reasoning	56%	55%	60%	30%	60%	75%	3.20

Overall held-out reasoning accuracy increased from 7% to 56% -- an 8x result, equivalent to a 700% relative increase in benchmark accuracy.

The gain is broad -- every category improved. Causal reasoning moved from 0% to 75%. Verbal reasoning from 0% to 60%. Math from 10% to 60%.

Perplexity increased from 2.64 to 3.20, indicating a modest distributional shift rather than catastrophic degradation.

Important context

This is a 1.4 billion parameter model. It does not produce high-quality free-form text regardless of reasoning edits. The improvement is measured at the logit/decision level, which is how standard benchmarks (MMLU, ARC, etc.) evaluate reasoning.
The benchmark contains 100 questions across 5 categories. Larger independent benchmarks would strengthen or weaken these results -- that is why we are publishing the model and evaluation script.
"8x higher accuracy on this benchmark" is accurate. "8x smarter" is not what we are claiming.
The base model was first processed with DNP (Direct Neural Programming) for knowledge injection before reasoning blazes were applied. The 7% baseline reflects the DNP model. Raw Pythia 1.4B scores 11% on the same benchmark -- both are near-random for reasoning.

Test it yourself

The evaluation script is included in this repository. Compare any model against this benchmark:

bash
# Test the jBlaze reasoning-enhanced model
python eval_reasoning.py --model ApolloRaines/Pythia-1.4B-jBlaze-Reasoning

# Test vanilla Pythia 1.4B
python eval_reasoning.py --model EleutherAI/pythia-1.4b

# Test any other model
python eval_reasoning.py --model <your-model-path-or-hf-id>

Requirements: torch, transformers

How to use

python
from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("ApolloRaines/Pythia-1.4B-jBlaze-Reasoning")
tokenizer = AutoTokenizer.from_pretrained("ApolloRaines/Pythia-1.4B-jBlaze-Reasoning")

What is jBlaze?

jBlaze is the behavioral weight editing compiler built by SAIQL. It applies targeted modifications to model weight matrices, changing specific behavioral traits without retraining.

The technology behind jBlaze is proprietary. The method is not published. The results are.

Released models: huggingface.co/ApolloRaines

Technical details

Base model: EleutherAI/pythia-1.4b (1.4B parameters, 24 layers, GPT-NeoX architecture)
Modification method: jBlaze weight editing (no gradients)
Parameter count: Unchanged (1,414,647,808)
Gradient-training data used: None
Compute cost: Under 2 minutes on an NVIDIA RTX 3090

Citation

markdown
@misc{raines2026jblaze-reasoning,
  title={jBlaze Reasoning Enhancement: Improving Held-Out Reasoning via Behavioral Weight Editing},
  author={Apollo Raines},
  year={2026},
  url={https://huggingface.co/ApolloRaines/Pythia-1.4B-jBlaze-Reasoning}
}

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Model Details

Model Provider

ApolloRaines

Model Tree

Base

EleutherAI/pythia-1.4b

Fine-tuned

this model

Input Modalities

Text

Output Modalities