Important usage note
This is not a normal text-generation checkpoint. The activation vector must be injected
at token id 149705 with scale 150 using the forward hook in the accompanying training or
evaluation code. Exact metadata and prompt templates are in nla_meta.yaml.
Evaluation
On 200 fresh Ultra-FineWeb prefixes with zero exact overlap with the 10k training set:
- Valid
<explanation> format: 200/200.
- Full AV -> AR cycle FVE: 0.03765, bootstrap 95% CI [-0.00674, 0.07194].
- Full-cycle mean cosine: 0.65645.
- Shuffled full-cycle FVE: -0.74131.
The model is fluent and activation-conditioned but the full-cycle FVE is low; it should
be treated as an SFT warm start for joint NLA RL, not as a finished interpretability tool.
Training
- Target layer: raw
model.layers[20], no final RMSNorm.
- Dense full-parameter transformer-block SFT, not LoRA.
- FP16, PyTorch SDPA, gradient checkpointing.
- Effective global batch: 33 on three V100-32GB GPUs.
- Exp17: 152 optimizer steps, peak LR 7e-6.
- Exp19: 73 optimizer steps, peak LR 3.5e-6, fresh optimizer.
See MaxChess/nla-affect-10k for exact splits and source code.