Inspect every question and response
Browse all 200 questions and both complete responses, grouped into 23 fixes, 7 regressions and unchanged answers. Download the questions, full responses, CSV summary or complete protocol. The package includes dataset attribution and its original license.
Load the adapter
This adapter’s tested loader is AutoModelForImageTextToText, which preserves Qwen3.5’s model.language_model module paths. The Hub’s generated PEFT shortcut currently uses AutoModelForCausalLM; use the complete example below.
Install the loading dependencies in your Python environment:
python -m pip install torch "transformers==5.22.2" "peft==0.21.2" accelerate safetensors
Clean CPU loading was checked with Torch 2.15.0, Transformers 5.22.2 and PEFT 0.21.2. The benchmark runtime is specified separately below. Load from the Hub or an extracted local folder:
from peft import PeftConfig, PeftModelfrom transformers import AutoModelForImageTextToText, AutoTokenizer adapter = "hunterbown/trainless-math-2b-loop-repair" # Or an extracted local folder.config = PeftConfig.from_pretrained(adapter)base = AutoModelForImageTextToText.from_pretrained( config.base_model_name_or_path, revision=config.revision, dtype="auto", device_map="auto",)model = PeftModel.from_pretrained(base, adapter)tokenizer = AutoTokenizer.from_pretrained( config.base_model_name_or_path, revision=config.revision,)messages = [{"role": "user", "content": "What is 13 times 7?"}]inputs = tokenizer.apply_chat_template( messages, tokenize=True, add_generation_prompt=True, enable_thinking=True, return_tensors="pt", return_dict=True,).to(model.device)outputs = model.generate(**inputs, max_new_tokens=32768)print(tokenizer.decode(outputs[0, inputs["input_ids"].shape[-1]:], skip_special_tokens=True))
This is a loading example. The measured run used vLLM 0.31.0, Torch 2.13.0, Transformers 5.17.0, bf16, thinking on, temperature 0.6, top_p 0.95, top_k 20, presence_penalty 1.5 and seed 0. Results and generation behavior can change with another runtime or sampling setup.
Exact version
Base: Qwen/Qwen3.5-2B, pinned revision 15852e8c16360a2fea060d615a32b45270f8a8fc.
Adapter weights SHA256: f67ffbbc22c7a0c0e1dd9ce28459751b18ab91de6132390a164c611f5744e27b.
Configuration SHA256: 1cf3e3e143f8447c72287aa37419f1661b9afae6e8f7ba1bb848bed95a531752.
The packaged weights and configuration match the measured analytic adapter exactly. trainless_model.json contains aggregate measurements and the fixed-question hash. export_report.json describes its two writer changes.
A separate complete HF checkpoint was prepared from the original full edited BF16 values, with every tensor checked against its declared source. It is not included in this adapter repository. The analytic adapter and those rounded BF16 values are near-exact, with 35 and 64 differing entries in the two writers; they are not bit-identical variants. The new 76.0% score belongs to this exact analytic adapter.
Quantized variants are being checked separately. Their results will be reported for those files and runtimes.
The pinned base’s Apache 2.0 license is included unchanged.
Research basis
The forward-only editing approach builds on Sparks of Weight-Space Programming by Rikiya Takehi, Jayden Teoh, Alex Zhang and Omar Khattab (MIT CSAIL, November 2, 2026). This release contains Trainless’s separately constructed loop-repair direction and analytic 2B export; its measurements are the results reported above.