ProofForge P3 probe: one-iteration Lean RL (CISPO) LoRA adapter
This adapter is a plumbing probe, not an improved prover. It records one CISPO optimizer step on top of
Goedel-LM/Goedel-Prover-V2-8B (LoRA r64, alpha 128, all attention and MLP projections). The step used 64 rollouts
(8 train-split Goedel-Pset problems x 8 samples, cap 16384 tokens), each verified by a frozen Lean 4 checker (v4.9.0-rc1,
Mathlib d1d1e4b7).
The probe confirmed:
- reward variance was nonzero, at 31/62 accepted;
- the update was applied, with 252/252 lora_B tensors moved;
- the behaviour and trainer log-probs agree, with a mean importance ratio of 1.0000.
Full numbers are in probe_result.json. Evaluation: none. Do not use it as a better model than the base. No miniF2F test
statement was used for generation or training.
Usage: PeftModel.from_pretrained(AutoModelForCausalLM.from_pretrained("Goedel-LM/Goedel-Prover-V2-8B"), "<this repo>").