ronpo-llama31-saferlhf-stage4-os-s42
Research checkpoint for the RONPO AAAI revision experiments.
- Method: RONPO OS, SafeRLHF Stage-4
- Base model:
meta-llama/Llama-3.1-8B-Instruct
- Seed: 42
- Local source at upload time:
/NHNHOME/AIPR/sjkim/MNPO_rev_20260710/results/p8_stage4_fresh_default_test_20260718/stage4/ronpo_os_stage4/train/full
- Uploaded at UTC: 2026-07-17T23:56:11Z
- Run status metadata:
not found
Measured P8 Stage-4 result on the locked 1,000-prompt PKU-SafeRLHF default-test panel: RONPO OS passed the corrected stability gate and exceeded IPO on Worst by +0.0445 (paired bootstrap 95% CI [+0.0217,+0.0670]); its Avg exceeded SimPO by +0.0248 (95% CI [+0.0082,+0.0416]). The panel is prompt-disjoint from earlier listed panels; no spent sealed split was touched.
Intended use: reproducibility and evaluation for the RONPO paper. This
checkpoint is not intended as a production assistant.