Experiment
- Base policy:
Qwen/Qwen3-1.7B
- Base revision:
70d244cc86ccca08cf5af4e1e306ecf908b1ad5e
- RL algorithm: GRPO
- Training reward: frozen prompt-specific initial rubric (
R0)
- Domain: RaR Medicine or RaR Science, as named in the repository
- Training seed: 11
- Export format: Hugging Face Transformers, BF16 safetensors
- Checkpoint contents: model weights, configuration, tokenizer, and chat template
- Excluded: optimizer, scheduler, trainer state, rollouts, rubrics, and evaluation data
Medicine checkpoint repositories cover the ten planned audit points through
step 48. Science training was only saved through step 3 at the time of this
upload, so the public Science repositories contain steps 0 and 3.
Loading
from transformers import AutoModelForCausalLM, AutoTokenizer
repo_id = "HYU-NLP-EVAL/<repository-name>"
tokenizer = AutoTokenizer.from_pretrained(repo_id)
model = AutoModelForCausalLM.from_pretrained(
repo_id,
dtype="bfloat16",
device_map="auto",
)
Intended use
These checkpoints are research artifacts for studying reward saturation and
static-rubric staleness during policy optimization. Medicine checkpoints are
not medical devices and must not be used as a substitute for professional
medical advice.