Usage
The policy acts with the agent prompts of the RSIPO code. To reproduce the evaluation, set up the
repository as described in its README, then run:
hf download Karl28/RSIPO-Qwen2.5-7B-Instruct-ALFWorld --local-dir $MODELS_ROOT/RSIPO-Qwen2.5-7B-Instruct-ALFWorldRSIPO_EVAL_HF=1 bash scripts/rsipo/evaluate.sh alfworld RSIPO-Qwen2.5-7B-Instruct-ALFWorld
This plays the seen (140 games) and unseen (134 games) splits of ALFWorld in three rounds with seeds 1, 2 and 3, with temperature 0.4, at most 50 turns and no skill in the prompt, and writes the success rates of every round to summary.json.
License
Apache License 2.0 (LICENSE), the license of the base model Qwen/Qwen2.5-7B-Instruct. The weights are modified from the base model by fine-tuning.
Citation
The citation will be added when the paper is public.