Usage
The policy acts with the agent prompts of the RSIPO code. To reproduce the evaluation, set up the
repository as described in its README, then run:
hf download Karl28/RSIPO-Qwen2.5-7B-Instruct-Search --local-dir $MODELS_ROOT/RSIPO-Qwen2.5-7B-Instruct-Search# first start the retriever in another terminal: bash scripts/rsipo/start_retriever.shRSIPO_EVAL_HF=1 bash scripts/rsipo/evaluate.sh search RSIPO-Qwen2.5-7B-Instruct-Search
This answers all 51,713 test questions with the retriever, with temperature 0.4, at most 4 turns and no skill in the prompt.
License
Apache License 2.0 (LICENSE), the license of the base model Qwen/Qwen2.5-7B-Instruct. The weights are modified from the base model by fine-tuning.
Citation
The citation will be added when the paper is public.