Results (pass@1, 320 tasks per site, matched criterion)
Table with columns: Eval on, Goodbuy (sim), Bestbuy (real)| Eval on | Goodbuy (sim) | Bestbuy (real) |
|---|
| This adapter | 25.0% | 0.6% |
Usage
from peft import PeftModel
from transformers import Qwen2_5_VLForConditionalGeneration
base = Qwen2_5_VLForConditionalGeneration.from_pretrained("Qwen/Qwen2.5-VL-7B-Instruct")
model = PeftModel.from_pretrained(base, "victoria-kp/qwen25vl-7b-simtoreal-grpo-goodbuy")
Training
GRPO from the corresponding SFT adapter: 8 rollouts per task, 8 tasks per
round, 10 rounds, binary matched-criterion reward from a deterministic
page-state verifier, KL 0.03 to the frozen SFT adapter, clip 0.2, lr 5e-6,
temperature 1.0. Trained on the Goodbuy split. This is the checkpoint with
the best held-out success (round 9).