Results (pass@1, 320 tasks per site, matched criterion)
Table with columns: Eval on, Goodbuy (sim), Bestbuy (real)| Eval on | Goodbuy (sim) | Bestbuy (real) |
|---|
| This adapter | 4.4% | 5.3% |
Usage
from peft import PeftModel
from transformers import Qwen2_5_VLForConditionalGeneration
base = Qwen2_5_VLForConditionalGeneration.from_pretrained("Qwen/Qwen2.5-VL-7B-Instruct")
model = PeftModel.from_pretrained(base, "victoria-kp/qwen25vl-7b-simtoreal-sft-bestbuy")
Training
QLoRA (4-bit NF4 base, LoRA rank 64, alpha 128, attention + MLP layers) on
success-only Claude Fable teacher trajectories from the Bestbuy training
split. One example per agent step: observation in (screenshot, task
instruction, BID element list, history), teacher reasoning and JSON action
out. Learning rate 5e-5 cosine with 5% warmup, effective batch size 2, max
sequence length 4096. This is the validation-loss-optimal checkpoint
(step 700, epoch 0.53).