Measured (150 held-out exec-scored pairs)
Table with columns: arm, exec_rate, exact_match| arm | exec_rate | exact_match |
|---|
| Qwen2.5-Coder-1.5B-Instruct | 0.533 | 0.293 |
| + this adapter | 0.620 | 0.253 |
Execution rises 8.7 points; exact match against bare-script references falls 4.0 points (the adapter adopts a wrapper-function answer style; see paper section 6 for the mechanism).
Usage
from transformers import AutoModelForCausalLM, AutoTokenizerfrom peft import PeftModel base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-Coder-1.5B-Instruct", torch_dtype="bfloat16").cuda()model = PeftModel.from_pretrained(base, "em908/analyst-v1")model = model.merge_and_unload().eval()
Training data
em908/analyst-data (same pair counts, same execution filter).
License
Apache-2.0 (matches the base model).