Results
Table with columns: retail test, 115 tasks, this adapter, starting adapter, same-pod re-run, starting adapter, earlier test (2 trials, other pod)| retail test, 115 tasks | this adapter | starting adapter, same-pod re-run | starting adapter, earlier test (2 trials, other pod) |
|---|
| pass^1 | 45.7% ± 3.4 | 41.7% ± 3.4 | 37.8% ± 3.7 |
| pass^2 | 29.9% | 27.1% | 21.7% |
| pass^3 | 22.0% | 20.2% | n/a |
| pass^4 | 16.5% | 16.5% | n/a |
By task type (pass^1): combo tasks (64) 34.8% vs 33.6%; other tasks (51) 59.3% vs 52.0%. That split was made after seeing the
results, so it is a hypothesis, not a finding. No airline result exists (that test was stopped after 10 rollouts).


How it was made
- A Qwen3-32B-AWQ teacher played 114 hard retail train tasks (up to 4 samples each, stopping a task after 2 passes) and solved 86 of them.
- The 180 passing conversations became SFT data: one example per assistant turn, loss on the completion only
(the
<think> reasoning, the tool call or reply and <|im_end|>).
- QLoRA on the 4-bit base, 1 epoch.




Usage
from peft import PeftModelfrom transformers import AutoModelForCausalLM, AutoTokenizerbase = "unsloth/Qwen3-14B-unsloth-bnb-4bit"model = AutoModelForCausalLM.from_pretrained(base, device_map="auto")model = PeftModel.from_pretrained(model, "teacher57/qwen3-14b-tau-distilled-from-32b")tok = AutoTokenizer.from_pretrained("teacher57/qwen3-14b-tau-distilled-from-32b")
For τ-bench evaluation we served it with vLLM 0.11.0 (--enable-lora --max-loras 3 --max-lora-rank 16, tool parser hermes,
reasoning parser qwen3).
Limitations
Retail domain only (the airline test was not completed); trained and tested with GPT-4o as the simulated customer; the training
conversations come from one teacher and one benchmark, so nothing here says the adapter generalises beyond τ-bench retail.