Results — tau2 retail test split, 3 trials, 60-hop cap
Table with columns: pass@3, avg@3, pass^3 | pass@3 | avg@3 | pass^3 |
|---|
| base | 0.775 | 0.575 | 0.400 |
| this model | 0.625 | 0.492 | 0.350 |
| memory GRPO, retail only | 0.650 | 0.558 | 0.475 |
On retail the memory-augmented variant is the stronger of the two at this budget
(avg@3 0.558 vs 0.492, pass^3 0.475 vs 0.350), and that ordering also held under
joint training. Joint training carried to 5 epochs reached avg@3 0.592 (memory)
and 0.558 (plain), so epoch count mattered more than domain separation here.
Numbers use a 60-hop episode cap rather than tau2's 200-hop default, so they are
not comparable to the public leaderboard.