What it does
At tool steps 5, 8, 11, ..., the monitor reads the step count and the three most recent action–observation pairs of
a run. Its failure score is the probability of ABORT among the labels CONTINUE, DELIVER and ABORT, read from
the next-token logits in one forward pass. Qwen3's thinking mode is turned off by the scoring code. A run is stopped once the score reaches a threshold calibrated on
successful runs.
Usage
git clone https://github.com/TIGER-AI-Lab/StopLoss.git && cd StopLosspip install -e ".[model]"python scripts/build_windows.py --runs my_runs.jsonl --out windows.jsonl --ks checkpointspython scripts/score_windows.py --base Qwen/Qwen3-8B \ --adapter TIGER-Lab/StopLoss-Qwen3-8B \ --windows windows.jsonl --out scores.jsonl
This adapter is seed 0 of its backbone; the results in the paper use an ensemble of four seeds.