Unified JSON format: a system prompt (task + output schema) + a numbered user sequence → one JSON
answer ({"reasoning": "...", "steps": [...]} for next-step/completion;
{"reasoning": "...", "valid": bool, "rule": "RULE_..."|null}
for anomaly). Build the exact messages with
zo_train.prompts.build_messages from the
project repo, then apply the tokenizer chat
template. See the flagship model card for a full
from_pretrained snippet.
Evaluation (MOSFET labeled eval, n≈200)
Table with columns: task, this checkpoint, n-gram baseline| task | this checkpoint | n-gram baseline |
|---|
| next-step (top-1) | 0.435 | 0.69 |
| sequence completion (block-acc) | 0.500 | 0.637 |
| anomaly (F1) | 0.000 | 0.89 |
Full study + all checkpoints: the project repo and submissions/XCombinator/REPORT.md.
Notes
- Full fine-tune (not a LoRA adapter) — loads directly with
AutoModelForCausalLM.from_pretrained.
- Trained on Leonardo (CINECA) A100 via a deterministic data factory over the organizer grammar.