Results (AutoScientist evaluation)
Table with columns: Metric, Value| Metric | Value |
|---|
| Win rate vs base (best checkpoint) | 52.56% |
| Iterations completed | 5 / 5 |
| Adaptation quality grade | A |
| Training rows (adapted dataset) | 27,965 |
| Real seed rows (production DB) | 1002 |
Win rate is Adaption's head-to-head metric: the share of held-out evals the
adapted model beats the base model on. 52.56% means the adapter wins
~53 of every 100 comparisons — a modest but real,
measurable improvement.
Intended use
Research artifact + challenge submission. Given a signal's evidence payload
(commit message, release notes, diff patch, or synthesis narrative) it
produces a JSON object like:
{"detector_type": "protocol_upgrade", "recommended_action": "review_before_mainnet", "confidence": 0.78, "price_direction": "up", "horizon": "24h"}
Limitations
- Trained on a small real seed (~272 unique
signals) expanded platform-side; the lift over base is real but narrow.
- Domain-locked to crypto protocol signals; not a general market analyst.
- Not trading or investment advice. Understands nothing about positions,
sizing, or your objectives.
Training provenance