Design Goals
- Long-horizon reasoning
- Reliable enterprise tool use
- Stable multi-turn planning
- Verifiable execution
- Efficient reinforcement learning
Results — AutomationBench (60-task subset, self-hosted)
Table with columns: Model, Size, Partial credit, Strict pass| Model | Size | Partial credit | Strict pass |
|---|
| Ornith-1.0-9B | 9B | 22% | 3% |
| seul-preview | 9B | 28% | 7% |
| Qwen3.6-27B | 27B | 34% | 10% |
A custom benchmark also improves performance across all benchmark categories. This serves as a proof of concept (PoC) that reinforcement learning with an environment not only preserves the capabilities of the base model but also improves its overall accuracy.
RLVR training raises partial credit +6 points and more than doubles the strict pass rate over the base, closing a large fraction of the gap to a 3× larger model on the same tasks.
Limittion
- This training process was conducted on only one domain.
- Due to limited GPU availability, the model was trained for only about half of the originally planned training steps, which may have prevented it from reaching its full potential.
Citation
If you use seul in your research or projects, please cite:
@misc{seul2026, title = {seul-preview}, author = {beyoru}, year = {2026}, publisher = {Hugging Face}, howpublished = {\url{https://huggingface.co/beyoru/seul-preview}}}