Training
79% Modern Greek, 20% foreign replay, 1% Old Greek. Extended vocabulary: 148,992 tokens. 18 training checkpoints and two checkpoint averages. main: terminal checkpoint.
Recommended checkpoint
base-avg30B-50B: GreekMMLU 56.78% (best single checkpoint: 56.81%). Apertus pretraining-suite macro: 64.58% (terminal: 62.95%).
Repositories and checkpoints
Table with columns: Resource, Links| Resource | Links |
|---|
| Original Apertus | Repository, Revision |
| Instruction models | Repository, Stage 1, Greek maths, Conversation |
| Greek base | base-avg30B-50B, 17-step18284-tokens77B, base-avg30B-50B, CHECKPOINTS.md, checkpoint-index.json |
| Pre-training data | Repository, Revision |
| SFT data | Stage 1, Repository |
| Post-training data | Greek maths, Conversation, Repository |
| Tokenizer | Revision, Repository |
| Benchmark audit | Repository |
Acknowledgements
This work was implemented thanks to a grant by Swiss AI for compute on CSCS.
Collection: Greek Apertus 8B.