Intended uses & limitations
Generate CrossFit-style workouts by prompting with an opening line (e.g. amrap 20 minutes) and sampling (top_k=50, temperature=0.9). The model reproduces the dataset's style and vocabulary, including its quirks (e.g. dumbell), not necessarily real-world programming wisdom. Small dataset (~136K tokens), so output can be repetitive.
Training and evaluation data
Full train split of flyfesan/wods (29,943 rows → 136,142 tokens → 1,063 blocks of 128 tokens); 95/5 train/eval split, seed 42.
Training procedure
Training hyperparameters
- learning_rate: 5e-05
- train_batch_size: 32
- eval_batch_size: 32
- seed: 42
- optimizer: AdamW (fused), betas=(0.9,0.999), epsilon=1e-08
- lr_scheduler_type: cosine
- lr_scheduler_warmup_steps: 20
- num_epochs: 3.0
- mixed_precision_training: Native AMP (fp16)
Training results
Table with columns: Training Loss, Epoch, Step, Validation Loss| Training Loss | Epoch | Step | Validation Loss |
|---|
| 1.4852 | 1.5625 | 50 | 1.3917 |
| 1.3315 | 3.0 | 96 | 1.2975 |
Training was run on Hugging Face Jobs (t4-small, ~2.5 min); the live loss curve is on the Trackio dashboard.
Framework versions
- Transformers 5.20.2
- Pytorch 2.14.1+cu130
- Datasets 5.1.0
- Tokenizers 0.23.3
Example generation
Prompt: amrap 20 minutes
amrap 20 minutes40 air squat40 dumbell kettlebell swing40 air squat30 dumbell kettlebell swing30 air squat30 dumbell kettlebell swing30 air squat30 dumbell kettlebell swing20 air squat10 dumbell kettlebell swing10 air squat