Model Description
SAUTI ASR v1 is a Whisper-medium model fine-tuned on ~89 hours of Swahili speech data from the keystats/swahili_asr_data dataset. The model achieves 13.52% WER on a held-out test set, a 50% relative improvement over the zero-shot Whisper-medium baseline (~27% WER).
This model is part of the SAUTI platform — an African languages voice agent system combining ASR, LLM, and TTS for natural Swahili voice conversations.
Training Details
Table with columns: Parameter, Value| Parameter | Value |
|---|
| Base model | openai/whisper-medium (764M params) |
| Training data | keystats/swahili_asr_data (52,699 train / 5,271 val / 585 test) |
| Total audio | ~88.7 hours |
| Epochs | 5 |
| Effective batch size | 32 (16 per device × 2 gradient accumulation) |
| Learning rate | 1e-5 |
| Optimizer | AdamW |
| FP16 | Yes |
| Hardware | NVIDIA A100-SXM4-80GB |
| Training time | 7 hours 3 minutes |
| Steps | 8,235 |
Evaluation Results
Table with columns: Metric, Value| Metric | Value |
|---|
| Test WER | 13.52% |
| Test CER | 3.85% |
| Test Loss | 0.252 |
| Best Eval WER | 13.44% (step 7000) |
WER Progression During Training
Table with columns: Step, WER, Epoch| Step | WER | Epoch |
|---|
| 500 | 27.23% | ~0.3 |
| 1000 | 21.37% | ~0.6 |
| 2500 | 15.58% | ~1.5 |
| 5000 | 14.11% | ~3.0 |
| 7000 | 13.44% | ~4.2 |
| 8235 (final) | 13.52% | 5.0 |
Usage
Intended Use
- Swahili (Kiswahili) speech-to-text transcription
- Voice agent applications for East African markets
- Research on low-resource African language ASR
Limitations
- Trained primarily on Kenyan Swahili — may perform differently on Tanzanian or other Swahili dialects
- Optimized for clean speech; performance may degrade in noisy environments
- Maximum audio length: 30 seconds per segment
Citation
If you use this model, please cite: