Model description
openai/whisper-tiny (39M parameters) fine-tuned for English
speech recognition on e-banking voice queries (Unit 5 hands-on exercise of the Hugging Face Audio Course).
Intended uses & limitations
Transcription of short American-English customer-service / banking requests (8 kHz telephone audio,
resampled to 16 kHz). Trained on only ~450 utterances, so it is a course exercise, not a general-purpose ASR model.
Training and evaluation data
PolyAI/minds14, en-US subset (563 utterances): the first 450
examples for training (445 kept after dropping clips longer than 30 s) and the remaining 113
for evaluation.
Metrics are decimals (not percentages). Wer is the word error rate after Whisper's BasicTextNormalizer
(lower-casing, punctuation removal); Wer Ortho is computed on the raw text. Zero-shot whisper-tiny on the same
evaluation split: normalized WER 0.4014, orthographic WER 0.5416.
Code: https://github.com/emrezorlu1239/course-projects/tree/main/huggingface-audio-course (unit5_whisper_finetune/).
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 1e-05
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 50
- training_steps: 500
- mixed_precision_training: Native AMP
Training results
Table with columns: Training Loss, Epoch, Step, Validation Loss, Model Preparation Time, Wer, Wer Ortho| Training Loss | Epoch | Step | Validation Loss | Model Preparation Time | Wer | Wer Ortho |
|---|
| 0.2652 | 3.5714 | 100 | 0.5062 | 0.0015 | 0.3022 | 0.2973 |
| 0.0375 | 7.1429 | 200 | 0.5724 | 0.0015 | 0.3099 |
Framework versions
- Transformers 5.18.0
- Pytorch 2.11.0+cu128
- Datasets 5.0.1
- Tokenizers 0.23.2