Model Overview
This model is a fine-tuned Whisper Small model for Bengali Automatic Speech Recognition (ASR) using 15 dB SNR noisy speech data.
Training Configuration
Table with columns: Parameter, Value| Parameter | Value |
|---|
| Base Model | Whisper Small |
| Language | Bengali |
| Training Samples | 5,000 |
| Validation Samples | 500 |
| Sampling Rate | 16 kHz |
| Learning Rate | 1e-5 |
| Batch Size | 32 |
| Epochs | 10 |
Evaluation Results
Table with columns: Step, Validation Loss, WER (%), CER (%)| Step | Validation Loss | WER (%) | CER (%) |
|---|
| 100 | 0.6018 | 82.21 | 35.25 |
| 200 | 0.3004 | 71.96 | 26.54 |
| 300 | 0.2693 | 67.14 | 24.48 |
| 400 | 0.2851 | 64.73 | 23.89 |
| 500 |
Selected Checkpoint
Checkpoint-300 was selected as the final model because it achieved the lowest validation loss (0.2693). After step 300, validation loss began to increase while training loss continued to decrease, indicating the onset of overfitting. Therefore, checkpoint-300 was chosen to ensure better generalization performance.
Intended Use
- Bengali Speech Recognition
- Academic Research
- Bengali ASR Benchmarking
- Noisy Speech Transcription (15 dB SNR)