shujaAK

whisper-medium-hindi-hinglish-asr-fine-tuned

README

License: apache-2.0

Overall Performance

Table with columns: Metric, Score
Metric	Score
Test Samples	373
Word Error Rate (WER)	0.0456
Character Error Rate (CER)	0.0262
Relative WER Improvement	86.99%

Performance by Difficulty

Table with columns: Difficulty, Samples, WER
Difficulty	Samples	WER
Easy	317	0.0303
Medium	49	0.1301
Hard	7	0.2182

Performance by Language

Table with columns: Language, Samples, WER
Language	Samples	WER
Hindi	280	0.0514
Hinglish	93	0.0300

Performance by Error Category

Table with columns: Category, Samples, WER
Category	Samples	WER
Perfect	288	0.0384
Minor Phonetic	50	0.0628
Digit Format	29	0.0758
Script Switch	3	0.0682
Genuine Error	2	0.0588
Loanword Mishear	1	0.0000

Usage

Load the model using the Hugging Face Transformers library.

markdown
import torch
from transformers import WhisperProcessor, WhisperForConditionalGeneration

processor = WhisperProcessor.from_pretrained(
    "shujaAK/whisper-medium-hindi-hinglish-asr-fine-tuned"
)

model = WhisperForConditionalGeneration.from_pretrained(
    "shujaAK/whisper-medium-hindi-hinglish-asr-fine-tuned"
)

device = "cuda" if torch.cuda.is_available() else "cpu"

model = model.to(device)
model.eval()

Intended Uses

This model is intended for:

Hindi Automatic Speech Recognition
Hinglish Automatic Speech Recognition
Academic Research
Speech Recognition Experiments
Fine-tuning Research

Limitations

The model is primarily trained on synthetic speech.
Performance may decrease on noisy recordings.
Performance may vary across unseen accents and speaking styles.
Not evaluated for streaming ASR.

Training Framework

Hugging Face Transformers
PyTorch

Results Summary

Table with columns: Metric, Value
Metric	Value
WER	0.0456
CER	0.0262
Test Samples	373
WER Improvement	86.99%

Acknowledgements

This project builds upon:

OpenAI Whisper
Hugging Face Transformers

Citation

If you use this model in your research or applications, please cite this Hugging Face repository.

bibtex
@misc{whisper_medium_hindi_hinglish_asr,
  title={Whisper Medium Hindi-Hinglish ASR (Fine-Tuned)},
  author={Suja Akhter},
  year={2026},
  publisher={Hugging Face},
  howpublished={\url{https://huggingface.co/shujaAK/whisper-medium-hindi-hinglish-asr-fine-tuned}}
}

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Container

Run this model inference with full control and performance in your environment.

Learn more

Model Details

Model Provider

shujaAK

Model Tree

Base

openai/whisper-medium

Fine-tuned

this model

Input Modalities

Audio

Output Modalities

Text

Supported Functionality

Dedicated EndpointsContainer

Explore FriendliAI today

Get started Talk to an engineer