GLM-5.2 is live. #1 throughput on OpenRouter, pay-per-token on FriendliAI. Try it today ➜
kiviki
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
kiviki
Model Tree
openai/whisper-large-v3-turbo
Input Modalities
Output Modalities
Supported Functionality
openai/whisper-large-v3-turboq_proj, v_proj<|romani|><|romani|><|transcribe|><|notimestamps|>All results below were rerun on 2026-08-10 with fixed manifests and guarded decoding. Lower WER/CER is better.
Naming used below:
test.csv, the original single-source prompt set
(R_prompts).validation_clean.csv, the cleaned multi-source
validation split.facebook/mms-1b-all with
target_lang=rmc-script_latin, with no local MMS training.| Split | System | Role | WER | CER | ASCII WER | ASCII CER | Non-Latin |
|---|---|---|---|---|---|---|---|
| Prompt Test | Whisper Turbo Baseline | unadapted baseline | 0.796 | 0.184 | 0.719 | 0.138 | 0 |
| Prompt Test | Whisper Turbo Romani LoRA | trained Whisper adapter | 0.653 |
Prompt Test contains one source group only, so it is useful for continuity with the original model card but too easy to be the only headline result. Multi-Recording Dev spans five recording groups and is a better stress test for iteration.
The detailed frozen report is included in this repository at
eval/frozen-asr-evaluation-2026-08-10.md.
This is an experimental low-resource ASR adapter. It still makes frequent word-boundary, spelling, and diacritic mistakes. It is kept as a reproducible Whisper adapter baseline while MMS adapter training is investigated separately.
The MMS rows above are comparison results only. This repository does not contain an MMS adapter.
Use this adapter for experimentation with Latin-script Romani transcription. Review transcripts before using them in user-facing or high-stakes settings.
This repository does not include the base Whisper model, raw audio data, training optimizer state, or training/evaluation logs.
| 0.122 |
| 0.606 |
| 0.101 |
| 0 |
| Prompt Test | MMS-1B-All Romani/Latin Zero-Shot | external zero-shot comparison | 0.300 | 0.047 | 0.293 | 0.046 | 0 |
| Multi-Recording Dev | Whisper Turbo Baseline | unadapted baseline | 0.921 | 0.496 | 0.882 | 0.459 | 0 |
| Multi-Recording Dev | Whisper Turbo Romani LoRA | trained Whisper adapter | 0.769 | 0.405 | 0.753 | 0.393 | 0 |
| Multi-Recording Dev | MMS-1B-All Romani/Latin Zero-Shot | external zero-shot comparison | 0.756 | 0.383 | 0.746 | 0.376 | 0 |