Dispatch
The Open ASR Leaderboard adds Hindi and swaps WER for an orthography-aware metric
Hugging Face added Hindi as the first Indic language on a multilingual tab that previously covered only European languages, alongside Monsoon en-IN (5.62 hours public, 5.58 private) and Monsoon hi-IN (1.33 hours public, 4.47 private). Hindi is scored with Orthographically-Informed WER rather than plain WER, because the language admits multiple valid spellings of the same word. The corpus-level results are a warning about leaderboard resolution: eight models land between 4.81 and 4.99 WER on Indian English, but regional breakdowns show one model swinging 1.68 points across zones while another moves only 0.46.
↳ Follow the thread