Benchmark Almanac

Voice Arena

We track 5 benchmarks and 15 arenas that Voice Arena made or helped make.

0 in use 2 with public code 15 with a leaderboard here

Arena leaderboards

Top five in each of its 14 arenas with three or more rated models, the most rated first. We don't have a leaderboard yet for one other, listed below.

Benchmarks

Name Kind Released Best score Status
Garble-Bench (Voice Arena) Models respond to dialogue with speech recognition errors. The evaluation measures error detection, transcription fidelity, conversation recovery and task completion. Audio understanding and voice Sep 2026 0.98 Not in cards
Voice Arena Full Duplex Bench Voice agents respond to pauses, changes of speaker, acknowledgments, and interruptions. The board averages success rates across these conversational behaviors. Audio understanding and voice 99.9% Not in cards
Voice Arena Diarization Bench Models identify who spoke when in recorded conversations. The board measures diarization error and publishes a separate track for speaker attributed transcription. Audio understanding and voice 31% Not in cards
Voice Arena Dictation Bench Dictation tools turn speech into written drafts. Judges measure the share of drafts a user could send without edits. Speech recognition and translation 75.8% Not in cards
Monsoon ASR Models transcribe Indian English and Hindi recordings. The Hindi evaluation accounts for alternative spellings in its word error rate. Speech recognition and translation Jul 2026 Not in cards

Arenas without a leaderboard here

Name Kind Released Best score Status
Voice Arena Goal Dataset Judges compare two calls and choose which caller achieved the airline task more successfully. Human preferences provide the reference. Audio understanding and voice Sep 2026 64.7% Not in cards