Benchmark Almanac

VoiceMOS Challenge organizing committee

We track 3 benchmarks that VoiceMOS Challenge organizing committee made or helped make.

0 in use 2 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
VoiceMOS Challenge 2023 Models predict listener ratings for French speech synthesis, singing voice conversion, and noisy Mandarin speech. Teams predicted French and singing ratings before organizers received them. Audio understanding and voice Apr 2023 Not in cards
VoiceMOS Challenge 2024 Models predict listener ratings for high-quality synthetic speech, singing, and noisy or enhanced speech. The noisy speech track scores the voice and background noise separately. Audio understanding and voice Apr 2024 Not in cards
VoiceMOS Challenge 2026 Models predict listener ratings for enhanced speech, emotional speech, and synthesized accents. Organizers compare predictions with ratings for individual utterances. Speech recognition and translation Apr 2026 Not in cards