Benchmark Almanac

Music Information Retrieval Evaluation eXchange

We track 2 benchmarks that Music Information Retrieval Evaluation eXchange made or helped make.

0 in use 0 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
MIREX 2026 Music Evaluation via CMI-RewardBench Models choose which of two generated recordings listeners prefer for a prompt. Organizers rank systems by accuracy on 249 pairs and report vocal and instrumental results separately. Audio understanding and voice Not in cards
MIREX 2026 Music Performance Difficulty Prediction Models listen to solo piano recordings and rank the pieces by how hard they are to play. Organizers compare the rankings with piano educators’ judgments. Audio understanding and voice Not in cards