Benchmark Almanac

Nankai University

We track 6 benchmarks that Nankai University made or helped make.

0 in use 5 with public code 2 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
MemGUI-Bench Agents remember details while working across Android apps. Tasks include recording audio and creating calendar events. A model checks the actions and results across repeated attempts. Phones Feb 2026 73.4% Not in cards
Omnilingua-AudioMC Models follow requirements across spoken conversations in ten languages. The authors compare each model's spoken and text responses against the same 1,404 rubric items. Speech recognition and translation Nov 2026 64% Not in cards
AudioMOS Challenge 2025 Models predict listener ratings for generated audio. Three tracks assess music quality and prompt alignment, general audio aesthetics, and speech quality across sampling rates. Audio understanding and voice Mar 2025 Not in cards
MusicEval Models predict how experts rate generated music for musical quality and agreement with a text prompt. The public test contains 413 clips. Audio understanding and voice Jan 2025 Not in cards
PiRhDy Accompaniment Suggestion Models rank 50 accompaniment phrases for a MIDI melody. Several tracks can belong with the melody. The authors report mean average precision. Audio understanding and voice Oct 2020 Not in cards
PiRhDy Melody Completion Models rank 50 possible continuations of a MIDI melody. One phrase follows the prompt in the original piece. The authors report mean average precision. Audio understanding and voice Oct 2020 Not in cards