Nankai University
We track 6 benchmarks that Nankai University made or helped make.
0 in use 5 with public code 2 with a leaderboard here
Benchmarks
| Name | Kind | Released | Best score | Status |
|---|---|---|---|---|
| MemGUI-Bench Agents remember details while working across Android apps. Tasks include recording audio and creating calendar events. A model checks the actions and results across repeated attempts. | Phones | Feb 2026 | | Not in cards |
| Omnilingua-AudioMC Models follow requirements across spoken conversations in ten languages. The authors compare each model's spoken and text responses against the same 1,404 rubric items. | Speech recognition and translation | Nov 2026 | | Not in cards |
| AudioMOS Challenge 2025 Models predict listener ratings for generated audio. Three tracks assess music quality and prompt alignment, general audio aesthetics, and speech quality across sampling rates. | Audio understanding and voice | Mar 2025 | Not in cards | |
| MusicEval Models predict how experts rate generated music for musical quality and agreement with a text prompt. The public test contains 413 clips. | Audio understanding and voice | Jan 2025 | Not in cards | |
| PiRhDy Accompaniment Suggestion Models rank 50 accompaniment phrases for a MIDI melody. Several tracks can belong with the melody. The authors report mean average precision. | Audio understanding and voice | Oct 2020 | Not in cards | |
| PiRhDy Melody Completion Models rank 50 possible continuations of a MIDI melody. One phrase follows the prompt in the original piece. The authors report mean average precision. | Audio understanding and voice | Oct 2020 | Not in cards |