Benchmark Almanac

Academia Sinica

We track 3 benchmarks that Academia Sinica made or helped make.

0 in use 3 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
Taiwan Mandarin Speech with Video: Speech Enhancement Models use lip video to remove noise from Mandarin sentences. Researchers compare the enhanced signal with clean speech for quality and intelligibility. Speech recognition and translation May 2020 Not in cards
TMHINT-QI Models listen to clean, noisy, and enhanced Mandarin sentences. They predict listener quality ratings and how many words listeners understood. Audio understanding and voice Nov 2021 Not in cards
TMHINT-QI version II Models predict how clear Mandarin speech sounds and how many words listeners understand. The test adds street noise and two previously unseen enhancement systems. Audio understanding and voice May 2023 Not in cards