Benchmark Almanac

Indiana University

We track 2 benchmarks that Indiana University made or helped make.

0 in use 2 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
IsiZulu Second Language Learner Speech Corpus Models detect sounds that learners mispronounce or insert when reading isiZulu. Teachers marked each sound against the intended pronunciation. Audio understanding and voice May 2024 Not in cards
OCNLI Models decide whether a Chinese hypothesis follows from, contradicts, or remains neutral toward a premise. Accuracy measures agreement with the majority annotation. Reasoning in many languages Oct 2020 Not in cards