Benchmark Almanac

Linguistic Data Consortium

We track 3 benchmarks that Linguistic Data Consortium made or helped make.

0 in use 0 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
CALLHOME American English Speech Models transcribe spontaneous telephone conversations in American English and assign words to speakers. NVIDIA uses the CH109 test subset. Speech recognition and translation Not in cards
CALLHOME diarization Models identify speakers in multilingual telephone conversations. NVIDIA evaluates Part 2 with two to six speakers per call. Audio understanding and voice Not in cards
Mixer 6 Speech Models transcribe conversations recorded across microphones and assign words to speakers. NVIDIA evaluates channel four recordings. Speech recognition and translation Aug 2013 Not in cards