Benchmark Almanac

AI4Bharat at IIT Madras

We track 2 benchmarks that AI4Bharat at IIT Madras made or helped make.

0 in use 1 with public code 1 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
IndicContextEval Models transcribe speech in eight Indian languages using hints about the topic or names. One prompt deliberately supplies names from an unrelated field. Speech recognition and translation Jun 2026 17.5% Not in cards
Indic DiarBench Models transcribe conversations in 22 Indian languages and identify who spoke each word. Human annotators supply speaker labels and timestamps, including for overlapping speech. Speech recognition and translation Jul 2026 36.2% Not in cards