Benchmark Almanac

Institute of the Estonian Language

We track 3 benchmarks and 1 arena that Institute of the Estonian Language made or helped make.

0 in use 3 with public code 4 with a leaderboard here

Arena leaderboards

Top five in each of its 1 arena with three or more rated models, the most rated first.

Benchmarks

Name Kind Released Best score Status
EKI Eesti mäng Models choose answers to 1,000 questions from an Estonian quiz book. The questions cover subjects including history, culture, and geography. Knowledge in many languages Jun 2026 90% Not in cards
EKI Propaganda Resistance Models answer 75 questions in Estonian, English, and Russian without web search. Claude Opus 4.5 grades how each answer handles misleading premises and propaganda. Deception and alignment Jun 2026 97.6 Not in cards
EKI Mälumäng Models answer 800 Estonian quiz questions without answer choices. Politics and geography each contribute 80 questions. GPT-5.4 nano judges answers that miss an exact match. Knowledge in many languages Aug 2026 50.8% Not in cards