Benchmark Almanac

WMT multilingual instruction organizers

We track 2 benchmarks that WMT multilingual instruction organizers made or helped make.

0 in use 1 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
WMT25 Multilingual Instruction Shared Task Models translate, solve language puzzles, generate text, summarize across languages and judge other answers. The shared task covers 30 languages. Reasoning in many languages Mar 2025 Not in cards
WMT26 Multilingual Instruction Shared Task Models answer questions from passages, summarize papers across languages and follow writing instructions. The overall ranking averages ranks across the three tasks. Reading in many languages Jan 2026 Not in cards