Benchmark Almanac

University of Hildesheim

We track 2 benchmarks that University of Hildesheim made or helped make.

0 in use 0 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
DFKI English-Russian Linguistic Test Suite at WMT25 Models translate English passages into idiomatic Russian. Rules match known translations. A linguist judges unresolved cases across 55 phenomena. The authors report item-weighted and category-weighted accuracy. Translation Jun 2025 89.5% Not in cards
GENDER1PERSON Models translate 1,000 English product reviews into Russian or Serbian. The test measures the difference between first-person masculine and feminine choices as a percentage of all reviews. Translation Jun 2025 Not in cards