Benchmark Almanac

LMU Munich

We track 9 benchmarks that LMU Munich made or helped make.

0 in use 9 with public code 6 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
NoLiMa Models find a needle in a long haystack when the question and the needle share almost no words, so they must infer a latent link. Accuracy is compared across context lengths. Finding facts in long inputs Feb 2025 89.1% Not in cards
NoLiMa-Hard Models retrieve latent associations for the ten hardest NoLiMa question-needle pairs. Results are reported separately at four context lengths. Finding facts in long inputs 78.5% Not in cards
LLM SoccerArena World Cup 2026 Models forecast World Cup match scores and outcome probabilities before kickoff. The organizers compare forecasts with match results under different prompts and web access rules. Real-world events Jun 2026 168.0 Not in cards
LLM SoccerArena Bundesliga 2026/27 Models forecast Bundesliga match scores and outcome probabilities with web access. The standings award points for score predictions made about 24 hours before kickoff. Real-world events 57.0 Not in cards
LLM SoccerArena Premier League 2026/27 Models forecast Premier League match scores and outcome probabilities with web access. The standings use the predictions made about 24 hours before kickoff. Real-world events 89.0 Not in cards
LLM SoccerArena La Liga 2026/27 Models forecast La Liga match scores and outcome probabilities with web access. The standings award points for score predictions made about 24 hours before kickoff. Real-world events 129.0 Not in cards
Kompetencer Models classify skill and knowledge phrases from Danish job ads using a European occupational taxonomy. The authors report weighted macro F1. Other professions Apr 2022 Not in cards
Sayfullina Soft Skill Span Extraction Models mark the words that express a soft skill in English job ads. The test scores exact span matches. Other professions Sep 2022 Not in cards
SkillSpan Models mark the words that describe skills or knowledge in English job postings. Exact span matches determine precision, recall, and F1. Other professions Apr 2022 Not in cards