Benchmark Almanac

ELLIS Institute Tübingen

We track 2 benchmarks that ELLIS Institute Tübingen made or helped make.

0 in use 2 with public code 2 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
InferenceBench Coding agents optimize a language model inference server within a fixed time budget. The harness measures serving speed and checks answer quality against a reference. Machine learning engineering 12.1× Not in cards
QuantSightBench Models give 90% prediction intervals for 1,000 numerical forecasting questions with known outcomes. The main setting allows retrieval from a fixed news corpus. Mean Log Interval Score penalizes wide intervals and missed outcomes, while coverage measures how often intervals contain the answer. Real-world events Apr 2026 6.70 Not in cards