Benchmark Almanac

University of Technology Nuremberg

We track 2 benchmarks that University of Technology Nuremberg made or helped make.

0 in use 2 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
AmbiStory Models rate how plausible a word meaning is in a short story. The shared task averages rank correlation and accuracy within the organizers’ tolerance. Reading comprehension Jul 2025 0.56 Not in cards
HM3DSem-Walks Models use indoor color and depth scans to find objects described by room and floor. The original retrieval test covers eight scenes. Spatial reasoning and counting Mar 2024 Not in cards