Benchmark Almanac

University of Freiburg

We track 5 benchmarks that University of Freiburg made or helped make.

0 in use 4 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
Arti4D Models watch first-person recordings of people opening furniture. They predict whether parts rotate or slide and estimate the axis of motion. Spatial reasoning and counting Sep 2025 Not in cards
CALVIN Simulated Franka follows chains of five language instructions from 34 tasks. ABC-to-D tests an unseen environment. Average chain length. Simulated robots Dec 2021 Not in cards
FreiHAND Models recover a hand's joint positions and surface from a color image. The evaluation compares predictions with reference hand geometry. Spatial reasoning and counting Sep 2019 Not in cards
HM3DSem-Walks Models use indoor color and depth scans to find objects described by room and floor. The original retrieval test covers eight scenes. Spatial reasoning and counting Mar 2024 Not in cards
OpenLex3D Models label points and retrieve objects in indoor 3D scans. Annotators distinguish an object’s synonyms from pictures on its surface and visually similar objects. Spatial reasoning and counting Mar 2025 Not in cards