Benchmark Almanac

University of Catania

We track 4 benchmarks that University of Catania made or helped make.

0 in use 4 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
Assembly101-O Models watch people assemble toy vehicles and flag the first procedural mistake. Training uses correct procedures, and evaluation stops at the first mistake in an incorrect sequence. Video understanding Apr 2024 Not in cards
Epic-tent-O Models watch someone pitch a tent and flag procedural mistakes using only the video so far. The test includes 15 videos. Video understanding Apr 2024 Not in cards
MECCANO Action Recognition Models identify an assembly action from a first-person video clip of someone building a toy motorcycle. The answer key has 61 action classes. Video understanding Oct 2020 Not in cards
TREK-150 Models follow a marked object through first-person kitchen videos. In the one-pass test, they receive its bounding box in the first frame and track it to the end. Video understanding Aug 2021 Not in cards