Benchmark Almanac

University of Toronto

We track 6 benchmarks that University of Toronto made or helped make.

0 in use 3 with public code 2 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
QIVD Models answer spoken questions about short phone videos in real time, as in a face to face talk. Each item has a short answer and a timestamp. Video understanding Mar 2025 69.6% Fading
AsyncTool Agents coordinate several tool-use tasks while tool responses arrive after simulated delays. The evaluator checks function calls, parameters, task completion, and the final environment state. Scheduling metrics measure whether agents use waiting time effectively. Function calling May 2026 38.1% Not in cards
CIFAR-10 Models classify small color images into ten object categories. General visual questions Apr 2009 Not in cards
CIFAR-100 Models classify small color images into 100 object categories. General visual questions Apr 2009 Not in cards
EPIC-KITCHENS VISOR Hand Object Segmentation Models outline each hand and the object it touches in a kitchen image. They also identify which hand appears and whether it touches anything. Detection and captioning Aug 2022 Not in cards
EPIC-KITCHENS VISOR Semi-Supervised Video Object Segmentation Models receive masks for hands and objects in the first frame of a kitchen video. They track those objects through later frames, including after occlusion. Video understanding Aug 2022 Not in cards