Benchmark Almanac

Tohoku University

We track 3 benchmarks that Tohoku University made or helped make.

0 in use 2 with public code 2 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
VisEditBench (TikZ diagram editing) Models edit TikZ code to follow instructions drawn on a diagram. A judge scores adherence, preservation of other content, and readability. Spatial reasoning and counting Sep 2026 83.6% Not in cards
VocalGrad Models decide which way an acoustic property changes within a recording. The authors compare model accuracy with human listeners on the same binary questions. Audio understanding and voice Oct 2026 51.8% Not in cards
JAQKET Models answer Japanese quiz questions. Knowledge in many languages Not in cards