Benchmark Almanac

Zhongguancun Academy

We track 4 benchmarks that Zhongguancun Academy made or helped make.

0 in use 3 with public code 3 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
VibeVideoBench Agents write code to render a finished video with sound, with no image or video generation model, in their native harness within one hour. Program checks, task rubrics and a judge panel score the result. Video generation Oct 2026 4.11 Not in cards
K12-Bench Models select curriculum concepts, prerequisite relationships, related knowledge, experimental evidence, and textbook locations. The 23,640 multi-select questions come from a textbook knowledge graph. Exact match and instance-level F1 compare selected options with graph-derived answers. Language reasoning May 2026 57.1% Not in cards
SWE-Game Agents build, complete, repair, or port games across 247 tasks derived from 41 reference games. Runtime probes and input replays check gameplay mechanics and preserved behavior. Vision-language rubrics separately grade presentation in construction tasks. Building whole projects Sep 2026 64.0 Not in cards
HandWorldBench Models generate videos of human or robotic hands moving objects. The benchmark combines 17 measures of hand motion, object state, and video quality. Video world models Nov 2026 52.2 Not in cards