Zhou, B. (2026). Shanghai Innovation Institute. Benchmark Almanac. Retrieved November 21, 2026, from https://www.benchmarkalmanac.com/makers/shanghai-innovation-institute/
BibTeX
Shanghai Innovation Institute
We track 3 benchmarks and 1 arena that Shanghai Innovation Institute made or helped make.
0 in use2 with public code4 with a leaderboard here
Arena leaderboards
Top five in each of its 1 arena with three or more rated models, the most rated first.
Agents build playable 3D browser games from specifications and reference images. Players compare anonymous game pairs. The authors also test functionality and playability.
RNG-BenchAgents play Matching Pairs and navigate 3D mazes using remembered observations. Scores measure matched pairs and combine maze success, efficiency, and exploration.
Puzzles and chess
Jun 2026
49.9%
Not in cards
SWE-GameAgents build, complete, repair, or port games across 247 tasks derived from 41 reference games. Runtime probes and input replays check gameplay mechanics and preserved behavior. Vision-language rubrics separately grade presentation in construction tasks.
Building whole projects
Sep 2026
64.0
Not in cards
LIBERO-PlusLIBERO policies run 10,030 perturbed tasks across seven dimensions: layout, camera, robot start state, language, light, background and sensor noise. Success rate.