Benchmark Almanac

Shanghai Innovation Institute

We track 3 benchmarks and 1 arena that Shanghai Innovation Institute made or helped make.

0 in use 2 with public code 4 with a leaderboard here

Arena leaderboards

Top five in each of its 1 arena with three or more rated models, the most rated first.

Benchmarks

Name Kind Released Best score Status
RNG-Bench Agents play Matching Pairs and navigate 3D mazes using remembered observations. Scores measure matched pairs and combine maze success, efficiency, and exploration. Puzzles and chess Jun 2026 49.9% Not in cards
SWE-Game Agents build, complete, repair, or port games across 247 tasks derived from 41 reference games. Runtime probes and input replays check gameplay mechanics and preserved behavior. Vision-language rubrics separately grade presentation in construction tasks. Building whole projects Sep 2026 64.0 Not in cards
LIBERO-Plus LIBERO policies run 10,030 perturbed tasks across seven dimensions: layout, camera, robot start state, language, light, background and sensor noise. Success rate. Simulated robots Oct 2025 69.6% Not in cards