Benchmark Almanac

Xi'an Jiaotong University

We track 6 benchmarks and 1 arena that Xi'an Jiaotong University made or helped make.

0 in use 6 with public code 4 with a leaderboard here

Arena leaderboards

Top five in each of its 1 arena with three or more rated models, the most rated first.

Benchmarks

Name Kind Released Best score Status
SWE-Perf Agents speed up code in 140 tasks drawn from performance pull requests in real GitHub repos. Scored on correctness and runtime gain. Speed and optimization Jul 2025 2.26% Fading
ProOPF-B Models translate operational requirements into executable optimal power flow programs. They change grid parameters, objectives, and constraints. The evaluator checks implementations against expert references. Scientific code Feb 2026 37.2% Not in cards
SimuVerity Agents build executable Simulink models from text for 101 tasks in ten engineering domains. Simulations check that each model meets its engineering requirements. Electronics Oct 2026 42.9 Not in cards
FortisAVQA Models answer questions about sounds and visible events in music videos. Accuracy is reported separately for frequent and rare question distributions after the original questions are rephrased. Video understanding Apr 2025 48.7% Not in cards
StateBench (video continuation) Models continue a video while tracking what happened in earlier segments. A judge checks whether visible objects, hidden processes, and later state changes remain consistent. Video generation Sep 2026 32.5 Not in cards
DecepEval LLM agents pursue tasks across varied scenarios and conditions, and judges detect when they use deception to improve task performance. Deception and alignment Oct 2026 Not in cards