Benchmark Almanac

Tongji University

We track 8 benchmarks that Tongji University made or helped make.

0 in use 6 with public code 7 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
MIRB Models compare, analyze and reason across several images in four categories: perception, visual world knowledge, reasoning and multi-hop reasoning. General visual questions Jun 2024 37.7% System cards only
OPT-BENCH Agents iteratively improve solutions to 20 machine-learning tasks and 10 combinatorial optimization problems using execution feedback. Win counts, invalid-solution rates, ranks, and improvement rates measure optimization performance. Scientific code Jun 2025 0.69 Not in cards
CaLM Models answer causal discovery, intervention, and counterfactual reasoning tasks in English and Chinese. Evaluation compares answers with reference labels to measure accuracy and robustness across causal targets and prompting methods. Language reasoning May 2024 45.3% Not in cards
HCSU-Bench Models match a Chinese calligraphy sample to one of eight styles. A second task asks models to describe the brushwork in fewer than 50 words. General visual questions Mar 2026 34.6% Not in cards
Civil-Bench Models answer Chinese civil engineering licensing questions. Answer keys grade the objective questions. In the paper, GPT-4 Turbo grades written answers against individual scoring points. Exam questions 64.8 Not in cards
AECBench (Liang et al.) Models interpret Chinese building codes, calculate design quantities, and write project documents. Answer keys score objective questions. A model judge grades report generation against expert rubrics. Expert-written questions Sep 2025 61.6 Not in cards
LIBERO-Plus LIBERO policies run 10,030 perturbed tasks across seven dimensions: layout, camera, robot start state, language, light, background and sensor noise. Success rate. Simulated robots Oct 2025 69.6% Not in cards
CauGym Models infer causal effects from descriptions and probabilities. Test questions vary the wording, add irrelevant facts, or remove information needed to answer. Language reasoning Feb 2026 Not in cards