Benchmark Almanac

Beihang University

We track 8 benchmarks that Beihang University made or helped make.

0 in use 8 with public code 4 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
McEval Models complete, explain and generate code in 40 programming languages across about 16,000 test samples. Scored by test execution. Function-level problems Jun 2024 65.2% System cards only
TableBench Models answer 886 questions about real-world tables across 18 fields in four groups: fact checking, numerical reasoning, data analysis and visualization. Fact and numeric answers are scored by exact match, analysis answers by ROUGE-L, and chart code by pass@1. Language reasoning Aug 2024 61.7% Not in cards
HelloBench Models generate long answers, summaries, conversations, text completions, and texts from writing instructions. Model judges apply task-specific checklists to the responses. Overall chat quality Sep 2024 48.5 Not in cards
PRISM-Bench (image generation) Models generate images from English or Chinese prompts. Vision-language judges score visual appeal and prompt alignment across seven tracks, including composition, lettering, and style. Image generation and editing Sep 2025 86.3 Not in cards
AutoPLC Models write Structured Text for CODESYS and Siemens controllers from requirements. The benchmark measures how often generated programs compile and how many errors the compiler reports. Electronics Dec 2024 9.88% Not in cards
PhysCapBench Models caption videos of physical interactions. The benchmark checks which motions, contacts, and changes of state the captions describe across 1,500 clips. Video captioning Nov 2026 Not in cards
TraceSpatial-Bench Models plan an object-centric 3D trace, an ordered list of metric 3D waypoints, from language instructions in real cluttered indoor scenes with depth. Embodied reasoning Dec 2025 Not in cards
TriWorldBench World models generate synchronized robot-view videos from head and wrist cameras. Nineteen signals measure cross-view agreement, task alignment, physical coherence, motion, temporal stability, and visual quality. Video world models Sep 2026 Not in cards