Benchmark Almanac

OpenBMB (ModelBest)

We track 5 benchmarks that OpenBMB (ModelBest) made or helped make. Its models are on its lab page.

0 in use 5 with public code 3 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
OlympiadBench Models solve bilingual olympiad-level math and physics problems in Chinese and English, many with images. Answers are checked against a key. Competition problems with answers Feb 2024 18% Dropped
InfiniteBench/En.MC Models answer 229 multiple choice questions about long fake books with altered entity names, averaging about 184K tokens. Scoring is accuracy. Reasoning over long documents Nov 2023 83.4% Dropped
InfiniteBench/En.QA Models answer free-form questions about novels longer than 100K tokens. Scored by F1 against reference answers. Reasoning over long documents Feb 2024 36.7 System cards only
CAGUI Models locate controls and read marked text in Chinese Android screenshots. A separate test checks each predicted action against the recorded steps for an app task. Phones May 2025 65.3% Not in cards
ToolBench Models plan and call real REST APIs from RapidAPI, over 16,000 of them, to answer instructions that need one or many tools. ToolEval judges pass rate and win rate. Function calling Jul 2023 Not in cards