OpenBMB (ModelBest)
We track 5 benchmarks that OpenBMB (ModelBest) made or helped make. Its models are on its lab page.
0 in use 5 with public code 3 with a leaderboard here
Benchmarks
| Name | Kind | Released | Best score | Status |
|---|---|---|---|---|
| OlympiadBench Models solve bilingual olympiad-level math and physics problems in Chinese and English, many with images. Answers are checked against a key. | Competition problems with answers | Feb 2024 | 18% | Dropped |
| InfiniteBench/En.MC Models answer 229 multiple choice questions about long fake books with altered entity names, averaging about 184K tokens. Scoring is accuracy. | Reasoning over long documents | Nov 2023 | | Dropped |
| InfiniteBench/En.QA Models answer free-form questions about novels longer than 100K tokens. Scored by F1 against reference answers. | Reasoning over long documents | Feb 2024 | | System cards only |
| CAGUI Models locate controls and read marked text in Chinese Android screenshots. A separate test checks each predicted action against the recorded steps for an app task. | Phones | May 2025 | | Not in cards |
| ToolBench Models plan and call real REST APIs from RapidAPI, over 16,000 of them, to answer instructions that need one or many tools. ToolEval judges pass rate and win rate. | Function calling | Jul 2023 | Not in cards |