Capabilities
- AGIEval 83.4
- MMLU-Pro 74.1
- C-Eval 92.1
- MultiLoKo 45.5
- SimpleQA Verified 42.3
- SuperGPQA 53.1
- BIG-Bench Hard 86.1
- BBEH micro average 27.2
- DROP 87.9
- HellaSwag 87.2
- BigCodeBench 60.6
- HumanEval 79.4
- GSM8K 93
- MATH 61.1
- MGSM 80.2
- LongBench v2 45.2
- MMMU-Pro 56.5
- CVBench 77.9
- DocVQA 95.6
- RefCOCO / RefCOCO+ / RefCOCOg 86