Capabilities
- MMLU 84.1
- MMLU-Pro 76.3
- AGIEval 75.7
- SuperGPQA 47.6
- GPQA Diamond 66.2
- GSM8K 91.7
- MATH 87.7
- MATH-500 81.6
- HumanEval 81.3
- MBPP 79.1
- LiveCodeBench 47.6
- BigCodeBench 48.4
- CommonSenseQA 85.3
- ARC-Challenge 96
- HellaSwag 89
- OpenBookQA 48.8
- PIQA 85.1
- TruthfulQA 71.2
- WinoGrande 79.1
- SIQA 49
- RACE 91.4
- Global MMLU 86.6
- MGSM 87.5