Capabilities
- MMLU 78.6
- MMLU-Pro 67.5
- AGIEval 68.6
- SuperGPQA 33.2
- GPQA Diamond 33.3
- GSM8K 91.7
- MATH 83.1
- MATH-500 79.5
- HumanEval 76.9
- MBPP 77
- LiveCodeBench 29.8
- BigCodeBench 50.1
- CommonSenseQA 81.1
- ARC-Challenge 93.2
- HellaSwag 85.3
- OpenBookQA 47.8
- PIQA 85.1
- TruthfulQA 55.5
- WinoGrande 78.1
- SIQA 47.8
- RACE 87.8
- Global MMLU 75.1
- MGSM 82.3