Gemma 4 model card Jun 3, 2026
- MMLU Pro 77.2
- AIME 2026 no tools 77.5
- LiveCodeBench v6 72
- Codeforces ELO 1659
- GPQA Diamond 78.8
- Tau2 (average over 3) 69
- HLE no tools 5.2
- BigBench Extra Hard 53
- MMMLU 83.4
- MMMU Pro 69.1
- OmniDocBench 1.5 (average edit distance, lower is better) 0.164
- MATH-Vision 79.7
- MedXPertQA MM 48.7
- CoVoST average, excluding Chinese 38.5
- FLEURS average WER, lower is better, excluding Chinese 0.069
- MRCR v2 8 needle 128k (average) 43.4