Sarvam-M: Explorations in Post Training and Inferencing Optimizations for a Hybrid Indic LLM (Sarvam AI blog) May 23, 2025
- MMLU (0.87) 87
- ARC-C (0.95) 95
- TriviaQA (0.91) 91
- GPQA Diamond (0.48) 48
- HumanEval (0.88) 88
- MBPP (0.75) 75
- GSM-8K (0.94) 94
- MATH (0.81) 81
- IFEval (0.87) 87
- MTBench 8.14
- IndicGenBench (0.49) 49
- MILU-IN, Indic queries only (0.75) 75