Benchmark Almanac

Sarvam-M

Sarvam-M places in the top three on TriviaQA.

Sarvam AI Released May 23rd, 2025 Family Sarvam The lab's model card Compare with others
13
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Sarvam AI May 2025

Sarvam-M

Open weights Flagship

127.1 #300 of 404
Self-Reported Index, from the lab's own numbers. No Epoch Capabilities Index score yet.
  • IFEval 87% #63 /135
  • Global PIQA 0.13% #44 /44
  • MMLU 87% #42 /131

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
TriviaQA 91% #2 of 40 Lab model card
ARC-Challenge 95% #8 of 49 Lab model card
MMLU 87% #42 of 131 Lab model card
IFEval 87% #63 of 135 Lab model card
MT-Bench 8.14 #21 of 23 Lab model card
IndicGenBench 37.2 #12 of 13 Official leaderboard
Global PIQA 0.13% #44 of 44 Official leaderboard
MILU 75% #11 of 11 Lab model card

Math and science

BenchmarkScoreRankSource
GSM8K 94% #20 of 92 Lab model card
MATH 81% #25 of 99 Lab model card
GPQA Diamond 48% #252 of 302 Lab model card

Coding

BenchmarkScoreRankSource
HumanEval 88% #26 of 101 Lab model card
MBPP 75% #34 of 71 Lab model card

Its lab's numbers put it at 127.1, number 300 of 404

The Self-Reported Index fits one score to the 10 capability results Sarvam AI reported for this model, on the scale of the Epoch Capabilities Index. Labs choose which benchmarks to show and how to run them, so read it as the lab's claim, not an independent measurement. The 90% interval runs from 124.0 to 130.1. How we compute it.

Its launch post

The benchmarks the lab chose to headline, with the scores it gave.