Benchmark Almanac

SmolLM-1.7B

SmolLM-1.7B.

Hugging Face Released July 14th, 2024 Family SmolLM The lab's model card Compare with others
5
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Hugging Face Jul 2024

SmolLM-1.7B

Open weights Small

No Epoch Capabilities Index score yet
  • BLUEX 22.8% #161 /177
  • HeQ 16.5% #86 /88

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
BLUEX 22.8% #161 of 177 Official leaderboard
Open Portuguese LLM Leaderboard 29.5 #162 of 175 Official leaderboard
Open Hebrew LLM Leaderboard 24.7 #85 of 88 Official leaderboard
HeQ 16.5% #86 of 88 Official leaderboard
MMLU-Pro 11.9% #208 of 212 Official leaderboard

Who measured it?

Independent runs cover all 5 of its benchmarks.

  • An independent run only 5
Official leaderboards scored it on 5.

Sources: Official leaderboards, Epoch AI (CC BY 4.0) and labs’ model cards