Llama 3.2 3B
Llama 3.2 3B.
33
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Meta Sep 2024 Llama 3.2 3B
Open weights
No Epoch Capabilities Index score yet
- When2Call 17.9% #9 /10
- BigCodeBench-Hard 5.40% #92 /96
- AraGen 15% #38 /42
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HELMET | 33.5% | #7 of 16 | Official leaderboard | |
| MadinahQA | 38.7% | #25 of 39 | Official leaderboard | |
| Seal-0 | 0% | #8 of 11 | Official leaderboard | |
| EQ-Bench v2 | 61.1 | #65 of 85 | Official leaderboard | |
| ArabicMMLU | 35.7% | #30 of 39 | Official leaderboard | |
| Open Arabic LLM Leaderboard v2 | 41.1% | #30 of 39 | Official leaderboard | |
| AlGhafa | 42.9% | #31 of 39 | Official leaderboard | |
| ArbMMLU-HT | 26% | #31 of 39 | Official leaderboard | |
| Vectara Hallucination Leaderboard (HHEM) | 7.90% | #119 of 148 | Official leaderboard | |
| ALRAGE | 53.3% | #33 of 39 | Official leaderboard | |
| MuSR | 35.8% | #84 of 98 | Official leaderboard | |
| FaithJudge | 46.2% | #33 of 37 | Official leaderboard | |
| LMArena (Elo) | 1,167 | #301 of 335 | Official leaderboard | |
| AraGen | 15% | #38 of 42 | Official leaderboard | |
| MMLU-Pro | 22.2% | #194 of 212 | Official leaderboard | |
| MLogiQA | 25.6% | #16 of 17 | Official leaderboard | |
| BuzzBench | 26.6 | #19 of 20 | Official leaderboard | |
| Creative Writing v3 | 42.8 | #115 of 120 | Official leaderboard | |
| SEA-HELM | 25.1 | #69 of 71 | Official leaderboard | |
| WritingBench | 38.1 | #44 of 45 | Official leaderboard | |
| Wer wird Millionär? LLM Benchmark | 50.0 | #77 of 77 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| ZebraLogic | 7.40% | #42 of 46 | Official leaderboard | |
| IneqMath | 0% | #34 of 34 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BigCodeBench | 25.9% | #63 of 69 | Official leaderboard | |
| BigCodeBench-Hard | 5.40% | #92 of 96 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Berkeley Function Calling Leaderboard (BFCL) | 45.9% | #56 of 67 | Official leaderboard | |
| BFCL V4 | 21.9% | #57 of 65 | Official leaderboard | |
| When2Call | 17.9% | #9 of 10 | Official leaderboard | |
| BALROG | 10.1% | #30 of 33 | Official leaderboard | |
| LisanBench | 8.00 | #132 of 133 | Official leaderboard | |
| AceBench | 19.6% | #16 of 16 | Official leaderboard |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| AraTrust | 58.5% | #27 of 39 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Open LLM Leaderboard v2 | 8.70 | #89 of 99 | Official leaderboard |