Amazon Nova Lite
Amazon Nova Lite.
23
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Amazon Dec 2024 Amazon Nova Lite
Closed weights
No Epoch Capabilities Index score yet
- Humanity's Last Exam 3.64% #46 /47
- GPQA Main 39.7% #44 /60
- VISTA 25.5% #51 /54
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Vectara Hallucination Leaderboard (HHEM) | 1.80% | #18 of 148 | Official leaderboard | |
| Vectara Hallucination Leaderboard (2025 dataset) | 6.10% | #25 of 104 | Official leaderboard | |
| CulturalRiddles | 14.7% | #11 of 20 | Official leaderboard | |
| LMArena (Elo) | 1,260 | #259 of 335 | Official leaderboard | |
| IFEval | 77.6% | #51 of 60 | Official leaderboard | |
| SnorkelSpatial | 13.3% | #23 of 27 | Official leaderboard | |
| Humanity's Last Exam | 3.64% | #46 of 47 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| GPQA Main | 39.7% | #44 of 60 | Official leaderboard | |
| SnorkelSequences | 40% | #19 of 25 | Official leaderboard | |
| SnorkelGraph | 19% | #22 of 24 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Galileo Agent Leaderboard | 0.87 | #14 of 29 | Official leaderboard | |
| Berkeley Function Calling Leaderboard (BFCL) | 55.9% | #37 of 67 | Official leaderboard | |
| LisanBench | 84.0 | #115 of 133 | Official leaderboard | |
| ToolComp | 36.5% | #29 of 32 | Official leaderboard | |
| Galileo Agent Leaderboard v2 | 16% | #20 of 21 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MedQA | 69.6% | #27 of 71 | Official leaderboard | |
| SnorkelUnderwrite | 40% | #22 of 27 | Official leaderboard | |
| FinQA (Snorkel OpenEnv environment) | 16.9% | #21 of 22 | Official leaderboard | |
| SnorkelFinance | 16.9% | #21 of 22 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Vision Arena | 1,019 | #125 of 136 | Official leaderboard | |
| VISTA | 25.5% | #51 of 54 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HELM Lite | 70.8 | #21 of 71 | Official leaderboard | |
| HELM Capabilities | 55.1 | #50 of 60 | Official leaderboard |