Hermes 2 Theta Llama-3 70B
Hermes 2 Theta Llama-3 70B.
5
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Nous Research Jun 2024
Hermes 2 Theta Llama-3 70B
Open weights
No Epoch Capabilities Index score yet
- GPQA Diamond 37.5% #192 /229
- BigCodeBench-Hard 22.3% #53 /96
- OTIS Mock AIME 2024-2025 2.50% #193 /212
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MATH Level 5 | 22.7% | #75 of 94 | Epoch AI run | |
| GPQA Diamond | 37.5% | #192 of 229 | Epoch AI run | |
| OTIS Mock AIME 2024-2025 | 2.50% | #193 of 212 | Epoch AI run |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BigCodeBench | 50.6% | #20 of 69 | Official leaderboard | |
| BigCodeBench-Hard | 22.3% | #53 of 96 | Official leaderboard |