Benchmark Almanac

Falcon 2 11B

Falcon 2 11B.

Technology Innovation Institute Released May 9th, 2024
4
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Technology Innovation Institute May 2024

Falcon 2 11B

Open weights

99.3 #216 of 256
Epoch Capabilities Index

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
HellaSwag 82.9% #17 of 63 Claim in Falcon2-11B Technical Report, via Epoch AI
WinoGrande 78.3% #22 of 76 Claim in Falcon2-11B Technical Report, via Epoch AI
MMLU 58.4% #47 of 85 Claim in Falcon2-11B Technical Report, via Epoch AI

Math and science

BenchmarkScoreRankSource
GSM8K 53.8% #35 of 70 Claim in Falcon2-11B Technical Report, via Epoch AI

Technology Innovation Institute's models over time

Technology Innovation Institute's models in color, against every other model on the Epoch Capabilities Index, by release date.

50 100 150 2023 2024 2025 2026 2027 Falcon 2 11B Falcon-180B Falcon-7B Falcon-40B 50 100 150 2023 2024 2025 2026 2027 Falcon 2 11B Falcon-7B

Source: Epoch Capabilities Index, Epoch AI (CC BY 4.0)