Benchmark Almanac

Ai2

19 models 8 model cards read allenai.org

What benchmarks does Ai2 mention most?

Here are the 20 benchmarks Ai2 mentions most in its launch posts.

Source: Labs’ launch posts, read by Benchmark Almanac

Model cards

DateModelDocumentBenchmarks
May 5, 2026 MolmoAct 2 MolmoAct 2 (Ai2 blog) 3
Mar 24, 2026 MolmoWeb 8B MolmoWeb (Ai2 blog) 4
Jan 27, 2026 SERA-32B Open Coding Agents: SERA (Ai2 blog) 1
Dec 12, 2025 Olmo 3.1 32B Think Olmo-3.1-32B-Think model card (Hugging Face) 17
Nov 20, 2025 Olmo 3 32B Think Olmo-3-32B-Think model card (Hugging Face) 17
Apr 29, 2025 OLMo 2 1B Instruct OLMo-2-0425-1B-Instruct model card (Hugging Face) 10
Mar 13, 2025 OLMo 2 32B Instruct OLMo-2-0325-32B-Instruct model card (Hugging Face) 10
Jan 30, 2025 Tulu 3 405B Llama-3.1-Tulu-3-405B model card (Hugging Face) 10

Every Ai2 model