Zhou, B. (2026). Arenas. Benchmark Almanac. Retrieved November 21, 2026, from https://www.benchmarkalmanac.com/arenas/
BibTeX
Arenas
We track 328 arenas and match leagues, with the last one added on November 20th. Benchmarks, where models are scored against fixed answers, can be found here. Have an arena that you want us to track? Let us know here.
229 with a leaderboard hereScores refreshed November 21st, 2026
All areas
Knowledge and language49
Knowledge3
Expert-written questions2
Questions that need search1
Factuality2
Faithful to sources1
Hallucination rates1
Multilingual2
Chat and instructions in many languages2
Long context2
Reasoning over long documents2
Instructions and chat24
Following precise instructions1
Multi-turn conversation2
Overall chat quality21
Writing and taste16
Creative writing12
Taste and style4
Math and science1
Science and reasoning1
Science questions1
Coding60
Coding59
Function-level problems2
Competitive programming1
Fixing real repositories3
Building whole projects23
Web and app front ends27
Data science and SQL3
AI research1
Machine learning engineering1
Agents and tools89
Tool use3
Deep research1
General assistants2
Games and long tasks86
Puzzles and chess15
Video games7
Multi-agent games64
Professional work18
Economic work10
Tasks from real jobs2
Running a business1
Documents and spreadsheets6
Simulated companies1
Law, finance and medicine3
Law1
Medicine1
Other professions1
Engineering and CAD5
CAD models5
Vision, audio and robotics98
Vision40
General visual questions4
Documents, charts and text in images1
Spatial reasoning and counting7
Image generation and editing28
Audio and video54
Speech recognition and translation9
Audio understanding and voice24
Video generation21
Robotics3
Simulated robots1
Real robots2
World models1
Interactive world models1
Safety and security10
Safety and alignment10
Refusing harmful requests5
Jailbreaks and prompt injection1
Bias, fairness and politics1
Wellbeing and sycophancy1
Dangerous capabilities2
Other3
Other3
Other3
Nothing matches.
Any level
Everyday215
School13
University42
Competition5
Expert42
Research frontier1
Any status
In use13
Fading6
Dropped1
Only in system cards30
Not in model cards278
Last model: any time
New model within 3 months146
New model within 6 months163
New model within a year195
Quiet for a year or more56
No scores yet69
Any data access
Public prompts or games255
Kept private53
Not stated20
With or without code
Public code94
What it measures
Measures
Capability106
Propensity1
Preference221
Risk
None324
Harmful manipulation2
Violent crimes1
Indiscriminate weapons1
Elections1
Behavior
None327
Bias1
What the tasks are about
Subject
Natural sciences73
Mathematics1
Computer and information sciences72
Physical sciences1
Chemical sciences1
Biological sciences2
Engineering and technology5
Civil engineering1
Electrical, electronic and information engineering2
LMArena (Elo)People chat with two anonymous models side by side and vote for the better reply. Votes become Elo-style ratings for each model.
Arena (formerly LMArena)
Overall chat quality
Votes
Fading
Gemini 4 Carbon1,527
345
May 2023
Nov 2026
Dubesor AI Chess LeaderboardModels play chess by continuing game notation or by reasoning from the board and legal moves. The organizer maintains separate Elo ratings for each mode.
Dubesor
Multi-agent games
Matches
Not in cards
Gemini 4 Neon1,907
250
Mar 2025
Nov 2026
SnakeBenchTwo language models each steer a snake on a shared board in a turn-based game, and the one that survives longest wins. Ratings come from many head-to-head games.
ARC Prize Foundation (Greg Kamradt)
Multi-agent games
Matches
Not in cards
GPT-5.539
201
Feb 2025
Nov 2026
DesignArena WebsiteModels build a complete website as one HTML file from a real user prompt. Users compare the rendered pages and vote for the better one.
DesignArena (Intelligence)
Web and app front ends
Votes
In use
Muse Wonder1,375
162
Nov 2026
DesignArena Game DevModels build a playable browser game as a single HTML file from a real user prompt. Users play the games and vote for the better one.
DesignArena (Intelligence)
Web and app front ends
Votes
In use
GPT-6 Astra1,465
154
Nov 2026
DesignArena CodeUsers give a prompt, and anonymous models each build a website, UI component, browser game, data visualization or 3D scene as one HTML file. Users vote, and votes become Bradley-Terry ratings.
DesignArena (Intelligence)
Web and app front ends
Votes
Not in cards
GPT-6 Astra1,393
153
Jul 2025
Nov 2026
DesignArena UI ComponentModels build one interface component as a single HTML file from a real user prompt. Users compare the rendered components and vote for the better one.
DesignArena (Intelligence)
Web and app front ends
Votes
Not in cards
GPT-6 Astra1,395
149
Nov 2026
DesignArena 3D DesignModels build an interactive 3D scene that runs in the browser as a single HTML file. Users explore the scenes and vote for the better one.
DesignArena (Intelligence)
Web and app front ends
Votes
In use
GPT-6 Astra1,535
144
Nov 2026
Vision ArenaPeople send an image with a prompt, compare answers from two anonymous vision-language models, and vote for the better one. Votes become Bradley-Terry ratings.
Arena (formerly LMArena)
General visual questions
Votes
Not in cards
Claude Fable 51,309
138
Jun 2024
Oct 2026
Code Arenav2Models act as coding agents that build web apps from user prompts, and users vote between two results. Votes yield Elo-style ratings.
DesignArena Data VisualizationModels turn a user prompt and its data into an interactive visualization as a single HTML file. Users compare the rendered charts and vote.
DesignArena (Intelligence)
Data science and SQL
Votes
Not in cards
Claude Opus 5.51,386
126
Nov 2026
LLM ChessModels play chess in multi-turn dialogs against a random player or the Komodo Dragon engine. The board reports wins, Elo and game duration, which tracks instruction following.
Maxim Saplin
Puzzles and chess
Matches
Not in cards
GPT-6 Astra1,614
123
Sep 2024
Nov 2026
DesignArena SVGModels write SVG code for a design request such as an icon, logo, badge or illustration. Users compare the rendered graphics and vote.
DesignArena (Intelligence)
Web and app front ends
Votes
Not in cards
GPT-6 Astra1,420
110
Oct 2026
StudyArena TextModels produce text responses to user prompts. Anonymous human comparisons determine the published rating in this separate vote pool.
StudyArena
Overall chat quality
Votes
Not in cards
LongCat-2.01,375
86
Oct 2026
DesignArena ASCII ArtModels draw a requested picture using only text characters. Users compare the ASCII art and vote for the better one.
DesignArena (Intelligence)
Creative writing
Votes
Not in cards
Gemini 4 Hydrogen1,457
82
Nov 2026
MineBenchModels turn a prompt into a Minecraft-style voxel build as raw 3D coordinates or tool calls. Users compare builds blind, and votes become rankings.
Ammaar Alam
Spatial reasoning and counting
Votes
Not in cards
GPT-6 Astra Pro2,169
81
Jan 2026
Nov 2026
DesignArena Agentic OverallCoding agents build apps, games, slides and spreadsheets from user prompts. Users compare the results, and votes from every agent board form one rating.
DesignArena (Intelligence)
Building whole projects
Votes
Not in cards
Claude Opus 5.51,443
80
Nov 2026
LMArena Text-to-Image ArenaImage generation models answer the same user prompt side by side and anonymously. Community votes between the two images give Elo-style ratings.
Arena (formerly LMArena)
Image generation and editing
Votes
Not in cards
GPT-Image-2.5 Sunburst1,428
79
Dec 2024
Nov 2026
Arena ExpertExperts compare model answers to questions drawn from their professional work. Arena ranks models from their votes.
Arena
Expert-written questions
Votes
Not in cards
DeepSeek-V3.2-Exp1,143
64
Nov 2025
Sep 2025
Step RaceSeveral models talk in public, then secretly pick moves in a race where colliding moves cancel. The game tests cooperation and deception.
Lech Mazur
Multi-agent games
Matches
Not in cards
GPT-55
59
Jan 2025
Dec 2025
Agent ArenaArena ranks models as the orchestrator in real Agent Mode sessions on arena.ai. Scores use behavioral signals such as file downloads, disapproval events, retries and steerability.
Arena (formerly LMArena)
General assistants
Votes
In use
Claude Fable 5.228.6%
58
Jun 2026
Nov 2026
DesignArena React NativeModels build cross-platform mobile apps in React Native from real user prompts. Users compare the running apps and vote for the better one.
DesignArena (Intelligence)
Building whole projects
Votes
Not in cards
Claude Fable 5.21,318
58
Nov 2026
LLM Debate BenchmarkModels debate an opponent over multiple rounds. Judges compare the arguments.
Lech Mazur
Multi-turn conversation
Matches
Not in cards
Claude Fable 5.11,706
58
Nov 2026
LMArena Image Edit ArenaImage editing models apply the same user edit request to the same image, anonymously and side by side. Community votes give Elo-style ratings.
Arena (formerly LMArena)
Image generation and editing
Votes
Not in cards
GPT-Image-2.5 Sunburst1,519
58
Jun 2025
Nov 2026
DuelLab GameBench 2Models get the rules of a strategy game and write a program that plays it. DuelLab checks and builds each program, then runs head-to-head matches between programs from different models. Match outcomes become per-game scores from 0 to 100 and a Bradley-Terry ranking, with no human or model judge.
DuelLab (independent project, Budapest)
Multi-agent games
Matches
Not in cards
Claude Fable 5.299.2
56
Jul 2026
Nov 2026
Elimination GameModels play a multi-player game of public and private talk, alliances and votes to eliminate each other. A jury of eliminated players picks the winner.
Lech Mazur
Multi-agent games
Matches
Not in cards
GPT-5.28
56
Feb 2025
Dec 2025
VoxelBenchLanguage models turn text or image prompts into voxel structures. Voters compare anonymous builds from the same prompt, and Glicko-2 ratings rank the models.
VoxelBench
Spatial reasoning and counting
Votes
Not in cards
GPT-6.1 Sol2,607
56
Sep 2025
Oct 2026
Image-to-WebDev ArenaUsers upload a screenshot, wireframe or mockup, two anonymous models build the website in Code Arena, and users vote for the better result. Votes become ratings with bootstrapped confidence intervals.
Arena (formerly LMArena)
Web and app front ends
Votes
Not in cards
Claude Opus 5.51,756
55
Apr 2026
Nov 2026
DesignArena Frontend Web AppCoding agents build multi-file React frontends from real user prompts. Users compare the running apps and vote, and the run logs record agent behavior.
DesignArena (Intelligence)
Web and app front ends
Votes
In use
GPT-6 Astra1,360
53
Nov 2026
DesignArena Image to HTMLModels recreate a reference image or mockup as a working single-file HTML website. Users compare the rendered pages and vote for the closer, better one.
DesignArena (Intelligence)
Web and app front ends
Votes
Not in cards
GPT-6 Astra1,300
53
Nov 2026
DesignArena ImageImage models generate a picture from a user prompt. Users compare two anonymous images and vote for the better one.
DesignArena (Intelligence)
Image generation and editing
Votes
Not in cards
GPT-Image-2.5 Sunburst1,381
52
Nov 2026
HUMAINEProlific participants, stratified across 22 demographic groups in the US and UK, hold multi-turn conversations with two anonymous models on topics they choose. They compare the models overall and on dimensions such as trust, ethics and safety. A hierarchical Bradley-Terry-Davidson model turns the votes into ratings, adjusted to census data.
Prolific
Overall chat quality
Votes
Not in cards
Gemini 3.1 Pro35
51
Sep 2025
Jul 2026
DesignArena Full StackCoding agents build complete React apps with sign-in, databases and backend code from real user prompts. Users try the apps and vote for the better one.
DesignArena (Intelligence)
Building whole projects
Votes
Not in cards
Claude Fable 5.21,400
50
Nov 2026
DesignArena PDFAgents build a PDF document from a user prompt. Users compare the two documents and vote for the better one.
DesignArena (Intelligence)
Documents and spreadsheets
Votes
Not in cards
Claude Fable 5.21,346
48
Nov 2026
DesignArena LogoImage models design a logo from a user prompt. Users compare two anonymous logos and vote for the better one.
DesignArena (Intelligence)
Image generation and editing
Votes
Not in cards
GPT-Image-21,365
47
Feb 2026
LLM Chess Arena (Louis Guichard)Models play each other from a text diagram, piece locations, and recent moves. A model forfeits after three failed attempts to make a legal move.
Louis Guichard
Multi-agent games
Matches
Not in cards
Gemini 3.5 Flash1,495
47
Aug 2025
Jul 2026
DesignArena Android (Kotlin)Models build native Android apps in Kotlin from real user prompts. The apps run in an Android emulator, and users compare them and vote.
DesignArena (Intelligence)
Building whole projects
Votes
Not in cards
Claude Opus 5.51,390
46
Oct 2026
DesignArena Graphic DesignImage models make a graphic design piece from a user prompt. Users compare two anonymous designs and vote for the better one.
DesignArena (Intelligence)
Image generation and editing
Votes
Not in cards
GPT-Image-2.5 Sunburst1,436
46
Feb 2026
LMArena Text-to-Video ArenaVideo generation models make clips from the same text prompt, anonymously and side by side. Votes from logged-in users give Elo-style ratings.
Arena (formerly LMArena)
Video generation
Votes
Not in cards
Gemini Omni 1.2 Flash1,540
46
Jan 2026
Nov 2026
LMArena Image-to-Video ArenaVideo generation models animate the same input image with the same prompt, anonymously and side by side. Votes give Elo-style ratings.
Arena (formerly LMArena)
Video generation
Votes
Not in cards
Gemini Omni 1.2 Flash1,503
45
Jan 2026
Nov 2026
Game Arena Four in a RowLanguage models play a Connect Four style game and try to line up four of their tokens before the opponent does.
Kaggle and Google DeepMind
Puzzles and chess
Matches
Not in cards
Gemini 4 Carbon1,003
43
Feb 2026
Nov 2026
Game Arena ChessLanguage models play full chess games against each other with the board given as FEN and PGN text. Ratings come from many games between each pair.
Kaggle and Google DeepMind
Puzzles and chess
Matches
Not in cards
Gemini 4 Carbon1,646
42
Aug 2025
Nov 2026
Kaggle Game ArenaLanguage models play each other in board, card and word games through a text harness. One leaderboard ranks models across all Game Arena games.
Kaggle and Google DeepMind
Multi-agent games
Matches
Not in cards
Gemini 4 Carbon638
42
Aug 2025
Nov 2026
Game Arena CheckersLanguage models play American checkers against each other, with forced jumps and crowned kings. Ratings come from head-to-head games.
Kaggle and Google DeepMind
Puzzles and chess
Matches
Not in cards
Gemini 4 Carbon1,382
41
Jun 2026
Nov 2026
Game Arena Dark HexLanguage models play Hex without seeing the opponent's stones, so they must probe cells to learn the hidden board while building a path.
Kaggle and Google DeepMind
Puzzles and chess
Matches
Not in cards
Gemini 3.8 Flash581
41
Jun 2026
Nov 2026
DesignArena SpreadsheetAgents build spreadsheets such as financial models, budgets and trackers as Excel or CSV workbooks. Users compare accuracy, structure and formatting and vote.
DesignArena (Intelligence)
Documents and spreadsheets
Votes
Not in cards
Claude Fable 5.21,429
40
Nov 2026
Document ArenaPeople upload their own PDFs with a question, compare answers from two anonymous models, and vote for the better one. Votes become Bradley-Terry ratings.
Arena (formerly LMArena)
Reasoning over long documents
Votes
Not in cards
Claude Fable 51,500
40
Mar 2026
Sep 2026
Game Arena Dots and BoxesLanguage models take turns drawing lines between dots on a grid. Closing the fourth side of a box claims it.
Kaggle and Google DeepMind
Puzzles and chess
Matches
Not in cards
Claude Fable 5.21,393
40
Jun 2026
Nov 2026
Game Arena Word AssociationTeams of language models give one-word clues and guess linked words, in a game like Codenames, against an opposing team.
Kaggle and Google DeepMind
Multi-agent games
Matches
Not in cards
Gemini 4 Carbon734
40
May 2026
Nov 2026
LMArena Search ArenaPeople compare answers from two anonymous search-augmented models on their own questions and vote for the better one. Votes become Bradley-Terry ratings.
Arena (formerly LMArena)
Deep research
Votes
Fading
GPT-5.6 Sol1,255
39
Apr 2025
Sep 2026
Game Arena BargainingTwo language models negotiate how to split a pool of items, each with private item values. Each side tries to reach a good deal without giving away its values.
Kaggle and Google DeepMind
Multi-agent games
Matches
Not in cards
Gemini 4 Carbon317
39
Jul 2026
Nov 2026
Game Arena ClobberLanguage models play Clobber, where every move captures an adjacent enemy stone. The player who makes the last legal move wins.
Kaggle and Google DeepMind
Puzzles and chess
Matches
Not in cards
Gemini 4 Carbon819
39
Jun 2026
Nov 2026
Game Arena Coin GameTwo language models move on a grid and pick up coins. Each should collect the coins that score for it and avoid the rest.
Kaggle and Google DeepMind
Multi-agent games
Matches
Not in cards
GPT-5.5514
39
Jul 2026
Nov 2026
Game Arena GoLanguage models play Go against each other through the Game Arena text harness. Ratings come from head-to-head games.
Kaggle and Google DeepMind
Puzzles and chess
Matches
Not in cards
Claude Fable 5.21,877
39
Sep 2026
Nov 2026
Game Arena Lines of ActionLanguage models play Lines of Action, where a piece moves as far as the number of pieces on its line. The goal is to join all of one's pieces into one group.
Kaggle and Google DeepMind
Puzzles and chess
Matches
Not in cards
Gemini 4 Carbon1,274
39
Jul 2026
Nov 2026
Game Arena Nine Men's MorrisLanguage models play Nine Men's Morris. Forming a row of three, called a mill, lets a player remove one of the opponent's pieces.
Kaggle and Google DeepMind
Puzzles and chess
Matches
Not in cards
Gemini 4 Carbon1,190
39
Aug 2026
Nov 2026
Game Arena ReversiLanguage models play Reversi, also called Othello, flipping the opponent's disks that they flank in a line.
Kaggle and Google DeepMind
Puzzles and chess
Matches
Not in cards
Gemini 4 Carbon1,306
39
Aug 2026
Nov 2026
Game Arena Ultimate Tic-Tac-ToeLanguage models play nine linked tic-tac-toe boards. Each move decides which small board the opponent must play next.
Kaggle and Google DeepMind
Puzzles and chess
Matches
Not in cards
Gemini 4 Carbon720
39
Jul 2026
Nov 2026
Game Arena Word ArtLanguage models take turns drawing a word as ASCII art and guessing what the other model drew.
Kaggle and Google DeepMind
Multi-agent games
Matches
Not in cards
Gemini 4 Carbon2,528
39
Aug 2026
Nov 2026
LMArcadeAgents build browser games from the same prompt. Players try two games and vote before learning which models and coding tools made them.
AfterQuery
Web and app front ends
Votes
Not in cards
Claude Fable 51,798
38
Jul 2026
Jul 2026
DesignArena Python-PPTX SlidesAgents build PowerPoint decks with python-pptx from a user prompt. Users compare narrative, visual design and structure and vote for the better deck.
DesignArena (Intelligence)
Documents and spreadsheets
Votes
Not in cards
Claude Opus 5.51,377
37
Nov 2026
Fiction Bench (Story Hacker)Models write three chapters for each of 20 genres. The overall score weights blind reader preferences at 60 percent and model judges’ craft scores at 40 percent.
Story Hacker AI
Creative writing
Votes
Not in cards
GPT-6.2 Astra73.6
36
Oct 2026
Nov 2026
Multi-Agent Arena Social PokerNo-limit hold’em tournaments with table talk, where people and anonymized models share a table. Models are ranked by a rating fit on who finished ahead at each table.
Olam Labs
Multi-agent games
Matches
Not in cards
Claude Fable 51,553
34
Jul 2026
Sep 2026
SciArenaResearchers ask scientific literature questions and vote between two models' long cited answers. Votes give Elo ratings.
Yale NLP and Allen Institute for AI
Science questions
Votes
Not in cards
o31,151
34
Jul 2025
Dec 2025
DesignArena Code to VideoAgents write code that renders a video from a user prompt. Users compare the two videos and vote for the better one.
DesignArena (Intelligence)
Video generation
Votes
Not in cards
Claude Fable 5.21,454
33
Nov 2026
DesignArena Image to FrontendCoding agents turn a reference image into a multi-file frontend web app. Users compare the running apps and vote for the better one.
DesignArena (Intelligence)
Web and app front ends
Votes
Not in cards
Gemini 4 Argon1,299
33
Oct 2026
Mana RP BenchModels write the next turn in a player’s story. The player sees two anonymous responses and chooses which one becomes part of the story.
Mana
Creative writing
Votes
Not in cards
MiMo-V2.6 Pro1,280
32
Oct 2026
SuperCLUE Arena Web CodingModels implement web interfaces. The arena ranks systems from pairwise comparisons.
SuperCLUE
Web and app front ends
Matches
Not in cards
Qwen3.8 Max (0902)1,462
32
Oct 2026
Vending-Bench ArenaSeveral agents each run a vending machine at the same location in the Vending-Bench 2 environment. They can email, pay and trade with each other, but each is scored on its own money balance.
Andon Labs
Simulated companies
Matches
Not in cards
Gemini 4 Carbon$15,962
32
Nov 2025
Oct 2026
Game Arena PokerLanguage models play heads-up no-limit Texas Hold'em against each other. Models are ranked by mean big blinds won per 100 hands.
Kaggle and Google DeepMind
Multi-agent games
Matches
Not in cards
GPT-5.6 Sol30.3
31
Feb 2026
Sep 2026
PlotPoints Round 3: Multi-Turn ArenaModels play multi-turn roleplay scenes. Readers compare transcripts in separate standard and adult tracks. The ratings start from model judges’ assessments of writing quality.
Rotom Champ BenchModels draft six level 50 Pokémon, select three for each match, and choose their moves. The organizer rates them on wins under Champions singles rules.
The RotomArena Team
Multi-agent games
Matches
Not in cards
Gemini 4 Argon2,304
30
Oct 2026
Oct 2026
DesignArena Agentic Game DevCoding agents build multi-file games from a user prompt. Users play the final games and vote, and the logs keep tool calls, retries and failures.
DesignArena (Intelligence)
Building whole projects
Votes
Not in cards
Claude Opus 5.51,408
29
Sep 2026
StudyArena ImageModels produce image responses to user prompts. Anonymous human comparisons determine the published rating in this separate vote pool.
StudyArena
Image generation and editing
Votes
Not in cards
GPT-Image-2.5 Flare1,284
29
Nov 2026
DesignArena HTML SlidesAgents write a self-contained HTML slide deck that is converted to PPTX. Users compare the decks and vote for the better one.
DesignArena (Intelligence)
Documents and spreadsheets
Votes
Not in cards
GPT-6 Astra1,531
28
Oct 2026
FlagEval ArenaModels answer the same prompt anonymously. Users compare their responses, and the leaderboard estimates a rating from the votes.
Beijing Academy of Artificial Intelligence
Overall chat quality
Votes
Not in cards
o4-mini1,134
28
Sep 2025
DesignArena Godot Game DevCoding agents build complete Godot projects with GDScript, scenes and generated assets, exported to run in the browser. Users play the games and vote.
DesignArena (Intelligence)
Building whole projects
Votes
Not in cards
GPT-6 Astra1,315
26
Sep 2026
Kaggle Pelican ArenaModels draw a pelican riding a bicycle in SVG. The arena checks whether each drawing renders and asks people to compare the passing entries.
Kaggle
Web and app front ends
Votes
Not in cards
Gemini 4 Neon1,816
26
Oct 2026
Nov 2026
PACTTwo models bargain over 20 rounds as buyer and seller, each with a hidden private value. Matches across many pairings rank the models.
Lech Mazur
Multi-agent games
Matches
Not in cards
GPT-5.51,607
26
Jul 2025
Jun 2026
Estonian AI BarometerModels answer a visitor’s prompt in Estonian. The visitor compares two anonymous replies and votes before seeing which models wrote them.
University of Tartu, Tallinn University of Technology, Tallinn University, and Institute of the Estonian Language
Chat and instructions in many languages
Votes
Not in cards
Gemini 3 Flash1,653
25
May 2025
Dec 2025
Joke ArenaModels write jokes. Pairwise votes determine the published Arena rating.
Kaggle
Creative writing
Votes
Not in cards
Kimi K31,585
25
Oct 2026
Kaggle SVG ArenaModels draw SVG images from 120 prompts across twelve categories. Submissions must render and satisfy the drawing rule for the prompt. Votes determine the arena rating.
Kaggle
Web and app front ends
Votes
Not in cards
Claude Opus 5.51,699
25
Oct 2026
Oct 2026
Ramen BenchAgents draw an interactive bowl of vegan ramen in one HTML file. Static checks verify the constraints and visitors rate the rendered pages.
Stephen Benjamin
Web and app front ends
Votes
Not in cards
Claude Opus 55
24
Nov 2026
Nov 2026
Clocktower RadioModels play the social deduction game Blood on the Clocktower (the Trouble Brewing script) in mirrored pairs of games. In each match one model plays good and the other evil, and then they swap. A coded Storyteller runs the game, and a Bradley–Terry fit over all matches gives ratings where 1500 is average.
Che Jami
Multi-agent games
Matches
Not in cards
GPT-5.51,708
23
Mar 2026
Oct 2026
DesignArena Image EditingImage models edit a user image following a text instruction. Users compare the two edits and vote for the better one.
DesignArena (Intelligence)
Image generation and editing
Votes
Not in cards
GPT-Image-2.5 Sunburst1,368
23
Nov 2026
Corp Speak ArenaModels rewrite text in corporate language. Pairwise votes determine the published Arena rating.
Kaggle
Taste and style
Votes
Not in cards
Claude Opus 51,723
22
Sep 2026
Game Arena Four-in-a-Row (Generality)Models place pieces on any empty square of a four by nine grid. Four in a line wins. The tournaments use different board encodings.
Generality, Inc.
Multi-agent games
Matches
Not in cards
GPT-592.0
22
Nov 2025
ArtifactArenaModels design robot bodies, controllers and strategy for a simulated sumo-style arena. Artifacts fight head-to-head and models get Elo ratings.
MIT CSAIL + MIT Media Lab + NYU + UCSF
Simulated robots
Matches
Not in cards
GPT-6 Astra1,539
21
Sep 2026
Sep 2026
CivBenchModels play full games of Civilization V with the Vox Populi mod against each other on matched maps and seeds. Pairwise skill ratings rank long-term strategy.
Vox Deorum
Video games
Matches
Not in cards
GLM-5.31,634
21
Oct 2026
Oct 2026
SettlerBench Season OneFour models trade resources, build settlements, and negotiate in public or private messages. Final victory points determine pairwise results for the Bradley-Terry rating.
Sam Donahue and SettlerBench contributors, Synopticon Research
Multi-agent games
Matches
Not in cards
GPT-6 Astra1,270
21
Oct 2026
Sep 2026
AI DiplomacyModels play the board game Diplomacy against each other, one power each. They negotiate, form alliances and betray each other in written messages.
Good Start Labs (Alex Duffy)
Multi-agent games
Matches
Not in cards
Gemini 3 Pro60
20
Feb 2025
Nov 2025
DesignArena Video to WebsiteModels watch a reference video and recreate its content as a working single-file HTML website. Users compare the rendered pages and vote.
DesignArena (Intelligence)
Web and app front ends
Votes
Not in cards
Muse Wonder1,274
20
Oct 2026
Game Arena Five in a RowLanguage models play a gomoku-style game and try to line up five of their tokens before the opponent does.
Kaggle and Google DeepMind
Puzzles and chess
Matches
Not in cards
Gemini 3.1 Pro1,131
20
Apr 2026
Jun 2026
Crest Arcade ChessModels play standard chess and Chess960 against fixed engine opponents without a list of legal moves. The organizer fits separate ratings for each variant.
Glimmer Index
Multi-agent games
Matches
Not in cards
GPT-6.2 Astra1,758
19
Nov 2026
ELI5 ArenaModels explain concepts in simple language. Pairwise votes determine the published Arena rating.
Kaggle
Overall chat quality
Votes
Not in cards
GPT-5.6 Sol1,695
19
Sep 2026
SCADBenchModels write OpenSCAD code from the same short prompt. Voters rotate two rendered objects and choose which one better fits the prompt.
SCADBench
CAD models
Votes
Not in cards
Gemini 3.1 Pro1,685
19
Feb 2026
Agent Arena (Gorilla)Users give a task, two agents built from different models, tools and frameworks run it, and users vote. A Bradley-Terry extension rates models, tools and frameworks.
UC Berkeley Gorilla team with LMSYS
General assistants
Votes
Not in cards
Llama 3.1-70B1,045
18
Oct 2024
Sep 2024
ChessBench (MadeByLupu)Models play each other with access to the board, move history and legal moves. The organizer rates each model and thinking setting with Glicko-2.
MadeByLupu
Multi-agent games
Matches
Not in cards
Gemini 4 Argon2,170
18
Oct 2026
DesignArena Video ArenaUsers compare videos from anonymous video generation models for the same prompt and vote for the better one. Votes become Elo ratings.
DesignArena (Intelligence)
Video generation
Votes
Not in cards
Gemini Omni 1.2 Flash1,369
18
Nov 2026
Kaggle ASCII ArenaModels draw images using text characters. Voters compare the drawings.
Kaggle
Creative writing
Votes
Not in cards
Gemini 4 Carbon2,016
18
Oct 2026
Oct 2026
Agent Poker BenchModels play 10-seat no-limit Texas Hold'em tournaments against each other. Chip counts and elimination order feed TrueSkill ratings.
Vals AI (with The Graphite Group)
Multi-agent games
Matches
Not in cards
GPT-5.21,132
17
Jan 2026
Dec 2025
Judge Arena (Atla)Users compare two anonymous model judges that score and critique the same answer.
Atla
Other
Votes
Not in cards
Llama 3.3 70B Instruct1,335
17
Nov 2024
Mar 2025
ProxyWarModels write bots for nine games. The harness tests each bot and runs tournaments to measure wins, errors, and decision time.
Valyrian Games Coding ChallengeModels create coding problems with integer answers and repeatedly solve their own problems to qualify. Tournament entrants solve one another’s problems and receive TrueSkill ratings.
Valyrian Tech
Competitive programming
Matches
Not in cards
GPT-5 mini30
17
Sep 2025
Aug 2025
XbenchMeasures firsthand X posts about frontier models and coding harnesses. An LLM labels each post's sentiment, aggregated per model per week.
Nico Christie (offpolicyinc)
Other
Votes
Not in cards
Claude Opus 5.575.7
17
Sep 2026
Sep 2026
Multi-Agent Arena CodenamesTwo teams of anonymized models play the word game Codenames. The board rates the clue giver and the guessers on separate rating scales.
Olam Labs
Multi-agent games
Matches
Not in cards
GPT-6 Astra1,535
16
Sep 2026
Sep 2026
Multi-Agent Arena DiplomacySeven players, people or anonymized models, negotiate and fight over World War I Europe. Models are ranked by their mean share of the sum-of-squares score, where 14.3 is an even split.
Olam Labs
Multi-agent games
Matches
Not in cards
GPT-6 Astra37.5%
16
Sep 2026
Oct 2026
Multi-Agent Arena RiskFour commanders, people or anonymized models, trade sealed messages and then attack for territory on a 42-territory map. Models are ranked by their mean share of territory, where 25 is an even split.
Olam Labs
Multi-agent games
Matches
Not in cards
GPT-6 Astra38.8%
16
Jul 2026
Sep 2026
Olam Labs Multi-Agent ArenaPeople and anonymized models share a table in social strategy games: Diplomacy, Social Poker, Codenames and Risk. One rating combines every game, fit on who finished ahead of whom at each table.
Olam Labs
Multi-agent games
Matches
Not in cards
GPT-6 Astra1,544
16
Jul 2026
Oct 2026
Opening Lines ArenaModels write opening lines for stories. Pairwise votes determine the published Arena rating.
Kaggle
Creative writing
Votes
Not in cards
GPT-6 Astra1,611
16
Sep 2026
Peer Arena (oddbit.ai)Five models debate for five rounds, then each privately votes for a survivor. The organizer calculates Bradley-Terry ratings from game outcomes.
Can Celik
Multi-agent games
Matches
Not in cards
GPT-5.11,799
16
Dec 2025
Chart ArenaModels create charts. Pairwise votes determine the published Arena rating.
Kaggle
Data science and SQL
Votes
Not in cards
GPT-6 Astra1,615
15
Oct 2026
Frontier Design BenchmarkProfessional designers vote blind between two models’ designs for the same real client brief from Contra’s marketplace, such as a marketing site. Models are ranked by Elo from the votes.
Contra Labs and BenchFlow
Web and app front ends
Votes
Not in cards
Claude Fable 5.21,713
15
Nov 2026
Nov 2026
SuperCLUE Arena Image EditingModels edit images in response to instructions. The arena ranks systems from pairwise comparisons.
SuperCLUE
Image generation and editing
Matches
Not in cards
GPT-Image-2.5 Sunburst1,308
15
3DCodeArenaModels generate 3D assets through code. Human preference votes determine the published Bradley-Terry Elo rating.
Google DeepMind + Google Research + University of Southern California
CAD models
Votes
Not in cards
Claude Fable 51,230
14
May 2026
Jun 2026
BigCodeArenaUsers ask for code, both models' programs run in a sandbox, and users try the results before voting for the better answer. Votes give Elo ratings.
BigCode project (Monash University and collaborators)
Function-level problems
Votes
Not in cards
DeepSeek-V3.2-Exp1,117
14
Oct 2025
Sep 2025
DesignArena BlenderAgents build a 3D scene in Blender from a user prompt. Users compare the rendered scenes and vote for the better one.
DesignArena (Intelligence)
Building whole projects
Votes
Not in cards
Claude Opus 5.51,381
14
Oct 2026
DesignArena Image to VideoVideo models animate a user image into a short video. Users compare two anonymous videos and vote for the better one.
DesignArena (Intelligence)
Video generation
Votes
Not in cards
MiniMax H31,319
14
Nov 2026
Human or AI? (Skills IL)Models write short Hebrew texts on the same assignments as human authors. Readers guess who wrote each text.
Skills IL
Chat and instructions in many languages
Votes
Not in cards
Gemini 1.0 Pro44.3%
14
Oct 2026
Oct 2026
Kaggle Explode ArenaModels build interactive exploded views of objects in three.js. A submission must render a self contained page where the viewer can separate the parts. Votes determine the arena rating.
Kaggle
Web and app front ends
Votes
Not in cards
GPT-6 Astra1,712
14
Oct 2026
Oct 2026
Kaggle Landmark ArenaModels recreate named landmarks in three.js. Each submission must render as a self contained web page. Votes determine the arena rating.
Kaggle
Web and app front ends
Votes
Not in cards
Claude Opus 5.51,788
14
Oct 2026
Oct 2026
Landing Page ArenaModels create landing pages. Pairwise votes determine the published Arena rating.
Kaggle
Web and app front ends
Votes
Not in cards
GPT-6.1 Sol1,694
14
Oct 2026
Pokémon VGC Bench (Ricotoma)Agents play competitive Pokémon doubles with assigned teams. They choose four Pokémon, select two leads, and choose actions for both active Pokémon each turn.
Ricotoma
Multi-agent games
Matches
Not in cards
GPT-6 Astra1,901
14
Sep 2026
ASCII Bench (Jason Botterill)Models draw pictures using plain text characters. Readers compare two anonymous drawings for the same prompt. The leaderboard estimates ratings from their votes.
Jason Botterill
Creative writing
Votes
Not in cards
Gemini 4 Argon1,948
13
Oct 2026
Code2Video ArenaModels create videos through code. Pairwise votes determine the published Arena rating.
HeyGen on Kaggle
Video generation
Votes
Not in cards
Gemini 4 Carbon1,598
13
Oct 2026
Game Arena 3 Check Chess (Generality)Models play both colors. A player can win by checking the opposing king three times. A double check counts once.
Generality, Inc.
Multi-agent games
Matches
Not in cards
o327.0
13
Sep 2025
Game Arena Anti Chess (Generality)Models must capture when they can. A player wins by losing every piece or by having no legal move. The king can be captured.
Generality, Inc.
Multi-agent games
Matches
Not in cards
GPT-525.0
13
Sep 2025
Game Arena Crazyhouse Chess (Generality)Models play Crazyhouse chess in both colors. A player can spend a turn placing a captured piece back on the board under its new owner's control.
Generality, Inc.
Multi-agent games
Matches
Not in cards
GPT-526.0
13
Sep 2025
Game Arena Horde Chess (Generality)Models take both sides in turn. White tries to checkmate with 36 pawns. Black starts with the usual pieces and must capture every white pawn.
Generality, Inc.
Multi-agent games
Matches
Not in cards
GPT-524.0
13
Sep 2025
Game Arena King of the Hill (Generality)Models can win by moving their king onto any of the four central squares. The king must reach the square without moving into check.
Generality, Inc.
Multi-agent games
Matches
Not in cards
GPT-524.0
13
Sep 2025
Game Arena Racing Kings (Generality)Models race their kings to the eighth rank without giving check. Black can draw by reaching that rank immediately after White.
Generality, Inc.
Multi-agent games
Matches
Not in cards
o323.5
13
Sep 2025
HEARTHumans and models respond to people seeking emotional support. Judges compare responses and explain their preferences.
Hippocratic AI
Wellbeing and sycophancy
Votes
Not in cards
GPT-51,612
13
Jan 2026
Nov 2025
Kaggle Sort Viz ArenaModels use Manim to animate sorting algorithms and explain their time complexity. A submission must produce a valid video under the file size limit. Votes determine the arena rating.
Kaggle
Web and app front ends
Votes
Not in cards
Claude Opus 5.51,650
13
Oct 2026
Oct 2026
VoxelBench ImageModels turn image prompts into voxel structures. Human comparisons determine Glicko-2 ratings in a separate image-prompt vote pool.
VoxelBench
Spatial reasoning and counting
Votes
Not in cards
GPT-6.1 Sol2,215
13
Sep 2025
Sep 2026
Agent-Only Fantasy Football LeagueModels draft NFL players, set lineups, and negotiate trades using the same prompt and tools. The organizer compares points, lineup efficiency, and cost per point.
Jake Moses
Multi-agent games
Matches
Not in cards
Claude Sonnet 51371.4
12
Aug 2026
Aug 2026
LLM 3D Worlds ArenaModels write Blender or three.js programs that build explorable 3D scenes. Voters compare the resulting scenes in a browser without seeing the model names.
3d-arena
Building whole projects
Votes
Not in cards
GPT-6 Astra1,253
12
Nov 2026
LLM Fantasy Football Arena ClassicModels manage two NFL fantasy teams each. One league allows trades and messages. The other disables both. Each league scores its own draft and season.
Wildcard Labs
Multi-agent games
Matches
Not in cards
Qwen 3.8 Max0.90
12
Aug 2026
Sep 2026
OCR ArenaUsers upload a document, compare two anonymous OCR or vision-language models side by side, and vote. Votes become Elo ratings.
Extend
Documents, charts and text in images
Votes
Not in cards
Gemini 3 Flash1,781
12
Nov 2025
Feb 2026
AI Battle ArenaModels play poker, Gomoku, and Connect Four through the same interface. The overall leaderboard averages each model’s finishing position across five head-to-head contests.
Infini-AI Lab
Multi-agent games
Matches
Not in cards
GPT-5.588.0
11
Jul 2026
Jun 2026
Clocktower BenchModels play the social deduction game Blood on the Clocktower (the Trouble Brewing script) against each other, with a scripted Storyteller. One model takes every good seat and another every evil seat, so each game tests one model's detection of the Demon against another's deception. A Bradley–Terry fit turns 386 games into Elo ratings.
Dwarkesh Patel
Multi-agent games
Matches
Not in cards
GPT-6 Astra1,859
11
Nov 2026
Sep 2026
DesignArena Agentic Image to HTMLCoding agents turn a user-uploaded image into a self-contained HTML website. Users compare how well each page reproduces the design and vote.
DesignArena (Intelligence)
Web and app front ends
Votes
Not in cards
Claude Sonnet 4.61,247
11
Apr 2026
DesignArena Audio Realism BenchVoice models produce conversational speech, and users vote on which sounds more real. DesignArena built it because 1 to 5 opinion scores for TTS had saturated.
DesignArena (Intelligence)
Audio understanding and voice
Votes
Not in cards
Grok TTS1,181
11
Oct 2026
DesignArena Text-to-SpeechSpeech models read the same text aloud. Users listen to two anonymous clips and vote for the more natural one.
DesignArena (Intelligence)
Audio understanding and voice
Votes
Not in cards
Gemini 3.8 Flash TTS1,476
11
Oct 2026
Floorplan ArenaModels furnish hand-drawn room sketches. People compare the layouts and vote for the better floorplan.
Kaggle
Data science and SQL
Votes
Not in cards
Gemini 4 Carbon1,807
11
Oct 2026
Game Arena Chess OpeningsLanguage models play chess against each other from varied two-move openings sampled from 20 popular human openings. The board is given as text.
Kaggle and Google DeepMind
Puzzles and chess
Matches
Not in cards
Gemini 3 Flash1,263
11
Feb 2026
Dec 2025
LMArena Video Edit ArenaVideo editing models apply the same edit request to the same clip, anonymously and side by side. Community votes give Elo-style ratings.
Arena (formerly LMArena)
Video generation
Votes
Not in cards
Wan 3.01,424
11
Nov 2026
Bench on the ClocktowerTen models play the social deduction game Blood on the Clocktower together, one seat each, over 300 ten-player games of the Trouble Brewing script. Each model plays 210 games on the good team and 90 on the evil team. The score is the share of games its team won.
Tom Taylor and coauthors
Multi-agent games
Matches
Not in cards
GPT-5.6 Sol58%
10
Sep 2026
Jul 2026
CompassArenaUsers chat with two anonymous models side by side, mostly in Chinese, and vote for the better answer. A Bradley-Terry model turns the votes into Elo-style ratings.
OpenCompass (Shanghai AI Laboratory) with ModelScope
Overall chat quality
Votes
Not in cards
MiMo-V2.5-Pro1,062
10
May 2024
Jun 2026
fAIntasy FootballModels draft NFL players, set lineups, bid for free agents, and trade under the same rules. The standings show wins, fantasy points, and lineup efficiency.
fAIntasy Football
Multi-agent games
Matches
Not in cards
Gemini 3.8 Flash4.00
10
Sep 2026
Sep 2026
FlagEval DebateModels debate a topic in Chinese. The leaderboard estimates their ratings from comparisons and reports uncertainty.
Beijing Academy of Artificial Intelligence
Overall chat quality
Votes
Not in cards
o1-mini1,149
10
Sep 2024
Dec 2024
PTCG-BenchAgents play the Pokémon Trading Card Game by choosing legal actions from a partially visible board. Match results determine their Glicko-2 ratings.
Zhejiang University and FinVolution Group
Multi-agent games
Matches
Not in cards
Gemini 3.1 Pro1,854
10
May 2026
Apr 2026
RSI ArenaTen frontier agents each post-train the same Nemotron base model on a shared GPU cluster for six days. People then rank the resulting models in blind side-by-side votes, and agents retrain on that feedback.
Bake AI
Machine learning engineering
Votes
Not in cards
GPT-6 Astra1,095
10
Sep 2026
Oct 2026
SEAL ShowdownUsers of Scale's Playground app chat with a model and sometimes compare its reply with a random opponent's reply. Scale ranks models with a Bradley-Terry model that controls for length and formatting. Rankings can be split by region, profession and age.
Scale AI
Overall chat quality
Votes
Not in cards
GPT-5 Chat1,113
10
Sep 2025
Aug 2025
WildVision ArenaUsers upload an image with a question, compare answers from two anonymous vision-language models, and vote. Votes give Elo ratings.
Allen Institute for AI and UCSB
General visual questions
Votes
Not in cards
Claude 3 Opus1,100
10
Feb 2024
Apr 2024
Wojak-Bench 3DModels turn the same drawing into a three-dimensional figure. Voters compare two anonymous prints or renders and choose which better matches the drawing.
Andon Labs
CAD models
Votes
Not in cards
GPT-6.2 Astra1,273
10
Nov 2026
Voice Arena HindiModels generate speech in Hindi. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings.
Voice Arena
Audio understanding and voice
Votes
System cards only
Gemini 3.8 Flash TTS1,097
9
Oct 2026
3D GameDev ArenaAgents build playable 3D browser games from specifications and reference images. Players compare anonymous game pairs. The authors also test functionality and playability.
Fudan University, Shanghai Innovation Institute, Xi’an Jiaotong University, and Shanghai Jiao Tong University
Building whole projects
Votes
Not in cards
Claude Opus 599.8%
9
Nov 2026
Sep 2026
Chess Engine Benchmark (Steve Maughan)Models have 24 hours to write a chess engine from scratch in C or C++. Maughan rates each engine against reference engines and other entries.
Steve Maughan
Building whole projects
Matches
Not in cards
Claude Fable 5.23,542
9
Sep 2026
Nov 2026
FantasyFootballBenchModels draft players, set weekly lineups, and negotiate trades in a replay of the 2024 NFL season. Actual player statistics determine points and wins.
Arya Tschand
Multi-agent games
Matches
Not in cards
Claude Opus 4.115.0
9
Jul 2025
Sep 2025
Game Arena Atomic Chess (Generality)Models play chess with exploding captures. A capture removes both involved pieces and neighboring pieces other than pawns. Exploding the opposing king wins.
Generality, Inc.
Multi-agent games
Matches
Not in cards
GPT-527.0
9
Aug 2025
GLEEAgents bargain, negotiate, or persuade another player through conversation while pursuing the payoff defined by the game.
Eilam Shapira and colleagues
Multi-agent games
Matches
Not in cards
Grok 4.62,595
9
Oct 2024
Aug 2026
StarSkirmish BenchEach model gets one hour in its lab's own CLI to write a StarCraft: Brood War bot in C++. The score is its win rate against human-written bots.
Kai McPheeters
Video games
Matches
Not in cards
GPT-6 Astra57.3%
9
Oct 2026
Oct 2026
Windsurf Arena Mode LeaderboardDevelopers compare two model responses to the same coding request inside the editor. Their choices determine model Elo ratings.
Cognition
Fixing real repositories
Votes
Not in cards
Claude Opus 4.61,098
9
Feb 2026
Apr 2026
Voice Arena US EnglishModels generate speech in US English. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings.
Voice Arena
Audio understanding and voice
Votes
System cards only
Gemini 3.8 Flash-Lite TTS1,083
8
Oct 2026
Artificial Turf WarModels bid for draft position, pick NFL players, and submit weekly lineups. The league ranks teams by wins and breaks ties with fantasy points.
Nate Lorenzen
Multi-agent games
Matches
Not in cards
GPT-5.6 Sol6.00
8
Jul 2026
Aug 2026
BIM BenchAgents draw a timber roof eaves detail in Revit. Reviewers see the exported sheet without the model name and rate its usability from one to five.
BIM Bench
CAD models
Votes
Not in cards
GPT-6.1 Sol4
8
Oct 2026
CodeClashModels build and improve their own codebases over many rounds, then compete in arenas such as Halite, poker and BattleSnake. Results give Elo ratings.
SWE-bench team (Stanford University and Princeton University)
Building whole projects
Matches
Not in cards
Claude Sonnet 4.51,385
8
Nov 2025
Sep 2025
CompassArena MultimodalUsers compare anonymous multimodal model answers and vote for the better response. A Bradley-Terry model estimates ratings from these votes.
OpenCompass (Shanghai AI Laboratory)
General visual questions
Votes
Not in cards
Qwen3-VL-235B-A22B-Instruct1,173
8
Sep 2025
Copilot ArenaDevelopers inside their IDE see paired code completions from two models and pick one. Pairwise votes give an Elo-style ranking of code models.
Arena (formerly LMArena) with Carnegie Mellon University
Function-level problems
Votes
Not in cards
DeepSeek-V2.51,074
8
Nov 2024
Sep 2024
DesignArena Multi-Image to VideoVideo models compose one video from several reference images. Users compare two anonymous videos and vote for the better one.
DesignArena (Intelligence)
Video generation
Votes
Not in cards
MiniMax H31,329
8
Nov 2026
Game Arena WerewolfTeams of language models play the social deduction game Werewolf in natural language. Villagers must find the hidden werewolves, who try to deceive them.
Kaggle and Google DeepMind
Multi-agent games
Matches
Not in cards
GPT-5.40
8
Feb 2026
Mar 2026
Kaggle Chess SuiteModels play chess from the standard starting position and from selected openings. Kaggle publishes both ratings for each model.
Kaggle
Puzzles and chess
Matches
Not in cards
Gemini 3 Flash1,238
8
Dec 2025
LLM GamesModels play Connect Four against one another. Ramp publishes match scores and final Elo ratings.
Ramp Labs
Multi-agent games
Matches
Not in cards
GPT-51,728
8
Aug 2025
Ludobench HokmModels play Hokm in partnerships. One player names trump, and partners try to take seven tricks before the other team.
Ludobench
Multi-agent games
Matches
Not in cards
Claude Haiku 4.5100%
8
Sep 2026
Sep 2026
Rotom Gen9 BenchModels draft six level 100 Pokémon and play the whole team in Generation 9 OverUsed singles. Match results determine their ratings.
The RotomArena Team
Multi-agent games
Matches
Not in cards
GPT-6 Luna2,318
8
Oct 2026
Oct 2026
Voice Arena Arabic MSAModels generate speech in Arabic MSA. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings.
Voice Arena
Audio understanding and voice
Votes
System cards only
Gemini 3.8 Flash TTS1,192
7
Sep 2026
Voice Arena Brazilian PortugueseModels generate speech in Brazilian Portuguese. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings.
Voice Arena
Audio understanding and voice
Votes
System cards only
Gemini 3.8 Flash-Lite TTS1,127
7
Sep 2026
Voice Arena Mexican SpanishModels generate speech in Mexican Spanish. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings.
Voice Arena
Audio understanding and voice
Votes
System cards only
Gemini 3.8 Flash TTS1,138
7
Sep 2026
Voice Arena VietnameseModels generate speech in Vietnamese. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings.
Voice Arena
Audio understanding and voice
Votes
System cards only
Gemini 3.8 Flash-Lite TTS1,141
7
Sep 2026
CATArenaCode agents write programs that play board and card games in repeated tournaments. Between rounds they refine their code through self-reflection and by studying rivals' code. Scores are average ranks that separate first-round skill from improvement.
AGI-Eval (Meituan)
Building whole projects
Matches
Not in cards
GPT-51,799
7
Oct 2025
Aug 2025
Labelbox Multimodal ReasoningModels interpret images, identify differences, write captions, and reason about spatial relationships. Human raters compare the responses.
Labelbox
General visual questions
Votes
Not in cards
Claude 3.5 Sonnet1,220
7
Dec 2024
Mar 2025
Honesty human feedback win rate (Anthropic)Crowdworkers try to make models say something false and pick the more honest reply in head-to-head chats. Score is the win rate against a baseline.
Anthropic
Hallucination rates
Votes
System cards only
6
Mar 2024
Feb 2026
Voice Arena JapaneseModels generate speech in Japanese. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings.
Voice Arena
Audio understanding and voice
Votes
System cards only
Gemini 3.8 Flash TTS1,188
6
Sep 2026
AAArenaAgents write and revise programs for 12 games. Each program competes against archived human entries under a fixed match budget.
AAArena team
Multi-agent games
Matches
Not in cards
Claude Opus 5.56.00
6
Oct 2026
Sep 2026
Brood War BenchCoding agents play StarCraft: Brood War against each other in real time. Systems are ranked by win rate over matches, with cost per game.
Ben Swerdlow
Video games
Matches
Not in cards
GPT-6 Astra100%
6
Sep 2026
Sep 2026
DesignArena Multimodal to VideoVideo models make a video from a mix of text, images and other inputs. Users compare two anonymous videos and vote for the better one.
DesignArena (Intelligence)
Video generation
Votes
Not in cards
MiniMax H31,305
6
Nov 2026
InteractiveBench Texas Hold’emModels play no-limit Texas Hold’em from partial observations of cards, chip stacks, and recent actions. Repeated matches measure chip gains, with invalid actions receiving one retry before an automatic fold.
InteractiveBench and Princeton University
Multi-agent games
Matches
Not in cards
Gemini 3 Flash31.8
6
Mar 2026
Dec 2025
InteractiveBench Trust GameModels choose whether to cooperate or defect in repeated prisoner’s dilemma matches. A round-robin tournament scores average realized payoff per round, with a random stopping rule.
InteractiveBench and Princeton University
Multi-agent games
Matches
Not in cards
Qwen3-Max1.87
6
Mar 2026
Dec 2025
Ludobench BackgammonModels play backgammon against opponents using dice rolls and legal moves. Ludobench publishes Glicko-2 ratings and match replays.
ChangeMyViewModels write rebuttals to r/ChangeMyView posts that human raters score for persuasiveness. Scored as percentile against human responses.
OpenAI
Dangerous capabilities
Votes
System cards only
5
Sep 2024
Feb 2025
CATArena GomokuCode agents compete in Gomoku. The public competition board reports Elo Rating for each agent configuration.
AGI-Eval (Meituan)
Building whole projects
Matches
Not in cards
GPT-51,799
5
Oct 2025
Aug 2025
CATArena OIBench-5Code agents compete in OIBench-5. The public competition board reports Time AUC for each agent configuration.
AGI-Eval (Meituan)
Building whole projects
Matches
Not in cards
GPT-50.40
5
Oct 2025
Aug 2025
CATArena SWE-Perf-10Code agents compete in SWE-Perf-10. The public competition board reports Time Ratio for each agent configuration.
AGI-Eval (Meituan)
Building whole projects
Matches
Not in cards
Claude Sonnet 41.95×
5
Oct 2025
Aug 2025
CATArena Texas HoldemCode agents compete in Texas Holdem. The public competition board reports Elo Rating for each agent configuration.
AGI-Eval (Meituan)
Building whole projects
Matches
Not in cards
GPT-51,463
5
Oct 2025
Aug 2025
Cooperate to Compete (C2C)Multi-player conquest game with private non-binding negotiation and secret asymmetric objectives. LM agents and humans are ranked by Plackett-Luce player strength from their game results.
UC Berkeley
Multi-agent games
Matches
Not in cards
Gemini 3.1 Pro0.74
5
Apr 2026
Mar 2026
DesignArena Video EditingVideo models edit a user video following a text instruction. Users compare the two results and vote for the better one.
DesignArena (Intelligence)
Video generation
Votes
Not in cards
MiniMax H31,373
5
Jarvis BenchVoice agents handle conversational tasks. Listeners rate naturalness, and the board reports task effectiveness separately.
Voice Arena
Speech recognition and translation
Votes
Not in cards
Gemini 3.8 Live998
5
Sep 2026
K-Sort ArenaUsers rank outputs from K image or video generation models at once instead of a pair. Bayesian updates turn the rankings into ratings.
Li et al. (UC Berkeley and collaborators)
Image generation and editing
Votes
Not in cards
GPT-Image-131
5
Aug 2024
Labelbox Image Generation v2Models generate images from text prompts. Human raters compare how well the outputs meet the request.
RIICHI ORBIT mahjong bot comparison (two-stage practice)Two-stage practiceModels improve a beginner mahjong bot during two timed coding periods. The maker runs the finished bots in four-player matches and reports mean placement by table.
Harmlessness human feedback win rate (Anthropic)Raters probe models in adversarial chats and pick the more harmless reply in head-to-head comparisons. Score is the win rate against a baseline model.
CC-BenchClaude Code runs realistic frontend, backend, tooling and data coding tasks in fresh containers. Humans compare models head-to-head (win rate).
Zhipu AI (Z.ai)
Building whole projects
Votes
System cards only
Claude Sonnet 441.9%
4
Jul 2025
Sep 2025
TetrisBenchModels play Tetris head-to-head in the original benchmark. The Harbor strategy track grades an agent-written JavaScript placement function on 20 fixed piece sequences.
TetrisBench
Video games
Matches
Not in cards
Claude Fable 566.7%
4
Jan 2026
Jul 2026
Turing TTSListeners hear a human recording and a synthesized recording. The score measures how often listeners identify the synthesized recording as human.
Voice Arena
Speech recognition and translation
Votes
Not in cards
Gemini 3.8 Flash TTS10.5%
4
Sep 2026
Voice Arena BahasaModels generate speech in Bahasa. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings.
Voice Arena
Audio understanding and voice
Votes
Not in cards
Gemini 3.8 Flash TTS1,138
4
Sep 2026
Voice Arena TagalogModels generate speech in Tagalog. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings.
Voice Arena
Audio understanding and voice
Votes
Not in cards
Gemini 3.8 Flash TTS1,130
4
Sep 2026
WMArena Video ArenaModels generate a video from a starting image and an action. Viewers compare anonymous clips and vote for the more convincing result.
WMArena
Video generation
Votes
Not in cards
Kling 2.5 Turbo1,487
4
3DCodeBenchAgentic procedural 3D modeling via code: author engine-ready 3D assets through software APIs. Graded for executability and shape fidelity.
Google DeepMind + Google Research + University of Southern California
CAD models
Votes
In use
3
May 2026
Nov 2026
AA-3DAgents in an offline sandbox turn a written brief into an interactive three.js scene. A recruited human panel votes on blind pairs, and votes become Elo ratings.
Artificial Analysis
Web and app front ends
Votes
In use
3
Oct 2026
Nov 2026
Copilot Arena Code EditingDevelopers highlight existing code and ask for a change. They choose between two anonymous edits.
Arena
Fixing real repositories
Votes
Not in cards
Claude 3.5 Sonnet1,058
3
Jan 2025
Sep 2024
GameAdsBenchModels generate video ads for games. Viewers watch two anonymous ads and choose the one they prefer.
Video Arena
Video generation
Votes
Not in cards
Dreamina Seedance 2.51,283
3
GTBenchModels play strategic games against other models or scripted opponents. The benchmark measures their advantage in game rewards.
GTBench authors
Multi-agent games
Matches
Not in cards
GPT-40.13
3
Feb 2024
Jan 2024
LLM ColosseumTwo models each control a fighter in Street Fighter III and choose moves from text descriptions of the game. Wins give Elo ratings.
phospho (OpenGenerativeAI)
Video games
Matches
Not in cards
GPT-4o mini1,835
3
Mar 2024
Jul 2024
Music ArenaUsers write a music prompt, listen to tracks from two text-to-music systems, and vote. Preferences, listening data and feedback feed a leaderboard.
Carnegie Mellon University (G-CLef) with Arena and Sony researchers
Audio understanding and voice
Votes
Not in cards
Lyria 3 Pro1,394
3
Jul 2025
May 2026
Real Point-of-Care QueriesClinical AI systems answer 620 questions from practicing physicians across 30 specialties. Specialists compare anonymous answers for accuracy, utility, source quality, completeness and verifiability.
Jean Feng and colleagues, with data collection by OpenEvidence
Medicine
Votes
Not in cards
Claude Opus 4.8-1.50%
3
Jun 2026
May 2026
RoboArenaDouble-blind pairwise A/B trials of generalist DROID policies on real Franka arms, free-form tasks by volunteer evaluators. Elo-style rating.
UC Berkeley + Stanford + UPenn + others
Real robots
Votes
Not in cards
π0.51,608
3
Jun 2025
Apr 2025
StudyArena AudioModels produce audio responses to user prompts. Anonymous human comparisons determine the published rating in this separate vote pool.
Voice Arena FrenchModels generate speech in French. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings.
Voice Arena
Audio understanding and voice
Votes
Not in cards
Gemini 3.8 Flash TTS1,084
3
Sep 2026
Voice Arena GermanModels generate speech in German. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings.
Voice Arena
Audio understanding and voice
Votes
Not in cards
Gemini 3.8 Flash TTS1,034
3
Sep 2026
Voice Arena Indian EnglishModels generate speech in Indian English. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings.
Hume AI Overall Quality IndexListeners rate generated speech on reliability and expressiveness. The benchmark reports an overall quality index.
Hume AI
Speech recognition and translation
Votes
In use
2
Sep 2026
Sep 2026
Red Teaming Network pairwise safety comparisonRed teamers compare anonymized responses from two models in free-form risky conversations. Scored as the share of ratings where a model is safer.
OpenAI
Refusing harmful requests
Votes
System cards only
2
Dec 2024
Feb 2025
Qwen Chinese human evaluationThree annotators rank chat model answers to 300 Chinese instructions on knowledge, language, writing, math and coding. Results are win rates against GPT-3.5.
Qwen Team, Alibaba Group
Overall chat quality
Votes
System cards only
2
Sep 2023
Sep 2023
LLMBoxingPeople see one question with two anonymous model answers and pick the better one. The site counts preferences between model pairs.
llmboxing.com
Overall chat quality
Votes
System cards only
Llama 2-70B22679.0
2
Oct 2023
Oct 2023
Labelbox Video Generation v2Models generate videos from text prompts. Human raters compare the outputs for visual quality and adherence to the prompt.
Music Arena VocalModels generate music with vocals. Listeners compare anonymous tracks, and separate vocal preference votes determine the Arena score.
Carnegie Mellon University (G-CLef) with Arena and Sony researchers
Audio understanding and voice
Votes
Not in cards
Lyria 3 Pro1,107
2
Jul 2025
Mar 2026
TTS ArenaUsers listen to two anonymous text-to-speech models read the same text and vote for the more natural one. Votes become Elo ratings.
TTS-AGI (Hugging Face community)
Audio understanding and voice
Votes
Not in cards
MiniMax Speech 2.8 HD1,552
2
Feb 2024
Jan 2026
Voice Arena Goal DatasetJudges compare two calls and choose which caller achieved the airline task more successfully. Human preferences provide the reference.
Voice Arena and collaborators
Audio understanding and voice
Votes
Not in cards
Qwen2.5-Omni-7B64.7%
2
Sep 2026
Mar 2025
Apple side-by-side human evaluationApple's in-house graders compare two models' responses to locale-specific text and image prompts and pick the preferred one. Results are win, tie and loss fractions per comparison.
Apple
Overall chat quality
Votes
Fading
1
Jun 2025
Jun 2026
Cohere enterprise human evaluationTrained annotators blindly compare two models' answers on enterprise tasks such as HR FAQs, technical FAQs and workplace assistants. They judge accuracy, instruction following and style. Results are win, tie and loss rates.
Cohere
Running a business
Votes
Dropped
1
Mar 2025
Apr 2025
GenAI-BenchImage generation systems are compared by human side-by-side preference on text-to-image prompts.
Google DeepMind
Image generation and editing
Votes
Fading
1
Feb 2026
Hume AI Voice Design BenchmarkListeners rate generated voices for English voice design, multilingual control, accents and voice qualities.
Hume AI
Speech recognition and translation
Votes
In use
1
Sep 2026
Sep 2026
Artificial Analysis Speech ArenaVoters listen to two speech clips made from the same text and pick the more natural one. Votes become Elo ratings.
Artificial Analysis
Audio understanding and voice
Votes
Fading
1
Apr 2026
DeepSeek Chinese functional writing evaluationModels answer 3,170 everyday Chinese writing prompts such as reports, emails and speeches. Pairwise judging against a baseline model gives a win rate.
DeepSeek
Taste and style
Matches
System cards only
1
Apr 2026
Apr 2026
DeepSeek Chinese white-collar tasks evaluationAgents complete 30 Chinese professional analysis, document generation and editing tasks across 13 industries. Blind human annotators compare outputs against a baseline model.
DeepSeek search Q&A evaluationModels answer objective and subjective Chinese search questions with retrieval or agentic search. Pairwise judging gives win, loss and tie rates.
DeepSeek
Questions that need search
Matches
System cards only
1
Apr 2026
Apr 2026
Expert Red Teaming for Violent Attack PlanningExpert red teamers compare anonymized responses from two models on violent attack planning prompts. Scored as the win rate for being safer.
OpenAI
Refusing harmful requests
Votes
System cards only
1
Aug 2025
Aug 2025
Kimi Webdev BenchModels build games, 3D scenes and website clones from real prompts. Blind experts compare two outputs and report win, tie and loss rates.
Moonshot AI
Web and app front ends
Votes
System cards only
1
Jul 2026
Jul 2026
MAI human side-by-side evaluationPaid raters compare two models' answers to 1,276 English prompts from experts and Copilot logs on a 7-point scale from -1.5 to 1.5.
Microsoft AI
Overall chat quality
Votes
System cards only
1
Jun 2026
Jun 2026
Pairwise Bioweaponization CampaignRed teamers with biology PhDs compare anonymized responses from two models on bioweaponization prompts. Scored as the win rate for being safer.
OpenAI
Refusing harmful requests
Votes
System cards only
1
Aug 2025
Aug 2025
Preference on ChatGPT and API promptsHuman labelers compare model responses to 5,214 prompts sent to ChatGPT and the OpenAI API. Scored as win rate against a baseline model.
OpenAI
Overall chat quality
Votes
System cards only
1
Mar 2023
Mar 2023
Speech Agent ArenaPeople hold live conversations with two hidden speech-to-speech agents on the same scenario, some with tool calls, then pick the one they preferred. Votes are fit to an Elo rating, and the arena also tracks task success.
Artificial Analysis
Speech recognition and translation
Votes
In use
1
Aug 2026
Oct 2026
Economics Arena for Large Language ModelsModels choose numbers in beauty contests and place sealed bids in auctions. Researchers compare payoffs and measure how strategies change when players see previous rounds.
Shangmin Guo and colleagues
Multi-agent games
Matches
Not in cards
Claude 20.95
1
Jan 2024
Jul 2023
GenAI-ArenaUsers compare outputs from two anonymous models for image generation, image editing and video generation, and vote. Votes give Elo ratings.
TIGER-Lab (University of Waterloo)
Image generation and editing
Votes
Not in cards
FLUX.1 [dev]1,133
1
Jun 2024
GenAI-Arena Image GenerationModels generate images from text prompts. Anonymous human comparisons determine Elo in this independent vote pool.
TIGER-Lab (University of Waterloo)
Image generation and editing
Votes
Not in cards
FLUX.1 [dev]1,133
1
Jun 2024
Speech ArenaModels generate speech. Listeners compare outputs, and pairwise votes determine Elo ratings.
Speech Arena
Audio understanding and voice
Votes
Not in cards
GPT-4o Mini TTS1,566
1
Mar 2025
Human feedback win rates (Anthropic)Raters chat with two models on tasks such as coding, documents and creative writing and pick the better reply. Score is the win rate.
Pairwise safety red teamingRed teamers compare anonymized responses from several models and pick the least safe. Scored as ELO or win rate.
OpenAI
Refusing harmful requests
Votes
System cards only
Apr 2025
Apr 2025
DeepSeek Chinese creative writing evaluationModels write Chinese fiction, prose, poetry and lyrics for 2,837 prompts. Pairwise judging gives separate win rates for instruction following and writing quality.
DeepSeek
Creative writing
Matches
System cards only
Apr 2026
Apr 2026
Kimi Chinese in-house open-ended benchmarkModels answer held-out Chinese prompts drawn from real user queries. Outputs are compared pairwise against another model to give win, tie and loss rates.
Moonshot AI
Overall chat quality
Matches
System cards only
Jul 2025
Jul 2025
Llama 3 pairwise human evaluation (Meta)Human raters compare Llama responses with a rival model on about 7,000 prompts across six capabilities and three multiturn sets.
Meta
Overall chat quality
Votes
System cards only
Jul 2024
Nov 2024
2024 NIST GenAI Text-to-Text GeneratorsModels summarize several articles for a given topic. NIST compares detector scores for generated and human summaries. Higher target Brier scores mean detectors more often miss generated summaries.
National Institute of Standards and Technology
Reasoning over long documents
Matches
Not in cards
Apr 2024
3D Animation ArenaModels reconstruct a moving 3D human from a video. Voters compare motion fidelity, ground contact, smoothness, and overall appearance.
3D-animation-arena
Image generation and editing
Votes
Not in cards
Apr 2025
3D ArenaUsers compare two 3D models generated from the same input and vote for the better one. A live leaderboard ranks the generators.
Hugging Face (Dylan Ebert)
Spatial reasoning and counting
Votes
Not in cards
3D Worlds ArenaModels generate explorable 3D scenes from an image and caption. Voters inspect two anonymous scenes from the same input and choose a favorite.
3d-arena
Interactive world models
Votes
Not in cards
3DArena-ModelingAgents create 3D models for 120 tasks covering precision and appearance. Tencent converts Elo ratings from blind comparisons into percentages.
Tencent
Spatial reasoning and counting
Matches
Not in cards
Nov 2026
3DGen-BenchPeople compare generated 3D objects in pairs. The authors use their judgments to evaluate automated scoring methods for text-to-3D and image-to-3D generation.
Yuhan Zhang and colleagues
Image generation and editing
Votes
Not in cards
Mar 2025
AA-Image-EditingValidated private evaluators compare two image edits made from the same instruction and vote blind. Votes become Elo ratings.
Artificial Analysis
Image generation and editing
Votes
Not in cards
AA-Video-EditingVoters compare two edits of the same video made from one instruction and pick the better one. Votes become Elo ratings.
Artificial Analysis
Video generation
Votes
Not in cards
Agronomy AI ArenaModels answer a visitor's agronomy question. The visitor compares two anonymous answers and votes for the more helpful one.
Artificial Analysis Image ArenaVoters compare images from two text-to-image models for the same prompt and pick the better one. Votes become Elo ratings.
Artificial Analysis
Image generation and editing
Votes
Not in cards
Artificial Analysis Video ArenaVoters compare videos from two text-to-video models for the same prompt and pick the better one. Votes become Elo ratings.
Artificial Analysis
Video generation
Votes
Not in cards
BigLaw Bench: ArenaLegal experts compare two answers to a legal task. The benchmark reports pairwise win percentages.
Harvey
Law
Matches
Not in cards
Nov 2025
BiomedArenaResearchers compare anonymous answers to biomedical research questions and vote for the response they prefer.
DataTecnica and Arena
Expert-written questions
Votes
Not in cards
Aug 2025
CATArena PommermanCode agents compete in Pommerman. The public competition board reports Elo Rating for each agent configuration.
AGI-Eval (Meituan)
Building whole projects
Matches
Not in cards
Oct 2025
CATArena TetrisCode agents compete in Tetris. The public competition board reports Score for each agent configuration.
AGI-Eval (Meituan)
Building whole projects
Matches
Not in cards
Oct 2025
DesignArena BuilderAI app builders make full-stack web and mobile apps from the same user prompt. Users compare the results and vote for the better one.
DesignArena (Intelligence)
Building whole projects
Votes
Not in cards
DesignArena Mobile BuilderAI app builders make a mobile app from the same user prompt. Users compare the apps and vote for the better one.
DesignArena (Intelligence)
Building whole projects
Votes
Not in cards
DesignArena Proprietary Harness SlidesSlide-making products build a presentation from a user prompt in their own harness. Users compare the decks and vote for the better one.
DesignArena (Intelligence)
Documents and spreadsheets
Votes
Not in cards
DesignArena Speech-to-SpeechVoice models answer spoken input with speech. Users listen to two anonymous replies and vote for the better one.
DesignArena (Intelligence)
Audio understanding and voice
Votes
Not in cards
DrawBenchModels generate images from text prompts that test counting, composition, and other skills. Human raters compare image quality and prompt alignment.
Google Research
Image generation and editing
Votes
Not in cards
May 2022
GenAI-Arena Image EditingModels edit images from user instructions. Anonymous human comparisons determine Elo in this independent vote pool.
TIGER-Lab (University of Waterloo)
Image generation and editing
Votes
Not in cards
Jun 2024
GenAI-Arena Video GenerationModels generate videos from text prompts. Anonymous human comparisons determine Elo in this independent vote pool.
Husky Hold'em BenchModels write Python poker bots and revise them after practice games. Six bots compete at each table, and the tournament tracks average winnings.
University of Washington and Nous Research
Multi-agent games
Matches
Not in cards
Jul 2025
Koala Test SetModels answer user prompts collected for an evaluation of dialogue systems. Human raters compare the quality of model responses.
Berkeley Artificial Intelligence Research
Overall chat quality
Votes
Not in cards
Apr 2023
KradleVerseAgent harnesses compete in a live Minecraft arena.
KradleVerse
Video games
Matches
Not in cards
Jan 2026
Labelbox Speech Generation v2Models generate speech from text. Human raters compare the outputs for quality and naturalness.
Large Language Model Football LeagueModels draft, trade, and set weekly NFL lineups. Each team earns one result against its opponent and another against the league median.
Recreation Instruments
Multi-agent games
Matches
Not in cards
Sep 2026
LeWitt-BenchImage models interpret instructions for Sol LeWitt wall drawings. People compare the resulting pictures.
Arcada Labs (Design Arena)
Image generation and editing
Votes
Not in cards
Oct 2025
LLMBarEvaluator models choose which of two outputs better follows an instruction using gold preference labels across natural and adversarial cases.
MC-BenchModels write code that builds a Minecraft structure from a prompt. Users vote between two builds without knowing the models.
MC-Bench (Aditya Singh and volunteers)
Spatial reasoning and counting
Votes
Not in cards
Mar 2025
MegaGemThree models bid in sealed auctions with private cards. The benchmark rotates starting hands and fits an Elo-scaled rating to the order in which players finish.
Alex Wa
Multi-agent games
Matches
Not in cards
Jan 2026
Minecraft Bed Wars (YC Labs)Teams of agents play Minecraft Bed Wars against one another. The researchers compare the number of matches each team wins.
YC Labs and Olam Labs
Multi-agent games
Matches
Not in cards
Oct 2026
Model SlantModels write up to 100 words on each of 30 US political issues. US respondents compare anonymous answers and judge their partisan slant.
Polarization Research Lab and Stanford University
Bias, fairness and politics
Votes
Not in cards
May 2025
MTEB ArenaUsers compare retrieval, clustering and similarity results from two anonymous embedding models and vote for the better one.
MTEB community
Other
Votes
Not in cards
Jul 2024
MWAHAHAModels write jokes from word pairs or news headlines in English, Spanish, and Chinese. They also caption animated GIFs in English.
MWAHAHA organizers
Creative writing
Votes
Not in cards
Jul 2025
PartiPromptsModels generate images from English prompts spanning subjects and difficulty types. Human raters compare image realism and fit to the prompt.
Google Research
Image generation and editing
Votes
Not in cards
Jun 2022
PokeAgent ChallengeAgents compete in Pokemon battles under partial observability in a Battling Track and play the Pokemon RPG in a Speedrunning Track that needs long-horizon planning.
Princeton University and collaborators
Video games
Matches
Not in cards
Mar 2026
PPLX Online LLM Human EvaluationModels answer three sets of 50 prompts about helpfulness, factuality and freshness. Contractors compare responses and give a separate overall preference.
Perplexity
Overall chat quality
Votes
Not in cards
Nov 2023
Qwen-Music Text-to-Music GenerationModels turn English or Chinese lyrics and style instructions into complete songs. Music professionals compare anonymized recordings, and automatic judges score the same outputs.
Alibaba Qwen Team
Audio understanding and voice
Votes
Not in cards
Jul 2026
RedTeam ArenaPlayers get 60 seconds to make a model say a target word. An extended Elo ranks players, models and target prompts, with models ranked by resistance.
Arena (formerly LMArena)
Jailbreaks and prompt injection
Matches
Not in cards
Sep 2024
RepoChat ArenaUsers give a GitHub repository link and a question. A retriever model picks files, two answer models reply, and users vote for the better answer.
Arena (formerly LMArena)
Fixing real repositories
Votes
Not in cards
Jan 2025
RoboColosseumPhysical robots execute fresh instructions in paired blind trials. Human evaluators choose the better run or a tie, and comparisons determine ratings for each embodiment.
RoboColosseum consortium
Real robots
Votes
Not in cards
Nov 2026
SAM 3D Objects human preference evaluationModels reconstruct objects from images of real scenes. People compare the shape and texture of competing reconstructions, including objects seen from an egocentric viewpoint.
Meta
Spatial reasoning and counting
Votes
Not in cards
Nov 2025
SAM Audio-BenchModels isolate a requested sound from an audio mixture using text, visual, or temporal prompts. Listeners judge how well the output preserves the target.
Meta
Audio understanding and voice
Votes
Not in cards
Dec 2025
Slop ArenaSite collecting writing-preference data to tune slop detection to a user's taste, paired with the slop-guard tool.
Taste and style
Votes
Not in cards
Mar 2026
Strategy BenchModels compete in six social deduction and strategy game environments.
TextArenaCollection of competitive text games for LLM eval and RL, with an online Elo leaderboard.
TextArena
Multi-agent games
Matches
Not in cards
Apr 2025
TGVE+plusModels follow video editing instructions on the original 76 TGVE videos. The extension adds object removal, object addition, and texture changes.
The AI Teacher TestModels reply to students in English lessons. People compare pairs of replies for teacher-like language, understanding, and helpfulness.
Anaïs Tack and Chris Piech, Stanford University
Other professions
Votes
Not in cards
May 2022
UI-BenchAI website builders generate sites from 30 text prompts. Experts compare paired sites without seeing the builder names. A TrueSkill-derived model converts preferences into ratings with confidence intervals.
AfterQuery
Web and app front ends
Votes
Not in cards
Aug 2025
VISTImage models generate a new image in a reference brand style. Human evaluators compare pairs of outputs.
Toloka
Image generation and editing
Votes
Not in cards
Dec 2025
VOX-DUBDubbing systems speak translated lines in the original speaker’s voice. Listeners compare pairs of recordings on five aspects of dubbing quality.
Toloka
Speech recognition and translation
Votes
Not in cards
Sep 2025
Web UI BenchMany models build the same 12 app UIs from one shared prompt. Outputs are shown side by side for people to compare. No automatic score.
Eric Zakariasson (Cursor)
Taste and style
Votes
Not in cards
May 2026
WildArtifactBenchAgents produce real deliverables in any format, from audio analysis and medical video reads to 3D meshes and kitchen layouts. Human and agent judges compare them with a baseline agent's work to give win rates and Elo.
Meta (Meta Superintelligence Labs)
Tasks from real jobs
Votes
Not in cards
Aug 2026
Yupp VIBE ScorePeople use Yupp for real tasks, see answers from two or more models, and pick the one they prefer. The preferences become VIBE scores for each model.
Yupp (Ber Sarai Labs)
Overall chat quality
Votes
Not in cards
Jun 2025
Arena leaderboards
Top five in the largest arena from each of the 93 makers. Some makers run many arenas, so we show one each here. Their names link to every arena they run.
Models play chess by continuing game notation or by reasoning from the board and legal moves. The organizer maintains separate Elo ratings for each mode.
Two language models each steer a snake on a shared board in a turn-based game, and the one that survives longest wins. Ratings come from many head-to-head games.
Models play chess in multi-turn dialogs against a random player or the Komodo Dragon engine. The board reports wins, Elo and game duration, which tracks instruction following.
Models get the rules of a strategy game and write a program that plays it. DuelLab checks and builds each program, then runs head-to-head matches between programs from different models. Match outcomes become per-game scores from 0 to 100 and a Bradley-Terry ranking, with no human or model judge.
Language models turn text or image prompts into voxel structures. Voters compare anonymous builds from the same prompt, and Glicko-2 ratings rank the models.
Prolific participants, stratified across 22 demographic groups in the US and UK, hold multi-turn conversations with two anonymous models on topics they choose. They compare the models overall and on dimensions such as trust, ethics and safety. A hierarchical Bradley-Terry-Davidson model turns the votes into ratings, adjusted to census data.
Models write three chapters for each of 20 genres. The overall score weights blind reader preferences at 60 percent and model judges’ craft scores at 40 percent.
No-limit hold’em tournaments with table talk, where people and anonymized models share a table. Models are ranked by a rating fit on who finished ahead at each table.
Several agents each run a vending machine at the same location in the Vending-Bench 2 environment. They can email, pay and trade with each other, but each is scored on its own money balance.
Models play multi-turn roleplay scenes. Readers compare transcripts in separate standard and adult tracks. The ratings start from model judges’ assessments of writing quality.
Models draft six level 50 Pokémon, select three for each match, and choose their moves. The organizer rates them on wins under Champions singles rules.
Models play the social deduction game Blood on the Clocktower (the Trouble Brewing script) in mirrored pairs of games. In each match one model plays good and the other evil, and then they swap. A coded Storyteller runs the game, and a Bradley–Terry fit over all matches gives ratings where 1500 is average.
Models play full games of Civilization V with the Vox Populi mod against each other on matched maps and seeds. Pairwise skill ratings rank long-term strategy.
Four models trade resources, build settlements, and negotiate in public or private messages. Final victory points determine pairwise results for the Bradley-Terry rating.
Models play standard chess and Chess960 against fixed engine opponents without a list of legal moves. The organizer fits separate ratings for each variant.
Users give a task, two agents built from different models, tools and frameworks run it, and users vote. A Bradley-Terry extension rates models, tools and frameworks.
Models create coding problems with integer answers and repeatedly solve their own problems to qualify. Tournament entrants solve one another’s problems and receive TrueSkill ratings.
Professional designers vote blind between two models’ designs for the same real client brief from Contra’s marketplace, such as a marketing site. Models are ranked by Elo from the votes.
Agents play competitive Pokémon doubles with assigned teams. They choose four Pokémon, select two leads, and choose actions for both active Pokémon each turn.
Models draw pictures using plain text characters. Readers compare two anonymous drawings for the same prompt. The leaderboard estimates ratings from their votes.
Models draft NFL players, set lineups, and negotiate trades using the same prompt and tools. The organizer compares points, lineup efficiency, and cost per point.
Models write Blender or three.js programs that build explorable 3D scenes. Voters compare the resulting scenes in a browser without seeing the model names.
Models play poker, Gomoku, and Connect Four through the same interface. The overall leaderboard averages each model’s finishing position across five head-to-head contests.
Models play the social deduction game Blood on the Clocktower (the Trouble Brewing script) against each other, with a scripted Storyteller. One model takes every good seat and another every evil seat, so each game tests one model's detection of the Demon against another's deception. A Bradley–Terry fit turns 386 games into Elo ratings.
Ten models play the social deduction game Blood on the Clocktower together, one seat each, over 300 ten-player games of the Trouble Brewing script. Each model plays 210 games on the good team and 90 on the evil team. The score is the share of games its team won.
Users chat with two anonymous models side by side, mostly in Chinese, and vote for the better answer. A Bradley-Terry model turns the votes into Elo-style ratings.
Models draft NFL players, set lineups, bid for free agents, and trade under the same rules. The standings show wins, fantasy points, and lineup efficiency.
Ten frontier agents each post-train the same Nemotron base model on a shared GPU cluster for six days. People then rank the resulting models in blind side-by-side votes, and agents retrain on that feedback.
Users of Scale's Playground app chat with a model and sometimes compare its reply with a random opponent's reply. Scale ranks models with a Bradley-Terry model that controls for length and formatting. Rankings can be split by region, profession and age.
Agents build playable 3D browser games from specifications and reference images. Players compare anonymous game pairs. The authors also test functionality and playability.
Code agents write programs that play board and card games in repeated tournaments. Between rounds they refine their code through self-reflection and by studying rivals' code. Scores are average ranks that separate first-round skill from improvement.
Models play no-limit Texas Hold’em from partial observations of cards, chip stacks, and recent actions. Repeated matches measure chip gains, with invalid actions receiving one retry before an automatic fold.
Models improve a beginner mahjong bot during two timed coding periods. The maker runs the finished bots in four-player matches and reports mean placement by table.
Models play Tetris head-to-head in the original benchmark. The Harbor strategy track grades an agent-written JavaScript placement function on 20 fixed piece sequences.
Agents in an offline sandbox turn a written brief into an interactive three.js scene. A recruited human panel votes on blind pairs, and votes become Elo ratings.
Clinical AI systems answer 620 questions from practicing physicians across 30 specialties. Specialists compare anonymous answers for accuracy, utility, source quality, completeness and verifiability.