Benchmark Almanac

Arenas

We track 328 arenas and match leagues, with the last one added on November 20th. Benchmarks, where models are scored against fixed answers, can be found here. Have an arena that you want us to track? Let us know here.

229 with a leaderboard here Scores refreshed November 21st, 2026
328 arenas
LMArena (Elo) People chat with two anonymous models side by side and vote for the better reply. Votes become Elo-style ratings for each model. Arena (formerly LMArena) Overall chat quality Votes Fading Gemini 4 Carbon 1,527 345 May 2023 Nov 2026
Dubesor AI Chess Leaderboard Models play chess by continuing game notation or by reasoning from the board and legal moves. The organizer maintains separate Elo ratings for each mode. Dubesor Multi-agent games Matches Not in cards Gemini 4 Neon 1,907 250 Mar 2025 Nov 2026
SnakeBench Two language models each steer a snake on a shared board in a turn-based game, and the one that survives longest wins. Ratings come from many head-to-head games. ARC Prize Foundation (Greg Kamradt) Multi-agent games Matches Not in cards GPT-5.5 39 201 Feb 2025 Nov 2026
DesignArena Website Models build a complete website as one HTML file from a real user prompt. Users compare the rendered pages and vote for the better one. DesignArena (Intelligence) Web and app front ends Votes In use Muse Wonder 1,375 162 Nov 2026
DesignArena Game Dev Models build a playable browser game as a single HTML file from a real user prompt. Users play the games and vote for the better one. DesignArena (Intelligence) Web and app front ends Votes In use GPT-6 Astra 1,465 154 Nov 2026
DesignArena Code Users give a prompt, and anonymous models each build a website, UI component, browser game, data visualization or 3D scene as one HTML file. Users vote, and votes become Bradley-Terry ratings. DesignArena (Intelligence) Web and app front ends Votes Not in cards GPT-6 Astra 1,393 153 Jul 2025 Nov 2026
DesignArena UI Component Models build one interface component as a single HTML file from a real user prompt. Users compare the rendered components and vote for the better one. DesignArena (Intelligence) Web and app front ends Votes Not in cards GPT-6 Astra 1,395 149 Nov 2026
DesignArena 3D Design Models build an interactive 3D scene that runs in the browser as a single HTML file. Users explore the scenes and vote for the better one. DesignArena (Intelligence) Web and app front ends Votes In use GPT-6 Astra 1,535 144 Nov 2026
Vision Arena People send an image with a prompt, compare answers from two anonymous vision-language models, and vote for the better one. Votes become Bradley-Terry ratings. Arena (formerly LMArena) General visual questions Votes Not in cards Claude Fable 5 1,309 138 Jun 2024 Oct 2026
Code Arena v2 Models act as coding agents that build web apps from user prompts, and users vote between two results. Votes yield Elo-style ratings. Arena (formerly LMArena) Web and app front ends Votes In use Claude Fable 5.2 1,826 131 Nov 2025 Nov 2026
DesignArena Data Visualization Models turn a user prompt and its data into an interactive visualization as a single HTML file. Users compare the rendered charts and vote. DesignArena (Intelligence) Data science and SQL Votes Not in cards Claude Opus 5.5 1,386 126 Nov 2026
LLM Chess Models play chess in multi-turn dialogs against a random player or the Komodo Dragon engine. The board reports wins, Elo and game duration, which tracks instruction following. Maxim Saplin Puzzles and chess Matches Not in cards GPT-6 Astra 1,614 123 Sep 2024 Nov 2026
DesignArena SVG Models write SVG code for a design request such as an icon, logo, badge or illustration. Users compare the rendered graphics and vote. DesignArena (Intelligence) Web and app front ends Votes Not in cards GPT-6 Astra 1,420 110 Oct 2026
StudyArena Text Models produce text responses to user prompts. Anonymous human comparisons determine the published rating in this separate vote pool. StudyArena Overall chat quality Votes Not in cards LongCat-2.0 1,375 86 Oct 2026
DesignArena ASCII Art Models draw a requested picture using only text characters. Users compare the ASCII art and vote for the better one. DesignArena (Intelligence) Creative writing Votes Not in cards Gemini 4 Hydrogen 1,457 82 Nov 2026
MineBench Models turn a prompt into a Minecraft-style voxel build as raw 3D coordinates or tool calls. Users compare builds blind, and votes become rankings. Ammaar Alam Spatial reasoning and counting Votes Not in cards GPT-6 Astra Pro 2,169 81 Jan 2026 Nov 2026
DesignArena Agentic Overall Coding agents build apps, games, slides and spreadsheets from user prompts. Users compare the results, and votes from every agent board form one rating. DesignArena (Intelligence) Building whole projects Votes Not in cards Claude Opus 5.5 1,443 80 Nov 2026
LMArena Text-to-Image Arena Image generation models answer the same user prompt side by side and anonymously. Community votes between the two images give Elo-style ratings. Arena (formerly LMArena) Image generation and editing Votes Not in cards GPT-Image-2.5 Sunburst 1,428 79 Dec 2024 Nov 2026
Arena Expert Experts compare model answers to questions drawn from their professional work. Arena ranks models from their votes. Arena Expert-written questions Votes Not in cards DeepSeek-V3.2-Exp 1,143 64 Nov 2025 Sep 2025
Step Race Several models talk in public, then secretly pick moves in a race where colliding moves cancel. The game tests cooperation and deception. Lech Mazur Multi-agent games Matches Not in cards GPT-5 5 59 Jan 2025 Dec 2025
Agent Arena Arena ranks models as the orchestrator in real Agent Mode sessions on arena.ai. Scores use behavioral signals such as file downloads, disapproval events, retries and steerability. Arena (formerly LMArena) General assistants Votes In use Claude Fable 5.2 28.6% 58 Jun 2026 Nov 2026
DesignArena React Native Models build cross-platform mobile apps in React Native from real user prompts. Users compare the running apps and vote for the better one. DesignArena (Intelligence) Building whole projects Votes Not in cards Claude Fable 5.2 1,318 58 Nov 2026
LLM Debate Benchmark Models debate an opponent over multiple rounds. Judges compare the arguments. Lech Mazur Multi-turn conversation Matches Not in cards Claude Fable 5.1 1,706 58 Nov 2026
LMArena Image Edit Arena Image editing models apply the same user edit request to the same image, anonymously and side by side. Community votes give Elo-style ratings. Arena (formerly LMArena) Image generation and editing Votes Not in cards GPT-Image-2.5 Sunburst 1,519 58 Jun 2025 Nov 2026
DuelLab GameBench 2 Models get the rules of a strategy game and write a program that plays it. DuelLab checks and builds each program, then runs head-to-head matches between programs from different models. Match outcomes become per-game scores from 0 to 100 and a Bradley-Terry ranking, with no human or model judge. DuelLab (independent project, Budapest) Multi-agent games Matches Not in cards Claude Fable 5.2 99.2 56 Jul 2026 Nov 2026
Elimination Game Models play a multi-player game of public and private talk, alliances and votes to eliminate each other. A jury of eliminated players picks the winner. Lech Mazur Multi-agent games Matches Not in cards GPT-5.2 8 56 Feb 2025 Dec 2025
VoxelBench Language models turn text or image prompts into voxel structures. Voters compare anonymous builds from the same prompt, and Glicko-2 ratings rank the models. VoxelBench Spatial reasoning and counting Votes Not in cards GPT-6.1 Sol 2,607 56 Sep 2025 Oct 2026
Image-to-WebDev Arena Users upload a screenshot, wireframe or mockup, two anonymous models build the website in Code Arena, and users vote for the better result. Votes become ratings with bootstrapped confidence intervals. Arena (formerly LMArena) Web and app front ends Votes Not in cards Claude Opus 5.5 1,756 55 Apr 2026 Nov 2026
DesignArena Frontend Web App Coding agents build multi-file React frontends from real user prompts. Users compare the running apps and vote, and the run logs record agent behavior. DesignArena (Intelligence) Web and app front ends Votes In use GPT-6 Astra 1,360 53 Nov 2026
DesignArena Image to HTML Models recreate a reference image or mockup as a working single-file HTML website. Users compare the rendered pages and vote for the closer, better one. DesignArena (Intelligence) Web and app front ends Votes Not in cards GPT-6 Astra 1,300 53 Nov 2026
DesignArena Image Image models generate a picture from a user prompt. Users compare two anonymous images and vote for the better one. DesignArena (Intelligence) Image generation and editing Votes Not in cards GPT-Image-2.5 Sunburst 1,381 52 Nov 2026
HUMAINE Prolific participants, stratified across 22 demographic groups in the US and UK, hold multi-turn conversations with two anonymous models on topics they choose. They compare the models overall and on dimensions such as trust, ethics and safety. A hierarchical Bradley-Terry-Davidson model turns the votes into ratings, adjusted to census data. Prolific Overall chat quality Votes Not in cards Gemini 3.1 Pro 35 51 Sep 2025 Jul 2026
DesignArena Full Stack Coding agents build complete React apps with sign-in, databases and backend code from real user prompts. Users try the apps and vote for the better one. DesignArena (Intelligence) Building whole projects Votes Not in cards Claude Fable 5.2 1,400 50 Nov 2026
DesignArena PDF Agents build a PDF document from a user prompt. Users compare the two documents and vote for the better one. DesignArena (Intelligence) Documents and spreadsheets Votes Not in cards Claude Fable 5.2 1,346 48 Nov 2026
DesignArena Logo Image models design a logo from a user prompt. Users compare two anonymous logos and vote for the better one. DesignArena (Intelligence) Image generation and editing Votes Not in cards GPT-Image-2 1,365 47 Feb 2026
LLM Chess Arena (Louis Guichard) Models play each other from a text diagram, piece locations, and recent moves. A model forfeits after three failed attempts to make a legal move. Louis Guichard Multi-agent games Matches Not in cards Gemini 3.5 Flash 1,495 47 Aug 2025 Jul 2026
DesignArena Android (Kotlin) Models build native Android apps in Kotlin from real user prompts. The apps run in an Android emulator, and users compare them and vote. DesignArena (Intelligence) Building whole projects Votes Not in cards Claude Opus 5.5 1,390 46 Oct 2026
DesignArena Graphic Design Image models make a graphic design piece from a user prompt. Users compare two anonymous designs and vote for the better one. DesignArena (Intelligence) Image generation and editing Votes Not in cards GPT-Image-2.5 Sunburst 1,436 46 Feb 2026
LMArena Text-to-Video Arena Video generation models make clips from the same text prompt, anonymously and side by side. Votes from logged-in users give Elo-style ratings. Arena (formerly LMArena) Video generation Votes Not in cards Gemini Omni 1.2 Flash 1,540 46 Jan 2026 Nov 2026
LMArena Image-to-Video Arena Video generation models animate the same input image with the same prompt, anonymously and side by side. Votes give Elo-style ratings. Arena (formerly LMArena) Video generation Votes Not in cards Gemini Omni 1.2 Flash 1,503 45 Jan 2026 Nov 2026
Game Arena Four in a Row Language models play a Connect Four style game and try to line up four of their tokens before the opponent does. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 4 Carbon 1,003 43 Feb 2026 Nov 2026
Game Arena Chess Language models play full chess games against each other with the board given as FEN and PGN text. Ratings come from many games between each pair. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 4 Carbon 1,646 42 Aug 2025 Nov 2026
Kaggle Game Arena Language models play each other in board, card and word games through a text harness. One leaderboard ranks models across all Game Arena games. Kaggle and Google DeepMind Multi-agent games Matches Not in cards Gemini 4 Carbon 638 42 Aug 2025 Nov 2026
Game Arena Checkers Language models play American checkers against each other, with forced jumps and crowned kings. Ratings come from head-to-head games. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 4 Carbon 1,382 41 Jun 2026 Nov 2026
Game Arena Dark Hex Language models play Hex without seeing the opponent's stones, so they must probe cells to learn the hidden board while building a path. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 3.8 Flash 581 41 Jun 2026 Nov 2026
DesignArena Spreadsheet Agents build spreadsheets such as financial models, budgets and trackers as Excel or CSV workbooks. Users compare accuracy, structure and formatting and vote. DesignArena (Intelligence) Documents and spreadsheets Votes Not in cards Claude Fable 5.2 1,429 40 Nov 2026
Document Arena People upload their own PDFs with a question, compare answers from two anonymous models, and vote for the better one. Votes become Bradley-Terry ratings. Arena (formerly LMArena) Reasoning over long documents Votes Not in cards Claude Fable 5 1,500 40 Mar 2026 Sep 2026
Game Arena Dots and Boxes Language models take turns drawing lines between dots on a grid. Closing the fourth side of a box claims it. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Claude Fable 5.2 1,393 40 Jun 2026 Nov 2026
Game Arena Word Association Teams of language models give one-word clues and guess linked words, in a game like Codenames, against an opposing team. Kaggle and Google DeepMind Multi-agent games Matches Not in cards Gemini 4 Carbon 734 40 May 2026 Nov 2026
LMArena Search Arena People compare answers from two anonymous search-augmented models on their own questions and vote for the better one. Votes become Bradley-Terry ratings. Arena (formerly LMArena) Deep research Votes Fading GPT-5.6 Sol 1,255 39 Apr 2025 Sep 2026
Game Arena Bargaining Two language models negotiate how to split a pool of items, each with private item values. Each side tries to reach a good deal without giving away its values. Kaggle and Google DeepMind Multi-agent games Matches Not in cards Gemini 4 Carbon 317 39 Jul 2026 Nov 2026
Game Arena Clobber Language models play Clobber, where every move captures an adjacent enemy stone. The player who makes the last legal move wins. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 4 Carbon 819 39 Jun 2026 Nov 2026
Game Arena Coin Game Two language models move on a grid and pick up coins. Each should collect the coins that score for it and avoid the rest. Kaggle and Google DeepMind Multi-agent games Matches Not in cards GPT-5.5 514 39 Jul 2026 Nov 2026
Game Arena Go Language models play Go against each other through the Game Arena text harness. Ratings come from head-to-head games. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Claude Fable 5.2 1,877 39 Sep 2026 Nov 2026
Game Arena Lines of Action Language models play Lines of Action, where a piece moves as far as the number of pieces on its line. The goal is to join all of one's pieces into one group. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 4 Carbon 1,274 39 Jul 2026 Nov 2026
Game Arena Nine Men's Morris Language models play Nine Men's Morris. Forming a row of three, called a mill, lets a player remove one of the opponent's pieces. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 4 Carbon 1,190 39 Aug 2026 Nov 2026
Game Arena Reversi Language models play Reversi, also called Othello, flipping the opponent's disks that they flank in a line. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 4 Carbon 1,306 39 Aug 2026 Nov 2026
Game Arena Ultimate Tic-Tac-Toe Language models play nine linked tic-tac-toe boards. Each move decides which small board the opponent must play next. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 4 Carbon 720 39 Jul 2026 Nov 2026
Game Arena Word Art Language models take turns drawing a word as ASCII art and guessing what the other model drew. Kaggle and Google DeepMind Multi-agent games Matches Not in cards Gemini 4 Carbon 2,528 39 Aug 2026 Nov 2026
LMArcade Agents build browser games from the same prompt. Players try two games and vote before learning which models and coding tools made them. AfterQuery Web and app front ends Votes Not in cards Claude Fable 5 1,798 38 Jul 2026 Jul 2026
DesignArena Python-PPTX Slides Agents build PowerPoint decks with python-pptx from a user prompt. Users compare narrative, visual design and structure and vote for the better deck. DesignArena (Intelligence) Documents and spreadsheets Votes Not in cards Claude Opus 5.5 1,377 37 Nov 2026
Fiction Bench (Story Hacker) Models write three chapters for each of 20 genres. The overall score weights blind reader preferences at 60 percent and model judges’ craft scores at 40 percent. Story Hacker AI Creative writing Votes Not in cards GPT-6.2 Astra 73.6 36 Oct 2026 Nov 2026
Multi-Agent Arena Social Poker No-limit hold’em tournaments with table talk, where people and anonymized models share a table. Models are ranked by a rating fit on who finished ahead at each table. Olam Labs Multi-agent games Matches Not in cards Claude Fable 5 1,553 34 Jul 2026 Sep 2026
SciArena Researchers ask scientific literature questions and vote between two models' long cited answers. Votes give Elo ratings. Yale NLP and Allen Institute for AI Science questions Votes Not in cards o3 1,151 34 Jul 2025 Dec 2025
DesignArena Code to Video Agents write code that renders a video from a user prompt. Users compare the two videos and vote for the better one. DesignArena (Intelligence) Video generation Votes Not in cards Claude Fable 5.2 1,454 33 Nov 2026
DesignArena Image to Frontend Coding agents turn a reference image into a multi-file frontend web app. Users compare the running apps and vote for the better one. DesignArena (Intelligence) Web and app front ends Votes Not in cards Gemini 4 Argon 1,299 33 Oct 2026
Mana RP Bench Models write the next turn in a player’s story. The player sees two anonymous responses and chooses which one becomes part of the story. Mana Creative writing Votes Not in cards MiMo-V2.6 Pro 1,280 32 Oct 2026
SuperCLUE Arena Web Coding Models implement web interfaces. The arena ranks systems from pairwise comparisons. SuperCLUE Web and app front ends Matches Not in cards Qwen3.8 Max (0902) 1,462 32 Oct 2026
Vending-Bench Arena Several agents each run a vending machine at the same location in the Vending-Bench 2 environment. They can email, pay and trade with each other, but each is scored on its own money balance. Andon Labs Simulated companies Matches Not in cards Gemini 4 Carbon $15,962 32 Nov 2025 Oct 2026
Game Arena Poker Language models play heads-up no-limit Texas Hold'em against each other. Models are ranked by mean big blinds won per 100 hands. Kaggle and Google DeepMind Multi-agent games Matches Not in cards GPT-5.6 Sol 30.3 31 Feb 2026 Sep 2026
PlotPoints Round 3: Multi-Turn Arena Models play multi-turn roleplay scenes. Readers compare transcripts in separate standard and adult tracks. The ratings start from model judges’ assessments of writing quality. Plotlight Studios Creative writing Votes Not in cards MiniMax-M3 1,623 30 Jun 2026 Jun 2026
Rotom Champ Bench Models draft six level 50 Pokémon, select three for each match, and choose their moves. The organizer rates them on wins under Champions singles rules. The RotomArena Team Multi-agent games Matches Not in cards Gemini 4 Argon 2,304 30 Oct 2026 Oct 2026
DesignArena Agentic Game Dev Coding agents build multi-file games from a user prompt. Users play the final games and vote, and the logs keep tool calls, retries and failures. DesignArena (Intelligence) Building whole projects Votes Not in cards Claude Opus 5.5 1,408 29 Sep 2026
StudyArena Image Models produce image responses to user prompts. Anonymous human comparisons determine the published rating in this separate vote pool. StudyArena Image generation and editing Votes Not in cards GPT-Image-2.5 Flare 1,284 29 Nov 2026
DesignArena HTML Slides Agents write a self-contained HTML slide deck that is converted to PPTX. Users compare the decks and vote for the better one. DesignArena (Intelligence) Documents and spreadsheets Votes Not in cards GPT-6 Astra 1,531 28 Oct 2026
FlagEval Arena Models answer the same prompt anonymously. Users compare their responses, and the leaderboard estimates a rating from the votes. Beijing Academy of Artificial Intelligence Overall chat quality Votes Not in cards o4-mini 1,134 28 Sep 2025
DesignArena Godot Game Dev Coding agents build complete Godot projects with GDScript, scenes and generated assets, exported to run in the browser. Users play the games and vote. DesignArena (Intelligence) Building whole projects Votes Not in cards GPT-6 Astra 1,315 26 Sep 2026
Kaggle Pelican Arena Models draw a pelican riding a bicycle in SVG. The arena checks whether each drawing renders and asks people to compare the passing entries. Kaggle Web and app front ends Votes Not in cards Gemini 4 Neon 1,816 26 Oct 2026 Nov 2026
PACT Two models bargain over 20 rounds as buyer and seller, each with a hidden private value. Matches across many pairings rank the models. Lech Mazur Multi-agent games Matches Not in cards GPT-5.5 1,607 26 Jul 2025 Jun 2026
Estonian AI Barometer Models answer a visitor’s prompt in Estonian. The visitor compares two anonymous replies and votes before seeing which models wrote them. University of Tartu, Tallinn University of Technology, Tallinn University, and Institute of the Estonian Language Chat and instructions in many languages Votes Not in cards Gemini 3 Flash 1,653 25 May 2025 Dec 2025
Joke Arena Models write jokes. Pairwise votes determine the published Arena rating. Kaggle Creative writing Votes Not in cards Kimi K3 1,585 25 Oct 2026
Kaggle SVG Arena Models draw SVG images from 120 prompts across twelve categories. Submissions must render and satisfy the drawing rule for the prompt. Votes determine the arena rating. Kaggle Web and app front ends Votes Not in cards Claude Opus 5.5 1,699 25 Oct 2026 Oct 2026
Ramen Bench Agents draw an interactive bowl of vegan ramen in one HTML file. Static checks verify the constraints and visitors rate the rendered pages. Stephen Benjamin Web and app front ends Votes Not in cards Claude Opus 5 5 24 Nov 2026 Nov 2026
Clocktower Radio Models play the social deduction game Blood on the Clocktower (the Trouble Brewing script) in mirrored pairs of games. In each match one model plays good and the other evil, and then they swap. A coded Storyteller runs the game, and a Bradley–Terry fit over all matches gives ratings where 1500 is average. Che Jami Multi-agent games Matches Not in cards GPT-5.5 1,708 23 Mar 2026 Oct 2026
DesignArena Image Editing Image models edit a user image following a text instruction. Users compare the two edits and vote for the better one. DesignArena (Intelligence) Image generation and editing Votes Not in cards GPT-Image-2.5 Sunburst 1,368 23 Nov 2026
Corp Speak Arena Models rewrite text in corporate language. Pairwise votes determine the published Arena rating. Kaggle Taste and style Votes Not in cards Claude Opus 5 1,723 22 Sep 2026
Game Arena Four-in-a-Row (Generality) Models place pieces on any empty square of a four by nine grid. Four in a line wins. The tournaments use different board encodings. Generality, Inc. Multi-agent games Matches Not in cards GPT-5 92.0 22 Nov 2025
ArtifactArena Models design robot bodies, controllers and strategy for a simulated sumo-style arena. Artifacts fight head-to-head and models get Elo ratings. MIT CSAIL + MIT Media Lab + NYU + UCSF Simulated robots Matches Not in cards GPT-6 Astra 1,539 21 Sep 2026 Sep 2026
CivBench Models play full games of Civilization V with the Vox Populi mod against each other on matched maps and seeds. Pairwise skill ratings rank long-term strategy. Vox Deorum Video games Matches Not in cards GLM-5.3 1,634 21 Oct 2026 Oct 2026
SettlerBench Season One Four models trade resources, build settlements, and negotiate in public or private messages. Final victory points determine pairwise results for the Bradley-Terry rating. Sam Donahue and SettlerBench contributors, Synopticon Research Multi-agent games Matches Not in cards GPT-6 Astra 1,270 21 Oct 2026 Sep 2026
AI Diplomacy Models play the board game Diplomacy against each other, one power each. They negotiate, form alliances and betray each other in written messages. Good Start Labs (Alex Duffy) Multi-agent games Matches Not in cards Gemini 3 Pro 60 20 Feb 2025 Nov 2025
DesignArena Video to Website Models watch a reference video and recreate its content as a working single-file HTML website. Users compare the rendered pages and vote. DesignArena (Intelligence) Web and app front ends Votes Not in cards Muse Wonder 1,274 20 Oct 2026
Game Arena Five in a Row Language models play a gomoku-style game and try to line up five of their tokens before the opponent does. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 3.1 Pro 1,131 20 Apr 2026 Jun 2026
Crest Arcade Chess Models play standard chess and Chess960 against fixed engine opponents without a list of legal moves. The organizer fits separate ratings for each variant. Glimmer Index Multi-agent games Matches Not in cards GPT-6.2 Astra 1,758 19 Nov 2026
ELI5 Arena Models explain concepts in simple language. Pairwise votes determine the published Arena rating. Kaggle Overall chat quality Votes Not in cards GPT-5.6 Sol 1,695 19 Sep 2026
SCADBench Models write OpenSCAD code from the same short prompt. Voters rotate two rendered objects and choose which one better fits the prompt. SCADBench CAD models Votes Not in cards Gemini 3.1 Pro 1,685 19 Feb 2026
Agent Arena (Gorilla) Users give a task, two agents built from different models, tools and frameworks run it, and users vote. A Bradley-Terry extension rates models, tools and frameworks. UC Berkeley Gorilla team with LMSYS General assistants Votes Not in cards Llama 3.1-70B 1,045 18 Oct 2024 Sep 2024
ChessBench (MadeByLupu) Models play each other with access to the board, move history and legal moves. The organizer rates each model and thinking setting with Glicko-2. MadeByLupu Multi-agent games Matches Not in cards Gemini 4 Argon 2,170 18 Oct 2026
DesignArena Video Arena Users compare videos from anonymous video generation models for the same prompt and vote for the better one. Votes become Elo ratings. DesignArena (Intelligence) Video generation Votes Not in cards Gemini Omni 1.2 Flash 1,369 18 Nov 2026
Kaggle ASCII Arena Models draw images using text characters. Voters compare the drawings. Kaggle Creative writing Votes Not in cards Gemini 4 Carbon 2,016 18 Oct 2026 Oct 2026
Agent Poker Bench Models play 10-seat no-limit Texas Hold'em tournaments against each other. Chip counts and elimination order feed TrueSkill ratings. Vals AI (with The Graphite Group) Multi-agent games Matches Not in cards GPT-5.2 1,132 17 Jan 2026 Dec 2025
Judge Arena (Atla) Users compare two anonymous model judges that score and critique the same answer. Atla Other Votes Not in cards Llama 3.3 70B Instruct 1,335 17 Nov 2024 Mar 2025
ProxyWar Models write bots for nine games. The harness tests each bot and runs tournaments to measure wins, errors, and decision time. Wenjun Peng, Xinyu Wang, and Qi Wu Multi-agent games Matches Not in cards DeepSeek-R1 39.6% 17 Feb 2026 Jun 2025
SuperCLUE Arena Text to Image Models generate images from text. The arena ranks systems from pairwise comparisons. SuperCLUE Image generation and editing Matches Not in cards GPT-Image-2.5 Flare 1,458 17 Nov 2023
Valyrian Games Coding Challenge Models create coding problems with integer answers and repeatedly solve their own problems to qualify. Tournament entrants solve one another’s problems and receive TrueSkill ratings. Valyrian Tech Competitive programming Matches Not in cards GPT-5 mini 30 17 Sep 2025 Aug 2025
Xbench Measures firsthand X posts about frontier models and coding harnesses. An LLM labels each post's sentiment, aggregated per model per week. Nico Christie (offpolicyinc) Other Votes Not in cards Claude Opus 5.5 75.7 17 Sep 2026 Sep 2026
Multi-Agent Arena Codenames Two teams of anonymized models play the word game Codenames. The board rates the clue giver and the guessers on separate rating scales. Olam Labs Multi-agent games Matches Not in cards GPT-6 Astra 1,535 16 Sep 2026 Sep 2026
Multi-Agent Arena Diplomacy Seven players, people or anonymized models, negotiate and fight over World War I Europe. Models are ranked by their mean share of the sum-of-squares score, where 14.3 is an even split. Olam Labs Multi-agent games Matches Not in cards GPT-6 Astra 37.5% 16 Sep 2026 Oct 2026
Multi-Agent Arena Risk Four commanders, people or anonymized models, trade sealed messages and then attack for territory on a 42-territory map. Models are ranked by their mean share of territory, where 25 is an even split. Olam Labs Multi-agent games Matches Not in cards GPT-6 Astra 38.8% 16 Jul 2026 Sep 2026
Olam Labs Multi-Agent Arena People and anonymized models share a table in social strategy games: Diplomacy, Social Poker, Codenames and Risk. One rating combines every game, fit on who finished ahead of whom at each table. Olam Labs Multi-agent games Matches Not in cards GPT-6 Astra 1,544 16 Jul 2026 Oct 2026
Opening Lines Arena Models write opening lines for stories. Pairwise votes determine the published Arena rating. Kaggle Creative writing Votes Not in cards GPT-6 Astra 1,611 16 Sep 2026
Peer Arena (oddbit.ai) Five models debate for five rounds, then each privately votes for a survivor. The organizer calculates Bradley-Terry ratings from game outcomes. Can Celik Multi-agent games Matches Not in cards GPT-5.1 1,799 16 Dec 2025
Chart Arena Models create charts. Pairwise votes determine the published Arena rating. Kaggle Data science and SQL Votes Not in cards GPT-6 Astra 1,615 15 Oct 2026
Frontier Design Benchmark Professional designers vote blind between two models’ designs for the same real client brief from Contra’s marketplace, such as a marketing site. Models are ranked by Elo from the votes. Contra Labs and BenchFlow Web and app front ends Votes Not in cards Claude Fable 5.2 1,713 15 Nov 2026 Nov 2026
SuperCLUE Arena Image Editing Models edit images in response to instructions. The arena ranks systems from pairwise comparisons. SuperCLUE Image generation and editing Matches Not in cards GPT-Image-2.5 Sunburst 1,308 15
3DCodeArena Models generate 3D assets through code. Human preference votes determine the published Bradley-Terry Elo rating. Google DeepMind + Google Research + University of Southern California CAD models Votes Not in cards Claude Fable 5 1,230 14 May 2026 Jun 2026
BigCodeArena Users ask for code, both models' programs run in a sandbox, and users try the results before voting for the better answer. Votes give Elo ratings. BigCode project (Monash University and collaborators) Function-level problems Votes Not in cards DeepSeek-V3.2-Exp 1,117 14 Oct 2025 Sep 2025
DesignArena Blender Agents build a 3D scene in Blender from a user prompt. Users compare the rendered scenes and vote for the better one. DesignArena (Intelligence) Building whole projects Votes Not in cards Claude Opus 5.5 1,381 14 Oct 2026
DesignArena Image to Video Video models animate a user image into a short video. Users compare two anonymous videos and vote for the better one. DesignArena (Intelligence) Video generation Votes Not in cards MiniMax H3 1,319 14 Nov 2026
Human or AI? (Skills IL) Models write short Hebrew texts on the same assignments as human authors. Readers guess who wrote each text. Skills IL Chat and instructions in many languages Votes Not in cards Gemini 1.0 Pro 44.3% 14 Oct 2026 Oct 2026
Kaggle Explode Arena Models build interactive exploded views of objects in three.js. A submission must render a self contained page where the viewer can separate the parts. Votes determine the arena rating. Kaggle Web and app front ends Votes Not in cards GPT-6 Astra 1,712 14 Oct 2026 Oct 2026
Kaggle Landmark Arena Models recreate named landmarks in three.js. Each submission must render as a self contained web page. Votes determine the arena rating. Kaggle Web and app front ends Votes Not in cards Claude Opus 5.5 1,788 14 Oct 2026 Oct 2026
Landing Page Arena Models create landing pages. Pairwise votes determine the published Arena rating. Kaggle Web and app front ends Votes Not in cards GPT-6.1 Sol 1,694 14 Oct 2026
Pokémon VGC Bench (Ricotoma) Agents play competitive Pokémon doubles with assigned teams. They choose four Pokémon, select two leads, and choose actions for both active Pokémon each turn. Ricotoma Multi-agent games Matches Not in cards GPT-6 Astra 1,901 14 Sep 2026
ASCII Bench (Jason Botterill) Models draw pictures using plain text characters. Readers compare two anonymous drawings for the same prompt. The leaderboard estimates ratings from their votes. Jason Botterill Creative writing Votes Not in cards Gemini 4 Argon 1,948 13 Oct 2026
Code2Video Arena Models create videos through code. Pairwise votes determine the published Arena rating. HeyGen on Kaggle Video generation Votes Not in cards Gemini 4 Carbon 1,598 13 Oct 2026
Game Arena 3 Check Chess (Generality) Models play both colors. A player can win by checking the opposing king three times. A double check counts once. Generality, Inc. Multi-agent games Matches Not in cards o3 27.0 13 Sep 2025
Game Arena Anti Chess (Generality) Models must capture when they can. A player wins by losing every piece or by having no legal move. The king can be captured. Generality, Inc. Multi-agent games Matches Not in cards GPT-5 25.0 13 Sep 2025
Game Arena Crazyhouse Chess (Generality) Models play Crazyhouse chess in both colors. A player can spend a turn placing a captured piece back on the board under its new owner's control. Generality, Inc. Multi-agent games Matches Not in cards GPT-5 26.0 13 Sep 2025
Game Arena Horde Chess (Generality) Models take both sides in turn. White tries to checkmate with 36 pawns. Black starts with the usual pieces and must capture every white pawn. Generality, Inc. Multi-agent games Matches Not in cards GPT-5 24.0 13 Sep 2025
Game Arena King of the Hill (Generality) Models can win by moving their king onto any of the four central squares. The king must reach the square without moving into check. Generality, Inc. Multi-agent games Matches Not in cards GPT-5 24.0 13 Sep 2025
Game Arena Racing Kings (Generality) Models race their kings to the eighth rank without giving check. Black can draw by reaching that rank immediately after White. Generality, Inc. Multi-agent games Matches Not in cards o3 23.5 13 Sep 2025
HEART Humans and models respond to people seeking emotional support. Judges compare responses and explain their preferences. Hippocratic AI Wellbeing and sycophancy Votes Not in cards GPT-5 1,612 13 Jan 2026 Nov 2025
Kaggle Sort Viz Arena Models use Manim to animate sorting algorithms and explain their time complexity. A submission must produce a valid video under the file size limit. Votes determine the arena rating. Kaggle Web and app front ends Votes Not in cards Claude Opus 5.5 1,650 13 Oct 2026 Oct 2026
VoxelBench Image Models turn image prompts into voxel structures. Human comparisons determine Glicko-2 ratings in a separate image-prompt vote pool. VoxelBench Spatial reasoning and counting Votes Not in cards GPT-6.1 Sol 2,215 13 Sep 2025 Sep 2026
Agent-Only Fantasy Football League Models draft NFL players, set lineups, and negotiate trades using the same prompt and tools. The organizer compares points, lineup efficiency, and cost per point. Jake Moses Multi-agent games Matches Not in cards Claude Sonnet 5 1371.4 12 Aug 2026 Aug 2026
LLM 3D Worlds Arena Models write Blender or three.js programs that build explorable 3D scenes. Voters compare the resulting scenes in a browser without seeing the model names. 3d-arena Building whole projects Votes Not in cards GPT-6 Astra 1,253 12 Nov 2026
LLM Fantasy Football Arena Classic Models manage two NFL fantasy teams each. One league allows trades and messages. The other disables both. Each league scores its own draft and season. Wildcard Labs Multi-agent games Matches Not in cards Qwen 3.8 Max 0.90 12 Aug 2026 Sep 2026
OCR Arena Users upload a document, compare two anonymous OCR or vision-language models side by side, and vote. Votes become Elo ratings. Extend Documents, charts and text in images Votes Not in cards Gemini 3 Flash 1,781 12 Nov 2025 Feb 2026
AI Battle Arena Models play poker, Gomoku, and Connect Four through the same interface. The overall leaderboard averages each model’s finishing position across five head-to-head contests. Infini-AI Lab Multi-agent games Matches Not in cards GPT-5.5 88.0 11 Jul 2026 Jun 2026
Clocktower Bench Models play the social deduction game Blood on the Clocktower (the Trouble Brewing script) against each other, with a scripted Storyteller. One model takes every good seat and another every evil seat, so each game tests one model's detection of the Demon against another's deception. A Bradley–Terry fit turns 386 games into Elo ratings. Dwarkesh Patel Multi-agent games Matches Not in cards GPT-6 Astra 1,859 11 Nov 2026 Sep 2026
DesignArena Agentic Image to HTML Coding agents turn a user-uploaded image into a self-contained HTML website. Users compare how well each page reproduces the design and vote. DesignArena (Intelligence) Web and app front ends Votes Not in cards Claude Sonnet 4.6 1,247 11 Apr 2026
DesignArena Audio Realism Bench Voice models produce conversational speech, and users vote on which sounds more real. DesignArena built it because 1 to 5 opinion scores for TTS had saturated. DesignArena (Intelligence) Audio understanding and voice Votes Not in cards Grok TTS 1,181 11 Oct 2026
DesignArena Text-to-Speech Speech models read the same text aloud. Users listen to two anonymous clips and vote for the more natural one. DesignArena (Intelligence) Audio understanding and voice Votes Not in cards Gemini 3.8 Flash TTS 1,476 11 Oct 2026
Floorplan Arena Models furnish hand-drawn room sketches. People compare the layouts and vote for the better floorplan. Kaggle Data science and SQL Votes Not in cards Gemini 4 Carbon 1,807 11 Oct 2026
Game Arena Chess Openings Language models play chess against each other from varied two-move openings sampled from 20 popular human openings. The board is given as text. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 3 Flash 1,263 11 Feb 2026 Dec 2025
LMArena Video Edit Arena Video editing models apply the same edit request to the same clip, anonymously and side by side. Community votes give Elo-style ratings. Arena (formerly LMArena) Video generation Votes Not in cards Wan 3.0 1,424 11 Nov 2026
Bench on the Clocktower Ten models play the social deduction game Blood on the Clocktower together, one seat each, over 300 ten-player games of the Trouble Brewing script. Each model plays 210 games on the good team and 90 on the evil team. The score is the share of games its team won. Tom Taylor and coauthors Multi-agent games Matches Not in cards GPT-5.6 Sol 58% 10 Sep 2026 Jul 2026
CompassArena Users chat with two anonymous models side by side, mostly in Chinese, and vote for the better answer. A Bradley-Terry model turns the votes into Elo-style ratings. OpenCompass (Shanghai AI Laboratory) with ModelScope Overall chat quality Votes Not in cards MiMo-V2.5-Pro 1,062 10 May 2024 Jun 2026
fAIntasy Football Models draft NFL players, set lineups, bid for free agents, and trade under the same rules. The standings show wins, fantasy points, and lineup efficiency. fAIntasy Football Multi-agent games Matches Not in cards Gemini 3.8 Flash 4.00 10 Sep 2026 Sep 2026
FlagEval Debate Models debate a topic in Chinese. The leaderboard estimates their ratings from comparisons and reports uncertainty. Beijing Academy of Artificial Intelligence Overall chat quality Votes Not in cards o1-mini 1,149 10 Sep 2024 Dec 2024
PTCG-Bench Agents play the Pokémon Trading Card Game by choosing legal actions from a partially visible board. Match results determine their Glicko-2 ratings. Zhejiang University and FinVolution Group Multi-agent games Matches Not in cards Gemini 3.1 Pro 1,854 10 May 2026 Apr 2026
RSI Arena Ten frontier agents each post-train the same Nemotron base model on a shared GPU cluster for six days. People then rank the resulting models in blind side-by-side votes, and agents retrain on that feedback. Bake AI Machine learning engineering Votes Not in cards GPT-6 Astra 1,095 10 Sep 2026 Oct 2026
SEAL Showdown Users of Scale's Playground app chat with a model and sometimes compare its reply with a random opponent's reply. Scale ranks models with a Bradley-Terry model that controls for length and formatting. Rankings can be split by region, profession and age. Scale AI Overall chat quality Votes Not in cards GPT-5 Chat 1,113 10 Sep 2025 Aug 2025
WildVision Arena Users upload an image with a question, compare answers from two anonymous vision-language models, and vote. Votes give Elo ratings. Allen Institute for AI and UCSB General visual questions Votes Not in cards Claude 3 Opus 1,100 10 Feb 2024 Apr 2024
Wojak-Bench 3D Models turn the same drawing into a three-dimensional figure. Voters compare two anonymous prints or renders and choose which better matches the drawing. Andon Labs CAD models Votes Not in cards GPT-6.2 Astra 1,273 10 Nov 2026
Voice Arena Hindi Models generate speech in Hindi. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes System cards only Gemini 3.8 Flash TTS 1,097 9 Oct 2026
3D GameDev Arena Agents build playable 3D browser games from specifications and reference images. Players compare anonymous game pairs. The authors also test functionality and playability. Fudan University, Shanghai Innovation Institute, Xi’an Jiaotong University, and Shanghai Jiao Tong University Building whole projects Votes Not in cards Claude Opus 5 99.8% 9 Nov 2026 Sep 2026
Chess Engine Benchmark (Steve Maughan) Models have 24 hours to write a chess engine from scratch in C or C++. Maughan rates each engine against reference engines and other entries. Steve Maughan Building whole projects Matches Not in cards Claude Fable 5.2 3,542 9 Sep 2026 Nov 2026
FantasyFootballBench Models draft players, set weekly lineups, and negotiate trades in a replay of the 2024 NFL season. Actual player statistics determine points and wins. Arya Tschand Multi-agent games Matches Not in cards Claude Opus 4.1 15.0 9 Jul 2025 Sep 2025
Game Arena Atomic Chess (Generality) Models play chess with exploding captures. A capture removes both involved pieces and neighboring pieces other than pawns. Exploding the opposing king wins. Generality, Inc. Multi-agent games Matches Not in cards GPT-5 27.0 9 Aug 2025
GLEE Agents bargain, negotiate, or persuade another player through conversation while pursuing the payoff defined by the game. Eilam Shapira and colleagues Multi-agent games Matches Not in cards Grok 4.6 2,595 9 Oct 2024 Aug 2026
StarSkirmish Bench Each model gets one hour in its lab's own CLI to write a StarCraft: Brood War bot in C++. The score is its win rate against human-written bots. Kai McPheeters Video games Matches Not in cards GPT-6 Astra 57.3% 9 Oct 2026 Oct 2026
Windsurf Arena Mode Leaderboard Developers compare two model responses to the same coding request inside the editor. Their choices determine model Elo ratings. Cognition Fixing real repositories Votes Not in cards Claude Opus 4.6 1,098 9 Feb 2026 Apr 2026
Voice Arena US English Models generate speech in US English. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes System cards only Gemini 3.8 Flash-Lite TTS 1,083 8 Oct 2026
Artificial Turf War Models bid for draft position, pick NFL players, and submit weekly lineups. The league ranks teams by wins and breaks ties with fantasy points. Nate Lorenzen Multi-agent games Matches Not in cards GPT-5.6 Sol 6.00 8 Jul 2026 Aug 2026
BIM Bench Agents draw a timber roof eaves detail in Revit. Reviewers see the exported sheet without the model name and rate its usability from one to five. BIM Bench CAD models Votes Not in cards GPT-6.1 Sol 4 8 Oct 2026
CodeClash Models build and improve their own codebases over many rounds, then compete in arenas such as Halite, poker and BattleSnake. Results give Elo ratings. SWE-bench team (Stanford University and Princeton University) Building whole projects Matches Not in cards Claude Sonnet 4.5 1,385 8 Nov 2025 Sep 2025
CompassArena Multimodal Users compare anonymous multimodal model answers and vote for the better response. A Bradley-Terry model estimates ratings from these votes. OpenCompass (Shanghai AI Laboratory) General visual questions Votes Not in cards Qwen3-VL-235B-A22B-Instruct 1,173 8 Sep 2025
Copilot Arena Developers inside their IDE see paired code completions from two models and pick one. Pairwise votes give an Elo-style ranking of code models. Arena (formerly LMArena) with Carnegie Mellon University Function-level problems Votes Not in cards DeepSeek-V2.5 1,074 8 Nov 2024 Sep 2024
DesignArena Multi-Image to Video Video models compose one video from several reference images. Users compare two anonymous videos and vote for the better one. DesignArena (Intelligence) Video generation Votes Not in cards MiniMax H3 1,329 8 Nov 2026
Game Arena Werewolf Teams of language models play the social deduction game Werewolf in natural language. Villagers must find the hidden werewolves, who try to deceive them. Kaggle and Google DeepMind Multi-agent games Matches Not in cards GPT-5.4 0 8 Feb 2026 Mar 2026
Kaggle Chess Suite Models play chess from the standard starting position and from selected openings. Kaggle publishes both ratings for each model. Kaggle Puzzles and chess Matches Not in cards Gemini 3 Flash 1,238 8 Dec 2025
LLM Games Models play Connect Four against one another. Ramp publishes match scores and final Elo ratings. Ramp Labs Multi-agent games Matches Not in cards GPT-5 1,728 8 Aug 2025
Ludobench Hokm Models play Hokm in partnerships. One player names trump, and partners try to take seven tricks before the other team. Ludobench Multi-agent games Matches Not in cards Claude Haiku 4.5 100% 8 Sep 2026 Sep 2026
Rotom Gen9 Bench Models draft six level 100 Pokémon and play the whole team in Generation 9 OverUsed singles. Match results determine their ratings. The RotomArena Team Multi-agent games Matches Not in cards GPT-6 Luna 2,318 8 Oct 2026 Oct 2026
Voice Arena Arabic MSA Models generate speech in Arabic MSA. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes System cards only Gemini 3.8 Flash TTS 1,192 7 Sep 2026
Voice Arena Brazilian Portuguese Models generate speech in Brazilian Portuguese. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes System cards only Gemini 3.8 Flash-Lite TTS 1,127 7 Sep 2026
Voice Arena Mexican Spanish Models generate speech in Mexican Spanish. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes System cards only Gemini 3.8 Flash TTS 1,138 7 Sep 2026
Voice Arena Vietnamese Models generate speech in Vietnamese. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes System cards only Gemini 3.8 Flash-Lite TTS 1,141 7 Sep 2026
CATArena Code agents write programs that play board and card games in repeated tournaments. Between rounds they refine their code through self-reflection and by studying rivals' code. Scores are average ranks that separate first-round skill from improvement. AGI-Eval (Meituan) Building whole projects Matches Not in cards GPT-5 1,799 7 Oct 2025 Aug 2025
Labelbox Multimodal Reasoning Models interpret images, identify differences, write captions, and reason about spatial relationships. Human raters compare the responses. Labelbox General visual questions Votes Not in cards Claude 3.5 Sonnet 1,220 7 Dec 2024 Mar 2025
Honesty human feedback win rate (Anthropic) Crowdworkers try to make models say something false and pick the more honest reply in head-to-head chats. Score is the win rate against a baseline. Anthropic Hallucination rates Votes System cards only 6 Mar 2024 Feb 2026
Voice Arena Japanese Models generate speech in Japanese. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes System cards only Gemini 3.8 Flash TTS 1,188 6 Sep 2026
AAArena Agents write and revise programs for 12 games. Each program competes against archived human entries under a fixed match budget. AAArena team Multi-agent games Matches Not in cards Claude Opus 5.5 6.00 6 Oct 2026 Sep 2026
Brood War Bench Coding agents play StarCraft: Brood War against each other in real time. Systems are ranked by win rate over matches, with cost per game. Ben Swerdlow Video games Matches Not in cards GPT-6 Astra 100% 6 Sep 2026 Sep 2026
DesignArena Multimodal to Video Video models make a video from a mix of text, images and other inputs. Users compare two anonymous videos and vote for the better one. DesignArena (Intelligence) Video generation Votes Not in cards MiniMax H3 1,305 6 Nov 2026
InteractiveBench Texas Hold’em Models play no-limit Texas Hold’em from partial observations of cards, chip stacks, and recent actions. Repeated matches measure chip gains, with invalid actions receiving one retry before an automatic fold. InteractiveBench and Princeton University Multi-agent games Matches Not in cards Gemini 3 Flash 31.8 6 Mar 2026 Dec 2025
InteractiveBench Trust Game Models choose whether to cooperate or defect in repeated prisoner’s dilemma matches. A round-robin tournament scores average realized payoff per round, with a random stopping rule. InteractiveBench and Princeton University Multi-agent games Matches Not in cards Qwen3-Max 1.87 6 Mar 2026 Dec 2025
Ludobench Backgammon Models play backgammon against opponents using dice rolls and legal moves. Ludobench publishes Glicko-2 ratings and match replays. Ludobench Multi-agent games Matches Not in cards Gemini 3.8 Flash 1,723 6 Sep 2026 Sep 2026
Rapidata Multi-Step Image Editing (Identity Drift) Image editors apply five sequential changes to 199 photographs, and people compare the final faces for identity drift. Rapidata Image generation and editing Votes Not in cards Ideogram 4.5 1,866 6 Nov 2026 Nov 2026
ChangeMyView Models write rebuttals to r/ChangeMyView posts that human raters score for persuasiveness. Scored as percentile against human responses. OpenAI Dangerous capabilities Votes System cards only 5 Sep 2024 Feb 2025
CATArena Gomoku Code agents compete in Gomoku. The public competition board reports Elo Rating for each agent configuration. AGI-Eval (Meituan) Building whole projects Matches Not in cards GPT-5 1,799 5 Oct 2025 Aug 2025
CATArena OIBench-5 Code agents compete in OIBench-5. The public competition board reports Time AUC for each agent configuration. AGI-Eval (Meituan) Building whole projects Matches Not in cards GPT-5 0.40 5 Oct 2025 Aug 2025
CATArena SWE-Perf-10 Code agents compete in SWE-Perf-10. The public competition board reports Time Ratio for each agent configuration. AGI-Eval (Meituan) Building whole projects Matches Not in cards Claude Sonnet 4 1.95× 5 Oct 2025 Aug 2025
CATArena Texas Holdem Code agents compete in Texas Holdem. The public competition board reports Elo Rating for each agent configuration. AGI-Eval (Meituan) Building whole projects Matches Not in cards GPT-5 1,463 5 Oct 2025 Aug 2025
Cooperate to Compete (C2C) Multi-player conquest game with private non-binding negotiation and secret asymmetric objectives. LM agents and humans are ranked by Plackett-Luce player strength from their game results. UC Berkeley Multi-agent games Matches Not in cards Gemini 3.1 Pro 0.74 5 Apr 2026 Mar 2026
DesignArena Video Editing Video models edit a user video following a text instruction. Users compare the two results and vote for the better one. DesignArena (Intelligence) Video generation Votes Not in cards MiniMax H3 1,373 5
Jarvis Bench Voice agents handle conversational tasks. Listeners rate naturalness, and the board reports task effectiveness separately. Voice Arena Speech recognition and translation Votes Not in cards Gemini 3.8 Live 998 5 Sep 2026
K-Sort Arena Users rank outputs from K image or video generation models at once instead of a pair. Bayesian updates turn the rankings into ratings. Li et al. (UC Berkeley and collaborators) Image generation and editing Votes Not in cards GPT-Image-1 31 5 Aug 2024
Labelbox Image Generation v2 Models generate images from text prompts. Human raters compare how well the outputs meet the request. Labelbox Image generation and editing Votes Not in cards GPT-Image-1 1,069 5 Dec 2024 Apr 2025
RIICHI ORBIT mahjong bot comparison (two-stage practice) Two-stage practice Models improve a beginner mahjong bot during two timed coding periods. The maker runs the finished bots in four-player matches and reports mean placement by table. Doui Lab Building whole projects Matches Not in cards GPT-5.6 Sol 2.28 5 Sep 2026 Sep 2026
Harmlessness human feedback win rate (Anthropic) Raters probe models in adversarial chats and pick the more harmless reply in head-to-head comparisons. Score is the win rate against a baseline model. Anthropic Refusing harmful requests Votes System cards only 4 Mar 2024 Oct 2024
Political Persuasion Parallel Generation Human raters pick the more persuasive of two short political social media posts. Scored as win rate against GPT-4o. OpenAI Dangerous capabilities Votes System cards only 4 Sep 2024 Jan 2025
CC-Bench Claude Code runs realistic frontend, backend, tooling and data coding tasks in fresh containers. Humans compare models head-to-head (win rate). Zhipu AI (Z.ai) Building whole projects Votes System cards only Claude Sonnet 4 41.9% 4 Jul 2025 Sep 2025
TetrisBench Models play Tetris head-to-head in the original benchmark. The Harbor strategy track grades an agent-written JavaScript placement function on 20 fixed piece sequences. TetrisBench Video games Matches Not in cards Claude Fable 5 66.7% 4 Jan 2026 Jul 2026
Turing TTS Listeners hear a human recording and a synthesized recording. The score measures how often listeners identify the synthesized recording as human. Voice Arena Speech recognition and translation Votes Not in cards Gemini 3.8 Flash TTS 10.5% 4 Sep 2026
Voice Arena Bahasa Models generate speech in Bahasa. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes Not in cards Gemini 3.8 Flash TTS 1,138 4 Sep 2026
Voice Arena Tagalog Models generate speech in Tagalog. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes Not in cards Gemini 3.8 Flash TTS 1,130 4 Sep 2026
WMArena Video Arena Models generate a video from a starting image and an action. Viewers compare anonymous clips and vote for the more convincing result. WMArena Video generation Votes Not in cards Kling 2.5 Turbo 1,487 4
3DCodeBench Agentic procedural 3D modeling via code: author engine-ready 3D assets through software APIs. Graded for executability and shape fidelity. Google DeepMind + Google Research + University of Southern California CAD models Votes In use 3 May 2026 Nov 2026
AA-3D Agents in an offline sandbox turn a written brief into an interactive three.js scene. A recruited human panel votes on blind pairs, and votes become Elo ratings. Artificial Analysis Web and app front ends Votes In use 3 Oct 2026 Nov 2026
Copilot Arena Code Editing Developers highlight existing code and ask for a change. They choose between two anonymous edits. Arena Fixing real repositories Votes Not in cards Claude 3.5 Sonnet 1,058 3 Jan 2025 Sep 2024
GameAdsBench Models generate video ads for games. Viewers watch two anonymous ads and choose the one they prefer. Video Arena Video generation Votes Not in cards Dreamina Seedance 2.5 1,283 3
GTBench Models play strategic games against other models or scripted opponents. The benchmark measures their advantage in game rewards. GTBench authors Multi-agent games Matches Not in cards GPT-4 0.13 3 Feb 2024 Jan 2024
LLM Colosseum Two models each control a fighter in Street Fighter III and choose moves from text descriptions of the game. Wins give Elo ratings. phospho (OpenGenerativeAI) Video games Matches Not in cards GPT-4o mini 1,835 3 Mar 2024 Jul 2024
Music Arena Users write a music prompt, listen to tracks from two text-to-music systems, and vote. Preferences, listening data and feedback feed a leaderboard. Carnegie Mellon University (G-CLef) with Arena and Sony researchers Audio understanding and voice Votes Not in cards Lyria 3 Pro 1,394 3 Jul 2025 May 2026
Real Point-of-Care Queries Clinical AI systems answer 620 questions from practicing physicians across 30 specialties. Specialists compare anonymous answers for accuracy, utility, source quality, completeness and verifiability. Jean Feng and colleagues, with data collection by OpenEvidence Medicine Votes Not in cards Claude Opus 4.8 -1.50% 3 Jun 2026 May 2026
RoboArena Double-blind pairwise A/B trials of generalist DROID policies on real Franka arms, free-form tasks by volunteer evaluators. Elo-style rating. UC Berkeley + Stanford + UPenn + others Real robots Votes Not in cards π0.5 1,608 3 Jun 2025 Apr 2025
StudyArena Audio Models produce audio responses to user prompts. Anonymous human comparisons determine the published rating in this separate vote pool. StudyArena Audio understanding and voice Votes Not in cards MiniMax Speech 2.8 Turbo 1,216 3 Apr 2026
SuperCLUE Arena Text to Speech Models synthesize speech from text. The arena ranks systems from pairwise comparisons. SuperCLUE Speech recognition and translation Matches Not in cards Gemini 3.8 Flash TTS 1,010 3 Sep 2026
Voice Arena French Models generate speech in French. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes Not in cards Gemini 3.8 Flash TTS 1,084 3 Sep 2026
Voice Arena German Models generate speech in German. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes Not in cards Gemini 3.8 Flash TTS 1,034 3 Sep 2026
Voice Arena Indian English Models generate speech in Indian English. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes Not in cards Gemini 3.8 Flash-Lite TTS 1,066 3 Sep 2026
Human SxS image editing Elo (Google) Google compares edited images side by side and converts human preferences into Elo ratings. Google DeepMind Image generation and editing Votes Fading 2 Feb 2026 Oct 2026
Human SxS image generation Elo (Google) Google compares generated images side by side and converts human preferences into Elo ratings. Google DeepMind Image generation and editing Votes In use 2 Feb 2026 Oct 2026
Hume AI Overall Quality Index Listeners rate generated speech on reliability and expressiveness. The benchmark reports an overall quality index. Hume AI Speech recognition and translation Votes In use 2 Sep 2026 Sep 2026
Red Teaming Network pairwise safety comparison Red teamers compare anonymized responses from two models in free-form risky conversations. Scored as the share of ratings where a model is safer. OpenAI Refusing harmful requests Votes System cards only 2 Dec 2024 Feb 2025
Qwen Chinese human evaluation Three annotators rank chat model answers to 300 Chinese instructions on knowledge, language, writing, math and coding. Results are win rates against GPT-3.5. Qwen Team, Alibaba Group Overall chat quality Votes System cards only 2 Sep 2023 Sep 2023
LLMBoxing People see one question with two anonymous model answers and pick the better one. The site counts preferences between model pairs. llmboxing.com Overall chat quality Votes System cards only Llama 2-70B 22679.0 2 Oct 2023 Oct 2023
Labelbox Video Generation v2 Models generate videos from text prompts. Human raters compare the outputs for visual quality and adherence to the prompt. Labelbox Video generation Votes Not in cards Veo 3 1,268 2 Dec 2024
Music Arena Vocal Models generate music with vocals. Listeners compare anonymous tracks, and separate vocal preference votes determine the Arena score. Carnegie Mellon University (G-CLef) with Arena and Sony researchers Audio understanding and voice Votes Not in cards Lyria 3 Pro 1,107 2 Jul 2025 Mar 2026
TTS Arena Users listen to two anonymous text-to-speech models read the same text and vote for the more natural one. Votes become Elo ratings. TTS-AGI (Hugging Face community) Audio understanding and voice Votes Not in cards MiniMax Speech 2.8 HD 1,552 2 Feb 2024 Jan 2026
Voice Arena Goal Dataset Judges compare two calls and choose which caller achieved the airline task more successfully. Human preferences provide the reference. Voice Arena and collaborators Audio understanding and voice Votes Not in cards Qwen2.5-Omni-7B 64.7% 2 Sep 2026 Mar 2025
Apple side-by-side human evaluation Apple's in-house graders compare two models' responses to locale-specific text and image prompts and pick the preferred one. Results are win, tie and loss fractions per comparison. Apple Overall chat quality Votes Fading 1 Jun 2025 Jun 2026
Cohere enterprise human evaluation Trained annotators blindly compare two models' answers on enterprise tasks such as HR FAQs, technical FAQs and workplace assistants. They judge accuracy, instruction following and style. Results are win, tie and loss rates. Cohere Running a business Votes Dropped 1 Mar 2025 Apr 2025
GenAI-Bench Image generation systems are compared by human side-by-side preference on text-to-image prompts. Google DeepMind Image generation and editing Votes Fading 1 Feb 2026
Hume AI Voice Design Benchmark Listeners rate generated voices for English voice design, multilingual control, accents and voice qualities. Hume AI Speech recognition and translation Votes In use 1 Sep 2026 Sep 2026
Artificial Analysis Speech Arena Voters listen to two speech clips made from the same text and pick the more natural one. Votes become Elo ratings. Artificial Analysis Audio understanding and voice Votes Fading 1 Apr 2026
DeepSeek Chinese functional writing evaluation Models answer 3,170 everyday Chinese writing prompts such as reports, emails and speeches. Pairwise judging against a baseline model gives a win rate. DeepSeek Taste and style Matches System cards only 1 Apr 2026 Apr 2026
DeepSeek Chinese white-collar tasks evaluation Agents complete 30 Chinese professional analysis, document generation and editing tasks across 13 industries. Blind human annotators compare outputs against a baseline model. DeepSeek Documents and spreadsheets Votes System cards only 1 Apr 2026 Apr 2026
DeepSeek complex instruction following and multi-turn writing evaluation Models answer 196 hard Chinese writing prompts with complex constraints or several turns. Pairwise judging against a baseline model gives a win rate. DeepSeek Multi-turn conversation Matches System cards only 1 Apr 2026 Apr 2026
DeepSeek search Q&A evaluation Models answer objective and subjective Chinese search questions with retrieval or agentic search. Pairwise judging gives win, loss and tie rates. DeepSeek Questions that need search Matches System cards only 1 Apr 2026 Apr 2026
Expert Red Teaming for Violent Attack Planning Expert red teamers compare anonymized responses from two models on violent attack planning prompts. Scored as the win rate for being safer. OpenAI Refusing harmful requests Votes System cards only 1 Aug 2025 Aug 2025
Kimi Webdev Bench Models build games, 3D scenes and website clones from real prompts. Blind experts compare two outputs and report win, tie and loss rates. Moonshot AI Web and app front ends Votes System cards only 1 Jul 2026 Jul 2026
MAI human side-by-side evaluation Paid raters compare two models' answers to 1,276 English prompts from experts and Copilot logs on a 7-point scale from -1.5 to 1.5. Microsoft AI Overall chat quality Votes System cards only 1 Jun 2026 Jun 2026
Pairwise Bioweaponization Campaign Red teamers with biology PhDs compare anonymized responses from two models on bioweaponization prompts. Scored as the win rate for being safer. OpenAI Refusing harmful requests Votes System cards only 1 Aug 2025 Aug 2025
Preference on ChatGPT and API prompts Human labelers compare model responses to 5,214 prompts sent to ChatGPT and the OpenAI API. Scored as win rate against a baseline model. OpenAI Overall chat quality Votes System cards only 1 Mar 2023 Mar 2023
Speech Agent Arena People hold live conversations with two hidden speech-to-speech agents on the same scenario, some with tool calls, then pick the one they preferred. Votes are fit to an Elo rating, and the arena also tracks task success. Artificial Analysis Speech recognition and translation Votes In use 1 Aug 2026 Oct 2026
Economics Arena for Large Language Models Models choose numbers in beauty contests and place sealed bids in auctions. Researchers compare payoffs and measure how strategies change when players see previous rounds. Shangmin Guo and colleagues Multi-agent games Matches Not in cards Claude 2 0.95 1 Jan 2024 Jul 2023
GenAI-Arena Users compare outputs from two anonymous models for image generation, image editing and video generation, and vote. Votes give Elo ratings. TIGER-Lab (University of Waterloo) Image generation and editing Votes Not in cards FLUX.1 [dev] 1,133 1 Jun 2024
GenAI-Arena Image Generation Models generate images from text prompts. Anonymous human comparisons determine Elo in this independent vote pool. TIGER-Lab (University of Waterloo) Image generation and editing Votes Not in cards FLUX.1 [dev] 1,133 1 Jun 2024
Speech Arena Models generate speech. Listeners compare outputs, and pairwise votes determine Elo ratings. Speech Arena Audio understanding and voice Votes Not in cards GPT-4o Mini TTS 1,566 1 Mar 2025
Human feedback win rates (Anthropic) Raters chat with two models on tasks such as coding, documents and creative writing and pick the better reply. Score is the win rate. Anthropic Overall chat quality Votes System cards only Jul 2023 Oct 2024
Llama 2-Chat helpfulness human evaluation (Meta) Three human raters compare Llama 2-Chat with a rival chat model on about 4,000 single and multi-turn helpfulness prompts. Meta Overall chat quality Votes System cards only Jul 2023 Jul 2023
Pairwise safety red teaming Red teamers compare anonymized responses from several models and pick the least safe. Scored as ELO or win rate. OpenAI Refusing harmful requests Votes System cards only Apr 2025 Apr 2025
DeepSeek Chinese creative writing evaluation Models write Chinese fiction, prose, poetry and lyrics for 2,837 prompts. Pairwise judging gives separate win rates for instruction following and writing quality. DeepSeek Creative writing Matches System cards only Apr 2026 Apr 2026
Kimi Chinese in-house open-ended benchmark Models answer held-out Chinese prompts drawn from real user queries. Outputs are compared pairwise against another model to give win, tie and loss rates. Moonshot AI Overall chat quality Matches System cards only Jul 2025 Jul 2025
Llama 3 pairwise human evaluation (Meta) Human raters compare Llama responses with a rival model on about 7,000 prompts across six capabilities and three multiturn sets. Meta Overall chat quality Votes System cards only Jul 2024 Nov 2024
2024 NIST GenAI Text-to-Text Generators Models summarize several articles for a given topic. NIST compares detector scores for generated and human summaries. Higher target Brier scores mean detectors more often miss generated summaries. National Institute of Standards and Technology Reasoning over long documents Matches Not in cards Apr 2024
3D Animation Arena Models reconstruct a moving 3D human from a video. Voters compare motion fidelity, ground contact, smoothness, and overall appearance. 3D-animation-arena Image generation and editing Votes Not in cards Apr 2025
3D Arena Users compare two 3D models generated from the same input and vote for the better one. A live leaderboard ranks the generators. Hugging Face (Dylan Ebert) Spatial reasoning and counting Votes Not in cards
3D Worlds Arena Models generate explorable 3D scenes from an image and caption. Voters inspect two anonymous scenes from the same input and choose a favorite. 3d-arena Interactive world models Votes Not in cards
3DArena-Modeling Agents create 3D models for 120 tasks covering precision and appearance. Tencent converts Elo ratings from blind comparisons into percentages. Tencent Spatial reasoning and counting Matches Not in cards Nov 2026
3DGen-Bench People compare generated 3D objects in pairs. The authors use their judgments to evaluate automated scoring methods for text-to-3D and image-to-3D generation. Yuhan Zhang and colleagues Image generation and editing Votes Not in cards Mar 2025
AA-Image-Editing Validated private evaluators compare two image edits made from the same instruction and vote blind. Votes become Elo ratings. Artificial Analysis Image generation and editing Votes Not in cards
AA-Video-Editing Voters compare two edits of the same video made from one instruction and pick the better one. Votes become Elo ratings. Artificial Analysis Video generation Votes Not in cards
Agronomy AI Arena Models answer a visitor's agronomy question. The visitor compares two anonymous answers and votes for the more helpful one. Bailey Stockdale Tasks from real jobs Votes Not in cards Mar 2025
Among Us: A Sandbox for Measuring and Detecting Agentic Deception Language agents play a multiplayer social-deception game with hidden roles. Deception Elo and detection Elo measure success over repeated matches. FAR.AI Multi-agent games Matches Not in cards Apr 2025
Artificial Analysis Image Arena Voters compare images from two text-to-image models for the same prompt and pick the better one. Votes become Elo ratings. Artificial Analysis Image generation and editing Votes Not in cards
Artificial Analysis Video Arena Voters compare videos from two text-to-video models for the same prompt and pick the better one. Votes become Elo ratings. Artificial Analysis Video generation Votes Not in cards
BigLaw Bench: Arena Legal experts compare two answers to a legal task. The benchmark reports pairwise win percentages. Harvey Law Matches Not in cards Nov 2025
BiomedArena Researchers compare anonymous answers to biomedical research questions and vote for the response they prefer. DataTecnica and Arena Expert-written questions Votes Not in cards Aug 2025
CATArena Pommerman Code agents compete in Pommerman. The public competition board reports Elo Rating for each agent configuration. AGI-Eval (Meituan) Building whole projects Matches Not in cards Oct 2025
CATArena Tetris Code agents compete in Tetris. The public competition board reports Score for each agent configuration. AGI-Eval (Meituan) Building whole projects Matches Not in cards Oct 2025
DesignArena Builder AI app builders make full-stack web and mobile apps from the same user prompt. Users compare the results and vote for the better one. DesignArena (Intelligence) Building whole projects Votes Not in cards
DesignArena Mobile Builder AI app builders make a mobile app from the same user prompt. Users compare the apps and vote for the better one. DesignArena (Intelligence) Building whole projects Votes Not in cards
DesignArena Proprietary Harness Slides Slide-making products build a presentation from a user prompt in their own harness. Users compare the decks and vote for the better one. DesignArena (Intelligence) Documents and spreadsheets Votes Not in cards
DesignArena Speech-to-Speech Voice models answer spoken input with speech. Users listen to two anonymous replies and vote for the better one. DesignArena (Intelligence) Audio understanding and voice Votes Not in cards
DrawBench Models generate images from text prompts that test counting, composition, and other skills. Human raters compare image quality and prompt alignment. Google Research Image generation and editing Votes Not in cards May 2022
GenAI-Arena Image Editing Models edit images from user instructions. Anonymous human comparisons determine Elo in this independent vote pool. TIGER-Lab (University of Waterloo) Image generation and editing Votes Not in cards Jun 2024
GenAI-Arena Video Generation Models generate videos from text prompts. Anonymous human comparisons determine Elo in this independent vote pool. TIGER-Lab (University of Waterloo) Image generation and editing Votes Not in cards Jun 2024
Grounded Language Model Customer Evaluations (Contextual AI) Models answer questions using retrieved documents. Contextual AI compares responses across four customer datasets. Contextual AI Faithful to sources Matches Not in cards Mar 2025
Husky Hold'em Bench Models write Python poker bots and revise them after practice games. Six bots compete at each table, and the tournament tracks average winnings. University of Washington and Nous Research Multi-agent games Matches Not in cards Jul 2025
Koala Test Set Models answer user prompts collected for an evaluation of dialogue systems. Human raters compare the quality of model responses. Berkeley Artificial Intelligence Research Overall chat quality Votes Not in cards Apr 2023
KradleVerse Agent harnesses compete in a live Minecraft arena. KradleVerse Video games Matches Not in cards Jan 2026
Labelbox Speech Generation v2 Models generate speech from text. Human raters compare the outputs for quality and naturalness. Labelbox Speech recognition and translation Votes Not in cards Dec 2024
Large Language Model Football League Models draft, trade, and set weekly NFL lineups. Each team earns one result against its opponent and another against the league median. Recreation Instruments Multi-agent games Matches Not in cards Sep 2026
LeWitt-Bench Image models interpret instructions for Sol LeWitt wall drawings. People compare the resulting pictures. Arcada Labs (Design Arena) Image generation and editing Votes Not in cards Oct 2025
LLMBar Evaluator models choose which of two outputs better follows an instruction using gold preference labels across natural and adversarial cases. Princeton NLP Following precise instructions Votes Not in cards Oct 2023
MAI Thinking 1 blind human preference evaluation Professional raters compare anonymous assistant responses to single-turn and multi-turn prompts and score their overall preference. Microsoft AI and Surge AI Overall chat quality Votes Not in cards Jun 2026
MC-Bench Models write code that builds a Minecraft structure from a prompt. Users vote between two builds without knowing the models. MC-Bench (Aditya Singh and volunteers) Spatial reasoning and counting Votes Not in cards Mar 2025
MegaGem Three models bid in sealed auctions with private cards. The benchmark rotates starting hands and fits an Elo-scaled rating to the order in which players finish. Alex Wa Multi-agent games Matches Not in cards Jan 2026
Minecraft Bed Wars (YC Labs) Teams of agents play Minecraft Bed Wars against one another. The researchers compare the number of matches each team wins. YC Labs and Olam Labs Multi-agent games Matches Not in cards Oct 2026
Model Slant Models write up to 100 words on each of 30 US political issues. US respondents compare anonymous answers and judge their partisan slant. Polarization Research Lab and Stanford University Bias, fairness and politics Votes Not in cards May 2025
MTEB Arena Users compare retrieval, clustering and similarity results from two anonymous embedding models and vote for the better one. MTEB community Other Votes Not in cards Jul 2024
MWAHAHA Models write jokes from word pairs or news headlines in English, Spanish, and Chinese. They also caption animated GIFs in English. MWAHAHA organizers Creative writing Votes Not in cards Jul 2025
PartiPrompts Models generate images from English prompts spanning subjects and difficulty types. Human raters compare image realism and fit to the prompt. Google Research Image generation and editing Votes Not in cards Jun 2022
PokeAgent Challenge Agents compete in Pokemon battles under partial observability in a Battling Track and play the Pokemon RPG in a Speedrunning Track that needs long-horizon planning. Princeton University and collaborators Video games Matches Not in cards Mar 2026
PPLX Online LLM Human Evaluation Models answer three sets of 50 prompts about helpfulness, factuality and freshness. Contractors compare responses and give a separate overall preference. Perplexity Overall chat quality Votes Not in cards Nov 2023
Qwen-Music Text-to-Music Generation Models turn English or Chinese lyrics and style instructions into complete songs. Music professionals compare anonymized recordings, and automatic judges score the same outputs. Alibaba Qwen Team Audio understanding and voice Votes Not in cards Jul 2026
RedTeam Arena Players get 60 seconds to make a model say a target word. An extended Elo ranks players, models and target prompts, with models ranked by resistance. Arena (formerly LMArena) Jailbreaks and prompt injection Matches Not in cards Sep 2024
RepoChat Arena Users give a GitHub repository link and a question. A retriever model picks files, two answer models reply, and users vote for the better answer. Arena (formerly LMArena) Fixing real repositories Votes Not in cards Jan 2025
RoboColosseum Physical robots execute fresh instructions in paired blind trials. Human evaluators choose the better run or a tie, and comparisons determine ratings for each embodiment. RoboColosseum consortium Real robots Votes Not in cards Nov 2026
SAM 3D Objects human preference evaluation Models reconstruct objects from images of real scenes. People compare the shape and texture of competing reconstructions, including objects seen from an egocentric viewpoint. Meta Spatial reasoning and counting Votes Not in cards Nov 2025
SAM Audio-Bench Models isolate a requested sound from an audio mixture using text, visual, or temporal prompts. Listeners judge how well the output preserves the target. Meta Audio understanding and voice Votes Not in cards Dec 2025
Slop Arena Site collecting writing-preference data to tune slop detection to a user's taste, paired with the slop-guard tool. Taste and style Votes Not in cards Mar 2026
Strategy Bench Models compete in six social deduction and strategy game environments. Freysa Multi-agent games Matches Not in cards Jan 2026
SuperCLUE Arena Image to Video Models animate images. The arena ranks systems from pairwise comparisons. SuperCLUE Video generation Matches Not in cards
SuperCLUE Arena Reference to Video Models generate videos from references. The arena ranks systems from pairwise comparisons. SuperCLUE Video generation Matches Not in cards
SuperCLUE Arena Text to Video Models generate videos from text. The arena ranks systems from pairwise comparisons. SuperCLUE Video generation Matches Not in cards
TextArena Collection of competitive text games for LLM eval and RL, with an online Elo leaderboard. TextArena Multi-agent games Matches Not in cards Apr 2025
TGVE+ plus Models follow video editing instructions on the original 76 TGVE videos. The extension adds object removal, object addition, and texture changes. Meta Video generation Votes Not in cards Mar 2024
The AI Teacher Test Models reply to students in English lessons. People compare pairs of replies for teacher-like language, understanding, and helpfulness. Anaïs Tack and Chris Piech, Stanford University Other professions Votes Not in cards May 2022
UI-Bench AI website builders generate sites from 30 text prompts. Experts compare paired sites without seeing the builder names. A TrueSkill-derived model converts preferences into ratings with confidence intervals. AfterQuery Web and app front ends Votes Not in cards Aug 2025
VIST Image models generate a new image in a reference brand style. Human evaluators compare pairs of outputs. Toloka Image generation and editing Votes Not in cards Dec 2025
VOX-DUB Dubbing systems speak translated lines in the original speaker’s voice. Listeners compare pairs of recordings on five aspects of dubbing quality. Toloka Speech recognition and translation Votes Not in cards Sep 2025
Web UI Bench Many models build the same 12 app UIs from one shared prompt. Outputs are shown side by side for people to compare. No automatic score. Eric Zakariasson (Cursor) Taste and style Votes Not in cards May 2026
WildArtifactBench Agents produce real deliverables in any format, from audio analysis and medical video reads to 3D meshes and kitchen layouts. Human and agent judges compare them with a baseline agent's work to give win rates and Elo. Meta (Meta Superintelligence Labs) Tasks from real jobs Votes Not in cards Aug 2026
Yupp VIBE Score People use Yupp for real tasks, see answers from two or more models, and pick the one they prefer. The preferences become VIBE scores for each model. Yupp (Ber Sarai Labs) Overall chat quality Votes Not in cards Jun 2025

Arena leaderboards

Top five in the largest arena from each of the 93 makers. Some makers run many arenas, so we show one each here. Their names link to every arena they run.

All 19 arenas from Arena (formerly LMArena)
More from Dubesor
More from ARC Prize Foundation
All 41 arenas from Design Arena
All 3 arenas from StudyArena
All 4 arenas from Lech Mazur

How an arena differs from a benchmark

Fixed answersArenas
What decides a score An answer key, unit tests, or a check of the final state Votes between two answers, or wins and losses in matches, turned into Elo-style ratings
What it captures Whether the model gets a defined task right Taste, helpfulness, style and strategy
What can go wrong Leaked test sets, and saturation once the best score nears the ceiling Length and formatting win votes, and ratings shift as new models arrive
How scores compare On an absolute scale, so 2023 and 2026 scores compare directly Relative to the other models in the pool at the time