Benchmark Almanac

Arenas

We track 197 arenas and match leagues, with the last one added on November 12th. Benchmarks, where models are scored against fixed answers, can be found here. Have an arena that you want us to track? Let us know here.

132 with a leaderboard here Scores refreshed November 13th, 2026
197 arenas
LMArena (Elo) People chat with two anonymous models side by side and vote for the better reply. Votes become Elo-style ratings for each model. Arena (formerly LMArena) Overall chat quality Votes Fading Gemini 4 Carbon 1,526 335 May 2023 Nov 2026
SnakeBench Two language models each steer a snake on a shared board in a turn-based game, and the one that survives longest wins. Ratings come from many head-to-head games. ARC Prize Foundation (Greg Kamradt) Multi-agent games Matches Not in cards GPT-5.1-Codex-Max 38 188 Feb 2025 Sep 2026
DesignArena Website Models build a complete website as one HTML file from a real user prompt. Users compare the rendered pages and vote for the better one. DesignArena (Intelligence) Web and app front ends Votes In use Muse Wonder 1,380 151 Nov 2026
DesignArena Game Dev Models build a playable browser game as a single HTML file from a real user prompt. Users play the games and vote for the better one. DesignArena (Intelligence) Web and app front ends Votes In use GPT-6 Astra 1,470 143 Nov 2026
DesignArena Code Users give a prompt, and anonymous models each build a website, UI component, browser game, data visualization or 3D scene as one HTML file. Users vote, and votes become Bradley-Terry ratings. DesignArena (Intelligence) Web and app front ends Votes Not in cards GPT-6 Astra 1,396 143 Jul 2025 Nov 2026
DesignArena UI Component Models build one interface component as a single HTML file from a real user prompt. Users compare the rendered components and vote for the better one. DesignArena (Intelligence) Web and app front ends Votes Not in cards GPT-6 Astra 1,401 139 Nov 2026
DesignArena 3D Design Models build an interactive 3D scene that runs in the browser as a single HTML file. Users explore the scenes and vote for the better one. DesignArena (Intelligence) Web and app front ends Votes In use GPT-6 Astra 1,525 136 Nov 2026
Vision Arena People send an image with a prompt, compare answers from two anonymous vision-language models, and vote for the better one. Votes become Bradley-Terry ratings. Arena (formerly LMArena) General visual questions Votes Not in cards Claude Fable 5 1,309 136 Jun 2024 Oct 2026
Code Arena v2 Models act as coding agents that build web apps from user prompts, and users vote between two results. Votes yield Elo-style ratings. Arena (formerly LMArena) Web and app front ends Votes In use Claude Fable 5.2 1,836 128 Nov 2025 Nov 2026
LLM Chess Models play chess in multi-turn dialogs against a random player or the Komodo Dragon engine. The board reports wins, Elo and game duration, which tracks instruction following. Maxim Saplin Puzzles and chess Matches Not in cards GPT-6 Astra 1,614 123 Sep 2024 Nov 2026
DesignArena Data Visualization Models turn a user prompt and its data into an interactive visualization as a single HTML file. Users compare the rendered charts and vote. DesignArena (Intelligence) Data science and SQL Votes Not in cards Claude Opus 5.5 1,388 118 Nov 2026
DesignArena SVG Models write SVG code for a design request such as an icon, logo, badge or illustration. Users compare the rendered graphics and vote. DesignArena (Intelligence) Web and app front ends Votes Not in cards GPT-6 Astra 1,423 103 Oct 2026
StudyArena Text Models produce text responses to user prompts. Anonymous human comparisons determine the published rating in this separate vote pool. StudyArena Overall chat quality Votes Not in cards LongCat-2.0 1,375 85 Oct 2026
LMArena Text-to-Image Arena Image generation models answer the same user prompt side by side and anonymously. Community votes between the two images give Elo-style ratings. Arena (formerly LMArena) Image generation and editing Votes Not in cards GPT-Image-2.5 Sunburst 1,429 78 Dec 2024 Nov 2026
DesignArena ASCII Art Models draw a requested picture using only text characters. Users compare the ASCII art and vote for the better one. DesignArena (Intelligence) Creative writing Votes Not in cards Claude Opus 5.5 1,354 77 Oct 2026
MineBench Models turn a prompt into a Minecraft-style voxel build as raw 3D coordinates or tool calls. Users compare builds blind, and votes become rankings. Ammaar Alam Spatial reasoning and counting Votes Not in cards GPT-6 Astra Pro 2,206 75 Jan 2026 Nov 2026
DesignArena Agentic Overall Coding agents build apps, games, slides and spreadsheets from user prompts. Users compare the results, and votes from every agent board form one rating. DesignArena (Intelligence) Building whole projects Votes Not in cards Claude Opus 5.5 1,442 74 Nov 2026
Step Race Several models talk in public, then secretly pick moves in a race where colliding moves cancel. The game tests cooperation and deception. Lech Mazur Multi-agent games Matches Not in cards GPT-5 5 59 Jan 2025 Dec 2025
LMArena Image Edit Arena Image editing models apply the same user edit request to the same image, anonymously and side by side. Community votes give Elo-style ratings. Arena (formerly LMArena) Image generation and editing Votes Not in cards GPT-Image-2.5 Sunburst 1,520 58 Jun 2025 Nov 2026
DuelLab GameBench 2 Models get the rules of a strategy game and write a program that plays it. DuelLab checks and builds each program, then runs head-to-head matches between programs from different models. Match outcomes become per-game scores from 0 to 100 and a Bradley-Terry ranking, with no human or model judge. DuelLab (independent project, Budapest) Multi-agent games Matches Not in cards Claude Fable 5.2 99.1 57 Jul 2026 Nov 2026
Agent Arena Arena ranks models as the orchestrator in real Agent Mode sessions on arena.ai. Scores use behavioral signals such as file downloads, disapproval events, retries and steerability. Arena (formerly LMArena) General assistants Votes System cards only Claude Fable 5.2 30.4% 56 Jun 2026 Nov 2026
DesignArena React Native Models build cross-platform mobile apps in React Native from real user prompts. Users compare the running apps and vote for the better one. DesignArena (Intelligence) Building whole projects Votes Not in cards Claude Fable 5.2 1,321 56 Nov 2026
Elimination Game Models play a multi-player game of public and private talk, alliances and votes to eliminate each other. A jury of eliminated players picks the winner. Lech Mazur Multi-agent games Matches Not in cards GPT-5.2 8 56 Feb 2025 Dec 2025
VoxelBench Language models turn text or image prompts into voxel structures. Voters compare anonymous builds from the same prompt, and Glicko-2 ratings rank the models. VoxelBench Spatial reasoning and counting Votes Not in cards GPT-6 Astra 2,726 56 Sep 2025 Oct 2026
Image-to-WebDev Arena Users upload a screenshot, wireframe or mockup, two anonymous models build the website in Code Arena, and users vote for the better result. Votes become ratings with bootstrapped confidence intervals. Arena (formerly LMArena) Web and app front ends Votes Not in cards Claude Opus 5.5 1,752 55 Apr 2026 Oct 2026
DesignArena Frontend Web App Coding agents build multi-file React frontends from real user prompts. Users compare the running apps and vote, and the run logs record agent behavior. DesignArena (Intelligence) Web and app front ends Votes In use GPT-6 Astra 1,340 53 Nov 2026
DesignArena Image to HTML Models recreate a reference image or mockup as a working single-file HTML website. Users compare the rendered pages and vote for the closer, better one. DesignArena (Intelligence) Web and app front ends Votes Not in cards GPT-6 Astra 1,304 51 Nov 2026
HUMAINE Prolific participants, stratified across 22 demographic groups in the US and UK, hold multi-turn conversations with two anonymous models on topics they choose. They compare the models overall and on dimensions such as trust, ethics and safety. A hierarchical Bradley-Terry-Davidson model turns the votes into ratings, adjusted to census data. Prolific Overall chat quality Votes Not in cards Gemini 3.1 Pro 35 50 Sep 2025 Jul 2026
DesignArena Full Stack Coding agents build complete React apps with sign-in, databases and backend code from real user prompts. Users try the apps and vote for the better one. DesignArena (Intelligence) Building whole projects Votes Not in cards Claude Opus 5.5 1,393 49 Oct 2026
DesignArena Android (Kotlin) Models build native Android apps in Kotlin from real user prompts. The apps run in an Android emulator, and users compare them and vote. DesignArena (Intelligence) Building whole projects Votes Not in cards Claude Opus 5.5 1,397 46 Oct 2026
DesignArena Image Image models generate a picture from a user prompt. Users compare two anonymous images and vote for the better one. DesignArena (Intelligence) Image generation and editing Votes Not in cards GPT-Image-2.5 Sunburst 1,386 46 Nov 2026
LMArena Text-to-Video Arena Video generation models make clips from the same text prompt, anonymously and side by side. Votes from logged-in users give Elo-style ratings. Arena (formerly LMArena) Video generation Votes Not in cards Gemini Omni 1.2 Flash 1,540 46 Jan 2026 Nov 2026
LMArena Image-to-Video Arena Video generation models animate the same input image with the same prompt, anonymously and side by side. Votes give Elo-style ratings. Arena (formerly LMArena) Video generation Votes Not in cards Gemini Omni 1.2 Flash 1,503 45 Jan 2026 Nov 2026
DesignArena Logo Image models design a logo from a user prompt. Users compare two anonymous logos and vote for the better one. DesignArena (Intelligence) Image generation and editing Votes Not in cards GPT-Image-2 1,365 44
DesignArena Graphic Design Image models make a graphic design piece from a user prompt. Users compare two anonymous designs and vote for the better one. DesignArena (Intelligence) Image generation and editing Votes Not in cards GPT-Image-2.5 Sunburst 1,436 43
Game Arena Four in a Row Language models play a Connect Four style game and try to line up four of their tokens before the opponent does. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 4 Carbon 1,003 43 Feb 2026 Nov 2026
Game Arena Chess Language models play full chess games against each other with the board given as FEN and PGN text. Ratings come from many games between each pair. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 4 Carbon 1,646 42 Aug 2025 Nov 2026
Kaggle Game Arena Language models play each other in board, card and word games through a text harness. One leaderboard ranks models across all Game Arena games. Kaggle and Google DeepMind Multi-agent games Matches Not in cards Gemini 4 Carbon 638 42 Aug 2025 Nov 2026
Game Arena Checkers Language models play American checkers against each other, with forced jumps and crowned kings. Ratings come from head-to-head games. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 4 Carbon 1,382 41 Jun 2026 Nov 2026
Game Arena Dark Hex Language models play Hex without seeing the opponent's stones, so they must probe cells to learn the hidden board while building a path. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 3.8 Flash 581 41 Jun 2026 Nov 2026
Game Arena Dots and Boxes Language models take turns drawing lines between dots on a grid. Closing the fourth side of a box claims it. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Claude Fable 5.2 1,393 40 Jun 2026 Nov 2026
Game Arena Word Association Teams of language models give one-word clues and guess linked words, in a game like Codenames, against an opposing team. Kaggle and Google DeepMind Multi-agent games Matches Not in cards Gemini 4 Carbon 734 40 May 2026 Nov 2026
Document Arena People upload their own PDFs with a question, compare answers from two anonymous models, and vote for the better one. Votes become Bradley-Terry ratings. Arena (formerly LMArena) Reasoning over long documents Votes Not in cards Claude Fable 5 1,500 39 Mar 2026 Sep 2026
Game Arena Bargaining Two language models negotiate how to split a pool of items, each with private item values. Each side tries to reach a good deal without giving away its values. Kaggle and Google DeepMind Multi-agent games Matches Not in cards Gemini 4 Carbon 317 39 Jul 2026 Nov 2026
Game Arena Clobber Language models play Clobber, where every move captures an adjacent enemy stone. The player who makes the last legal move wins. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 4 Carbon 819 39 Jun 2026 Nov 2026
Game Arena Coin Game Two language models move on a grid and pick up coins. Each should collect the coins that score for it and avoid the rest. Kaggle and Google DeepMind Multi-agent games Matches Not in cards GPT-5.5 514 39 Jul 2026 Nov 2026
Game Arena Go Language models play Go against each other through the Game Arena text harness. Ratings come from head-to-head games. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Claude Fable 5.2 1,877 39 Sep 2026 Nov 2026
Game Arena Lines of Action Language models play Lines of Action, where a piece moves as far as the number of pieces on its line. The goal is to join all of one's pieces into one group. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 4 Carbon 1,274 39 Jul 2026 Nov 2026
Game Arena Nine Men's Morris Language models play Nine Men's Morris. Forming a row of three, called a mill, lets a player remove one of the opponent's pieces. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 4 Carbon 1,190 39 Aug 2026 Nov 2026
Game Arena Reversi Language models play Reversi, also called Othello, flipping the opponent's disks that they flank in a line. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 4 Carbon 1,306 39 Aug 2026 Nov 2026
Game Arena Ultimate Tic-Tac-Toe Language models play nine linked tic-tac-toe boards. Each move decides which small board the opponent must play next. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 4 Carbon 720 39 Jul 2026 Nov 2026
Game Arena Word Art Language models take turns drawing a word as ASCII art and guessing what the other model drew. Kaggle and Google DeepMind Multi-agent games Matches Not in cards Gemini 4 Carbon 2,528 39 Aug 2026 Nov 2026
LMArena Search Arena People compare answers from two anonymous search-augmented models on their own questions and vote for the better one. Votes become Bradley-Terry ratings. Arena (formerly LMArena) Deep research Votes Fading GPT-5.6 Sol 1,255 37 Apr 2025 Sep 2026
DesignArena PDF Agents build a PDF document from a user prompt. Users compare the two documents and vote for the better one. DesignArena (Intelligence) Documents and spreadsheets Votes Not in cards Gemini 4 Carbon 1,335 37 Nov 2026
DesignArena Python-PPTX Slides Agents build PowerPoint decks with python-pptx from a user prompt. Users compare narrative, visual design and structure and vote for the better deck. DesignArena (Intelligence) Documents and spreadsheets Votes Not in cards Claude Opus 5.5 1,427 36 Nov 2026
DesignArena Spreadsheet Agents build spreadsheets such as financial models, budgets and trackers as Excel or CSV workbooks. Users compare accuracy, structure and formatting and vote. DesignArena (Intelligence) Documents and spreadsheets Votes Not in cards Claude Fable 5.1 1,400 35 Nov 2026
SciArena Researchers ask scientific literature questions and vote between two models' long cited answers. Votes give Elo ratings. Yale NLP and Allen Institute for AI Science questions Votes Not in cards o3 1,151 34 Jul 2025 Dec 2025
Vending-Bench Arena Several agents each run a vending machine at the same location in the Vending-Bench 2 environment. They can email, pay and trade with each other, but each is scored on its own money balance. Andon Labs Simulated companies Matches Not in cards Gemini 4 Carbon $15,962 32 Nov 2025 Oct 2026
DesignArena Image to Frontend Coding agents turn a reference image into a multi-file frontend web app. Users compare the running apps and vote for the better one. DesignArena (Intelligence) Web and app front ends Votes Not in cards Gemini 4 Argon 1,314 31 Oct 2026
Game Arena Poker Language models play heads-up no-limit Texas Hold'em against each other. Models are ranked by mean big blinds won per 100 hands. Kaggle and Google DeepMind Multi-agent games Matches Not in cards GPT-5.6 Sol 30.3 31 Feb 2026 Sep 2026
DesignArena Code to Video Agents write code that renders a video from a user prompt. Users compare the two videos and vote for the better one. DesignArena (Intelligence) Video generation Votes Not in cards Claude Opus 5.5 1,341 29 Oct 2026
DesignArena HTML Slides Agents write a self-contained HTML slide deck that is converted to PPTX. Users compare the decks and vote for the better one. DesignArena (Intelligence) Documents and spreadsheets Votes Not in cards GPT-6 Astra 1,535 28 Oct 2026
DesignArena Agentic Game Dev Coding agents build multi-file games from a user prompt. Users play the final games and vote, and the logs keep tool calls, retries and failures. DesignArena (Intelligence) Building whole projects Votes Not in cards Gemini 4 Argon 1,265 27 Sep 2026
PACT Two models bargain over 20 rounds as buyer and seller, each with a hidden private value. Matches across many pairings rank the models. Lech Mazur Multi-agent games Matches Not in cards GPT-5.5 1,607 26 Jul 2025 Jun 2026
Joke Arena Models write jokes. Pairwise votes determine the published Arena rating. Kaggle Creative writing Votes Not in cards Kimi K3 1,573 25 Oct 2026
DesignArena Godot Game Dev Coding agents build complete Godot projects with GDScript, scenes and generated assets, exported to run in the browser. Users play the games and vote. DesignArena (Intelligence) Building whole projects Votes Not in cards GPT-6 Astra 1,319 24 Sep 2026
Clocktower Radio Models play the social deduction game Blood on the Clocktower (the Trouble Brewing script) in mirrored pairs of games. In each match one model plays good and the other evil, and then they swap. A coded Storyteller runs the game, and a Bradley–Terry fit over all matches gives ratings where 1500 is average. Che Jami Multi-agent games Matches Not in cards GPT-5.5 1,708 23 Mar 2026 Oct 2026
StudyArena Image Models produce image responses to user prompts. Anonymous human comparisons determine the published rating in this separate vote pool. StudyArena Image generation and editing Votes Not in cards Grok Imagine Image 2.0 1,326 23
Corp Speak Arena Models rewrite text in corporate language. Pairwise votes determine the published Arena rating. Kaggle Taste and style Votes Not in cards GLM-5.3 1,731 22 Sep 2026
ArtifactArena Models design robot bodies, controllers and strategy for a simulated sumo-style arena. Artifacts fight head-to-head and models get Elo ratings. MIT CSAIL + MIT Media Lab + NYU + UCSF Simulated robots Matches Not in cards GPT-6 Astra 1,539 21 Sep 2026 Sep 2026
DesignArena Image Editing Image models edit a user image following a text instruction. Users compare the two edits and vote for the better one. DesignArena (Intelligence) Image generation and editing Votes Not in cards GPT-Image-2.5 Sunburst 1,370 21 Nov 2026
Game Arena Five in a Row Language models play a gomoku-style game and try to line up five of their tokens before the opponent does. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 3.1 Pro 1,131 20 Apr 2026 Jun 2026
CivBench Models play full games of Civilization V with the Vox Populi mod against each other on matched maps and seeds. Pairwise skill ratings rank long-term strategy. Vox Deorum Video games Matches Not in cards GLM-5.3 1,634 19 Oct 2026 Sep 2026
DesignArena Video to Website Models watch a reference video and recreate its content as a working single-file HTML website. Users compare the rendered pages and vote. DesignArena (Intelligence) Web and app front ends Votes Not in cards Muse Spark 1.3 1,250 19 Oct 2026
ELI5 Arena Models explain concepts in simple language. Pairwise votes determine the published Arena rating. Kaggle Overall chat quality Votes Not in cards Gemini 4 Argon 1,691 18 Sep 2026
Agent Poker Bench Models play 10-seat no-limit Texas Hold'em tournaments against each other. Chip counts and elimination order feed TrueSkill ratings. Vals AI (with The Graphite Group) Multi-agent games Matches Not in cards GPT-5.2 1,132 17 Jan 2026 Dec 2025
Xbench Measures firsthand X posts about frontier models and coding harnesses. An LLM labels each post's sentiment, aggregated per model per week. Nico Christie (offpolicyinc) Other Votes Not in cards Claude Opus 5.5 75.7 17 Sep 2026 Sep 2026
Chart Arena Models create charts. Pairwise votes determine the published Arena rating. Kaggle Data science and SQL Votes Not in cards GPT-6.1 Sol 1,628 15 Oct 2026
DesignArena Video Arena Users compare videos from anonymous video generation models for the same prompt and vote for the better one. Votes become Elo ratings. DesignArena (Intelligence) Video generation Votes Not in cards Gemini Omni 1.2 Flash 1,369 15 Nov 2026
Opening Lines Arena Models write opening lines for stories. Pairwise votes determine the published Arena rating. Kaggle Creative writing Votes Not in cards GPT-6 Astra 1,613 15 Sep 2026
3DCodeArena Models generate 3D assets through code. Human preference votes determine the published Bradley-Terry Elo rating. Google DeepMind + Google Research + University of Southern California CAD models Votes Not in cards Claude Fable 5 1,230 14 May 2026 Jun 2026
Landing Page Arena Models create landing pages. Pairwise votes determine the published Arena rating. Kaggle Web and app front ends Votes Not in cards GPT-6.1 Sol 1,692 14 Oct 2026
BigCodeArena Users ask for code, both models' programs run in a sandbox, and users try the results before voting for the better answer. Votes give Elo ratings. BigCode project (Monash University and collaborators) Function-level problems Votes Not in cards DeepSeek-V3.2-Exp 1,117 13 Oct 2025 Sep 2025
Code2Video Arena Models create videos through code. Pairwise votes determine the published Arena rating. HeyGen on Kaggle Video generation Votes Not in cards Gemini 4 Carbon 1,599 13 Oct 2026
VoxelBench Image Models turn image prompts into voxel structures. Human comparisons determine Glicko-2 ratings in a separate image-prompt vote pool. VoxelBench Spatial reasoning and counting Votes Not in cards GPT-6.1 Sol 2,264 13 Sep 2025 Sep 2026
DesignArena Blender Agents build a 3D scene in Blender from a user prompt. Users compare the rendered scenes and vote for the better one. DesignArena (Intelligence) Building whole projects Votes Not in cards Claude Opus 5.5 1,413 12 Oct 2026
Clocktower Bench Models play the social deduction game Blood on the Clocktower (the Trouble Brewing script) against each other, with a scripted Storyteller. One model takes every good seat and another every evil seat, so each game tests one model's detection of the Demon against another's deception. A Bradley–Terry fit turns 386 games into Elo ratings. Dwarkesh Patel Multi-agent games Matches Not in cards GPT-6 Astra 1,859 11 Nov 2026 Sep 2026
DesignArena Agentic Image to HTML Coding agents turn a user-uploaded image into a self-contained HTML website. Users compare how well each page reproduces the design and vote. DesignArena (Intelligence) Web and app front ends Votes Not in cards Claude Sonnet 4.6 1,247 11 Apr 2026
DesignArena Image to Video Video models animate a user image into a short video. Users compare two anonymous videos and vote for the better one. DesignArena (Intelligence) Video generation Votes Not in cards MiniMax H3 1,319 11 Nov 2026
Floorplan Arena Models furnish hand-drawn room sketches. People compare the layouts and vote for the better floorplan. Kaggle Data science and SQL Votes Not in cards Gemini 4 Carbon 1,792 11 Oct 2026
Game Arena Chess Openings Language models play chess against each other from varied two-move openings sampled from 20 popular human openings. The board is given as text. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 3 Flash 1,263 11 Feb 2026 Dec 2025
LMArena Video Edit Arena Video editing models apply the same edit request to the same clip, anonymously and side by side. Community votes give Elo-style ratings. Arena (formerly LMArena) Video generation Votes Not in cards Wan 3.0 1,424 11 Nov 2026
OCR Arena Users upload a document, compare two anonymous OCR or vision-language models side by side, and vote. Votes become Elo ratings. Extend Documents, charts and text in images Votes Not in cards Gemini 3 Flash 1,781 11 Nov 2025 Feb 2026
Bench on the Clocktower Ten models play the social deduction game Blood on the Clocktower together, one seat each, over 300 ten-player games of the Trouble Brewing script. Each model plays 210 games on the good team and 90 on the evil team. The score is the share of games its team won. Tom Taylor and coauthors Multi-agent games Matches Not in cards GPT-5.6 Sol 58% 10 Sep 2026 Jul 2026
CompassArena Users chat with two anonymous models side by side, mostly in Chinese, and vote for the better answer. A Bradley-Terry model turns the votes into Elo-style ratings. OpenCompass (Shanghai AI Laboratory) with ModelScope Overall chat quality Votes Not in cards MiMo-V2.5-Pro 1,062 10 May 2024 Jun 2026
RSI Arena Ten frontier agents each post-train the same Nemotron base model on a shared GPU cluster for six days. People then rank the resulting models in blind side-by-side votes, and agents retrain on that feedback. Bake AI Machine learning engineering Votes Not in cards GPT-6 Astra 1,095 10 Sep 2026 Oct 2026
WildVision Arena Users upload an image with a question, compare answers from two anonymous vision-language models, and vote. Votes give Elo ratings. Allen Institute for AI and UCSB General visual questions Votes Not in cards Claude 3 Opus 1,100 10 Feb 2024 Apr 2024
Voice Arena Hindi Models generate speech in Hindi. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes System cards only Gemini 3.8 Flash TTS 1,084 9 Oct 2026
StarSkirmish Bench Each model gets one hour in its lab's own CLI to write a StarCraft: Brood War bot in C++. The score is its win rate against human-written bots. Kai McPheeters Video games Matches Not in cards GPT-6 Astra 57.3% 9 Oct 2026 Oct 2026
CodeClash Models build and improve their own codebases over many rounds, then compete in arenas such as Halite, poker and BattleSnake. Results give Elo ratings. SWE-bench team (Stanford University and Princeton University) Building whole projects Matches Not in cards Claude Sonnet 4.5 1,385 8 Nov 2025 Sep 2025
CompassArena Multimodal Users compare anonymous multimodal model answers and vote for the better response. A Bradley-Terry model estimates ratings from these votes. OpenCompass (Shanghai AI Laboratory) General visual questions Votes Not in cards Qwen3-VL-235B-A22B-Instruct 1,173 8 Sep 2025
Game Arena Werewolf Teams of language models play the social deduction game Werewolf in natural language. Villagers must find the hidden werewolves, who try to deceive them. Kaggle and Google DeepMind Multi-agent games Matches Not in cards GPT-5.4 0 8 Feb 2026 Mar 2026
Voice Arena Arabic MSA Models generate speech in Arabic MSA. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes System cards only Gemini 3.8 Flash TTS 1,192 7 Sep 2026
Voice Arena Brazilian Portuguese Models generate speech in Brazilian Portuguese. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes System cards only Gemini 3.8 Flash-Lite TTS 1,127 7 Sep 2026
Voice Arena Mexican Spanish Models generate speech in Mexican Spanish. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes System cards only Gemini 3.8 Flash TTS 1,138 7 Sep 2026
Voice Arena US English Models generate speech in US English. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes System cards only Gemini 3.8 Flash-Lite TTS 1,081 7 Oct 2026
Voice Arena Vietnamese Models generate speech in Vietnamese. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes System cards only Gemini 3.8 Flash-Lite TTS 1,141 7 Sep 2026
Honesty human feedback win rate (Anthropic) Crowdworkers try to make models say something false and pick the more honest reply in head-to-head chats. Score is the win rate against a baseline. Anthropic Hallucination rates Votes System cards only 6 Sep 2025 Feb 2026
Voice Arena Japanese Models generate speech in Japanese. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes System cards only Gemini 3.8 Flash TTS 1,188 6 Sep 2026
Brood War Bench Coding agents play StarCraft: Brood War against each other in real time. Systems are ranked by win rate over matches, with cost per game. Ben Swerdlow Video games Matches Not in cards GPT-6 Astra 100% 6 Sep 2026 Sep 2026
DesignArena Multi-Image to Video Video models compose one video from several reference images. Users compare two anonymous videos and vote for the better one. DesignArena (Intelligence) Video generation Votes Not in cards MiniMax H3 1,329 6 Nov 2026
DesignArena Multimodal to Video Video models make a video from a mix of text, images and other inputs. Users compare two anonymous videos and vote for the better one. DesignArena (Intelligence) Video generation Votes Not in cards MiniMax H3 1,305 6 Nov 2026
ChangeMyView Models write rebuttals to r/ChangeMyView posts that human raters score for persuasiveness. Scored as percentile against human responses. OpenAI Dangerous capabilities Votes System cards only 5 Sep 2024 Feb 2025
CATArena Gomoku Code agents compete in Gomoku. The public competition board reports Elo Rating for each agent configuration. AGI-Eval (Meituan) Building whole projects Matches Not in cards GPT-5 1,799 5 Oct 2025 Aug 2025
CATArena OIBench-5 Code agents compete in OIBench-5. The public competition board reports Time AUC for each agent configuration. AGI-Eval (Meituan) Building whole projects Matches Not in cards GPT-5 0.40 5 Oct 2025 Aug 2025
CATArena SWE-Perf-10 Code agents compete in SWE-Perf-10. The public competition board reports Time Ratio for each agent configuration. AGI-Eval (Meituan) Building whole projects Matches Not in cards Claude Sonnet 4 1.95× 5 Oct 2025 Aug 2025
CATArena Texas Holdem Code agents compete in Texas Holdem. The public competition board reports Elo Rating for each agent configuration. AGI-Eval (Meituan) Building whole projects Matches Not in cards GPT-5 1,463 5 Oct 2025 Aug 2025
Cooperate to Compete (C2C) Multi-player conquest game with private non-binding negotiation and secret asymmetric objectives. LM agents and humans are ranked by Plackett-Luce player strength from their game results. UC Berkeley Multi-agent games Matches Not in cards Gemini 3.1 Pro 0.74 5 Apr 2026 Mar 2026
DesignArena Video Editing Video models edit a user video following a text instruction. Users compare the two results and vote for the better one. DesignArena (Intelligence) Video generation Votes Not in cards MiniMax H3 1,373 5
K-Sort Arena Users rank outputs from K image or video generation models at once instead of a pair. Bayesian updates turn the rankings into ratings. Li et al. (UC Berkeley and collaborators) Image generation and editing Votes Not in cards GPT-Image-1 31 5 Aug 2024
Harmlessness human feedback win rate (Anthropic) Raters probe models in adversarial chats and pick the more harmless reply in head-to-head comparisons. Score is the win rate against a baseline model. Anthropic Refusing harmful requests Votes System cards only 4 Jun 2024 Oct 2024
Political Persuasion Parallel Generation Human raters pick the more persuasive of two short political social media posts. Scored as win rate against GPT-4o. OpenAI Dangerous capabilities Votes System cards only 4 Sep 2024 Jan 2025
CC-Bench Claude Code runs realistic frontend, backend, tooling and data coding tasks in fresh containers. Humans compare models head-to-head (win rate). Zhipu AI (Z.ai) Building whole projects Votes System cards only Claude Sonnet 4 41.9% 4 Jul 2025 Sep 2025
DesignArena Audio Realism Bench Voice models produce conversational speech, and users vote on which sounds more real. DesignArena built it because 1 to 5 opinion scores for TTS had saturated. DesignArena (Intelligence) Audio understanding and voice Votes Not in cards Grok TTS 1,179 4 Oct 2026
DesignArena Text-to-Speech Speech models read the same text aloud. Users listen to two anonymous clips and vote for the more natural one. DesignArena (Intelligence) Audio understanding and voice Votes Not in cards Grok TTS 1,226 4 Oct 2026
3DCodeBench Agentic procedural 3D modeling via code: author engine-ready 3D assets through software APIs. Graded for executability and shape fidelity. Google DeepMind + Google Research + University of Southern California CAD models Votes In use 3 May 2026 Nov 2026
LLM Colosseum Two models each control a fighter in Street Fighter III and choose moves from text descriptions of the game. Wins give Elo ratings. phospho (OpenGenerativeAI) Video games Matches Not in cards GPT-4o mini 1,835 3 Mar 2024 Jul 2024
Music Arena Users write a music prompt, listen to tracks from two text-to-music systems, and vote. Preferences, listening data and feedback feed a leaderboard. Carnegie Mellon University (G-CLef) with Arena and Sony researchers Audio understanding and voice Votes Not in cards Lyria 3 Pro 1,394 3 Jul 2025 May 2026
RoboArena Double-blind pairwise A/B trials of generalist DROID policies on real Franka arms, free-form tasks by volunteer evaluators. Elo-style rating. UC Berkeley + Stanford + UPenn + others Real robots Votes Not in cards π0.5 1,608 3 Jun 2025 Apr 2025
Voice Arena Bahasa Models generate speech in Bahasa. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes Not in cards Gemini 3.8 Flash TTS 1,138 3 Sep 2026
Voice Arena Tagalog Models generate speech in Tagalog. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes Not in cards Gemini 3.8 Flash TTS 1,130 3 Sep 2026
Human SxS image editing Elo (Google) Google compares edited images side by side and converts human preferences into Elo ratings. Google DeepMind Image generation and editing Votes Fading 2 Feb 2026 Oct 2026
Human SxS image generation Elo (Google) Google compares generated images side by side and converts human preferences into Elo ratings. Google DeepMind Image generation and editing Votes In use 2 Feb 2026 Oct 2026
Hume AI Overall Quality Index Listeners rate generated speech on reliability and expressiveness. The benchmark reports an overall quality index. Hume AI Speech recognition and translation Votes In use 2 Sep 2026 Sep 2026
Red Teaming Network pairwise safety comparison Red teamers compare anonymized responses from two models in free-form risky conversations. Scored as the share of ratings where a model is safer. OpenAI Refusing harmful requests Votes System cards only 2 Dec 2024 Feb 2025
Qwen Chinese human evaluation Three annotators rank chat model answers to 300 Chinese instructions on knowledge, language, writing, math and coding. Results are win rates against GPT-3.5. Qwen Team, Alibaba Group Overall chat quality Votes System cards only 2 Sep 2023 Sep 2023
LLMBoxing People see one question with two anonymous model answers and pick the better one. The site counts preferences between model pairs. llmboxing.com Overall chat quality Votes System cards only Llama 2-70B 22679.0 2 Oct 2023 Oct 2023
Music Arena Vocal Models generate music with vocals. Listeners compare anonymous tracks, and separate vocal preference votes determine the Arena score. Carnegie Mellon University (G-CLef) with Arena and Sony researchers Audio understanding and voice Votes Not in cards Lyria 3 Pro 1,107 2 Jul 2025 Mar 2026
StudyArena Audio Models produce audio responses to user prompts. Anonymous human comparisons determine the published rating in this separate vote pool. StudyArena Audio understanding and voice Votes Not in cards MiniMax Speech 2.8 Turbo 1,216 2 Jan 2026
TTS Arena Users listen to two anonymous text-to-speech models read the same text and vote for the more natural one. Votes become Elo ratings. TTS-AGI (Hugging Face community) Audio understanding and voice Votes Not in cards MiniMax Speech 2.8 HD 1,545 2 Feb 2024 Jan 2026
Voice Arena French Models generate speech in French. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes Not in cards Gemini 3.8 Flash TTS 1,084 2 Sep 2026
Voice Arena German Models generate speech in German. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes Not in cards Gemini 3.8 Flash TTS 1,034 2 Sep 2026
Voice Arena Indian English Models generate speech in Indian English. Listeners compare anonymous clips, and preference votes determine independent language Elo ratings. Voice Arena Audio understanding and voice Votes Not in cards Gemini 3.8 Flash-Lite TTS 1,066 2 Sep 2026
Apple side-by-side human evaluation Apple's in-house graders compare two models' responses to locale-specific text and image prompts and pick the preferred one. Results are win, tie and loss fractions per comparison. Apple Overall chat quality Votes Fading 1 Jun 2025 Jun 2026
Cohere enterprise human evaluation Trained annotators blindly compare two models' answers on enterprise tasks such as HR FAQs, technical FAQs and workplace assistants. They judge accuracy, instruction following and style. Results are win, tie and loss rates. Cohere Running a business Votes Dropped 1 Mar 2025 Apr 2025
GenAI-Bench Image generation systems are compared by human side-by-side preference on text-to-image prompts. Google DeepMind Image generation and editing Votes Fading 1 Feb 2026
Hume AI Voice Design Benchmark Listeners rate generated voices for English voice design, multilingual control, accents and voice qualities. Hume AI Speech recognition and translation Votes In use 1 Sep 2026 Sep 2026
AA-3D Agents in an offline sandbox turn a written brief into an interactive three.js scene. A recruited human panel votes on blind pairs, and votes become Elo ratings. Artificial Analysis Web and app front ends Votes In use 1 Oct 2026 Nov 2026
Artificial Analysis Speech Arena Voters listen to two speech clips made from the same text and pick the more natural one. Votes become Elo ratings. Artificial Analysis Audio understanding and voice Votes Fading 1 Apr 2026
DeepSeek Chinese functional writing evaluation Models answer 3,170 everyday Chinese writing prompts such as reports, emails and speeches. Pairwise judging against a baseline model gives a win rate. DeepSeek Taste and style Matches System cards only 1 Apr 2026 Apr 2026
DeepSeek Chinese white-collar tasks evaluation Agents complete 30 Chinese professional analysis, document generation and editing tasks across 13 industries. Blind human annotators compare outputs against a baseline model. DeepSeek Documents and spreadsheets Votes System cards only 1 Apr 2026 Apr 2026
DeepSeek complex instruction following and multi-turn writing evaluation Models answer 196 hard Chinese writing prompts with complex constraints or several turns. Pairwise judging against a baseline model gives a win rate. DeepSeek Multi-turn conversation Matches System cards only 1 Apr 2026 Apr 2026
DeepSeek search Q&A evaluation Models answer objective and subjective Chinese search questions with retrieval or agentic search. Pairwise judging gives win, loss and tie rates. DeepSeek Questions that need search Matches System cards only 1 Apr 2026 Apr 2026
Expert Red Teaming for Violent Attack Planning Expert red teamers compare anonymized responses from two models on violent attack planning prompts. Scored as the win rate for being safer. OpenAI Refusing harmful requests Votes System cards only 1 Aug 2025 Aug 2025
Kimi Webdev Bench Models build games, 3D scenes and website clones from real prompts. Blind experts compare two outputs and report win, tie and loss rates. Moonshot AI Web and app front ends Votes System cards only 1 Jul 2026 Jul 2026
MAI human side-by-side evaluation Paid raters compare two models' answers to 1,276 English prompts from experts and Copilot logs on a 7-point scale from -1.5 to 1.5. Microsoft AI Overall chat quality Votes System cards only 1 Jun 2026 Jun 2026
Pairwise Bioweaponization Campaign Red teamers with biology PhDs compare anonymized responses from two models on bioweaponization prompts. Scored as the win rate for being safer. OpenAI Refusing harmful requests Votes System cards only 1 Aug 2025 Aug 2025
Preference on ChatGPT and API prompts Human labelers compare model responses to 5,214 prompts sent to ChatGPT and the OpenAI API. Scored as win rate against a baseline model. OpenAI Overall chat quality Votes System cards only 1 Mar 2023 Mar 2023
Speech Agent Arena People hold live conversations with two hidden speech-to-speech agents on the same scenario, some with tool calls, then pick the one they preferred. Votes are fit to an Elo rating, and the arena also tracks task success. Artificial Analysis Speech recognition and translation Votes In use 1 Aug 2026 Oct 2026
GenAI-Arena Users compare outputs from two anonymous models for image generation, image editing and video generation, and vote. Votes give Elo ratings. TIGER-Lab (University of Waterloo) Image generation and editing Votes Not in cards FLUX.1 [dev] 1,133 1 Jun 2024
GenAI-Arena Image Generation Models generate images from text prompts. Anonymous human comparisons determine Elo in this independent vote pool. TIGER-Lab (University of Waterloo) Image generation and editing Votes Not in cards FLUX.1 [dev] 1,133 1 Jun 2024
Speech Arena Models generate speech. Listeners compare outputs, and pairwise votes determine Elo ratings. Speech Arena Audio understanding and voice Votes Not in cards GPT-4o Mini TTS 1,566 1 Mar 2025
Human feedback win rates (Anthropic) Raters chat with two models on tasks such as coding, documents and creative writing and pick the better reply. Score is the win rate. Anthropic Overall chat quality Votes System cards only Mar 2024 Oct 2024
Llama 2-Chat helpfulness human evaluation (Meta) Three human raters compare Llama 2-Chat with a rival chat model on about 4,000 single and multi-turn helpfulness prompts. Meta Overall chat quality Votes System cards only Jul 2023 Jul 2023
Pairwise safety red teaming Red teamers compare anonymized responses from several models and pick the least safe. Scored as ELO or win rate. OpenAI Refusing harmful requests Votes System cards only Apr 2025 Apr 2025
DeepSeek Chinese creative writing evaluation Models write Chinese fiction, prose, poetry and lyrics for 2,837 prompts. Pairwise judging gives separate win rates for instruction following and writing quality. DeepSeek Creative writing Matches System cards only Apr 2026 Apr 2026
Kimi Chinese in-house open-ended benchmark Models answer held-out Chinese prompts drawn from real user queries. Outputs are compared pairwise against another model to give win, tie and loss rates. Moonshot AI Overall chat quality Matches System cards only Jul 2025 Jul 2025
Llama 3 pairwise human evaluation (Meta) Human raters compare Llama responses with a rival model on about 7,000 prompts across six capabilities and three multiturn sets. Meta Overall chat quality Votes System cards only Jul 2024 Nov 2024
3D Arena Users compare two 3D models generated from the same input and vote for the better one. A live leaderboard ranks the generators. Hugging Face (Dylan Ebert) Spatial reasoning and counting Votes Not in cards
AA-Image-Editing Validated private evaluators compare two image edits made from the same instruction and vote blind. Votes become Elo ratings. Artificial Analysis Image generation and editing Votes Not in cards
AA-Video-Editing Voters compare two edits of the same video made from one instruction and pick the better one. Votes become Elo ratings. Artificial Analysis Video generation Votes Not in cards
Agent Arena (Gorilla) Users give a task, two agents built from different models, tools and frameworks run it, and users vote. A Bradley-Terry extension rates models, tools and frameworks. UC Berkeley Gorilla team with LMSYS General assistants Votes Not in cards Oct 2024
AI Diplomacy Models play the board game Diplomacy against each other, one power each. They negotiate, form alliances and betray each other in written messages. Good Start Labs (Alex Duffy) Multi-agent games Matches Not in cards Feb 2025
Artificial Analysis Image Arena Voters compare images from two text-to-image models for the same prompt and pick the better one. Votes become Elo ratings. Artificial Analysis Image generation and editing Votes Not in cards
Artificial Analysis Video Arena Voters compare videos from two text-to-video models for the same prompt and pick the better one. Votes become Elo ratings. Artificial Analysis Video generation Votes Not in cards
CATArena Code agents write programs that play board and card games in repeated tournaments. Between rounds they refine their code through self-reflection and by studying rivals' code. Scores are average ranks that separate first-round skill from improvement. AGI-Eval (Meituan) Building whole projects Matches Not in cards Oct 2025
CATArena Pommerman Code agents compete in Pommerman. The public competition board reports Elo Rating for each agent configuration. AGI-Eval (Meituan) Building whole projects Matches Not in cards Oct 2025
CATArena Tetris Code agents compete in Tetris. The public competition board reports Score for each agent configuration. AGI-Eval (Meituan) Building whole projects Matches Not in cards Oct 2025
Copilot Arena Developers inside their IDE see paired code completions from two models and pick one. Pairwise votes give an Elo-style ranking of code models. Arena (formerly LMArena) with Carnegie Mellon University Function-level problems Votes Not in cards Nov 2024
DesignArena Builder AI app builders make full-stack web and mobile apps from the same user prompt. Users compare the results and vote for the better one. DesignArena (Intelligence) Building whole projects Votes Not in cards
DesignArena Mobile Builder AI app builders make a mobile app from the same user prompt. Users compare the apps and vote for the better one. DesignArena (Intelligence) Building whole projects Votes Not in cards
DesignArena Proprietary Harness Slides Slide-making products build a presentation from a user prompt in their own harness. Users compare the decks and vote for the better one. DesignArena (Intelligence) Documents and spreadsheets Votes Not in cards
DesignArena Speech-to-Speech Voice models answer spoken input with speech. Users listen to two anonymous replies and vote for the better one. DesignArena (Intelligence) Audio understanding and voice Votes Not in cards
GenAI-Arena Image Editing Models edit images from user instructions. Anonymous human comparisons determine Elo in this independent vote pool. TIGER-Lab (University of Waterloo) Image generation and editing Votes Not in cards Jun 2024
GenAI-Arena Video Generation Models generate videos from text prompts. Anonymous human comparisons determine Elo in this independent vote pool. TIGER-Lab (University of Waterloo) Image generation and editing Votes Not in cards Jun 2024
MC-Bench Models write code that builds a Minecraft structure from a prompt. Users vote between two builds without knowing the models. MC-Bench (Aditya Singh and volunteers) Spatial reasoning and counting Votes Not in cards Mar 2025
MTEB Arena Users compare retrieval, clustering and similarity results from two anonymous embedding models and vote for the better one. MTEB community Other Votes Not in cards Jul 2024
PokeAgent Challenge Agents compete in Pokemon battles under partial observability in a Battling Track and play the Pokemon RPG in a Speedrunning Track that needs long-horizon planning. Princeton University and collaborators Video games Matches Not in cards Mar 2026
RedTeam Arena Players get 60 seconds to make a model say a target word. An extended Elo ranks players, models and target prompts, with models ranked by resistance. Arena (formerly LMArena) Jailbreaks and prompt injection Matches Not in cards Sep 2024
RepoChat Arena Users give a GitHub repository link and a question. A retriever model picks files, two answer models reply, and users vote for the better answer. Arena (formerly LMArena) Fixing real repositories Votes Not in cards Jan 2025
SEAL Showdown Users of Scale's Playground app chat with a model and sometimes compare its reply with a random opponent's reply. Scale ranks models with a Bradley-Terry model that controls for length and formatting. Rankings can be split by region, profession and age. Scale AI Overall chat quality Votes Not in cards Sep 2025
Slop Arena Site collecting writing-preference data to tune slop detection to a user's taste, paired with the slop-guard tool. Taste and style Votes Not in cards Mar 2026
TextArena Collection of competitive text games for LLM eval and RL, with an online Elo leaderboard. TextArena Multi-agent games Matches Not in cards Apr 2025
Web UI Bench Many models build the same 12 app UIs from one shared prompt. Outputs are shown side by side for people to compare. No automatic score. Eric Zakariasson (Cursor) Taste and style Votes Not in cards May 2026
WildArtifactBench Agents produce real deliverables in any format, from audio analysis and medical video reads to 3D meshes and kitchen layouts. Human and agent judges compare them with a baseline agent's work to give win rates and Elo. Meta (Meta Superintelligence Labs) Tasks from real jobs Votes Not in cards Aug 2026
Yupp VIBE Score People use Yupp for real tasks, see answers from two or more models, and pick the one they prefer. The preferences become VIBE scores for each model. Yupp (Ber Sarai Labs) Overall chat quality Votes Not in cards Jun 2025

Arena leaderboards

Top five in each of the 9 arenas with the most rated models.

How an arena differs from a benchmark

Fixed answersArenas
What decides a score An answer key, unit tests, or a check of the final state Votes between two answers, or wins and losses in matches, turned into Elo-style ratings
What it captures Whether the model gets a defined task right Taste, helpfulness, style and strategy
What can go wrong Leaked test sets, and saturation once the best score nears the ceiling Length and formatting win votes, and ratings shift as new models arrive
How scores compare On an absolute scale, so 2023 and 2026 scores compare directly Relative to the other models in the pool at the time