Benchmark Almanac

UI-Bench

Orchids 30 tops its leaderboard
Not in model cards

AI website builders generate sites from 30 text prompts. Experts compare paired sites without seeing the builder names. A TrueSkill-derived model converts preferences into ratings with confidence intervals.

The paper covers ten tools, 300 generated sites, and more than 4,000 judgments. The current board reports 4,047 comparisons. Tool results include their surrounding product workflows and do not isolate base-model performance. The paper promises a site release that this review did not verify.

Made by
AfterQuery
Released
August 2025
Kind
Web and app front ends
Level
University
Scored
Ranked by votes
Answers
Code
Measures
Preference
Language
English
In and out
Text → Code
Interaction
Single turn
Refresh
One fixed set
Run by
Anyone

In the authors’ words

AI text-to-app tools promise high quality applications and websites in minutes, yet no public benchmark rigorously verifies those claims. We introduce UI-Bench, the first large-scale benchmark that evaluates visual excellence across competing AI text-to-app tools through expert pairwise comparison. Spanning 10 tools, 30 prompts, 300 generated sites, and 4,000+ expert judgments, UI-Bench ranks systems with a TrueSkill-derived model that yields calibrated confidence intervals. UI-Bench establishes a reproducible standard for advancing AI-driven web design. We release (i) the complete prompt set, (ii) an open-source evaluation framework, and (iii) a public leaderboard. The generated sites rated by participants will be released soon. View the UI-Bench leaderboard at https://uibench.ai/leaderboard.

Abstract of UI-Bench: A Benchmark for Evaluating Design Capabilities of AI Text-to-App Tools (arXiv:2508.20410, CC0)
10
Entries on its own leaderboard, 0 models we track

Orchids tops the leaderboard with 30

Best score per entry from the benchmark's own leaderboard, read on November 19th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders.

Bars start at 20.

  1. 1 Orchids 30
  2. 2 Figma Make 27
  3. 3 Lovable 27
  4. 4 Anything 25
  5. 5 Bolt 24
  6. 6 Magic Patterns 24
  7. 7 Same.new 24
  8. 8 Base44 by Wix 23
  9. 9 v0 22
  10. 10 Replit 21

Source: Official UI-Bench leaderboard

#EntryScore ± 95% CISettingDateSource
1 Orchids 30 ±3.5 Official leaderboard
2 Figma Make 27 ±3.4 Official leaderboard
3 Lovable 27 ±3.4 Official leaderboard
4 Anything 25 ±3.3 Official leaderboard
5 Bolt 24 ±3.3 Official leaderboard
6 Magic Patterns 24 ±3.3 Official leaderboard
7 Same.new 24 ±3.3 Official leaderboard
8 Base44 by Wix 23 ±3.3 Official leaderboard
9 v0 22 ±3.4 Official leaderboard
10 Replit 21 ±3.4 Official leaderboard

No lab model card reports it yet

We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.

More in Coding

All 523 in Coding
  • SWE-bench Verified In use 500 human-validated GitHub issues from 12 Python repos. Agent writes a patch that must pass hidden tests. Claude Opus 4.7 83.5%
  • LiveCodeBench v6 In use Competitive programming problems collected after model cutoffs from LeetCode, AtCoder, Codeforces. Scored pass@1 on hidden tests. DeepSeek-V4-Pro 93.5%
  • SWE-bench Multilingual In use 300 GitHub-issue tasks across nine programming languages in SWE-bench format. Patch graded by repository tests. Claude Fable 5.2 96.6%
  • DeepSWE In use 113 original long-horizon engineering tasks across 91 repos and five languages, written from scratch. Hand-written verifiers accept alternative solutions. GPT-6 Astra 74.1%
  • SciCode In use Scientist-curated research coding problems split into subproblems across natural sciences. Code checked against test cases. Seed2.1 Pro 59.8%
  • Codeforces rating In use Model solves recent Codeforces contest problems. An Elo-style rating is computed from simulated contest performance. DeepSeek V4.1 Flash 3,471

Data audit

7 of 8 checks pass, 1 warning. Look first at the Task access check. We don’t know whether the tasks are public. Every benchmark

Catalog record 1 warning 1 pass
  • Warning Task access We don’t know whether the tasks are public.
  • Pass Confidence Checked against a primary source.
Scores 2 pass 3 notes
  • Pass Independent runs Scores from the official leaderboard (10 entries).
  • Pass Models scored 10 entries on its leaderboard, none a model we track.
  • Note Newest score No scores yet.
  • Note Frontier models No models scored yet.
  • Note Headroom Scored as a rating, with no fixed ceiling.
Leaderboard import 3 pass
  • Pass Importer We read the board on uibench.ai: 10 entries at the last read, none a model we track.
  • Pass Last read November 19th, 2026.
  • Pass Read worked The last read worked.
Consistency 1 pass 1 note
  • Note Lab claims No model has both a lab number and an independent run.
  • Pass Known issues No published audit found problems.

How we check