Benchmark Almanac

OTBench

TabPFN-3 76.0 tops its leaderboard
Not in model cards

Tabular models generate missing data, impute cells, and predict targets under shared evaluation protocols. The suite compares 46 methods over 56 datasets and 20 evaluation axes.

There is no single interchangeable score across generation, imputation, and prediction. Dataset and metric identities must accompany results.

Released
November 2026
Kind
Data science and SQL
Level
University
Scored
Checked automatically
Answers
Prediction
Tasks
All public
Measures
Capability
Language
English
In and out
Tables → Tables, Text
Interaction
Single turn
Refresh
One fixed set
Run by
Anyone

In the authors’ words

Generation, imputation, and prediction query different aspects of the same tabular distribution, but are usually evaluated separately. This leaves unclear which capabilities they share, how their training objectives interact, and whether one model can perform all three well. We introduce the One Table Benchmark (\ours), spanning 56 datasets, 46 registered methods, and 20 capability axes under aligned data splits and explicit task contracts. We compare task ranks on aligned support, train five backbones under all seven non-empty objective combinations on five datasets with three seeds, and contrast fixed-model profiles with specialist portfolios. Rank comparisons connect imputation and prediction through numerical recovery and dependence preservation, and link generation to both through predictive utility; distributional fidelity follows different, sometimes opposing, rankings. Objective interventions show the largest pooled gains from including the recipient's own objective. Generation has the broadest coverage of positive pooled auxiliary effects, while prediction shows potential to improve imputation and synthetic-data utility, with responses that vary across backbones. Cross-addition effects reveal that objective benefits need not add and depend on the objectives already present. Fixed-model comparisons expose corresponding utility–fidelity trade-offs: some generalists surpass specialist portfolios on utility, while fidelity continues to favor specialization. Frozen foundation models show strong prediction and numerical point imputation, together with promising synthetic-data utility, highlighting their potential across all three tasks. These findings motivate unified tabular models that share useful conditional information while improving categorical reconstruction and faithful joint sampling.

Abstract of One Table, Many Queries: Benchmarking Generalist Tabular Models Across Generation, Imputation, and Prediction (arXiv:2611.13001, CC0)
9
Entries in its paper, 0 models we track

TabPFN-3 tops the leaderboard with 76.0

Best score per entry from the benchmark's paper, read on November 20th, 2026. A paper’s table doesn’t add newer models. The paper reports the axes separately. The headline is the plain mean percentage of fixed specialists beaten across its 19 capability axes. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders.

  1. 1 TabPFN-3 76.0
  2. 2 TabICLv2 74.8
  3. 3 LimiX-2 67.3
  4. 4 TabDDPM 50.2
  5. 5 Forest-VP Joint 46.5
  6. 6 TabSyn 46.2
  7. 7 TabDiff 44.0
  8. 8 Gaussian Copula 42.0
  9. 9 GReaT 20.3

Source: The OTBench paper

#EntryScoreSettingDateSource
1 TabPFN-3 76.0 Official leaderboard
2 TabICLv2 74.8 Official leaderboard
3 LimiX-2 67.3 Official leaderboard
4 TabDDPM 50.2 Official leaderboard
5 Forest-VP Joint 46.5 Official leaderboard
6 TabSyn 46.2 Official leaderboard
7 TabDiff 44.0 Official leaderboard
8 Gaussian Copula 42.0 Official leaderboard
9 GReaT 20.3 Official leaderboard

No lab model card reports it yet

We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.

More in Coding

All 523 in Coding
  • SWE-bench Verified In use 500 human-validated GitHub issues from 12 Python repos. Agent writes a patch that must pass hidden tests. Claude Opus 4.7 83.5%
  • LiveCodeBench v6 In use Competitive programming problems collected after model cutoffs from LeetCode, AtCoder, Codeforces. Scored pass@1 on hidden tests. DeepSeek-V4-Pro 93.5%
  • SWE-bench Multilingual In use 300 GitHub-issue tasks across nine programming languages in SWE-bench format. Patch graded by repository tests. Claude Fable 5.2 96.6%
  • DeepSWE In use 113 original long-horizon engineering tasks across 91 repos and five languages, written from scratch. Hand-written verifiers accept alternative solutions. GPT-6 Astra 74.1%
  • SciCode In use Scientist-curated research coding problems split into subproblems across natural sciences. Code checked against test cases. Seed2.1 Pro 59.8%
  • Codeforces rating In use Model solves recent Codeforces contest problems. An Elo-style rating is computed from simulated contest performance. DeepSeek V4.1 Flash 3,471

Data audit

All 8 checks pass. Every benchmark

Catalog record 2 pass
  • Pass Task access All tasks are public.
  • Pass Confidence Checked against a primary source.
Scores 2 pass 3 notes
  • Pass Independent runs Scores from the benchmark’s paper (9 entries).
  • Pass Models scored 9 entries on its leaderboard, none a model we track.
  • Note Newest score No scores yet.
  • Note Frontier models No models scored yet.
  • Note Headroom Scored as a plain number, with no fixed ceiling.
Leaderboard import 3 pass
  • Pass Importer We read the board on arxiv.org: 9 entries at the last read, none a model we track.
  • Pass Last read November 20th, 2026.
  • Pass Read worked The last read worked.
Consistency 1 pass 1 note
  • Note Lab claims No model has both a lab number and an independent run.
  • Pass Known issues No published audit found problems.

How we check