Benchmark Almanac

WorldOlympiad

LingBot-World 0.68 tops its leaderboard
Not in model cards

Models generate long videos for gaming, robotics, and everyday scenes. The evaluator checks physical rules, reconstructed geometry, and instruction following across video segments.

The benchmark contains 1,000 reference videos. Physical and interaction tracks use model judges, while geometric checks use reconstruction diagnostics.

Released
June 2026
Kind
Video world models
Level
Everyday
Scored
Graded by a model
Answers
Open-ended
Tasks
All public
Measures
Capability
Language
English
In and out
Text, Images → Video
Interaction
Multi-turn
Refresh
One fixed set
Run by
Anyone

In the authors’ words

We introduce WorldOlympiad, a benchmark for diagnosing video-based world models across physical faithfulness, geometric consistency, and interaction fidelity. While existing benchmarks often focus on visual quality, semantic alignment, or short-term temporal coherence, they provide limited insight into whether generated videos obey physical rules, preserve coherent 3D structure, and sustain controllable interactions over long horizons. To address this gap, WorldOlympiad decomposes world-model evaluation into three complementary dimensions. The physical track uses object segmentation and MLLM-as-judge to assess whether generated videos follow interpretable rules in mechanics, thermal phenomena, and material properties. The geometry track reconstructs generated videos with Gaussian splatting and evaluates structural consistency, cross-view coherence, and camera-trajectory alignment. The interaction track assesses whether generated rollouts follow complex action prompts and maintain smooth, coherent transitions across consecutive video chunks. WorldOlympiad further covers three major downstream scenarios, including gaming, robotics, and general real-world videos, capturing diverse challenges from interactive control and embodied manipulation to open-domain motion and camera dynamics. Together, these tracks and scenarios form a scalable and interpretable evaluation suite that exposes failure modes beyond generic video quality. Experiments on state-of-the-art models reveal substantial gaps in physical reasoning, 3D consistency, and long-horizon interaction, underscoring the need for more structured evaluation protocols for generative world models.

Abstract of WorldOlympiad: Can Your World Model Survive a Triathlon? (arXiv:2606.11129, CC0)
8
Entries on its own leaderboard, 0 models we track

LingBot-World tops the leaderboard with 0.68

Best score per entry from the benchmark's own leaderboard, read on November 18th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders.

  1. 1 LingBot-World 0.68
  2. 2 Cosmos-Predict-2.5 0.67
  3. 3 Rolling Forcing 0.61
  4. 4 Yume-1.5 0.60
  5. 5 LongLive 0.58
  6. 6 Hunyuan-WorldPlay 0.48
  7. 7 WoW 0.43
  8. 8 Matrix-Game 2.0 0.23

Source: Official WorldOlympiad leaderboard

#EntryScoreSettingDateSource
1 LingBot-World 0.68 Official leaderboard
2 Cosmos-Predict-2.5 0.67 Official leaderboard
3 Rolling Forcing 0.61 Official leaderboard
4 Yume-1.5 0.60 Official leaderboard
5 LongLive 0.58 Official leaderboard
6 Hunyuan-WorldPlay 0.48 Official leaderboard
7 WoW 0.43 Official leaderboard
8 Matrix-Game 2.0 0.23 Official leaderboard

No lab model card reports it yet

We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.

More in World models

All 53 in World models
  • AgentWorldBench In use Language world models predict the next environment observation after an agent action, in 7 domains from MCP and search to Android and desktop OS. A judge model scores each prediction against the real observation on five dimensions. GPT-5.4 58.3
  • IntPhys 2 In use Models watch simulated videos and judge whether each event is physically possible, testing object permanence, immutability, continuity and solidity. Scored by accuracy. Muse Spark Open 68.3%
  • QwenWorldBench Fading Models act as world models that simulate agent environments in 7 domains, such as terminal, web, and Android. A rubric judge scores five dimensions. Qwen3.7-Plus 62.1%
  • VPCT Fading Models view an image of a ball, ramps, and three buckets and predict which bucket the ball falls into. Scored by accuracy on 100 problems. Gemini 3 Pro 91%
  • ContPhy Fading Models infer physical properties such as mass and density of fluids and soft bodies from videos and predict their dynamics. Seed2.0 Pro 67.4%
  • RBench Only in system cards 650 image+text prompts for robot video generation (tasks and embodiments). MLLM judge scores task completion, physical plausibility, stability. Wan 2.6 60.7%

Data audit

All 8 checks pass. Every benchmark

Catalog record 2 pass
  • Pass Task access All tasks are public.
  • Pass Confidence Checked against a primary source.
Scores 2 pass 3 notes
  • Pass Independent runs Scores from the official leaderboard (8 entries).
  • Pass Models scored 8 entries on its leaderboard, none a model we track.
  • Note Newest score No scores yet.
  • Note Frontier models No models scored yet.
  • Note Headroom Scored as a plain number, with no fixed ceiling.
Leaderboard import 3 pass
  • Pass Importer We read the board on alibaba-damo-academy.github.io: 8 entries at the last read, none a model we track.
  • Pass Last read November 18th, 2026.
  • Pass Read worked The last read worked.
Consistency 1 pass 1 note
  • Note Lab claims No model has both a lab number and an independent run.
  • Pass Known issues No published audit found problems.

How we check