Benchmark Almanac

OdysseyArena Energy Dispatch

Gemini 3 Pro Preview [snapshot unspecified] 30% tops its leaderboard GPT-5 23.3% leads the models we track
Not in model cards

Agents manage energy dispatch under hidden rules. The score is average task success over four trials.

One track of OdysseyArena. The OdysseyArena record keeps lab scores that combine tracks.

Released
February 2026
Kind
Puzzles and chess
Level
Expert
Scored
Checked automatically
Answers
Agent task
Tasks
All public
Strongest model tested
GPT-5 #70 on the capability index
Last model added
December 2025
Scores refreshed
November 12th, 2026

In the authors’ words

The advancement of Large Language Models (LLMs) has catalyzed the development of autonomous agents capable of navigating complex environments. However, existing evaluations primarily adopt a deductive paradigm, where agents execute tasks based on explicitly provided rules and static goals, often within limited planning horizons. Crucially, this neglects the inductive necessity for agents to discover latent transition laws from experience autonomously, which is the cornerstone for enabling agentic foresight and sustaining strategic coherence. To bridge this gap, we introduce OdysseyArena, which re-centers agent evaluation on long-horizon, active, and inductive interactions. We formalize and instantiate four primitives, translating abstract transition dynamics into concrete interactive environments. Building upon this, we establish OdysseyArena-Lite for standardized benchmarking, providing a set of 120 tasks to measure an agent's inductive efficiency and long-horizon discovery. Pushing further, we introduce OdysseyArena-Challenge to stress-test agent stability across extreme interaction horizons (e.g., > 200 steps). Extensive experiments on 15+ leading LLMs reveal that even frontier models exhibit a deficiency in inductive scenarios, identifying a critical bottleneck in the pursuit of autonomous discovery in complex environments. Project homepage: https://os-copilot.github.io/OdysseyArena-Home/

Abstract of OdysseyArena: Benchmarking Large Language Models For Long-Horizon, Active and Inductive Interactions (arXiv:2602.05843, CC0)
13
Entries on its own leaderboard, 8 models we track

Gemini 3 Pro Preview [snapshot unspecified] tops the leaderboard with 30%

Best score per entry from the benchmark's own leaderboard, read on November 12th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. The best model we track is GPT-5, at 23.3%.

The newest model with a score here came out in December 2025, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:

  1. 1 Gemini 3 Pro Preview [snapshot unspecified] 30%
  2. 2 GPT-5 23.3%
  3. 3 Gemini 2.5 Pro [snapshot unspecified] 10.8%
  4. 4 GLM-4-32B-0414 0%
  5. 5 Llama 3.1 8B Instruct 0%
  6. 6 Qwen3-4B-Instruct 0%
  7. 7 GLM-4-9B-Chat 0%
  8. 8 Llama 3.3 70B Instruct 0%
  9. 9 Qwen3-235B-A22B-Instruct Jul 2025 0%
  10. 10 Qwen3-30B-A3B-Instruct Jul 2025 0%
  11. 11 gpt-oss-120b high 0%
  12. 12 Grok 4 Fast 0%
  13. 13 DeepSeek-V3.2 0%

Source: Official OdysseyArena Energy Dispatch leaderboard

#EntryScoreSettingDateSource
1 Gemini 3 Pro Preview [snapshot unspecified] 30% Official leaderboard
2 GPT-5 23.3% Aug 2025 Official leaderboard
3 Gemini 2.5 Pro [snapshot unspecified] 10.8% Official leaderboard
4 GLM-4-32B-0414 0% Official leaderboard
5 Llama 3.1 8B Instruct 0% Official leaderboard
6 Qwen3-4B-Instruct 0% Official leaderboard
7 GLM-4-9B-Chat 0% Jun 2024 Official leaderboard
8 Llama 3.3 70B Instruct 0% Dec 2024 Official leaderboard
9 Qwen3-235B-A22B-Instruct Jul 2025 0% Jul 2025 Official leaderboard
10 Qwen3-30B-A3B-Instruct Jul 2025 0% Jul 2025 Official leaderboard
11 gpt-oss-120b 0% high Aug 2025 Official leaderboard
12 Grok 4 Fast 0% Sep 2025 Official leaderboard
13 DeepSeek-V3.2 0% Dec 2025 Official leaderboard

Number one over time

Lab claims count from the day the card came out, independent runs from the model’s release.

OpenAI
Own leaderboard Not tested since Feb 2026
GPT-5 23.3%

Source: Official OdysseyArena Energy Dispatch leaderboard

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

On the benchmark’s own leaderboard Best so far
0% 20% 40% 60% 80% 100% 2024 2025 2026 Near the ceiling (85%) GPT-5 GLM-4-9B-Chat 0% 20% 40% 60% 80% 100% 2024 2025 2026 Near the ceiling (85%) GPT-5 GLM-4-9B-Chat

Source: Official OdysseyArena Energy Dispatch leaderboard

No lab model card reports it yet

We read the headline results of 522 launch posts from 52 labs, and none of them list this benchmark.

More in Games and long tasks

All 82 in Games and long tasks
  • ARC-AGI-3 In use Interactive game environments where agents must explore, infer goals and rules, and act efficiently without instructions. GPT-6 Astra 99.95%
  • Orak Fading LLM agents play 12 popular video games across most genres through an MCP interface. Each game scores in-game progress or outcomes, and the board ranks models by their average rank across the games. Gemini 2.5 Pro 3.90
  • MineDojo Fading Agents complete open-ended tasks in Minecraft, such as mining blocks and fighting mobs, from a large simulation suite. Programmatic checks score many tasks. Seed2.0 Pro 49%
  • TextQuests Only in system cards Agents play 25 classic interactive fiction games. The score is harmful actions per 100 steps, where lower is better. The board also reports game progress. Llama 4 Scout 7.00
  • GameWorld Only in system cards Multimodal game agents play 34 browser games across 170 tasks. Outcomes are checked from the game state. GPT-6.1 Terra 76.8%
  • Swarm Bench Only in system cards Models orchestrate agent swarms on complex tasks that benefit from coordinated decomposition and parallel execution. Kimi K3 76.3%