FutureEval (Metaculus)
Models forecast open Metaculus questions with a fixed prompt and are scored as the questions resolve. Seasonal bot tournaments and Pro Forecaster baselines run alongside.
Metaculus renamed its AI Benchmarking bot tournaments, run since 2024, to FutureEval in February 2026. The model score is based on log scores.
- Made by
- Metaculus
- Released
- February 2026
- Kind
- Real-world events
- Level
- Expert
- Scored
- Settled by events
- Answers
- Prediction
- Tasks
- All public
No scores here yet
We have no scores for FutureEval (Metaculus) yet.
No lab model card reports it yet
We read the headline results of 522 launch posts from 52 labs, and none of them list this benchmark.
More in Forecasting
- ForecastBench In use Models give probabilities for 500 auto-generated questions per round about future events, drawn from prediction markets and time-series datasets. Forecasts are scored with difficulty-adjusted Brier scores once the questions resolve. GPT-5.5 0.11
- Prophet Arena In use Models and agents forecast open Kalshi prediction-market events and are scored once the events resolve. The live board ranks a difficulty-adjusted Arena score and also reports calibration error and market return. Claude Opus 5.5 86.2
- Echo General AI Prediction Leaderboard Not in model cards Models forecast unresolved events drawn from prediction markets, synthesized news questions and expert-written questions. Forecasts made at aligned times are compared in pairwise battles, and an Elo fit ranks the models.
DeepSeek-V4-Pro 1,017 - Human Behavior Bench Not in model cards Models predict how specified groups of U.S. adults answer closed survey questions, as a distribution over options. Scored as 1 minus total variation distance.
Gemini 4 Argon 80.6 - BTF-3 Not in model cards Agents forecast already-resolved binary and numeric questions while researching a frozen snapshot of the web. Scoring pools Brier and ranked probability scores. Claude Opus 5 0.12
- FutureX Not in model cards Agents predict upcoming events collected daily from 195 websites in 11 domains, within a one-week window. Answers are scored once real results are crawled, with harder tiers weighted more. Grok 4 27.9