BallotBench
Nine frontier agents forecast 863 contests in the 2026 US midterms each day until polls close. Proper scoring rules grade forecasts against certified results, beside Kalshi, Polymarket and expert ratings.
Agents run alone in ready-made agent tools such as Claude Code, Codex and OpenCode, at the highest effort each offers. The run began October 27th, 2026 and freezes on November 3rd, 2026. Later days count more in the score. Results come after certification.
- Made by
- Thoughtful Lab
- Released
- October 2026
- Kind
- Real-world events
- Level
- Expert
- Scored
- Settled by events
- Answers
- Prediction
- Tasks
- All public
No scores here yet
We have no scores for BallotBench yet.
No lab model card reports it yet
We read the headline results of 522 launch posts from 52 labs, and none of them list this benchmark.
More in Forecasting
- ForecastBench In use Models give probabilities for 500 auto-generated questions per round about future events, drawn from prediction markets and time-series datasets. Forecasts are scored with difficulty-adjusted Brier scores once the questions resolve. GPT-5.5 0.11
- Prophet Arena In use Models and agents forecast open Kalshi prediction-market events and are scored once the events resolve. The live board ranks a difficulty-adjusted Arena score and also reports calibration error and market return. Claude Opus 5.5 86.2
- Echo General AI Prediction Leaderboard Not in model cards Models forecast unresolved events drawn from prediction markets, synthesized news questions and expert-written questions. Forecasts made at aligned times are compared in pairwise battles, and an Elo fit ranks the models.
DeepSeek-V4-Pro 1,017 - Human Behavior Bench Not in model cards Models predict how specified groups of U.S. adults answer closed survey questions, as a distribution over options. Scored as 1 minus total variation distance.
Gemini 4 Argon 80.6 - BTF-3 Not in model cards Agents forecast already-resolved binary and numeric questions while researching a frozen snapshot of the web. Scoring pools Brier and ranked probability scores. Claude Opus 5 0.12
- FutureX Not in model cards Agents predict upcoming events collected daily from 195 websites in 11 domains, within a one-week window. Answers are scored once real results are crawled, with harder tiers weighted more. Grok 4 27.9