PWS-Decisions
Decision APIs choose answers to 300 closed-ended questions whose answers depend on current or scattered facts on the public web.
The benchmark has 100 public questions and 200 private questions. Parallel reports three-run whole-set results for five decision APIs, with 76.22% for Parallel Decisions and 41.67% for OpenAI Decisions.
- Made by
- Parallel Web Systems
- Released
- November 2026
- Kind
- Deep research
- Level
- Expert
- Scored
- Checked automatically
- Answers
- Multiple choice
- Tasks
- Public, plus a private test set
- Measures
- Capability
- Language
- English
- Interaction
- Agentic
- Environment
- Browser, APIs and tools
- Items from
- Real work and use
- Refresh
- One fixed set
- Run by
- A host
- In views
- Agents
Parallel Decisions API tops the leaderboard with 76.2%
Best score per entry from the benchmark's own leaderboard, read on November 21st, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders.
- 1 Parallel Decisions API whole set 76.2%
- 2 Perplexity Decisions whole set 50.9%
- 3 Baseten Mammoth whole set 45%
- 4 OpenAI Decisions API whole set 41.7%
- 5 TypeSafe Jev 1.14 whole set 33.4%
Source: Official PWS-Decisions leaderboard
| # | Entry | Score ± | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | Parallel Decisions API | 76.2% ±0.5 | whole set | Oct 2026 | Official leaderboard |
| 2 | Perplexity Decisions | 50.9% ±1 | whole set | Oct 2026 | Official leaderboard |
| 3 | Baseten Mammoth | 45% | whole set | Oct 2026 | Official leaderboard |
| 4 | OpenAI Decisions API | 41.7% | whole set | Oct 2026 | Official leaderboard |
| 5 | TypeSafe Jev 1.14 | 33.4% ±0.5 | whole set | Oct 2026 | Official leaderboard |
No lab model card reports it yet
We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.
More in Tool use
- AutomationBench In use Agent completes end-to-end business workflows inside a simulated company exposing dozens of REST APIs. Graded on resulting state.
Gemini 4 Neon 56.3%
- MCP Atlas In use Multi-step workflows over real MCP servers. Scores tool-use competency on realistic tasks.
Gemini 4 Argon 90.7%
- BFCL V4 In use Models call functions and tools, including multi-turn agentic tasks with web search and memory. Checked against expected calls and outcomes.
Qwen3.7-Max 75%
- τ³-bench Banking In use Agents act as banking customer-service reps over many turns with a simulated user, following policy. Pass^1 on the final database state.
Qwen 3.8 Max 55.1%
- Toolathlon-Verified In use 108 long-horizon tasks across 32 apps through about 600 MCP tools. Execution-based checkers inspect final environment state. GLM-5.3-Flash 78.4%
- DeepSearchQA In use Questions that need multi-step search and synthesis. Final answers graded against references. Kimi K3 95%
Data audit
All 8 checks pass. Every benchmark
Catalog record 2 pass
- Pass Task access Public tasks, plus a private test set.
- Pass Confidence Checked against a primary source.
Scores 2 pass 3 notes
- Pass Independent runs Scores from the official leaderboard (5 entries).
- Pass Models scored 5 entries on its leaderboard, none a model we track.
- Note Newest score No scores yet.
- Note Frontier models No models scored yet.
- Note Headroom No scores yet.
Leaderboard import 3 pass
- Pass Importer We read the board on github.com: 5 entries at the last read, none a model we track.
- Pass Last read November 21st, 2026.
- Pass Read worked The last read worked.
Consistency 1 pass 1 note
- Note Lab claims No model has both a lab number and an independent run.
- Pass Known issues No published audit found problems.