Cozzo AI Receptionist Benchmark (Round 5)
Version Round 5
Voice agents answer calls for a roofer, a gym, and a career coach. Cozzo checks quotes, bookings, urgent requests, after-hours answers, and interruptions.
Cozzo compares seven agents across three businesses. It lists a partial OpenAI run separately. Six agents have resolved scores for repeating the roofing caller’s number.
- Made by
- Cozzo Labs LLC
- Released
- October 2026
- Kind
- Customer service
- Level
- Everyday
- Scored
- Graded by people
- Answers
- Agent task
- Measures
- Capability
- Language
- English
- Interaction
- Multi-turn
- Items from
- Written by experts
- Refresh
- New versions replace it
- Run by
- A host
- Based on
- A version of another benchmark
- Occupations
- Office and administrative support
- In views
- Audio and speech
Vapi tops the leaderboard with 100%
Best score per entry from the benchmark's own leaderboard, read on November 20th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders.
- 1 Vapi 100%
- 2 Bland 50%
- 3 ElevenLabs 50%
- 4 LiveKit 50%
- 5 Millis 50%
- 6 Retell 0%
Source: Official Cozzo AI Receptionist Benchmark (Round 5) leaderboard
| # | Entry | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | Vapi | 100% | Vapi | Oct 2026 | Official leaderboard |
| 2 | Bland | 50% | Bland | Oct 2026 | Official leaderboard |
| 3 | ElevenLabs | 50% | ElevenLabs | Oct 2026 | Official leaderboard |
| 4 | LiveKit | 50% | LiveKit | Oct 2026 | Official leaderboard |
| 5 | Millis | 50% | Millis | Oct 2026 | Official leaderboard |
| 6 | Retell | 0% | Retell | Oct 2026 | Official leaderboard |
No lab model card reports it yet
We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.
Versions
More in Tool use
- AutomationBench In use Agent completes end-to-end business workflows inside a simulated company exposing dozens of REST APIs. Graded on resulting state.
Gemini 4 Neon 56.3%
- MCP Atlas In use Multi-step workflows over real MCP servers. Scores tool-use competency on realistic tasks.
Gemini 4 Argon 90.7%
- BFCL V4 In use Models call functions and tools, including multi-turn agentic tasks with web search and memory. Checked against expected calls and outcomes.
Qwen3.7-Max 75%
- τ³-bench Banking In use Agents act as banking customer-service reps over many turns with a simulated user, following policy. Pass^1 on the final database state.
Qwen 3.8 Max 55.1%
- Toolathlon-Verified In use 108 long-horizon tasks across 32 apps through about 600 MCP tools. Execution-based checkers inspect final environment state. GLM-5.3-Flash 78.4%
- DeepSearchQA In use Questions that need multi-step search and synthesis. Final answers graded against references. Kimi K3 95%
Data audit
7 of 8 checks pass, 1 warning. Look first at the Task access check. We don’t know whether the tasks are public. Every benchmark
Catalog record 1 warning 1 pass
- Warning Task access We don’t know whether the tasks are public.
- Pass Confidence Checked against a primary source.
Scores 2 pass 3 notes
- Pass Independent runs Scores from the official leaderboard (6 entries).
- Pass Models scored 6 entries on its leaderboard, none a model we track.
- Note Newest score No scores yet.
- Note Frontier models No models scored yet.
- Note Headroom No scores yet.
Leaderboard import 3 pass
- Pass Importer We read the board on cozzo.io: 6 entries at the last read, none a model we track.
- Pass Last read November 20th, 2026.
- Pass Read worked The last read worked.
Consistency 1 pass 1 note
- Note Lab claims No model has both a lab number and an independent run.
- Pass Known issues No published audit found problems.