- SWE-Bench Pro 65.2
- KAT Code Bench 53.1
- PinchBench(Avg) 94.9
- KAT Claw Bench 85.5
- Terminal-Bench 2.1 (AA Coding Index category) 60.7
- SciCode (AA Coding Index category) 50.3
KAT-Coder-Pro V2.5
KAT-Coder-Pro V2.5 ranks first on PinchBench.
6
Benchmarks with a score
1
Ranked first, out of five or more models
1
In the top three
KAT-Coder-Pro V2.5
Closed weights Flagship
No Epoch Capabilities Index score yet
- SciCode 50.3% #9 /49
- PinchBench 94.9% #1 /14
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SWE-Bench Pro | 65.2% | #14 of 81 | Lab model card | |
| SciCode | 50.3% | #9 of 49 | Lab model card | |
| KAT Code Bench | 53.1% | #1 of 2 | Lab model card |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| PinchBench | 94.9% | #1 of 14 | Lab model card | |
| Terminal-Bench 2.1 | 60.7% | #44 of 56 | Lab model card | |
| KAT Claw Bench | 85.5% | #1 of 1 | Lab model card |
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.