Benchmark Almanac

BenchCAD 2.1-beta

Not in model cards

Models reconstruct parts, assemblies, and circuit boards from drawings and images. The Core set contains 100 problems with partial credit.

Models retain reasoning across rounds with 40 rounds and 500,000 output tokens. Scores do not compare with 2.0 or 2.1. Core requires a Hugging Face account with access. Public samples are available.

Made by
BenchCAD team
Released
October 2026
Kind
CAD models
Level
Expert
Scored
Checked automatically
Answers
Agent task
Tasks
Public, plus a private test set

No scores here yet

No lab, leaderboard or Epoch AI run has reported a score for BenchCAD 2.1-beta yet.

No lab model card reports it yet

We read the headline results of 522 launch posts from 52 labs, and none of them list this benchmark.

Versions

We switch the top row to each new version when it comes out. Open it for one row per version. An old version stays in play while people still test it, so whoever first takes it past 85% gets credit for closing it out.

Anthropic OpenAI
BenchCAD 2.0 4 leaders
GPT-6 Astra 59%
BenchCAD Passed 85% in Sep 2026, by GPT-6 Astra
GPT-6 Astra 95.9%
BenchCAD 2.0 1 leader
GPT-6 Astra 59%

Sources: Official leaderboards and labs’ model cards

Replaces BenchCAD 2.0 Replaced by BenchCAD 2.1

More in Engineering and CAD

All 23 in Engineering and CAD
  • EEBench In use 13 electrical-engineering circuit and PCB design tasks graded by deterministic build checks, simulation and BOM constraints. No LLM judge. Gemini 4 Carbon 83.9%
  • Parametric CAD Bench In use Agents author editable parametric FreeCAD part designs, graded against held-back references for geometry and spec consistency. Claude Opus 5.5 61%
  • 3DCodeBench In use Agentic procedural 3D modeling via code: author engine-ready 3D assets through software APIs. Graded for executability and shape fidelity. LongCat-2.5 55.4%
  • CADGenBench Only in system cards Agents construct CAD models from design prompts. The generation split is graded for executability and geometric correctness. Claude Fable 5 45.1%
  • PartBench Only in system cards Parametric mechanical part design and CAD-style generation, graded for geometric and manufacturing fidelity. Grok 4.6 58.5%
  • LMBuild Not in model cards Language model agents design 3D structures as parts, joints, materials and assembly steps. Scoring checks that the structures can be built and work as intended. GPT-6 Astra 66.5%