Benchmark Almanac

Markov

We track 2 benchmarks that Markov made or helped make.

0 in use 1 with public code 2 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
SolidWorks Bench Agents model the custom parts of 73 real machines in SolidWorks and assemble them from raster drawing packages, through screenshots and the SolidWorks API. A grader checks the geometry against the reference and reads mates, motion and feature trees from the native files. CAD models Nov 2026 0.57 Not in cards
AutoCAD Bench Computer-use agents turn a dimensioned reference drawing into a correct, editable DWG in AutoCAD through the screen alone, with mouse and keyboard. 50 tasks span 2D drafting and 3D modeling at four difficulty levels. CAD models Jul 2026 46% Not in cards