Benchmark Almanac

Pennsylvania State University

We track 5 benchmarks that Pennsylvania State University made or helped make.

0 in use 4 with public code 5 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
OmniRouting Models route copper traces between pads on printed circuit boards. The evaluator counts required nets that connect without design rule violations. Electronics Jul 2026 28% Not in cards
OmniLayout Models place components inside a board outline. The evaluator checks overlap, routing, and electrical functionality against the schematic and the reference layout. Electronics Jun 2026 0.76 Not in cards
OmniCAD Models choose parts from a component library and predict their assembly positions, orientations, and connections. The evaluator measures pose accuracy and how well connections match. CAD models Aug 2026 100% Not in cards
OmniMech Models write CAD programs to reconstruct parts from dimensioned drawings. The evaluator compares the reconstructed geometry with reference parts and measures relative volume error. CAD models Aug 2026 15.9% Not in cards
OmniSch Models convert circuit schematics into graphs of components, pins, and connections. A second task lets models search schematic images for individual features. Electronics Mar 2026 0.28 Not in cards