Benchmark Almanac

Massachusetts Institute of Technology

We track 2 benchmarks that Massachusetts Institute of Technology made or helped make.

0 in use 2 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
DesignQA Models read Formula SAE rules and inspect CAD views and drawings of a student race car. They retrieve rules, identify parts, and check compliance. CAD models Apr 2024 0.72 Not in cards
Materials Science Procedural Text Corpus Models identify operations in materials synthesis procedures and link each operation to its materials, instruments, and conditions. Experts annotated 230 procedures. Lab and data work Nov 2018 Not in cards