Benchmark Almanac

Université de Montréal

We track 2 benchmarks that Université de Montréal made or helped make.

0 in use 2 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
MatSci-NLP Models read text from materials science papers and complete seven tasks, including identifying synthesis actions and linking measurements to experiments. The authors used 99% of examples for testing. Lab and data work May 2023 Not in cards
OpenLex3D Models label points and retrieve objects in indoor 3D scans. Annotators distinguish an object’s synonyms from pictures on its surface and visually similar objects. Spatial reasoning and counting Mar 2025 Not in cards