Benchmark Almanac

MIT CSAIL

We track 1 benchmark and 1 arena that MIT CSAIL made or helped make.

0 in use 2 with public code 2 with a leaderboard here

Arena leaderboards

Top five in each of its 1 arena with three or more rated models, the most rated first.

Benchmarks

Name Kind Released Best score Status
CRUXEval Models predict the output of 800 short Python functions for a given input, or an input that yields a given output. Scored by pass@1. Function-level problems Jan 2024 95.9% Fading