Benchmark Almanac

Multimodal Art Projection

We track 4 benchmarks that Multimodal Art Projection made or helped make.

0 in use 3 with public code 4 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
KOR-Bench Models read a new rule set and apply it to questions in five task types: operation, logic, cipher, puzzle and counterfactual. Scored by accuracy against an answer key. Abstract puzzles and logic Oct 2024 72.9% Fading
OmniBench Models answer multiple choice questions that need an image, an audio clip and text together. Scored by accuracy. Audio understanding and voice Sep 2024 56.1% Dropped
CodeEditorBench Models edit code in four scenarios: debugging, translation, requirement switching and polishing. Unit tests check the edits, and polishing also measures speed and memory gains. Function-level problems Apr 2024 85.5% System cards only
MusicTheoryBench Models answer college music theory questions about musical knowledge and reasoning. Some questions include a score written in ABC notation. Exam questions Dec 2023 71.1% Not in cards