Multimodal Art Projection
We track 4 benchmarks that Multimodal Art Projection made or helped make.
0 in use 3 with public code 4 with a leaderboard here
Benchmarks
| Name | Kind | Released | Best score | Status |
|---|---|---|---|---|
| KOR-Bench Models read a new rule set and apply it to questions in five task types: operation, logic, cipher, puzzle and counterfactual. Scored by accuracy against an answer key. | Abstract puzzles and logic | Oct 2024 | 72.9% | Fading |
| OmniBench Models answer multiple choice questions that need an image, an audio clip and text together. Scored by accuracy. | Audio understanding and voice | Sep 2024 | | Dropped |
| CodeEditorBench Models edit code in four scenarios: debugging, translation, requirement switching and polishing. Unit tests check the edits, and polishing also measures speed and memory gains. | Function-level problems | Apr 2024 | 85.5% | System cards only |
| MusicTheoryBench Models answer college music theory questions about musical knowledge and reasoning. Some questions include a score written in ABC notation. | Exam questions | Dec 2023 | 71.1% | Not in cards |