UC Santa Barbara
We track 8 benchmarks that UC Santa Barbara made or helped make.
0 in use 6 with public code 5 with a leaderboard here
Benchmarks
| Name | Kind | Released | Best score | Status |
|---|---|---|---|---|
| VATEX Models write English or Chinese captions for short video clips from a set of over 41,000 videos. Scored by CIDEr. | Video captioning | Apr 2019 | | Fading |
| VATEX ZH Models write Chinese captions for short videos of human activities from the VATEX dataset. Captions are scored with CIDEr against human references. | Video captioning | Apr 2019 | | Dropped |
| Visual Aesthetic Benchmark Models see a set of images with the same subject and intent and must pick the best one, and in a harder setting both the best and the worst. The 400 sets hold 1,195 commissioned works across fine art, photography and illustration. Labels come from expert judgments, and only sets where experts largely agreed are kept. | Taste and style | May 2026 | 40.3% | Not in cards |
| HarnessAudit-Bench Agents run inside execution harnesses such as Claude Code, Codex and OpenClaw on 210 tasks across eight domains, from finance to software engineering, with safety rules built in. The audit reads the full trajectory through channels the agent cannot change. It scores whether the agent stays inside its permission and information-flow policies, completes checkpoints, and keeps both under prompt injection, vague goals and tool errors. | Refusing harmful requests | May 2026 | | Not in cards |
| WorldAuditBench Multimodal agents explore interactive 3D worlds to find anomalies such as floating objects, walls that can be walked through or out-of-place objects. | Embodied reasoning | Sep 2026 | 42.3% | Not in cards |
| ConvFinQA Models answer a conversation of related numerical questions about a company's financial report, with tables and text, where later questions build on earlier answers. The dataset has about 3,900 conversations with 14,000 questions, built from FinQA. Answers are checked by execution accuracy against the gold reasoning program. | Finance | Oct 2022 | 58.7% | Not in cards |
| FinQA Models answer numerical questions about company earnings reports that mix tables and text. Financial experts wrote 8,281 question and answer pairs, each with a gold reasoning program. Answers are checked by execution accuracy and program accuracy. | Finance | Sep 2021 | Not in cards | |
| TabFact Models decide whether a statement is entailed or refuted by a Wikipedia table. Classification accuracy measures agreement with human labels. | Faithful to sources | Sep 2019 | Not in cards |