Benchmark Almanac

University of Pennsylvania

We track 4 benchmarks that University of Pennsylvania made or helped make.

0 in use 4 with public code 1 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
MultiRC Models pick all correct answers to questions that need reasoning over several sentences of a paragraph. Scored by F1 over answer options. Reading comprehension Jun 2018 88.2% Dropped
MentalChat16K Counseling Evaluation Models answer 200 mental health questions from online forums. Judges rate each response from one to ten on seven counseling skills. Medicine Jan 2024 8 Not in cards
Penn epilepsy clinic notes Models read dated paragraphs from epilepsy clinic notes and classify recent seizures. Two other questions ask for seizure frequency and the most recent seizure date. Medicine Jan 2022 Not in cards
VAERS influenza vaccine adverse event extraction Models mark six kinds of clinical information in influenza vaccine safety reports, including neurological events, procedures, and time expressions. Researchers score exact or overlapping text spans. Medicine Aug 2020 Not in cards