Benchmark Almanac

Asma Ben Abacha

We track 6 benchmarks that Asma Ben Abacha made or helped make.

0 in use 6 with public code 1 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
MEDEC Models identify and correct errors in clinical notes across five categories. The OpenMed port uses the MEDEC-MS subset. Medicine Dec 2024 69.1% Not in cards
MEDIQA 2019 Question Answering Models answer consumer health questions or assess candidate answers. The shared task evaluates the relevance and quality of answers to medical questions. Medicine Aug 2019 Not in cards
MedQuAD Systems answer medical questions using a collection of 47,457 question-answer pairs from NIH websites. The OpenMed port uses a model judge on a subset. Medicine Jan 2019 Not in cards
MeQSum Models condense consumer health questions into shorter questions while preserving the medical information needed for retrieval. Reference summaries provide the comparison. Medicine Jul 2019 Not in cards
MTS-Dialog Models write a clinical note section from a conversation between a doctor and a patient. The evaluation compares it with the reference note. Medicine May 2023 Not in cards
TREC 2017 LiveQA Medical Task Models answer consumer health questions. The shared task compares responses with expert assessments of answer quality. Medicine Not in cards