Benchmark Almanac

SMM4H-HeaRD organizers

We track 5 benchmarks that SMM4H-HeaRD organizers made or helped make.

0 in use 0 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
SMM4H 2025 Food Recalls and Foodborne Disease Outbreaks Models classify news articles as recalls, outbreaks, or neither. They also extract details such as the product, cause, and number of people affected. Medicine Mar 2025 0.88 Not in cards
SMM4H 2025 Shingles Vaccine Reactions Models classify English Reddit posts about shingles vaccines. Organizers score F1 for posts in which the author reports a personal reaction. Medicine Feb 2025 Not in cards
SMM4H-HeaRD 2025 Multilingual Adverse Drug Event Detection Models classify posts in English, French, German, and Russian by whether the author reports a drug side effect. The French test translates German forum posts. Medicine Feb 2025 Not in cards
SMM4H-HeaRD 2026 Flu Vaccine Effectiveness Models classify posts by the author’s flu vaccination status and flu test result. The labels distinguish the current flu season from past seasons. Medicine Nov 2025 Not in cards
SMM4H-HeaRD 2026 Multilingual Adverse Drug Event Detection Models flag personal reports of drug side effects in seven languages. The organizers withheld Farsi from training and added 15,184 Farsi posts at test time. Medicine Nov 2025 Not in cards