Benchmark Almanac

University of British Columbia

We track 3 benchmarks that University of British Columbia made or helped make.

0 in use 2 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
Jawaher Models translate Arabic proverbs into English and explain their meanings in English and Arabic. Human raters score translations and explanations on five-point scales. Translation Feb 2025 Not in cards
PalmX 2025 General Culture Models choose answers about customs, history and daily life across Arab countries. The test contains 2,000 questions in Modern Standard Arabic. Knowledge in many languages Jun 2025 Not in cards
PalmX 2025 Islamic Culture Models choose answers about Islamic practices, scripture and history in Modern Standard Arabic. The organizers score exact answer choices. Knowledge in many languages Jun 2025 Not in cards