Benchmark Almanac

Julen Etxaniz

We track 5 benchmarks that Julen Etxaniz made or helped make.

0 in use 5 with public code 5 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
BertaQA Models answer questions about Basque culture and general knowledge. Parallel Basque and English questions help distinguish language effects from familiarity with local topics. Trivia and open questions Jun 2024 81.5% Not in cards
EusExams Models answer past public service examination questions in Basque. The questions come from several Basque institutions. Knowledge in many languages Mar 2024 51.3% Not in cards
EusReading Models answer comprehension questions about Basque passages from past C1 proficiency examinations. The scorer checks their choices against the exam key. Reading in many languages Mar 2024 62.2% Not in cards
EusTrivia Models answer trivia questions in Basque. The set combines elementary-school questions with harder general knowledge questions. Knowledge in many languages Mar 2024 51% Not in cards
EusProficiency Models complete Basque language exercises from the official C1 proficiency examination. The questions test vocabulary and grammar. Reading in many languages Mar 2024 56.7% Not in cards