Benchmark Almanac

EPFL

We track 2 benchmarks that EPFL made or helped make.

0 in use 0 with public code 1 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
INCLUDE Models answer multiple-choice questions from local academic and professional exams in 44 languages that test regional knowledge. Scored by accuracy. Knowledge in many languages Nov 2024 89.8% Fading
Passkey Retrieval Models find a random passkey hidden at a random position in a long filler prompt. Scored by retrieval accuracy. Finding facts in long inputs May 2023 100% Dropped