Benchmark Almanac

Orion Weller

We track 4 benchmarks that Orion Weller made or helped make.

0 in use 2 with public code 1 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
FollowIR Models rank documents in response to a search instruction. The benchmark tests whether revising the instruction changes the ranking of the affected documents. Questions that need search Mar 2024 0.12 Not in cards
mFollowIR Models rank documents according to a search instruction across multiple languages. Questions that need search Jan 2025 5.40 Not in cards
LIMIT Models retrieve specific pairs of documents from a shared collection using embeddings. Questions that need search Aug 2025 Not in cards
NevIR Models distinguish documents whose meanings differ because one passage negates a statement. Questions that need search May 2023 Not in cards