Benchmark Almanac

Vésteinn Snæbjarnarson

We track 4 benchmarks that Vésteinn Snæbjarnarson made or helped make.

0 in use 2 with public code 2 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
Icelandic WinoGrande Models complete Icelandic sentences by choosing which referent fits the context. The evaluation uses an Icelandic adaptation of WinoGrande. Reasoning in many languages Jun 2022 96.3% Not in cards
Faroese Semantic Textual Similarity Models score how closely two Faroese sentences agree in meaning. The evaluation compares their rankings with reference judgments. Reading in many languages May 2023 0.87 Not in cards
FoNE Models identify named entities in Faroese news articles. The authors manually verified the automatically assigned labels. Reading in many languages May 2023 Not in cards
Natural Questions in Icelandic Models extract answers from Icelandic Wikipedia articles. Annotators write questions after seeing only the beginning of an article. Reading in many languages Jun 2022 Not in cards