Benchmark Almanac

GAIK project

We track 3 benchmarks that GAIK project made or helped make.

0 in use 3 with public code 3 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
GAIK Ajokortti transcription test Models transcribe one three-minute Finnish dental webinar excerpt with two speakers. The project reports word error rate and separately counts errors that change the meaning. Speech recognition and translation Jan 2026 1.00% Not in cards
GAIK LA-murre dialect test Models transcribe 583 Finnish dialect interview segments from ten localities. The reference preserves dialect forms, so standard Finnish spellings can count as errors. Speech recognition and translation Oct 2026 60.2% Not in cards
GAIK SKN dialect test Models transcribe 600 Finnish dialect interview segments from ten municipalities. The reference uses standard Finnish word forms. Speech recognition and translation Oct 2026 34.6% Not in cards