Benchmark Almanac

Avature

We track 7 benchmarks that Avature made or helped make.

0 in use 3 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
Multilingual Entity Linking of Occupations Models map occupational titles from national classifications to European occupation codes. The benchmark scores the rank of the first correct match. Other professions Oct 2024 Not in cards
Multilingual Entity Linking of Skills Models match skill names from Belgian, German, and Swedish classifications to European skill entries. Official mappings identify the correct matches. Other professions Jan 2026 Not in cards
TalentCLEF 2025 Job Title-Based Skill Prediction Models rank skills for an English job title. Organizers compare the ranking with annotated skills using mean average precision. Other professions Sep 2024 Not in cards
TalentCLEF 2025 Multilingual Job Title Matching Models rank job titles by how closely they match a query title within or across languages. Organizers score mean average precision. Other professions Sep 2024 Not in cards
TalentCLEF 2026 Contextualized Job-Person Matching Models rank candidate resumes for a job description in English or Spanish. Organizers score retrieval within and across languages and compare rankings across gender variants. Other professions Nov 2025 Not in cards
TalentCLEF 2026 Job-Skill Matching with Skill Type Classification Models rank skills for an English job title. The main ranking metric gives core skills more weight than contextual skills. Other professions Nov 2025 Not in cards
WorkRB Skill Extraction Challenge 2026 Models rank occupational skills for vacancy sentences and alternative skill names. Organizers average graded ranking scores at depth 100 across five test sets. Other professions Jun 2026 Not in cards