Benchmark Almanac

Inria

We track 3 benchmarks that Inria made or helped make.

0 in use 2 with public code 2 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
Stick to Your Role! Models simulate populations of fictional personas and answer personal-values questionnaires in many different conversation contexts. The benchmark measures how stable the expressed values stay across contexts, both for each persona and for the ranking of personas within the population. Creative writing Feb 2024 0.90 Not in cards
RoCS-MT v2 Models translate Reddit posts with revised spelling annotations and corrected references. The authors combine COMETKiwi and MetricX rankings for translations of the original text. Translation Nov 2025 7.00 Not in cards
RoCS-MT Models translate English Reddit posts before and after editors standardize the spelling and wording. The authors compare translation scores across both inputs. Translation Oct 2023 Not in cards