Benchmark Almanac

École des Ponts

We track 3 benchmarks that École des Ponts made or helped make.

0 in use 3 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
CMD-AD-Eval Models describe what happens on screen during gaps in movie dialogue. The authors compare the descriptions with timed human narration using text overlap and model judgments. Video captioning Apr 2024 Not in cards
MAD-Eval Models write descriptions for scenes from ten movies. One set of references names characters. Another replaces their names with the word “SOMEONE.” Video captioning Mar 2023 Not in cards
TV-AD Models describe what viewers can see during clips from television episodes. The test pairs each clip with a timed reference description. Video captioning Jul 2024 Not in cards