Benchmark Almanac

VideoFDB

Tavus Griffin Lite 3.73 tops its leaderboard MiniCPM-o 4.5 3.44 leads the models we track
Not in model cards

Multimodal agents are evaluated on two-person video conference recordings. They cover 11 conversational dynamics across verbal, nonverbal and mixed behavior, annotated by people in three passes.

Gated Hugging Face dataset. A launch post on r/singularity (1,387 points) said a human interaction model ranked first on it. Scoring method needs a check.

Made by
NVIDIA
Released
May 2026
Kind
Speech recognition and translation
Level
Everyday
Scored
Graded by people
Answers
Open-ended
Tasks
All public
Last model added
February 2026
Scores refreshed
November 11th, 2026
8
Entries on its own leaderboard, 2 models we track

Tavus Griffin Lite tops the leaderboard with 3.73

Best score per entry from the benchmark's own leaderboard, read on November 11th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. The best model we track is MiniCPM-o 4.5, at 3.44.

  1. 3.73 Tavus Griffin Lite
  2. 3.44 MiniCPM-o 4.5
  3. 3.17 Gemini 2.5 Flash Native
  4. 3.03 Gemini 3.1 Flash Live
  5. 2.97 OpenAI gpt-realtime
  6. 2.88 OpenAI gpt-realtime-mini
  7. 2.00 VITA-1.5
  8. 1.72 MiniOmni2
  1. 1 Tavus Griffin Lite audio+video 3.73
  2. 2 MiniCPM-o 4.5 audio-only 3.44
  3. 3 Gemini 2.5 Flash Native audio+video 3.17
  4. 4 Gemini 3.1 Flash Live audio-only 3.03
  5. 5 OpenAI gpt-realtime audio-only 2.97
  6. 6 OpenAI gpt-realtime-mini audio-only 2.88
  7. 7 VITA-1.5 audio-only 2.00
  8. 8 MiniOmni2 audio-only 1.72

Source: Official VideoFDB leaderboard

#EntryScoreSettingDateSource
1 Tavus Griffin Lite 3.73 audio+video Official leaderboard
2 MiniCPM-o 4.5 3.44 audio-only Feb 2026 Official leaderboard
3 Gemini 2.5 Flash Native 3.17 audio+video Official leaderboard
4 Gemini 3.1 Flash Live 3.03 audio-only Official leaderboard
5 OpenAI gpt-realtime 2.97 audio-only Official leaderboard
6 OpenAI gpt-realtime-mini 2.88 audio-only Official leaderboard
7 VITA-1.5 2.00 audio-only Dec 2024 Official leaderboard
8 MiniOmni2 1.72 audio-only Official leaderboard

Number one over time

Lab claims count from the day the card came out, independent runs from the model’s release.

OpenBMB (ModelBest)
Own leaderboard Not tested since May 2026
MiniCPM-o 4.5 3.44

Source: Official VideoFDB leaderboard

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

On the benchmark’s own leaderboard
1.50 2.00 2.50 3.00 3.50 2025 2026 1.50 2.00 2.50 3.00 3.50 2025 2026

Source: Official VideoFDB leaderboard

No lab model card reports it yet

We read the headline results of 522 launch posts from 52 labs, and none of them list this benchmark.

More in Audio and video

All 233 in Audio and video
  • Video-MMMU In use 300 expert-level lecture videos with questions testing perception, comprehension and adaptation of knowledge. Accuracy. Qwen 3.8 Max 88.7%
  • LVBench In use Hours-long video understanding with multiple-choice questions on reasoning, grounding and summarization. Gemini 4 Argon 91.7%
  • MMVU In use 3,000 expert-annotated questions on videos across 27 disciplines. Multiple-choice and open-ended accuracy. Qwen 3.8 Max 82.4%
  • MLVU In use Multi-task long video understanding (minutes to hours) with multiple-choice and generation tasks. Accuracy. Qwen 3.8 Max 90.8%
  • FLEURS In use Models transcribe read speech in 102 languages built from FLoRes-101 sentences. Model cards usually report word error rate, so lower scores are better. Phi-4-multimodal 4.00%
  • VoiceBench In use Spoken instructions with speaker, environment and content variation. Voice assistant responses scored by GPT judge or rules. Qwen3.5-Omni-Plus 93.1%