Benchmark Almanac

IntelligentBench

BAGEL 55.3 leads
BAGEL 55.3 leads
Dropped

Image editing models complete 350 free-form edits that need reasoning and world knowledge. GPT-4o scores each output from 0 to 2 against a reference image, normalized to 100.

In-house benchmark proposed in the BAGEL paper. Criteria are request fulfillment, visual consistency and knowledge-grounded creativity.

Released
May 2025
Kind
Video generation
Level
Everyday
Scored
Graded by a model
Answers
Open-ended
Last in a launch post
May 2025, dropped before it saturated
Last model added
May 2025
Scores refreshed
November 12th, 2026
1
Model scored in lab cards
1
Launch post lists it, from 1 lab
1
System card reports it, from 1 lab

BAGEL-7B-MoT leads with 55.3

Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.

BAGEL leads with 55.3 across all independent runs

Best score per model across the official leaderboard, Epoch AI’s own runs and any board Epoch AI copied. Each bar and row names its source.

BAGEL leads with 55.3, claims included

Best score per model from every source, including labs’ own numbers and claims Epoch AI collected from reports and papers. Labs pick their own settings, so a claim can beat an independent run of the same model.

  1. 1 BAGEL-7B-MoT 55.3

Source: Labs’ model cards

Source: Official IntelligentBench leaderboard

Sources: Official IntelligentBench leaderboard and labs’ model cards

#ModelScoreSettingDateSource
1 BAGEL-7B-MoT 55.3 May 2025 Lab model card
#ModelScoreSettingDateSource
1 BAGEL 55.3 CoT Official leaderboard
2 Step1X-Edit 14.9 Official leaderboard
#ModelScoreSettingDateSource
1 BAGEL 55.3 CoT Official leaderboard
2 BAGEL-7B-MoT 55.3 May 2025 Lab model card
3 Step1X-Edit 14.9 Official leaderboard

The benchmark's own leaderboard has 4 entries, 2 of them models we track. Switch the scores above to rank them together.

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

Reported by the lab in its model card
55.3 2025 55.3 2025

Source: Labs’ model cards

No launch post has listed it since May 2025

Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.

ByteDance Seed
DateLaunch postScoreAs the post writes it
May 20, 2025 BAGEL-7B-MoT 55.3 IntelligentBench 44.0 (BAGEL+CoT 55.3)

One system card reports it

Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.

DateDocumentScoreAs the document writes itSection
May 20, 2025 BAGEL-7B-MoT technical report 55.3 IntelligentBench Score, BAGEL w/ Self-CoT (Table 8). Without CoT 44.9 Capabilities

More in Audio and video

All 233 in Audio and video
  • Video-MMMU In use 300 expert-level lecture videos with questions testing perception, comprehension and adaptation of knowledge. Accuracy. Qwen 3.8 Max 88.7%
  • LVBench In use Hours-long video understanding with multiple-choice questions on reasoning, grounding and summarization. Gemini 4 Argon 91.7%
  • MMVU In use 3,000 expert-annotated questions on videos across 27 disciplines. Multiple-choice and open-ended accuracy. Qwen 3.8 Max 82.4%
  • MLVU In use Multi-task long video understanding (minutes to hours) with multiple-choice and generation tasks. Accuracy. Qwen 3.8 Max 90.8%
  • FLEURS In use Models transcribe read speech in 102 languages built from FLoRes-101 sentences. Model cards usually report word error rate, so lower scores are better. Phi-4-multimodal 4.00%
  • VoiceBench In use Spoken instructions with speaker, environment and content variation. Voice assistant responses scored by GPT judge or rules. Qwen3.5-Omni-Plus 93.1%