Benchmark Almanac

Reka Flash

Reka Flash places in the top three on 2 benchmarks.

Reka Released February 12th, 2024 Family Reka The lab's model card Compare with others
18
Benchmarks with a score
0
Ranked first, out of five or more models
2
In the top three
Reka Feb 2024

Reka Flash

Closed weights Mid-size

No Epoch Capabilities Index score yet
  • MM-Vet 52.5% #78 /164
  • CoreCognition 57.6% #45 /119
  • MMMU 53.3% #75 /136

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 71.4% #93 of 178 Official leaderboard
MixEval 79.8% #20 of 34 Official leaderboard
WildBench 34.6 #32 of 47 Official leaderboard
LMArena (Elo) 1,273 #252 of 335 Official leaderboard

Math and science

BenchmarkScoreRankSource
ZebraLogic 9.30% #38 of 46 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
WildVision 64.7 #2 of 14 Official leaderboard
CoreCognition 57.6% #45 of 119 Official leaderboard
Vibe-Eval 56% #2 of 5 Official leaderboard
MM-Vet 52.5% #78 of 164 Official leaderboard
MMBench 76.8% #76 of 155 Official leaderboard
MMBench-EN v1.1 74.5% #93 of 178 Official leaderboard
MMMU 53.3% #75 of 136 Official leaderboard
MMStar 50.2% #102 of 173 Official leaderboard
CharXiv (DQ) 56.5% #41 of 67 Official leaderboard
CharXiv 26.6% #52 of 77 Official leaderboard
CCBench (MMBench Chinese Culture) 33.7% #103 of 152 Official leaderboard
TOMATO 20.5% #20 of 22 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 56.5 #100 of 173 Official leaderboard