Benchmark Almanac

Chameleon-7B

Chameleon-7B.

Meta Released June 18th, 2024 Family Chameleon The lab's model card Compare with others
10
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Meta Jun 2024

Chameleon-7B

Open weights Small

No Epoch Capabilities Index score yet
  • HumanEval-V 1.20% #23 /24
  • MM-Vet 8.30% #164 /164
  • SEED-Bench-2-Plus 29.7% #132 /136

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 19.6% #173 of 178 Official leaderboard

Coding

BenchmarkScoreRankSource
HumanEval-V 1.20% #23 of 24 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
SEED-Bench-2-Plus 29.7% #132 of 136 Official leaderboard
VCR (Visual Caption Restoration) 3.30% #41 of 42 Official leaderboard
MMStar 31.1% #169 of 173 Official leaderboard
MMBench-EN v1.1 19.9% #175 of 178 Official leaderboard
MMBench 15.4% #153 of 155 Official leaderboard
CCBench (MMBench Chinese Culture) 1.40% #151 of 152 Official leaderboard
MM-Vet 8.30% #164 of 164 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 21.0 #173 of 173 Official leaderboard