Benchmark Almanac

GLM-4V-9B

GLM-4V-9B places in the top three on MMIU.

Z.ai Released June 4th, 2024 Family GLM-4V The lab's model card Compare with others
15
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Z.ai Jun 2024

GLM-4V-9B

Open weights Small

No Epoch Capabilities Index score yet
  • MM-Vet 58% #63 /164
  • SEED-Bench-2-Plus 59.7% #81 /136
  • CoreCognition 64.2% #5 /119

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 67.1% #110 of 178 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
CoreCognition 64.2% #5 of 119 Official leaderboard
VCR (Visual Caption Restoration) 49.8% #4 of 42 Official leaderboard
MMIU 27% #2 of 10 Official leaderboard
A-Bench 74% #41 of 116 Official leaderboard
MM-Vet 58% #63 of 164 Official leaderboard
MMStar 54.8% #85 of 173 Official leaderboard
CCBench (MMBench Chinese Culture) 44.9% #76 of 152 Official leaderboard
SEED-Bench-2-Plus 59.7% #81 of 136 Official leaderboard
CharXiv (DQ) 57.6% #40 of 67 Official leaderboard
CharXiv 29.1% #46 of 77 Official leaderboard
MMBench 71.4% #105 of 155 Official leaderboard
MMBench-EN v1.1 68.7% #129 of 178 Official leaderboard
We-Math 14.9% #16 of 21 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 59.2 #86 of 173 Official leaderboard