Benchmark Almanac

CogVLM2-19B-Chat

CogVLM2-19B-Chat.

Z.ai Released May 16th, 2024 Family CogVLM The lab's model card Compare with others
13
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Z.ai May 2024

CogVLM2-19B-Chat

Open weights Small

No Epoch Capabilities Index score yet
  • MM-Vet 57.8% #64 /164
  • SEED-Bench-2-Plus 66% #49 /136
  • CoreCognition 60.1% #29 /119

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 68.6% #107 of 178 Official leaderboard

Coding

BenchmarkScoreRankSource
ChartMimic 23.3 #9 of 14 Official leaderboard

Agents and tools

BenchmarkScoreRankSource
GroundUI 3.40% #7 of 11 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
CoreCognition 60.1% #29 of 119 Official leaderboard
SEED-Bench-2-Plus 66% #49 of 136 Official leaderboard
MM-Vet 57.8% #64 of 164 Official leaderboard
A-Bench 72.3% #57 of 116 Official leaderboard
MMBench-EN v1.1 72.7% #99 of 178 Official leaderboard
MMBench 73.9% #88 of 155 Official leaderboard
MMStar 50.5% #101 of 173 Official leaderboard
CCBench (MMBench Chinese Culture) 38.8% #91 of 152 Official leaderboard
Vision Arena 964 #132 of 136 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 56.3 #101 of 173 Official leaderboard