Benchmark Almanac

DeepSeek-VL-1.3B-Chat

DeepSeek-VL-1.3B-Chat.

DeepSeek Released March 7th, 2024 Family DeepSeek-VL The lab's model card Compare with others
13
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
DeepSeek Mar 2024

DeepSeek-VL-1.3B-Chat

Open weights Small

No Epoch Capabilities Index score yet
  • MM-Vet 29.2% #156 /164
  • SEED-Bench-2-Plus 43.7% #121 /136
  • CoreCognition 41.1% #109 /119

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 61.9% #138 of 178 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
MMIU 23.2% #4 of 10 Official leaderboard
CCBench (MMBench Chinese Culture) 37.6% #93 of 152 Official leaderboard
VCR (Visual Caption Restoration) 17.4% #31 of 42 Official leaderboard
MMBench-EN v1.1 65.6% #143 of 178 Official leaderboard
MMBench 66.4% #127 of 155 Official leaderboard
MMStar 39.9% #143 of 173 Official leaderboard
SEED-Bench-2-Plus 43.7% #121 of 136 Official leaderboard
A-Bench 62.8% #106 of 116 Official leaderboard
CoreCognition 41.1% #109 of 119 Official leaderboard
MM-Vet 29.2% #156 of 164 Official leaderboard
We-Math 5.90% #21 of 21 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 39.7 #161 of 173 Official leaderboard