Benchmark Almanac

ZeroCLUE

CPM-Bee 78.2 tops its leaderboard ChatGLM-6B 30.9 leads the models we track
Not in model cards

Models perform Chinese language tasks without training on labeled examples from the target task.

The repository reports baseline results.

Kind
Reading in many languages
Level
School
Scored
Checked automatically
Answers
Short answer
Tasks
All public
Measures
Capability
Language
Chinese
In and out
Text → Text
Interaction
Single turn
Refresh
One fixed set
Run by
A host
Based on
CLUE
Last model added
March 2023
Scores refreshed
November 20th, 2026
450
Entries on its own leaderboard, 1 model we track

CPM-Bee tops the leaderboard with 78.2 ChatGLM-6B leads with 30.9

Best score per entry from the benchmark's own leaderboard, read on November 20th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. The best model we track is ChatGLM-6B, at 30.9. This view shows only models we track, each at its best.

450 entries. Scroll sideways for the rest.

  1. 78.2 CPM-Bee
  2. 76.2 Ctyun_Big_Model
  3. 70.5 PaddleNLP-UTC
  4. 70.3 二郎神-UnifiedMC
  5. 69.5 GPT-MoE
  6. 69.2 Randeng-T5-784M-MultiTask
  7. 68.9 Mengzi-T5-MT
  8. 67.7 asdf
  9. 65.9 assistant
  10. 63.8 XXXX-Test
  11. 63.5 二郎神-MRC
  12. 61.5 abtest03
  13. 61.5 bumble-75
  14. 61.2 4731
  15. 60.4 XXXXRoberta
  16. 60.1 bumble-20
  17. 60.0 t5_wu
  18. 59.3 UniCU
  19. 59.0 源1.0
  20. 58.6 abtest01
  21. 58.0 zero-t5
  22. 56.8 jjtest01
  23. 56.6 XT5
  24. 55.9 t5-gp
  25. 55.4 T5-zeroshot-V2-0
  26. 54.3 T5
  27. 54.1 test_rf
  28. 51.9 needle
  29. 51.1 200
  30. 50.1 needle9
  31. 50.0 bumble-20w
  32. 49.9 OBERT-C-base.Zero-shot
  33. 49.6 needle10
  34. 49.2 T5-ZeroShot-V2
  35. 48.9 test_rt
  36. 48.3 gpt2
  37. 48.0 test1122
  38. 47.5 T5-test-4-zero-shot
  39. 47.0 RoBERTa_wwm.Zero-shot
  40. 46.9 jjtest05
  41. 46.8 bumble-47
  42. 45.5 bert
  43. 45.5 BT5-test2
  44. 45.4 ChatCPM
  45. 44.9 t5
  46. 44.2 NEZHA-Gen.Zero-shot
  47. 44.0 XXXXZC
  48. 43.9 Robbberta
  49. 42.9 BD-Test
  50. 42.0 cpm-bee
  51. 42.0 bb-75
  52. 41.7 gpt
  53. 40.4 fi
  54. 40.2 jjtest04
  55. 40.0 1600
  56. 39.8 mmtest01
  57. 37.4 jjtest02
  58. 36.1 2888
  59. 35.1 Baichuan2-7B-Chat
  60. 35.1 VILLM-0.5-tiny-11.8M
  61. 34.9 5211
  62. 34.8 Z_BERT
  63. 34.3 MOSS
  64. 34.2 VILLM_0.3
  65. 33.7 09
  66. 33.7 qw
  67. 33.7 cadfs
  68. 33.7 jjtest03
  69. 33.6 0510-11-1
  70. 33.5 123
  71. 33.5 yeee
  72. 33.4 ZeroCLUE.M
  73. 33.3 VILLM-0.10-320M
  74. 33.3 17
  75. 32.8 18
  76. 32.8 CC
  77. 32.8 ff
  78. 32.7 VILLM-0.3
  79. 32.7 ma
  80. 32.7 metaseq.bloom.1b3
  81. 32.6 ai
  82. 32.5 22
  83. 32.5 220
  84. 32.5 lm
  85. 32.5 521
  86. 32.4 ck
  87. 32.3 VILLM_0.3_982M
  88. 32.2 ByBloom-1B6
  89. 32.0 VILLM-0.3-327M
  90. 32.0 lll
  91. 31.9 ChatCPM1
  92. 31.9 20
  93. 31.7 ByBloom-303M
  94. 31.7 VILLM-0.9-50M
  95. 31.5 75-41
  96. 31.4 ByBloom-303M-R2
  97. 31.3 NN-MAC3
  98. 31.2 12421
  99. 30.9 耳畔
  100. 30.9 ChatGLM-6B
  101. 30.8 B-1
  102. 30.6 VILLM_0.3_0914
  103. 30.4 请问
  104. 30.2 VILLM-0.4
  105. 30.2 Chinese-RoBERTa-wwm-ext-large
  106. 30.1 Test47
  107. 29.8 metaseq.opt.6B
  108. 29.6 yaaaa
  109. 29.1 前文
  110. 29.1 啊是
  111. 29.1 177
  112. 29.0 we
  113. 29.0 188
  114. 29.0 casdf
  115. 29.0 sadf
  116. 29.0 fiiii
  117. 28.9 ByBloom-303M-R3
  118. 28.9 Supervised pre-trainning
  119. 28.8 1233
  120. 28.7 2001
  121. 28.6 二炮
  122. 28.6 cpmb
  123. 28.5 mammam
  124. 28.5 220000
  125. 28.5 mll
  126. 28.4 mmmm
  127. 28.4 aiiii
  128. 28.4 fff
  129. 28.2 222
  130. 27.9 75-42
  131. 27.5 chhhhh
  132. 27.1 Model.Zero-shot
  133. 26.7 bb-47
  134. 26.3 BertForCLS
  135. 24.4 needle4
  136. 24.3 BD-Chinese-Roberta-Large
  137. 23.6 needle2
  138. 22.7 needle5
  139. 22.0 091
  140. 21.1 1666
  141. 19.6 tantan4
  142. 18.8 hhhh
  143. 18.5 just_test
  144. 18.3 ckkk
  145. 18.3 just_test2
  146. 18.2 A9
  147. 17.8 S-Bert
  148. 17.7 nene
  149. 17.5 12322
  150. 17.5 1777
  151. 17.5 aaaaay
  152. 17.4 18888
  153. 17.4 dsfccc
  154. 17.3 needle3
  155. 17.2 canser
  156. 17.2 er
  157. 17.2 dsfsdf
  158. 17.2 0002222
  159. 17.2 lmlmlm
  160. 17.1 nannan
  161. 17.1 baa
  162. 17.1 fuuu
  163. 17.1 15656
  164. 17.0 mmtest02
  165. 16.9 2222
  166. 16.8 201
  167. 16.4 S-Bert-V2
  168. 15.6 1055
  169. 15.6 pre-trainning
  170. 15.3 as
  171. 15.3 前往
  172. 14.8 CSL
  173. 14.7 恩平
  174. 11.7 0510-11-2
  175. 11.5 tantan3
  176. 11.4 uclai_xlarge_p231003a
  177. 11.4 uclai_xlarge_p231007a
  178. 11.3 uclai_medium_p230917b
  179. 11.3 uclai_medium_p230917a
  180. 11.3 0508aa
  181. 11.3 xq_uclai_small_p230901b
  182. 11.2 uclai_small_p230827b
  183. 11.2 uclai_medium_p230913b
  184. 11.2 ul-sm-v1-7
  185. 11.2 xq_uclai_large_v3_3
  186. 11.1 zeroclue_ll
  187. 11.1 ul_small_v3_5
  188. 11.1 small_p1_0_v1
  189. 11.1 small_p3_5_v3
  190. 11.1 uclai_small_p230829b
  191. 11.1 zy-zeroclue
  192. 11.1 ul_large_v1_4_w
  193. 11.1 uclai_small_p230814a
  194. 11.1 ul-sm-v2-9
  195. 11.1 ul-vs5
  196. 11.1 uclai-231012
  197. 11.1 xq_uclai_small_p230901a
  198. 11.1 0510-11-3
  199. 11.0 B-2
  200. 11.0 uclai_medium_p230913a
  201. 11.0 ul_large_v1_4_12
  202. 11.0 uclai_small_p230827a
  203. 11.0 uclai_small_p230910b
  204. 11.0 uclai_small_s230821a_p3_5_1
  205. 11.0 uclai_small_v3_8
  206. 11.0 xq_uclai_small_s230817a_p3_5_flatatt
  207. 11.0 xq_0823_1
  208. 11.0 uclai_large_v1_14
  209. 11.0 xq_uclai_small_s230817a_p3_5
  210. 11.0 xq_uclai_small_s230818a_p3_5
  211. 11.0 xq_uclai_small_s230818a_p3_5_flatatt
  212. 11.0 s230814a_p230814a
  213. 10.9 uclai-chat-stream-small-p3-6-v1
  214. 10.9 xq_uclai_large_v3_2
  215. 10.9 uclai_small_p230814b
  216. 10.9 uclai_small_p230829a
  217. 10.9 uclai_small_p230823a
  218. 10.8 uclai_small_p230910a
  219. 10.8 uclai_small_p230904b
  220. 10.8 xq_uclai_small_v3_5
  221. 10.8 xq_uclai_chat_stream_large_p3_3_v1
  222. 10.8 xq_uclai_chat_stream_large_s2_16_v2
  223. 10.7 xq_uclai_small_v3_3
  224. 10.7 xq_uclai_small_v3_4
  225. 10.7 uclai_small_v1_11
  226. 10.7 ul-sm-v1-6
  227. 10.7 Test
  228. 10.7 test56
  229. 10.7 test_chid
  230. 10.6 uclai_small_p230822a
  231. 10.6 uclai-chat-stream-small-p3-5-v1
  232. 10.6 uclai_small_p230904a
  233. 10.6 uclai_large_v3_1_0703
  234. 10.6 uclai_small_v1_10
  235. 10.6 uclai_small_v1_13
  236. 10.5 ul_large_v1_10
  237. 10.5 uclai_small_v3_2
  238. 10.5 pardon
  239. 10.5 pai-ckbert-base-xnli_zh-nli
  240. 10.4 xq_0825_uclai-chat-stream-small-p3-5-v1-3
  241. 10.4 uclai_chat_stream_xlarge_p3_1_v1
  242. 10.4 textcnn-shopping
  243. 10.3 pai-bert-base-xnli_zh-nli
  244. 10.3 pai-ckbert-large-nli
  245. 10.2 wj_ul-s-p3-5-v3
  246. 10.1 opt_6bm_60bt_ww
  247. 10.1 opt_6bm_50bt_ww
  248. 10.0 zero-bustm
  249. 10.0 xq_uclai_1B_p230825b
  250. 10.0 uclai_1B_p230825b
  251. 9.99 py_xlarge_s231110a_p231107a
  252. 9.93 uclai_small_v3_1
  253. 9.93 uclai_xlarge_s231127a_s231016a
  254. 9.91 uclai_xlarge_s231009a_p231007a
  255. 9.90 nalll
  256. 9.89 opt_6bm_40bt_ww
  257. 9.89 xq_uclai_1B_p230825a
  258. 9.89 uclai_1B_p230825a
  259. 9.88 opt_6B_60T_3_2_1k_ww
  260. 9.87 xq_uclai_small_s230902b_p230901b
  261. 9.85 ocnli
  262. 9.84 uclai_medium_s231120a_p231013a
  263. 9.82 sft_20230327_ww
  264. 9.81 ul-v16
  265. 9.80 xq_uclai_small_s230902a_p230827b
  266. 9.77 uclai_700m_p230821a
  267. 9.77 xq_uclai_small_s230902c_p230829b
  268. 9.74 ul-v17
  269. 9.74 ul_large_v1_7_0703_2
  270. 9.74 ul-l-v1-7
  271. 9.74 ul-l-v1-7-new
  272. 9.73 u-wj8
  273. 9.72 uclai_xlarge_s231016a_p231007a
  274. 9.70 pul-v15
  275. 9.70 520
  276. 9.69 ul-sm-v2-10
  277. 9.67 uclai_small_s230906a_p3_5
  278. 9.66 bustm
  279. 9.66 py_xlarge_s231016a_p231007a-2
  280. 9.66 py_xlarge_s231016a_p231007a-sys
  281. 9.66 py_xlarge_s231016a_p231007a-sys2
  282. 9.66 uclai_xlarge_s231016a_p231007a-3
  283. 9.65 zeroclue_llll
  284. 9.65 uclai_xlarge_s230907a_v3_2
  285. 9.64 uuuu
  286. 9.63 uclai_small_s230822a_p3_5
  287. 9.63 uc_large_v1_3_ww
  288. 9.61 xq_uclai_700m_p230816c
  289. 9.59 xq_uclai_700m_p230818a
  290. 9.59 py_xlarge_d231108a_s231016a
  291. 9.59 uclai_small_s230817a_p3_5_flashatt
  292. 9.56 uclai-chat-stream-small_p3_5_v2
  293. 9.51 xa_uclai_small_s230831a_p3_5
  294. 9.51 xq_uclai_small_s230902d_p230823a
  295. 9.50 uclai_small_s230818a_p3_5_flashatt
  296. 9.49 ≈
  297. 9.49 xq_uclai_xlarge_s230830a
  298. 9.48 t5-zeroshot-5t
  299. 9.47 xq_uclai_small_s230823c_v3_5
  300. 9.47 xq_uclai-chat-stream-small-p3-5-v1-2_0825
  301. 9.47 uclai_1B_s231218f_p231208a
  302. 9.47 uclai_medium_s231014a_p231013a
  303. 9.46 uclai_small_s230823b_v3_5
  304. 9.46 uclai_small_s230905c_p230904b
  305. 9.46 small_s231114b_p231113a
  306. 9.44 uclai_small_s230823d_v3_5
  307. 9.43 uclai_700m_v3_9
  308. 9.41 lake_large_20bt_ww
  309. 9.41 xq_uclai_small_s230901a_p3_5
  310. 9.39 py_medium_s231026a_p230917c
  311. 9.39 uclai_medium_s230914a_p230913c
  312. 9.38 uclai_large_s230915a_s2_16
  313. 9.38 stm-l-v2-3
  314. 9.38 uclai_1B_s231208a_p231208a
  315. 9.36 py_medium_d231030a_s231014a
  316. 9.36 small_s231114a_p231113a
  317. 9.35 t5-zeroshot-5t1
  318. 9.34 csl-212
  319. 9.34 ul-wj12
  320. 9.34 tt
  321. 9.31 uclai_small_s230905a_p230904b
  322. 9.31 uclai_chat_stream_700m_p3_9_v1
  323. 9.29 py_small_s231029a_p230910c
  324. 9.22 csl-211
  325. 9.21 lake_large_15bt_ww
  326. 9.17 py_small_s231030a_p230910c
  327. 9.13 uclai_small_d20230828b
  328. 9.12 uclai_small_s231007a_p230910c
  329. 9.11 medium_s230918b_p230917c
  330. 9.11 uclai_small_s231012a_p230910c
  331. 9.10 uclai_small_l230914a_s230905b
  332. 9.07 uclai_small_d20230828a
  333. 9.02 uclai_700m_v3_8
  334. 9.01 py_medium_s230918b_p230917c-2
  335. 9.00 uclai_medium_s230914b_p230913c
  336. 8.96 uclai_small_s230915a_p230910c
  337. 8.94 uclai_small_s231005a_p230910c
  338. 8.94 uclai_small_s231013a_p230910c
  339. 8.94 uclai_small_s20231129_p230910c
  340. 8.93 uclai_small_d20230824a
  341. 8.91 uclai_small_s230911a_p3_5
  342. 8.91 uclai_small_s230920c_p230904b
  343. 8.91 uclai_large_s230814_s2_16_v5
  344. 8.89 lake_small_70bt_ww
  345. 8.89 uclai-small-v1_0
  346. 8.88 stm-large-v2-1_ww
  347. 8.87 lake_small_60bt_ww
  348. 8.84 lake_small_50bt_ww
  349. 8.84 la_30b_10bt_ww
  350. 8.79 uclai_small_s230922a_p230904c
  351. 8.78 la_7b_40bt_ww
  352. 8.75 uclai_small_s230828a_p3_5
  353. 8.72 s230814b_p230814b_1
  354. 8.70 uclai_large_s231207a_p231202a
  355. 8.68 uclai_small_s230917a_p230904b
  356. 8.68 uclai_small_s230925a_p230904c
  357. 8.67 uclai_small_s230912b_p3_5
  358. 8.66 zyc_test
  359. 8.63 stm-l-v2-10
  360. 8.63 small_s230919a_p230904b
  361. 8.60 xq_uclai_small_s230825a_v3_5
  362. 8.53 uclai_small_s230905b_p230904b_flashatt
  363. 8.53 1
  364. 8.49 la_7b_30bt_ww
  365. 8.46 test
  366. 8.41 chat-stream-small-1_ww
  367. 8.41 uclai_small_s231214a_p231213a
  368. 8.40 stm-s-v2-3
  369. 8.28 stm-s-v2-5
  370. 8.22 stm-s-v2-4
  371. 8.22 py_medium_d231027a_s231014a
  372. 8.19 t5-zeroshot-5t3
  373. 8.19 la_7b_30b_sft_ww
  374. 8.16 ul-sm-v2-11
  375. 8.13 stm-l-v2-8
  376. 8.10 t5-zeroshot-5t2
  377. 8.07 la_7bm_30bt_sft_2bt_ww
  378. 8.06 la_7b_20t_ww
  379. 8.02 stm-s-v2-6
  380. 7.97 stm-s-v2-7
  381. 7.96 wj_u-s-2-11
  382. 7.88 stm-l-v2-4
  383. 7.83 tantan
  384. 7.82 pai-bert-tiny-xnli_zh-nli
  385. 7.82 pai-bert-tiny
  386. 7.67 wj_uc-s-p1-0-v1
  387. 7.62 stm-l-v2-5
  388. 7.40 eprstmt
  389. 7.32 uclai_small_s230914a_p230904b
  390. 7.29 uclai-chat-stream-small-v2-6-0905-FT
  391. 7.25 cccc
  392. 7.20 cluewscf
  393. 7.04 fly-20
  394. 7.02 uclai_small_l230920a_s230905b
  395. 6.95 ul-wj14
  396. 6.95 csl-214
  397. 6.92 stm-l-v2-7
  398. 6.82 gpt-3.5
  399. 6.81 hanhan
  400. 6.81 uclai_700m_v3_9_onlytext_sft
  401. 6.80 la_30b_1t_ww
  402. 6.72 bbbbbb
  403. 6.63 fly-75
  404. 6.63 mc
  405. 6.62 qwe
  406. 6.62 tantan1
  407. 6.57 hhh
  408. 6.57 cslf
  409. 6.51 gpt3.5
  410. 6.48 fly-47
  411. 6.46 csl-213
  412. 6.46 ul-wj13
  413. 6.46 ul-lg-v2-15-qianhai
  414. 6.41 uclai_700m_v3_9_polly_sft
  415. 6.39 la_7b_15bt_sft_4_5_ww
  416. 6.21 bbbbbb-c
  417. 6.16 uclai_small_l230921a_s230905b
  418. 6.04 ul-wj15
  419. 6.04 csl-215
  420. 6.04 ul-wj15-1
  421. 6.04 ul-wj15-2
  422. 6.03 gpt2_350M_ns231113a_np231111a
  423. 5.96 stream-small-v2-2_ww
  424. 5.91 uclai_small_l231102a_s230905b
  425. 5.76 xq_0822
  426. 5.76 uclai_chat_stream_large_s2_16_v5
  427. 5.75 xq_uclai_chat_stream_large_s2_16_v5_safety
  428. 5.61 hhhhh
  429. 5.33 cpm-test-1
  430. 5.33 cpm-test-2
  431. 5.04 chat-stream-small_ww
  432. 4.81 xq_uclai_tiny_v1_2
  433. 4.80 47-2task
  434. 4.80 llama2_13B_chat_hf
  435. 4.65 xq_uclai_chat-stream-tiny_v1_2
  436. 4.45 q1
  437. 4.31 xq_uclai_chat-stream-tiny_v1_1
  438. 4.18 llama2_7B_chat_hf
  439. 4.17 20-2task
  440. 4.08 xq_uclai_tiny_v1_1
  441. 3.81 ocnlif
  442. 3.49 xq_uclai_chat_stream_large_s2_16_v2_0717_2
  443. 3.21 llama_7B_hf_ww
  444. 2.93 la_7b_sft_4_1_ww
  445. 2.53 uclai_large_v1_7
  446. 2.53 ul_large_v1_7_0703
  447. 2.52 wj_u-l-2-16
  448. 2.29 gpt2-large-test
  449. 1.93 xq_uclai-chat-stream-small-p3-5-v1-2
  450. 0.01 test-ot5-tnews-20221017
  1. 1 CPM-Bee Submission 26012 78.2
  2. 2 Ctyun_Big_Model Submission 23753 76.2
  3. 3 PaddleNLP-UTC Submission 210742 70.5
  4. 4 二郎神-UnifiedMC Submission 15715 70.3
  5. 5 GPT-MoE Submission 15603 69.5
  6. 6 Randeng-T5-784M-MultiTask Submission 22479 69.2
  7. 7 Mengzi-T5-MT Submission 15602 68.9
  8. 8 asdf Submission 25263 67.7
  9. 9 assistant Submission 25829 65.9
  10. 10 XXXX-Test Submission 20636 63.8
  11. 11 二郎神-MRC Submission 10590 63.5
  12. 12 abtest03 Submission 22870 61.5
  13. 13 bumble-75 Submission 25432 61.5
  14. 14 4731 Submission 25817 61.2
  15. 15 XXXXRoberta Submission 20708 60.4
  16. 16 bumble-20 Submission 25431 60.1
  17. 17 t5_wu Submission 20481 60.0
  18. 18 UniCU Submission 20069 59.3
  19. 19 源1.0 Submission 7618 59.0
  20. 20 abtest01 Submission 22871 58.6
  21. 21 zero-t5 Submission 25122 58.0
  22. 22 jjtest01 Submission 22770 56.8
  23. 23 XT5 Submission 20851 56.6
  24. 24 t5-gp Submission 24601 55.9
  25. 25 T5-zeroshot-V2-0 Submission 24497 55.4
  26. 26 T5 Submission 17151 54.3
  27. 27 test_rf Submission 15237 54.1
  28. 28 needle Submission 20511 51.9
  29. 29 200 Submission 25949 51.1
  30. 30 needle9 Submission 21095 50.1
  31. 31 bumble-20w Submission 25430 50.0
  32. 32 OBERT-C-base.Zero-shot Submission 8277 49.9
  33. 33 needle10 Submission 21085 49.6
  34. 34 T5-ZeroShot-V2 Submission 24495 49.2
  35. 35 test_rt Submission 15232 48.9
  36. 36 gpt2 Submission 15444 48.3
  37. 37 test1122 Submission 15589 48.0
  38. 38 T5-test-4-zero-shot Submission 26104 47.5
  39. 39 RoBERTa_wwm.Zero-shot Submission 8124 ✓ 47.0
  40. 40 jjtest05 Submission 22764 46.9
  41. 41 bumble-47 Submission 25270 46.8
  42. 42 bert Submission 15440 45.5
  43. 43 BT5-test2 Submission 26382 45.5
  44. 44 ChatCPM Submission 25825 45.4
  45. 45 t5 Submission 15302 44.9
  46. 46 NEZHA-Gen.Zero-shot Submission 6033 ✓ 44.2
  47. 47 XXXXZC Submission 19776 44.0
  48. 48 Robbberta Submission 19778 43.9
  49. 49 BD-Test Submission 19052 42.9
  50. 50 cpm-bee Submission 25260 42.0
  51. 51 bb-75 Submission 25273 42.0
  52. 52 gpt Submission 15224 41.7
  53. 53 fi Submission 25990 40.4
  54. 54 jjtest04 Submission 22769 40.2
  55. 55 1600 Submission 25993 40.0
  56. 56 mmtest01 Submission 23107 39.8
  57. 57 jjtest02 Submission 22772 37.4
  58. 58 2888 Submission 25937 36.1
  59. 59 Baichuan2-7B-Chat Submission 26474 35.1
  60. 60 VILLM-0.5-tiny-11.8M Submission 26476 35.1
  61. 61 5211 Submission 25965 34.9
  62. 62 Z_BERT Submission 12804 34.8
  63. 63 MOSS Submission 26044 34.3
  64. 64 VILLM_0.3 Submission 26428 34.2
  65. 65 09 Submission 25770 33.7
  66. 66 qw Submission 25922 33.7
  67. 67 cadfs Submission 25959 33.7
  68. 68 jjtest03 Submission 22767 33.7
  69. 69 0510-11-1 Submission 25488 33.6
  70. 70 123 Submission 25773 33.5
  71. 71 yeee Submission 25985 33.5
  72. 72 ZeroCLUE.M Submission 18945 33.4
  73. 73 VILLM-0.10-320M Submission 26634 33.3
  74. 74 17 Submission 25927 33.3
  75. 75 18 Submission 25932 32.8
  76. 76 CC Submission 25956 32.8
  77. 77 ff Submission 25973 32.8
  78. 78 VILLM-0.3 Submission 26443 32.7
  79. 79 ma Submission 26018 32.7
  80. 80 metaseq.bloom.1b3 Submission 15300 32.7
  81. 81 ai Submission 25980 32.6
  82. 82 22 Submission 25970 32.5
  83. 83 220 Submission 26027 32.5
  84. 84 lm Submission 26031 32.5
  85. 85 521 Submission 25964 32.5
  86. 86 ck Submission 26002 32.4
  87. 87 VILLM_0.3_982M Submission 26459 32.3
  88. 88 ByBloom-1B6 Submission 26425 32.2
  89. 89 VILLM-0.3-327M Submission 26424 32.0
  90. 90 lll Submission 26034 32.0
  91. 91 ChatCPM1 Submission 25810 31.9
  92. 92 20 Submission 25953 31.9
  93. 93 ByBloom-303M Submission 26433 31.7
  94. 94 VILLM-0.9-50M Submission 26506 31.7
  95. 95 75-41 Submission 25755 31.5
  96. 96 ByBloom-303M-R2 Submission 26456 31.4
  97. 97 NN-MAC3 Submission 12794 31.3
  98. 98 12421 Submission 25264 31.2
  99. 99 耳畔 Submission 25818 30.9
  100. 100 ChatGLM-6B Submission 26053 30.9
  101. 101 B-1 Submission 25691 30.8
  102. 102 VILLM_0.3_0914 Submission 26453 30.6
  103. 103 请问 Submission 25821 30.4
  104. 104 VILLM-0.4 Submission 26463 30.2
  105. 105 Chinese-RoBERTa-wwm-ext-large Submission 18914 30.2
  106. 106 Test47 Submission 25485 30.1
  107. 107 metaseq.opt.6B Submission 15221 29.8
  108. 108 yaaaa Submission 25986 29.6
  109. 109 前文 Submission 25822 29.1
  110. 110 啊是 Submission 25827 29.1
  111. 111 177 Submission 25928 29.1
  112. 112 we Submission 25923 29.0
  113. 113 188 Submission 25933 29.0
  114. 114 casdf Submission 25960 29.0
  115. 115 sadf Submission 25957 29.0
  116. 116 fiiii Submission 25991 29.0
  117. 117 ByBloom-303M-R3 Submission 26434 28.9
  118. 118 Supervised pre-trainning Submission 8430 28.9
  119. 119 1233 Submission 25774 28.8
  120. 120 2001 Submission 25950 28.7
  121. 121 二炮 Submission 25819 28.6
  122. 122 cpmb Submission 26055 28.6
  123. 123 mammam Submission 26019 28.5
  124. 124 220000 Submission 26028 28.5
  125. 125 mll Submission 26032 28.5
  126. 126 mmmm Submission 26035 28.4
  127. 127 aiiii Submission 25981 28.4
  128. 128 fff Submission 25974 28.4
  129. 129 222 Submission 25971 28.2
  130. 130 75-42 Submission 25756 27.9
  131. 131 chhhhh Submission 26004 27.5
  132. 132 Model.Zero-shot Submission 5525 27.1
  133. 133 bb-47 Submission 25272 26.7
  134. 134 BertForCLS Submission 6092 26.3
  135. 135 needle4 Submission 20674 24.4
  136. 136 BD-Chinese-Roberta-Large Submission 19044 24.3
  137. 137 needle2 Submission 20637 23.6
  138. 138 needle5 Submission 20676 22.7
  139. 139 091 Submission 25771 22.0
  140. 140 1666 Submission 25994 21.1
  141. 141 tantan4 Submission 15378 19.6
  142. 142 hhhh Submission 15158 18.8
  143. 143 just_test Submission 14899 18.5
  144. 144 ckkk Submission 26003 18.3
  145. 145 just_test2 Submission 14901 18.3
  146. 146 A9 Submission 25772 18.2
  147. 147 S-Bert Submission 6139 17.8
  148. 148 nene Submission 14904 17.7
  149. 149 12322 Submission 25775 17.5
  150. 150 1777 Submission 25929 17.5
  151. 151 aaaaay Submission 25987 17.5
  152. 152 18888 Submission 25934 17.4
  153. 153 dsfccc Submission 25958 17.4
  154. 154 needle3 Submission 20657 17.3
  155. 155 canser Submission 26036 17.2
  156. 156 er Submission 25924 17.2
  157. 157 dsfsdf Submission 25961 17.2
  158. 158 0002222 Submission 26029 17.2
  159. 159 lmlmlm Submission 26033 17.2
  160. 160 nannan Submission 14903 17.1
  161. 161 baa Submission 25982 17.1
  162. 162 fuuu Submission 25975 17.1
  163. 163 15656 Submission 25995 17.1
  164. 164 mmtest02 Submission 23108 17.0
  165. 165 2222 Submission 25972 16.9
  166. 166 201 Submission 25955 16.8
  167. 167 S-Bert-V2 Submission 6145 16.4
  168. 168 1055 Submission 25694 15.6
  169. 169 pre-trainning Submission 8429 15.6
  170. 170 as Submission 25828 15.3
  171. 171 前往 Submission 25823 15.3
  172. 172 CSL Submission 25705 14.8
  173. 173 恩平 Submission 25820 14.7
  174. 174 0510-11-2 Submission 25489 11.7
  175. 175 tantan3 Submission 15373 11.5
  176. 176 uclai_xlarge_p231003a Submission 26485 11.4
  177. 177 uclai_xlarge_p231007a Submission 26486 11.4
  178. 178 uclai_medium_p230917b Submission 26471 11.3
  179. 179 uclai_medium_p230917a Submission 26470 11.3
  180. 180 0508aa Submission 25707 11.3
  181. 181 xq_uclai_small_p230901b Submission 26404 11.3
  182. 182 uclai_small_p230827b Submission 26385 11.2
  183. 183 uclai_medium_p230913b Submission 26450 11.2
  184. 184 ul-sm-v1-7 Submission 26022 11.2
  185. 185 xq_uclai_large_v3_3 Submission 26178 11.2
  186. 186 zeroclue_ll Submission 7849 11.1
  187. 187 ul_small_v3_5 Submission 26169 11.1
  188. 188 small_p1_0_v1 Submission 26270 11.1
  189. 189 small_p3_5_v3 Submission 26268 11.1
  190. 190 uclai_small_p230829b Submission 26396 11.1
  191. 191 zy-zeroclue Submission 13090 11.1
  192. 192 ul_large_v1_4_w Submission 26038 11.1
  193. 193 uclai_small_p230814a Submission 26341 11.1
  194. 194 ul-sm-v2-9 Submission 25984 11.1
  195. 195 ul-vs5 Submission 25977 11.1
  196. 196 uclai-231012 Submission 26487 11.1
  197. 197 xq_uclai_small_p230901a Submission 26403 11.1
  198. 198 0510-11-3 Submission 25490 11.1
  199. 199 B-2 Submission 25692 11.0
  200. 200 uclai_medium_p230913a Submission 26449 11.0
  201. 201 ul_large_v1_4_12 Submission 26096 11.0
  202. 202 uclai_small_p230827a Submission 26384 11.0
  203. 203 uclai_small_p230910b Submission 26426 11.0
  204. 204 uclai_small_s230821a_p3_5_1 Submission 26356 11.0
  205. 205 uclai_small_v3_8 Submission 26333 11.0
  206. 206 xq_uclai_small_s230817a_p3_5_flatatt Submission 26352 11.0
  207. 207 xq_0823_1 Submission 26362 11.0
  208. 208 uclai_large_v1_14 Submission 26110 11.0
  209. 209 xq_uclai_small_s230817a_p3_5 Submission 26353 11.0
  210. 210 xq_uclai_small_s230818a_p3_5 Submission 26348 11.0
  211. 211 xq_uclai_small_s230818a_p3_5_flatatt Submission 26351 11.0
  212. 212 s230814a_p230814a Submission 26344 11.0
  213. 213 uclai-chat-stream-small-p3-6-v1 Submission 26170 10.9
  214. 214 xq_uclai_large_v3_2 Submission 26156 10.9
  215. 215 uclai_small_p230814b Submission 26343 10.9
  216. 216 uclai_small_p230829a Submission 26395 10.9
  217. 217 uclai_small_p230823a Submission 26367 10.9
  218. 218 uclai_small_p230910a Submission 26420 10.8
  219. 219 uclai_small_p230904b Submission 26411 10.8
  220. 220 xq_uclai_small_v3_5 Submission 26158 10.8
  221. 221 xq_uclai_chat_stream_large_p3_3_v1 Submission 26216 10.8
  222. 222 xq_uclai_chat_stream_large_s2_16_v2 Submission 26215 10.8
  223. 223 xq_uclai_small_v3_3 Submission 26146 10.7
  224. 224 xq_uclai_small_v3_4 Submission 26157 10.7
  225. 225 uclai_small_v1_11 Submission 26081 10.7
  226. 226 ul-sm-v1-6 Submission 26008 10.7
  227. 227 Test Submission 25479 10.7
  228. 228 test56 Submission 25486 10.7
  229. 229 test_chid Submission 14898 10.7
  230. 230 uclai_small_p230822a Submission 26366 10.6
  231. 231 uclai-chat-stream-small-p3-5-v1 Submission 26166 10.6
  232. 232 uclai_small_p230904a Submission 26410 10.6
  233. 233 uclai_large_v3_1_0703 Submission 26135 10.6
  234. 234 uclai_small_v1_10 Submission 26047 10.6
  235. 235 uclai_small_v1_13 Submission 26083 10.6
  236. 236 ul_large_v1_10 Submission 26085 10.5
  237. 237 uclai_small_v3_2 Submission 26132 10.5
  238. 238 pardon Submission 26006 10.5
  239. 239 pai-ckbert-base-xnli_zh-nli Submission 26724 10.5
  240. 240 xq_0825_uclai-chat-stream-small-p3-5-v1-3 Submission 26370 10.4
  241. 241 uclai_chat_stream_xlarge_p3_1_v1 Submission 26269 10.4
  242. 242 textcnn-shopping Submission 26767 10.4
  243. 243 pai-bert-base-xnli_zh-nli Submission 26725 10.3
  244. 244 pai-ckbert-large-nli Submission 26761 10.3
  245. 245 wj_ul-s-p3-5-v3 Submission 26274 10.2
  246. 246 opt_6bm_60bt_ww Submission 23870 10.1
  247. 247 opt_6bm_50bt_ww Submission 23869 10.1
  248. 248 zero-bustm Submission 25120 10.0
  249. 249 xq_uclai_1B_p230825b Submission 26374 10.0
  250. 250 uclai_1B_p230825b Submission 26390 10.0
  251. 251 py_xlarge_s231110a_p231107a Submission 26518 9.99
  252. 252 uclai_small_v3_1 Submission 26126 9.93
  253. 253 uclai_xlarge_s231127a_s231016a Submission 26536 9.93
  254. 254 uclai_xlarge_s231009a_p231007a Submission 26493 9.91
  255. 255 nalll Submission 25992 9.90
  256. 256 opt_6bm_40bt_ww Submission 23342 9.89
  257. 257 xq_uclai_1B_p230825a Submission 26373 9.89
  258. 258 uclai_1B_p230825a Submission 26383 9.89
  259. 259 opt_6B_60T_3_2_1k_ww Submission 24185 9.88
  260. 260 xq_uclai_small_s230902b_p230901b Submission 26406 9.87
  261. 261 ocnli Submission 26021 9.85
  262. 262 uclai_medium_s231120a_p231013a Submission 26534 9.84
  263. 263 sft_20230327_ww Submission 24512 9.82
  264. 264 ul-v16 Submission 25414 9.81
  265. 265 xq_uclai_small_s230902a_p230827b Submission 26405 9.80
  266. 266 uclai_700m_p230821a Submission 26358 9.77
  267. 267 xq_uclai_small_s230902c_p230829b Submission 26407 9.77
  268. 268 ul-v17 Submission 25481 9.74
  269. 269 ul_large_v1_7_0703_2 Submission 26136 9.74
  270. 270 ul-l-v1-7 Submission 26141 9.74
  271. 271 ul-l-v1-7-new Submission 26149 9.74
  272. 272 u-wj8 Submission 25939 9.73
  273. 273 uclai_xlarge_s231016a_p231007a Submission 26491 9.72
  274. 274 pul-v15 Submission 25312 9.70
  275. 275 520 Submission 25966 9.70
  276. 276 ul-sm-v2-10 Submission 26009 9.69
  277. 277 uclai_small_s230906a_p3_5 Submission 26469 9.67
  278. 278 bustm Submission 25484 9.66
  279. 279 py_xlarge_s231016a_p231007a-2 Submission 26522 9.66
  280. 280 py_xlarge_s231016a_p231007a-sys Submission 26521 9.66
  281. 281 py_xlarge_s231016a_p231007a-sys2 Submission 26520 9.66
  282. 282 uclai_xlarge_s231016a_p231007a-3 Submission 26535 9.66
  283. 283 zeroclue_llll Submission 7582 9.65
  284. 284 uclai_xlarge_s230907a_v3_2 Submission 26419 9.65
  285. 285 uuuu Submission 26509 9.64
  286. 286 uclai_small_s230822a_p3_5 Submission 26361 9.63
  287. 287 uc_large_v1_3_ww Submission 24685 9.63
  288. 288 xq_uclai_700m_p230816c Submission 26349 9.61
  289. 289 xq_uclai_700m_p230818a Submission 26350 9.59
  290. 290 py_xlarge_d231108a_s231016a Submission 26519 9.59
  291. 291 uclai_small_s230817a_p3_5_flashatt Submission 26393 9.59
  292. 292 uclai-chat-stream-small_p3_5_v2 Submission 26272 9.56
  293. 293 xa_uclai_small_s230831a_p3_5 Submission 26402 9.51
  294. 294 xq_uclai_small_s230902d_p230823a Submission 26408 9.51
  295. 295 uclai_small_s230818a_p3_5_flashatt Submission 26394 9.50
  296. 296 ≈ Submission 26400 9.49
  297. 297 xq_uclai_xlarge_s230830a Submission 26399 9.49
  298. 298 t5-zeroshot-5t Submission 24522 9.48
  299. 299 xq_uclai_small_s230823c_v3_5 Submission 26372 9.47
  300. 300 xq_uclai-chat-stream-small-p3-5-v1-2_0825 Submission 26369 9.47
  301. 301 uclai_1B_s231218f_p231208a Submission 26595 9.47
  302. 302 uclai_medium_s231014a_p231013a Submission 26490 9.47
  303. 303 uclai_small_s230823b_v3_5 Submission 26364 9.46
  304. 304 uclai_small_s230905c_p230904b Submission 26422 9.46
  305. 305 small_s231114b_p231113a Submission 26517 9.46
  306. 306 uclai_small_s230823d_v3_5 Submission 26365 9.44
  307. 307 uclai_700m_v3_9 Submission 26331 9.43
  308. 308 lake_large_20bt_ww Submission 24618 9.41
  309. 309 xq_uclai_small_s230901a_p3_5 Submission 26401 9.41
  310. 310 py_medium_s231026a_p230917c Submission 26527 9.39
  311. 311 uclai_medium_s230914a_p230913c Submission 26451 9.39
  312. 312 uclai_large_s230915a_s2_16 Submission 26464 9.38
  313. 313 stm-l-v2-3 Submission 24729 9.38
  314. 314 uclai_1B_s231208a_p231208a Submission 26549 9.38
  315. 315 py_medium_d231030a_s231014a Submission 26525 9.36
  316. 316 small_s231114a_p231113a Submission 26516 9.36
  317. 317 t5-zeroshot-5t1 Submission 24523 9.35
  318. 318 csl-212 Submission 25468 9.34
  319. 319 ul-wj12 Submission 25926 9.34
  320. 320 tt Submission 15304 9.34
  321. 321 uclai_small_s230905a_p230904b Submission 26412 9.31
  322. 322 uclai_chat_stream_700m_p3_9_v1 Submission 26334 9.31
  323. 323 py_small_s231029a_p230910c Submission 26526 9.29
  324. 324 csl-211 Submission 25265 9.22
  325. 325 lake_large_15bt_ww Submission 24593 9.21
  326. 326 py_small_s231030a_p230910c Submission 26524 9.17
  327. 327 uclai_small_d20230828b Submission 26387 9.13
  328. 328 uclai_small_s231007a_p230910c Submission 26484 9.12
  329. 329 medium_s230918b_p230917c Submission 26465 9.11
  330. 330 uclai_small_s231012a_p230910c Submission 26489 9.11
  331. 331 uclai_small_l230914a_s230905b Submission 26446 9.10
  332. 332 uclai_small_d20230828a Submission 26386 9.07
  333. 333 uclai_700m_v3_8 Submission 26332 9.02
  334. 334 py_medium_s230918b_p230917c-2 Submission 26523 9.01
  335. 335 uclai_medium_s230914b_p230913c Submission 26448 9.00
  336. 336 uclai_small_s230915a_p230910c Submission 26455 8.96
  337. 337 uclai_small_s231005a_p230910c Submission 26483 8.94
  338. 338 uclai_small_s231013a_p230910c Submission 26492 8.94
  339. 339 uclai_small_s20231129_p230910c Submission 26567 8.94
  340. 340 uclai_small_d20230824a Submission 26375 8.93
  341. 341 uclai_small_s230911a_p3_5 Submission 26429 8.91
  342. 342 uclai_small_s230920c_p230904b Submission 26475 8.91
  343. 343 uclai_large_s230814_s2_16_v5 Submission 26392 8.91
  344. 344 lake_small_70bt_ww Submission 24598 8.89
  345. 345 uclai-small-v1_0 Submission 26127 8.89
  346. 346 stm-large-v2-1_ww Submission 24693 8.88
  347. 347 lake_small_60bt_ww Submission 24597 8.87
  348. 348 lake_small_50bt_ww Submission 24589 8.84
  349. 349 la_30b_10bt_ww Submission 24570 8.84
  350. 350 uclai_small_s230922a_p230904c Submission 26480 8.79
  351. 351 la_7b_40bt_ww Submission 24587 8.78
  352. 352 uclai_small_s230828a_p3_5 Submission 26388 8.75
  353. 353 s230814b_p230814b_1 Submission 26345 8.72
  354. 354 uclai_large_s231207a_p231202a Submission 26550 8.70
  355. 355 uclai_small_s230917a_p230904b Submission 26467 8.68
  356. 356 uclai_small_s230925a_p230904c Submission 26479 8.68
  357. 357 uclai_small_s230912b_p3_5 Submission 26441 8.67
  358. 358 zyc_test Submission 24510 8.66
  359. 359 stm-l-v2-10 Submission 25083 8.63
  360. 360 small_s230919a_p230904b Submission 26472 8.63
  361. 361 xq_uclai_small_s230825a_v3_5 Submission 26371 8.60
  362. 362 uclai_small_s230905b_p230904b_flashatt Submission 26414 8.53
  363. 363 1 Submission 15404 8.53
  364. 364 la_7b_30bt_ww Submission 24565 8.49
  365. 365 test Submission 14528 8.46
  366. 366 chat-stream-small-1_ww Submission 24673 8.41
  367. 367 uclai_small_s231214a_p231213a Submission 26568 8.41
  368. 368 stm-s-v2-3 Submission 24727 8.40
  369. 369 stm-s-v2-5 Submission 24731 8.28
  370. 370 stm-s-v2-4 Submission 24730 8.22
  371. 371 py_medium_d231027a_s231014a Submission 26528 8.22
  372. 372 t5-zeroshot-5t3 Submission 24525 8.19
  373. 373 la_7b_30b_sft_ww Submission 24574 8.19
  374. 374 ul-sm-v2-11 Submission 26025 8.16
  375. 375 stm-l-v2-8 Submission 24984 8.13
  376. 376 t5-zeroshot-5t2 Submission 24524 8.10
  377. 377 la_7bm_30bt_sft_2bt_ww Submission 24575 8.07
  378. 378 la_7b_20t_ww Submission 24493 8.06
  379. 379 stm-s-v2-6 Submission 24781 8.02
  380. 380 stm-s-v2-7 Submission 24985 7.97
  381. 381 wj_u-s-2-11 Submission 26198 7.96
  382. 382 stm-l-v2-4 Submission 24735 7.88
  383. 383 tantan Submission 14881 7.83
  384. 384 pai-bert-tiny-xnli_zh-nli Submission 26726 7.82
  385. 385 pai-bert-tiny Submission 26762 7.82
  386. 386 wj_uc-s-p1-0-v1 Submission 26273 7.67
  387. 387 stm-l-v2-5 Submission 24782 7.62
  388. 388 eprstmt Submission 26075 7.40
  389. 389 uclai_small_s230914a_p230904b Submission 26466 7.32
  390. 390 uclai-chat-stream-small-v2-6-0905-FT Submission 26413 7.29
  391. 391 cccc Submission 26020 7.25
  392. 392 cluewscf Submission 26073 7.20
  393. 393 fly-20 Submission 25813 7.04
  394. 394 uclai_small_l230920a_s230905b Submission 26481 7.02
  395. 395 ul-wj14 Submission 25919 6.95
  396. 396 csl-214 Submission 25921 6.95
  397. 397 stm-l-v2-7 Submission 24983 6.92
  398. 398 gpt-3.5 Submission 26763 6.82
  399. 399 hanhan Submission 14886 6.81
  400. 400 uclai_700m_v3_9_onlytext_sft Submission 26473 6.81
  401. 401 la_30b_1t_ww Submission 24501 6.80
  402. 402 bbbbbb Submission 26065 6.72
  403. 403 fly-75 Submission 25815 6.63
  404. 404 mc Submission 26533 6.63
  405. 405 qwe Submission 15106 6.62
  406. 406 tantan1 Submission 15179 6.62
  407. 407 hhh Submission 14889 6.57
  408. 408 cslf Submission 26074 6.57
  409. 409 gpt3.5 Submission 26764 6.51
  410. 410 fly-47 Submission 25814 6.48
  411. 411 csl-213 Submission 25918 6.46
  412. 412 ul-wj13 Submission 25917 6.46
  413. 413 ul-lg-v2-15-qianhai Submission 26010 6.46
  414. 414 uclai_700m_v3_9_polly_sft Submission 26442 6.41
  415. 415 la_7b_15bt_sft_4_5_ww Submission 24566 6.39
  416. 416 bbbbbb-c Submission 26069 6.21
  417. 417 uclai_small_l230921a_s230905b Submission 26482 6.16
  418. 418 ul-wj15 Submission 25920 6.04
  419. 419 csl-215 Submission 25935 6.04
  420. 420 ul-wj15-1 Submission 25938 6.04
  421. 421 ul-wj15-2 Submission 25962 6.04
  422. 422 gpt2_350M_ns231113a_np231111a Submission 26530 6.03
  423. 423 stream-small-v2-2_ww Submission 24679 5.96
  424. 424 uclai_small_l231102a_s230905b Submission 26529 5.91
  425. 425 xq_0822 Submission 26357 5.76
  426. 426 uclai_chat_stream_large_s2_16_v5 Submission 26494 5.76
  427. 427 xq_uclai_chat_stream_large_s2_16_v5_safety Submission 26355 5.75
  428. 428 hhhhh Submission 15197 5.61
  429. 429 cpm-test-1 Submission 26173 5.33
  430. 430 cpm-test-2 Submission 26172 5.33
  431. 431 chat-stream-small_ww Submission 24637 5.04
  432. 432 xq_uclai_tiny_v1_2 Submission 26125 4.81
  433. 433 47-2task Submission 25754 4.80
  434. 434 llama2_13B_chat_hf Submission 26397 4.80
  435. 435 xq_uclai_chat-stream-tiny_v1_2 Submission 26138 4.65
  436. 436 q1 Submission 14530 4.45
  437. 437 xq_uclai_chat-stream-tiny_v1_1 Submission 26139 4.31
  438. 438 llama2_7B_chat_hf Submission 26391 4.18
  439. 439 20-2task Submission 25753 4.17
  440. 440 xq_uclai_tiny_v1_1 Submission 26124 4.08
  441. 441 ocnlif Submission 26076 3.81
  442. 442 xq_uclai_chat_stream_large_s2_16_v2_0717_2 Submission 26186 3.49
  443. 443 llama_7B_hf_ww Submission 24492 3.21
  444. 444 la_7b_sft_4_1_ww Submission 24511 2.93
  445. 445 uclai_large_v1_7 Submission 26131 2.53
  446. 446 ul_large_v1_7_0703 Submission 26134 2.53
  447. 447 wj_u-l-2-16 Submission 26200 2.52
  448. 448 gpt2-large-test Submission 26457 2.29
  449. 449 xq_uclai-chat-stream-small-p3-5-v1-2 Submission 26368 1.93
  450. 450 test-ot5-tnews-20221017 Submission 17200 0.01

Source: Official ZeroCLUE leaderboard

Source: Official ZeroCLUE leaderboard

#EntryScoreSettingSubmitted byReleasedRun onLinkSource
1 CPM-Bee 78.2 Submission 26012 OpenBMB&面壁智能 May 2023 github.com Official leaderboard
2 Ctyun_Big_Model 76.2 Submission 23753 天翼云AI Feb 2023 github.com Official leaderboard
3 PaddleNLP-UTC 70.5 Submission 210742 飞桨PaddleNLP Jan 2023 Official leaderboard
4 二郎神-UnifiedMC 70.3 Submission 15715 IDEA研究院 Aug 2022 github.com Official leaderboard
5 GPT-MoE 69.5 Submission 15603 阿里云机器学习平台PAI Aug 2022 github.com Official leaderboard
6 Randeng-T5-784M-MultiTask 69.2 Submission 22479 IDEA研究院 Dec 2022 github.com Official leaderboard
7 Mengzi-T5-MT 68.9 Submission 15602 澜舟科技 Aug 2022 github.com Official leaderboard
8 asdf 67.7 Submission 25263 11 Apr 2023 Official leaderboard
9 assistant 65.9 Submission 25829 zz May 2023 live.openbmb.org Official leaderboard
10 XXXX-Test 63.8 Submission 20636 XXXX-Test Nov 2022 Official leaderboard
11 二郎神-MRC 63.5 Submission 10590 IDEA研究院 Jan 2022 github.com Official leaderboard
12 abtest03 61.5 Submission 22870 abtest03 Dec 2022 Official leaderboard
13 bumble-75 61.5 Submission 25432 lpnhtu May 2023 github.com Official leaderboard
14 4731 61.2 Submission 25817 4731 May 2023 live.openbmb.org Official leaderboard
15 XXXXRoberta 60.4 Submission 20708 XXXXRoberta Nov 2022 Official leaderboard
16 bumble-20 60.1 Submission 25431 plnuht May 2023 github.com Official leaderboard
17 t5_wu 60.0 Submission 20481 t5_wu Nov 2022 github.com Official leaderboard
18 UniCU 59.3 Submission 20069 UniCU Nov 2022 Official leaderboard
19 源1.0 59.0 Submission 7618 浪潮人工智能研究院 Sep 2021 github.com Official leaderboard
20 abtest01 58.6 Submission 22871 abtest01 Dec 2022 Official leaderboard
21 zero-t5 58.0 Submission 25122 just_try Apr 2023 github.com Official leaderboard
22 jjtest01 56.8 Submission 22770 jjtest01 Dec 2022 Official leaderboard
23 XT5 56.6 Submission 20851 XT5 Nov 2022 Official leaderboard
24 t5-gp 55.9 Submission 24601 yimiao Apr 2023 github.com Official leaderboard
25 T5-zeroshot-V2-0 55.4 Submission 24497 test Mar 2023 github.com Official leaderboard
26 T5 54.3 Submission 17151 T5 Oct 2022 Official leaderboard
27 test_rf 54.1 Submission 15237 test_rf Jul 2022 github.com Official leaderboard
28 needle 51.9 Submission 20511 needle Nov 2022 github.com Official leaderboard
29 200 51.1 Submission 25949 20018 May 2023 github.com Official leaderboard
30 needle9 50.1 Submission 21095 needle9 Nov 2022 arxiv.org Official leaderboard
31 bumble-20w 50.0 Submission 25430 sodier58 May 2023 github.com Official leaderboard
32 OBERT-C-base.Zero-shot 49.9 Submission 8277 OPPO小布助手 Oct 2021 github.com Official leaderboard
33 needle10 49.6 Submission 21085 needle10 Nov 2022 arxiv.org Official leaderboard
34 T5-ZeroShot-V2 49.2 Submission 24495 test Mar 2023 github.com Official leaderboard
35 test_rt 48.9 Submission 15232 test_rt Jul 2022 github.com Official leaderboard
36 gpt2 48.3 Submission 15444 水果 Aug 2022 github.com Official leaderboard
37 test1122 48.0 Submission 15589 test1122 Aug 2022 github.com Official leaderboard
38 T5-test-4-zero-shot 47.5 Submission 26104 try Jun 2023 github.com Official leaderboard
39 RoBERTa_wwm.Zero-shot ✓ 47.0 Submission 8124 CLUE Jun 2021 github.com Official leaderboard
40 jjtest05 46.9 Submission 22764 jjtest05 Dec 2022 Official leaderboard
41 bumble-47 46.8 Submission 25270 plnhut Apr 2023 github.com Official leaderboard
42 bert 45.5 Submission 15440 perrier Aug 2022 github.com Official leaderboard
43 BT5-test2 45.5 Submission 26382 sdgrtd Aug 2023 Official leaderboard
44 ChatCPM 45.4 Submission 25825 zz May 2023 live.openbmb.org Official leaderboard
45 t5 44.9 Submission 15302 红豆 Aug 2022 Official leaderboard
46 NEZHA-Gen.Zero-shot ✓ 44.2 Submission 6033 CLUE Jun 2021 github.com Official leaderboard
47 XXXXZC 44.0 Submission 19776 XXXXZC Nov 2022 Official leaderboard
48 Robbberta 43.9 Submission 19778 Robbberta Nov 2022 Official leaderboard
49 BD-Test 42.9 Submission 19052 BD-Test Oct 2022 Official leaderboard
50 cpm-bee 42.0 Submission 25260 Modelbest Apr 2023 github.com Official leaderboard
51 bb-75 42.0 Submission 25273 sodier77 Apr 2023 github.com Official leaderboard
52 gpt 41.7 Submission 15224 perrier Jul 2022 github.com Official leaderboard
53 fi 40.4 Submission 25990 nal May 2023 github.com Official leaderboard
54 jjtest04 40.2 Submission 22769 jjtest04 Dec 2022 Official leaderboard
55 1600 40.0 Submission 25993 succcccc May 2023 github.com Official leaderboard
56 mmtest01 39.8 Submission 23107 mmtest01 Dec 2022 Official leaderboard
57 jjtest02 37.4 Submission 22772 jjtest02 Dec 2022 Official leaderboard
58 2888 36.1 Submission 25937 123123 May 2023 github.com Official leaderboard
59 Baichuan2-7B-Chat 35.1 Submission 26474 Tibok Sep 2023 huggingface.co Official leaderboard
60 VILLM-0.5-tiny-11.8M 35.1 Submission 26476 Tibok Sep 2023 huggingface.co Official leaderboard
61 5211 34.9 Submission 25965 dog May 2023 github.com Official leaderboard
62 Z_BERT 34.8 Submission 12804 zzttll Apr 2022 github.com Official leaderboard
63 MOSS 34.3 Submission 26044 GDL Jun 2023 github.com Official leaderboard
64 VILLM_0.3 34.2 Submission 26428 Tibok Sep 2023 huggingface.co Official leaderboard
65 09 33.7 Submission 25770 TTT May 2023 github.com Official leaderboard
66 qw 33.7 Submission 25922 qw May 2023 github.com Official leaderboard
67 cadfs 33.7 Submission 25959 aaaadd May 2023 github.com Official leaderboard
68 jjtest03 33.7 Submission 22767 jjtest03 Dec 2022 Official leaderboard
69 0510-11-1 33.6 Submission 25488 0510-11 May 2023 github.com Official leaderboard
70 123 33.5 Submission 25773 123 May 2023 github.com Official leaderboard
71 yeee 33.5 Submission 25985 uuuu May 2023 github.com Official leaderboard
72 ZeroCLUE.M 33.4 Submission 18945 ZeroCLUE.M Oct 2022 github.com Official leaderboard
73 VILLM-0.10-320M 33.3 Submission 26634 Tibok Jan 2024 huggingface.co Official leaderboard
74 17 33.3 Submission 25927 1111 May 2023 github.com Official leaderboard
75 18 32.8 Submission 25932 188 May 2023 github.com Official leaderboard
76 CC 32.8 Submission 25956 差差差 May 2023 github.com Official leaderboard
77 ff 32.8 Submission 25973 fu May 2023 github.com Official leaderboard
78 VILLM-0.3 32.7 Submission 26443 Tibok Sep 2023 huggingface.co Official leaderboard
79 ma 32.7 Submission 26018 maaa May 2023 github.com Official leaderboard
80 metaseq.bloom.1b3 32.7 Submission 15300 optfree Aug 2022 huggingface.co Official leaderboard
81 ai 32.6 Submission 25980 aiii May 2023 github.com Official leaderboard
82 22 32.5 Submission 25970 233 May 2023 github.com Official leaderboard
83 220 32.5 Submission 26027 aggg May 2023 github.com Official leaderboard
84 lm 32.5 Submission 26031 lmmmmmmm May 2023 github.com Official leaderboard
85 521 32.5 Submission 25964 dog May 2023 github.com Official leaderboard
86 ck 32.4 Submission 26002 hhhhhh May 2023 github.com Official leaderboard
87 VILLM_0.3_982M 32.3 Submission 26459 Tibok Sep 2023 huggingface.co Official leaderboard
88 ByBloom-1B6 32.2 Submission 26425 Tibok Sep 2023 huggingface.co Official leaderboard
89 VILLM-0.3-327M 32.0 Submission 26424 Tibok Sep 2023 huggingface.co Official leaderboard
90 lll 32.0 Submission 26034 mmmmm May 2023 github.com Official leaderboard
91 ChatCPM1 31.9 Submission 25810 zz May 2023 live.openbmb.org Official leaderboard
92 20 31.9 Submission 25953 fsdf May 2023 github.com Official leaderboard
93 ByBloom-303M 31.7 Submission 26433 Tibok Sep 2023 huggingface.co Official leaderboard
94 VILLM-0.9-50M 31.7 Submission 26506 Tibok Oct 2023 huggingface.co Official leaderboard
95 75-41 31.5 Submission 25755 sodier511 May 2023 github.com Official leaderboard
96 ByBloom-303M-R2 31.4 Submission 26456 Tibok Sep 2023 huggingface.co Official leaderboard
97 NN-MAC3 31.3 Submission 12794 开心一点 Apr 2022 github.com Official leaderboard
98 12421 31.2 Submission 25264 11 Apr 2023 Official leaderboard
99 耳畔 30.9 Submission 25818 耳畔 May 2023 github.com Official leaderboard
100 ChatGLM-6B 30.9 Submission 26053 CCC Mar 2023 Jun 2023 github.com Official leaderboard
101 B-1 30.8 Submission 25691 B May 2023 github.com Official leaderboard
102 VILLM_0.3_0914 30.6 Submission 26453 Tibok Sep 2023 huggingface.co Official leaderboard
103 请问 30.4 Submission 25821 请问 May 2023 github.com Official leaderboard
104 VILLM-0.4 30.2 Submission 26463 Tibok Sep 2023 huggingface.co Official leaderboard
105 Chinese-RoBERTa-wwm-ext-large 30.2 Submission 18914 XXXXZC Oct 2022 github.com Official leaderboard
106 Test47 30.1 Submission 25485 test47 May 2023 github.com Official leaderboard
107 metaseq.opt.6B 29.8 Submission 15221 optfree Jul 2022 github.com Official leaderboard
108 yaaaa 29.6 Submission 25986 uuuuu May 2023 github.com Official leaderboard
109 前文 29.1 Submission 25822 前文 May 2023 github.com Official leaderboard
110 啊是 29.1 Submission 25827 啊是 May 2023 github.com Official leaderboard
111 177 29.1 Submission 25928 1111 May 2023 github.com Official leaderboard
112 we 29.0 Submission 25923 we May 2023 github.com Official leaderboard
113 188 29.0 Submission 25933 123123 May 2023 github.com Official leaderboard
114 casdf 29.0 Submission 25960 ccccccaaa May 2023 github.com Official leaderboard
115 sadf 29.0 Submission 25957 sdaf May 2023 github.com Official leaderboard
116 fiiii 29.0 Submission 25991 nalll May 2023 github.com Official leaderboard
117 ByBloom-303M-R3 28.9 Submission 26434 Tibok Sep 2023 huggingface.co Official leaderboard
118 Supervised pre-trainning 28.9 Submission 8430 Zero-Shot Oct 2021 github.com Official leaderboard
119 1233 28.8 Submission 25774 2333 May 2023 github.com Official leaderboard
120 2001 28.7 Submission 25950 2008 May 2023 github.com Official leaderboard
121 二炮 28.6 Submission 25819 二炮 May 2023 github.com Official leaderboard
122 cpmb 28.6 Submission 26055 ccc Jun 2023 github.com Official leaderboard
123 mammam 28.5 Submission 26019 fffuuuu May 2023 github.com Official leaderboard
124 220000 28.5 Submission 26028 aaagggg May 2023 github.com Official leaderboard
125 mll 28.5 Submission 26032 mllllllll May 2023 github.com Official leaderboard
126 mmmm 28.4 Submission 26035 markkkkk May 2023 github.com Official leaderboard
127 aiiii 28.4 Submission 25981 aiiiii May 2023 github.com Official leaderboard
128 fff 28.4 Submission 25974 fu May 2023 github.com Official leaderboard
129 222 28.2 Submission 25971 2333 May 2023 github.com Official leaderboard
130 75-42 27.9 Submission 25756 sodier511 May 2023 github.com Official leaderboard
131 chhhhh 27.5 Submission 26004 hhhhhh May 2023 github.com Official leaderboard
132 Model.Zero-shot 27.1 Submission 5525 ZeroCLUE.M Aug 2021 github.com Official leaderboard
133 bb-47 26.7 Submission 25272 sodier76 Apr 2023 github.com Official leaderboard
134 BertForCLS 26.3 Submission 6092 bert Aug 2021 github.com Official leaderboard
135 needle4 24.4 Submission 20674 needle4 Nov 2022 arxiv.org Official leaderboard
136 BD-Chinese-Roberta-Large 24.3 Submission 19044 BD-Chinese-Roberta-Large Oct 2022 github.com Official leaderboard
137 needle2 23.6 Submission 20637 needle2 Nov 2022 github.com Official leaderboard
138 needle5 22.7 Submission 20676 needle5 Nov 2022 arxiv.org Official leaderboard
139 091 22.0 Submission 25771 TTT May 2023 github.com Official leaderboard
140 1666 21.1 Submission 25994 succcccc May 2023 github.com Official leaderboard
141 tantan4 19.6 Submission 15378 tantanbaobao4 Aug 2022 github.com Official leaderboard
142 hhhh 18.8 Submission 15158 tantanbaobao Jul 2022 github.com Official leaderboard
143 just_test 18.5 Submission 14899 just_test Jul 2022 github.com Official leaderboard
144 ckkk 18.3 Submission 26003 hhhhhh May 2023 github.com Official leaderboard
145 just_test2 18.3 Submission 14901 just_test2 Jul 2022 github.com Official leaderboard
146 A9 18.2 Submission 25772 sadfsdf May 2023 github.com Official leaderboard
147 S-Bert 17.8 Submission 6139 Sysu Aug 2021 github.com Official leaderboard
148 nene 17.7 Submission 14904 nene Jul 2022 github.com Official leaderboard
149 12322 17.5 Submission 25775 23333 May 2023 github.com Official leaderboard
150 1777 17.5 Submission 25929 B777 May 2023 github.com Official leaderboard
151 aaaaay 17.5 Submission 25987 kkkkk May 2023 github.com Official leaderboard
152 18888 17.4 Submission 25934 23rwer May 2023 github.com Official leaderboard
153 dsfccc 17.4 Submission 25958 dsaf May 2023 github.com Official leaderboard
154 needle3 17.3 Submission 20657 needle3 Nov 2022 arxiv.org Official leaderboard
155 canser 17.2 Submission 26036 ffffff May 2023 github.com Official leaderboard
156 er 17.2 Submission 25924 er May 2023 github.com Official leaderboard
157 dsfsdf 17.2 Submission 25961 hjhhhh May 2023 github.com Official leaderboard
158 0002222 17.2 Submission 26029 ggggggggg May 2023 github.com Official leaderboard
159 lmlmlm 17.2 Submission 26033 lmlmlmlmlmlmlm May 2023 github.com Official leaderboard
160 nannan 17.1 Submission 14903 nannan Jul 2022 github.com Official leaderboard
161 baa 17.1 Submission 25982 TTT May 2023 github.com Official leaderboard
162 fuuu 17.1 Submission 25975 ff May 2023 github.com Official leaderboard
163 15656 17.1 Submission 25995 cesss May 2023 github.com Official leaderboard
164 mmtest02 17.0 Submission 23108 mmtest02 Dec 2022 Official leaderboard
165 2222 16.9 Submission 25972 2323 May 2023 github.com Official leaderboard
166 201 16.8 Submission 25955 23234 May 2023 github.com Official leaderboard
167 S-Bert-V2 16.4 Submission 6145 Sysu Aug 2021 github.com Official leaderboard
168 1055 15.6 Submission 25694 1055 May 2023 github.com Official leaderboard
169 pre-trainning 15.6 Submission 8429 Zero-Shot Oct 2021 github.com Official leaderboard
170 as 15.3 Submission 25828 as May 2023 github.com Official leaderboard
171 前往 15.3 Submission 25823 前往 May 2023 github.com Official leaderboard
172 CSL 14.8 Submission 25705 CSL May 2023 github.com Official leaderboard
173 恩平 14.7 Submission 25820 恩平 May 2023 github.com Official leaderboard
174 0510-11-2 11.7 Submission 25489 0510-11 May 2023 github.com Official leaderboard
175 tantan3 11.5 Submission 15373 tantanbaobao3 Aug 2022 github.com Official leaderboard
176 uclai_xlarge_p231003a 11.4 Submission 26485 mc_10 Oct 2023 github.com Official leaderboard
177 uclai_xlarge_p231007a 11.4 Submission 26486 mc_10 Oct 2023 github.com Official leaderboard
178 uclai_medium_p230917b 11.3 Submission 26471 mc_14 Sep 2023 github.com Official leaderboard
179 uclai_medium_p230917a 11.3 Submission 26470 mc_14 Sep 2023 github.com Official leaderboard
180 0508aa 11.3 Submission 25707 fansile May 2023 github.com Official leaderboard
181 xq_uclai_small_p230901b 11.3 Submission 26404 mc09032 Sep 2023 github.com Official leaderboard
182 uclai_small_p230827b 11.2 Submission 26385 mc_lq Aug 2023 github.com Official leaderboard
183 uclai_medium_p230913b 11.2 Submission 26450 mc_14 Sep 2023 github.com Official leaderboard
184 ul-sm-v1-7 11.2 Submission 26022 mc May 2023 github.com Official leaderboard
185 xq_uclai_large_v3_3 11.2 Submission 26178 mc Jul 2023 github.com Official leaderboard
186 zeroclue_ll 11.1 Submission 7849 lhl Sep 2021 github.com Official leaderboard
187 ul_small_v3_5 11.1 Submission 26169 mc Jul 2023 github.com Official leaderboard
188 small_p1_0_v1 11.1 Submission 26270 mc Jul 2023 github.com Official leaderboard
189 small_p3_5_v3 11.1 Submission 26268 mc Jul 2023 github.com Official leaderboard
190 uclai_small_p230829b 11.1 Submission 26396 mc_8 Aug 2023 github.com Official leaderboard
191 zy-zeroclue 11.1 Submission 13090 zy Apr 2022 github.com Official leaderboard
192 ul_large_v1_4_w 11.1 Submission 26038 mc Jun 2023 github.com Official leaderboard
193 uclai_small_p230814a 11.1 Submission 26341 mc_lq Aug 2023 github.com Official leaderboard
194 ul-sm-v2-9 11.1 Submission 25984 mc May 2023 github.com Official leaderboard
195 ul-vs5 11.1 Submission 25977 mc May 2023 github.com Official leaderboard
196 uclai-231012 11.1 Submission 26487 mc Oct 2023 github.com Official leaderboard
197 xq_uclai_small_p230901a 11.1 Submission 26403 mc09031 Sep 2023 github.com Official leaderboard
198 0510-11-3 11.1 Submission 25490 0510-11 May 2023 github.com Official leaderboard
199 B-2 11.0 Submission 25692 B May 2023 github.com Official leaderboard
200 uclai_medium_p230913a 11.0 Submission 26449 mc_14 Sep 2023 github.com Official leaderboard
201 ul_large_v1_4_12 11.0 Submission 26096 mc Jun 2023 github.com Official leaderboard
202 uclai_small_p230827a 11.0 Submission 26384 mc_lq Aug 2023 github.com Official leaderboard
203 uclai_small_p230910b 11.0 Submission 26426 mc_12 Sep 2023 github.com Official leaderboard
204 uclai_small_s230821a_p3_5_1 11.0 Submission 26356 mcpy Aug 2023 github.com Official leaderboard
205 uclai_small_v3_8 11.0 Submission 26333 mc_lq Aug 2023 github.com Official leaderboard
206 xq_uclai_small_s230817a_p3_5_flatatt 11.0 Submission 26352 mcdd Aug 2023 github.com Official leaderboard
207 xq_0823_1 11.0 Submission 26362 mcdd Aug 2023 github.com Official leaderboard
208 uclai_large_v1_14 11.0 Submission 26110 mc Jun 2023 github.com Official leaderboard
209 xq_uclai_small_s230817a_p3_5 11.0 Submission 26353 mcdd Aug 2023 github.com Official leaderboard
210 xq_uclai_small_s230818a_p3_5 11.0 Submission 26348 mcdd Aug 2023 github.com Official leaderboard
211 xq_uclai_small_s230818a_p3_5_flatatt 11.0 Submission 26351 mcdd Aug 2023 github.com Official leaderboard
212 s230814a_p230814a 11.0 Submission 26344 mcpy Aug 2023 github.com Official leaderboard
213 uclai-chat-stream-small-p3-6-v1 10.9 Submission 26170 mc_lq Jul 2023 github.com Official leaderboard
214 xq_uclai_large_v3_2 10.9 Submission 26156 mc Jul 2023 github.com Official leaderboard
215 uclai_small_p230814b 10.9 Submission 26343 mc_lq Aug 2023 github.com Official leaderboard
216 uclai_small_p230829a 10.9 Submission 26395 mc_8 Aug 2023 github.com Official leaderboard
217 uclai_small_p230823a 10.9 Submission 26367 mc_lq Aug 2023 github.com Official leaderboard
218 uclai_small_p230910a 10.8 Submission 26420 mc_11 Sep 2023 github.com Official leaderboard
219 uclai_small_p230904b 10.8 Submission 26411 mc_9 Sep 2023 github.com Official leaderboard
220 xq_uclai_small_v3_5 10.8 Submission 26158 mc Jul 2023 github.com Official leaderboard
221 xq_uclai_chat_stream_large_p3_3_v1 10.8 Submission 26216 mc Jul 2023 github.com Official leaderboard
222 xq_uclai_chat_stream_large_s2_16_v2 10.8 Submission 26215 mc Jul 2023 github.com Official leaderboard
223 xq_uclai_small_v3_3 10.7 Submission 26146 mc Jul 2023 github.com Official leaderboard
224 xq_uclai_small_v3_4 10.7 Submission 26157 mc Jul 2023 github.com Official leaderboard
225 uclai_small_v1_11 10.7 Submission 26081 mc Jun 2023 github.com Official leaderboard
226 ul-sm-v1-6 10.7 Submission 26008 mc May 2023 github.com Official leaderboard
227 Test 10.7 Submission 25479 Bee May 2023 github.com Official leaderboard
228 test56 10.7 Submission 25486 test56 May 2023 github.com Official leaderboard
229 test_chid 10.7 Submission 14898 test_chid Jul 2022 github.com Official leaderboard
230 uclai_small_p230822a 10.6 Submission 26366 mc_lq Aug 2023 github.com Official leaderboard
231 uclai-chat-stream-small-p3-5-v1 10.6 Submission 26166 mc_lq Jul 2023 github.com Official leaderboard
232 uclai_small_p230904a 10.6 Submission 26410 mc_9 Sep 2023 github.com Official leaderboard
233 uclai_large_v3_1_0703 10.6 Submission 26135 mc Jul 2023 github.com Official leaderboard
234 uclai_small_v1_10 10.6 Submission 26047 mc Jun 2023 github.com Official leaderboard
235 uclai_small_v1_13 10.6 Submission 26083 mc Jun 2023 github.com Official leaderboard
236 ul_large_v1_10 10.5 Submission 26085 mc Jun 2023 github.com Official leaderboard
237 uclai_small_v3_2 10.5 Submission 26132 mc Jun 2023 github.com Official leaderboard
238 pardon 10.5 Submission 26006 bustmpardon May 2023 github.com Official leaderboard
239 pai-ckbert-base-xnli_zh-nli 10.5 Submission 26724 forrest Feb 2024 Official leaderboard
240 xq_0825_uclai-chat-stream-small-p3-5-v1-3 10.4 Submission 26370 mcdd_0825 Aug 2023 github.com Official leaderboard
241 uclai_chat_stream_xlarge_p3_1_v1 10.4 Submission 26269 mc_lq Jul 2023 github.com Official leaderboard
242 textcnn-shopping 10.4 Submission 26767 forrest Mar 2024 Official leaderboard
243 pai-bert-base-xnli_zh-nli 10.3 Submission 26725 forrest Feb 2024 Official leaderboard
244 pai-ckbert-large-nli 10.3 Submission 26761 forrest Mar 2024 baidu.com Official leaderboard
245 wj_ul-s-p3-5-v3 10.2 Submission 26274 mc Jul 2023 github.com Official leaderboard
246 opt_6bm_60bt_ww 10.1 Submission 23870 wen Feb 2023 github.com Official leaderboard
247 opt_6bm_50bt_ww 10.1 Submission 23869 wen Feb 2023 github.com Official leaderboard
248 zero-bustm 10.0 Submission 25120 just_try Apr 2023 Official leaderboard
249 xq_uclai_1B_p230825b 10.0 Submission 26374 mc08254 Aug 2023 github.com Official leaderboard
250 uclai_1B_p230825b 10.0 Submission 26390 mc_lq_new Aug 2023 github.com Official leaderboard
251 py_xlarge_s231110a_p231107a 9.99 Submission 26518 pymc Nov 2023 github.com Official leaderboard
252 uclai_small_v3_1 9.93 Submission 26126 mc Jun 2023 github.com Official leaderboard
253 uclai_xlarge_s231127a_s231016a 9.93 Submission 26536 mc2311291 Nov 2023 github.com Official leaderboard
254 uclai_xlarge_s231009a_p231007a 9.91 Submission 26493 mc231017 Oct 2023 github.com Official leaderboard
255 nalll 9.90 Submission 25992 fiiiiii May 2023 github.com Official leaderboard
256 opt_6bm_40bt_ww 9.89 Submission 23342 wen Feb 2023 github.com Official leaderboard
257 xq_uclai_1B_p230825a 9.89 Submission 26373 mc08253 Aug 2023 github.com Official leaderboard
258 uclai_1B_p230825a 9.89 Submission 26383 mc_lq Aug 2023 github.com Official leaderboard
259 opt_6B_60T_3_2_1k_ww 9.88 Submission 24185 wen Mar 2023 github.com Official leaderboard
260 xq_uclai_small_s230902b_p230901b 9.87 Submission 26406 mc09034 Sep 2023 github.com Official leaderboard
261 ocnli 9.85 Submission 26021 ocnliiiii May 2023 github.com Official leaderboard
262 uclai_medium_s231120a_p231013a 9.84 Submission 26534 mc2311211 Nov 2023 github.com Official leaderboard
263 sft_20230327_ww 9.82 Submission 24512 wen Apr 2023 github.com Official leaderboard
264 ul-v16 9.81 Submission 25414 mc May 2023 github.com Official leaderboard
265 xq_uclai_small_s230902a_p230827b 9.80 Submission 26405 mc09033 Sep 2023 github.com Official leaderboard
266 uclai_700m_p230821a 9.77 Submission 26358 mc_lq Aug 2023 github.com Official leaderboard
267 xq_uclai_small_s230902c_p230829b 9.77 Submission 26407 mc09035 Sep 2023 github.com Official leaderboard
268 ul-v17 9.74 Submission 25481 mc May 2023 github.com Official leaderboard
269 ul_large_v1_7_0703_2 9.74 Submission 26136 mc Jul 2023 github.com Official leaderboard
270 ul-l-v1-7 9.74 Submission 26141 mc Jul 2023 github.com Official leaderboard
271 ul-l-v1-7-new 9.74 Submission 26149 mc Jul 2023 github.com Official leaderboard
272 u-wj8 9.73 Submission 25939 mc May 2023 github.com Official leaderboard
273 uclai_xlarge_s231016a_p231007a 9.72 Submission 26491 mc2310162 Oct 2023 github.com Official leaderboard
274 pul-v15 9.70 Submission 25312 mc May 2023 github.com Official leaderboard
275 520 9.70 Submission 25966 dog May 2023 github.com Official leaderboard
276 ul-sm-v2-10 9.69 Submission 26009 mc May 2023 github.com Official leaderboard
277 uclai_small_s230906a_p3_5 9.67 Submission 26469 mc_14 Sep 2023 github.com Official leaderboard
278 bustm 9.66 Submission 25484 bustm May 2023 github.com Official leaderboard
279 py_xlarge_s231016a_p231007a-2 9.66 Submission 26522 pymc Nov 2023 github.com Official leaderboard
280 py_xlarge_s231016a_p231007a-sys 9.66 Submission 26521 pymc Nov 2023 github.com Official leaderboard
281 py_xlarge_s231016a_p231007a-sys2 9.66 Submission 26520 pymc Nov 2023 github.com Official leaderboard
282 uclai_xlarge_s231016a_p231007a-3 9.66 Submission 26535 mc202311281 Nov 2023 github.com Official leaderboard
283 zeroclue_llll 9.65 Submission 7582 lhl Sep 2021 github.com Official leaderboard
284 uclai_xlarge_s230907a_v3_2 9.65 Submission 26419 mc_11 Sep 2023 github.com Official leaderboard
285 uuuu 9.64 Submission 26509 mcdd Oct 2023 github.com Official leaderboard
286 uclai_small_s230822a_p3_5 9.63 Submission 26361 mc_lq Aug 2023 github.com Official leaderboard
287 uc_large_v1_3_ww 9.63 Submission 24685 wen Apr 2023 github.com Official leaderboard
288 xq_uclai_700m_p230816c 9.61 Submission 26349 mcdd Aug 2023 github.com Official leaderboard
289 xq_uclai_700m_p230818a 9.59 Submission 26350 mcdd Aug 2023 github.com Official leaderboard
290 py_xlarge_d231108a_s231016a 9.59 Submission 26519 pymc Nov 2023 github.com Official leaderboard
291 uclai_small_s230817a_p3_5_flashatt 9.59 Submission 26393 mc_8 Aug 2023 github.com Official leaderboard
292 uclai-chat-stream-small_p3_5_v2 9.56 Submission 26272 mc_lq Jul 2023 github.com Official leaderboard
293 xa_uclai_small_s230831a_p3_5 9.51 Submission 26402 mc09012 Sep 2023 github.com Official leaderboard
294 xq_uclai_small_s230902d_p230823a 9.51 Submission 26408 mc009036 Sep 2023 github.com Official leaderboard
295 uclai_small_s230818a_p3_5_flashatt 9.50 Submission 26394 mc_8 Aug 2023 github.com Official leaderboard
296 ≈ 9.49 Submission 26400 mc0831 Aug 2023 github.com Official leaderboard
297 xq_uclai_xlarge_s230830a 9.49 Submission 26399 mc0831 Aug 2023 github.com Official leaderboard
298 t5-zeroshot-5t 9.48 Submission 24522 yimiao Apr 2023 github.com Official leaderboard
299 xq_uclai_small_s230823c_v3_5 9.47 Submission 26372 mc08252 Aug 2023 github.com Official leaderboard
300 xq_uclai-chat-stream-small-p3-5-v1-2_0825 9.47 Submission 26369 mcdd Aug 2023 github.com Official leaderboard
301 uclai_1B_s231218f_p231208a 9.47 Submission 26595 mc2312201 Dec 2023 github.com Official leaderboard
302 uclai_medium_s231014a_p231013a 9.47 Submission 26490 mc231016 Oct 2023 github.com Official leaderboard
303 uclai_small_s230823b_v3_5 9.46 Submission 26364 mc_lq Aug 2023 github.com Official leaderboard
304 uclai_small_s230905c_p230904b 9.46 Submission 26422 mc_11 Sep 2023 github.com Official leaderboard
305 small_s231114b_p231113a 9.46 Submission 26517 pymc Nov 2023 github.com Official leaderboard
306 uclai_small_s230823d_v3_5 9.44 Submission 26365 mc_lq Aug 2023 github.com Official leaderboard
307 uclai_700m_v3_9 9.43 Submission 26331 mc_lq Aug 2023 github.com Official leaderboard
308 lake_large_20bt_ww 9.41 Submission 24618 wen Apr 2023 github.com Official leaderboard
309 xq_uclai_small_s230901a_p3_5 9.41 Submission 26401 mc09011 Sep 2023 github.com Official leaderboard
310 py_medium_s231026a_p230917c 9.39 Submission 26527 pymc Nov 2023 github.com Official leaderboard
311 uclai_medium_s230914a_p230913c 9.39 Submission 26451 mc_14 Sep 2023 github.com Official leaderboard
312 uclai_large_s230915a_s2_16 9.38 Submission 26464 mc_14 Sep 2023 github.com Official leaderboard
313 stm-l-v2-3 9.38 Submission 24729 mc Apr 2023 github.com Official leaderboard
314 uclai_1B_s231208a_p231208a 9.38 Submission 26549 mc231211a Dec 2023 github.com Official leaderboard
315 py_medium_d231030a_s231014a 9.36 Submission 26525 pymc Nov 2023 github.com Official leaderboard
316 small_s231114a_p231113a 9.36 Submission 26516 pymc Nov 2023 github.com Official leaderboard
317 t5-zeroshot-5t1 9.35 Submission 24523 yimiao Apr 2023 github.com Official leaderboard
318 csl-212 9.34 Submission 25468 mc May 2023 github.com Official leaderboard
319 ul-wj12 9.34 Submission 25926 mc May 2023 github.com Official leaderboard
320 tt 9.34 Submission 15304 火龙果 Aug 2022 Official leaderboard
321 uclai_small_s230905a_p230904b 9.31 Submission 26412 mc_9 Sep 2023 github.com Official leaderboard
322 uclai_chat_stream_700m_p3_9_v1 9.31 Submission 26334 mc_lq Aug 2023 github.com Official leaderboard
323 py_small_s231029a_p230910c 9.29 Submission 26526 pymc Nov 2023 github.com Official leaderboard
324 csl-211 9.22 Submission 25265 mc Apr 2023 github.com Official leaderboard
325 lake_large_15bt_ww 9.21 Submission 24593 wen Apr 2023 github.com Official leaderboard
326 py_small_s231030a_p230910c 9.17 Submission 26524 pymc Nov 2023 github.com Official leaderboard
327 uclai_small_d20230828b 9.13 Submission 26387 mc_lq_new Aug 2023 github.com Official leaderboard
328 uclai_small_s231007a_p230910c 9.12 Submission 26484 mc_10 Oct 2023 github.com Official leaderboard
329 medium_s230918b_p230917c 9.11 Submission 26465 pymc Sep 2023 github.com Official leaderboard
330 uclai_small_s231012a_p230910c 9.11 Submission 26489 mc2310132 Oct 2023 github.com Official leaderboard
331 uclai_small_l230914a_s230905b 9.10 Submission 26446 mc_14 Sep 2023 github.com Official leaderboard
332 uclai_small_d20230828a 9.07 Submission 26386 mc_lq_new Aug 2023 github.com Official leaderboard
333 uclai_700m_v3_8 9.02 Submission 26332 mc_lq Aug 2023 github.com Official leaderboard
334 py_medium_s230918b_p230917c-2 9.01 Submission 26523 pymc Nov 2023 github.com Official leaderboard
335 uclai_medium_s230914b_p230913c 9.00 Submission 26448 mc_14 Sep 2023 github.com Official leaderboard
336 uclai_small_s230915a_p230910c 8.96 Submission 26455 mc_14 Sep 2023 github.com Official leaderboard
337 uclai_small_s231005a_p230910c 8.94 Submission 26483 mc_10 Oct 2023 github.com Official leaderboard
338 uclai_small_s231013a_p230910c 8.94 Submission 26492 mc2310163 Oct 2023 github.com Official leaderboard
339 uclai_small_s20231129_p230910c 8.94 Submission 26567 mc2312151 Dec 2023 github.com Official leaderboard
340 uclai_small_d20230824a 8.93 Submission 26375 mc_lq Aug 2023 github.com Official leaderboard
341 uclai_small_s230911a_p3_5 8.91 Submission 26429 mc_12 Sep 2023 github.com Official leaderboard
342 uclai_small_s230920c_p230904b 8.91 Submission 26475 mc_14 Sep 2023 github.com Official leaderboard
343 uclai_large_s230814_s2_16_v5 8.91 Submission 26392 mc_8 Aug 2023 github.com Official leaderboard
344 lake_small_70bt_ww 8.89 Submission 24598 wen Apr 2023 github.com Official leaderboard
345 uclai-small-v1_0 8.89 Submission 26127 mc Jun 2023 github.com Official leaderboard
346 stm-large-v2-1_ww 8.88 Submission 24693 wen Apr 2023 github.com Official leaderboard
347 lake_small_60bt_ww 8.87 Submission 24597 wen Apr 2023 github.com Official leaderboard
348 lake_small_50bt_ww 8.84 Submission 24589 wen Apr 2023 github.com Official leaderboard
349 la_30b_10bt_ww 8.84 Submission 24570 wen Apr 2023 github.com Official leaderboard
350 uclai_small_s230922a_p230904c 8.79 Submission 26480 mc_25 Sep 2023 github.com Official leaderboard
351 la_7b_40bt_ww 8.78 Submission 24587 wen Apr 2023 github.com Official leaderboard
352 uclai_small_s230828a_p3_5 8.75 Submission 26388 mc_lq_new Aug 2023 lil.nlp.cornell.edu Official leaderboard
353 s230814b_p230814b_1 8.72 Submission 26345 mcpy Aug 2023 github.com Official leaderboard
354 uclai_large_s231207a_p231202a 8.70 Submission 26550 mc2312121 Dec 2023 github.com Official leaderboard
355 uclai_small_s230917a_p230904b 8.68 Submission 26467 mc_14 Sep 2023 github.com Official leaderboard
356 uclai_small_s230925a_p230904c 8.68 Submission 26479 mc_25 Sep 2023 github.com Official leaderboard
357 uclai_small_s230912b_p3_5 8.67 Submission 26441 mc_12 Sep 2023 lil.nlp.cornell.edu Official leaderboard
358 zyc_test 8.66 Submission 24510 zyc_test Apr 2023 github.com Official leaderboard
359 stm-l-v2-10 8.63 Submission 25083 mc Apr 2023 github.com Official leaderboard
360 small_s230919a_p230904b 8.63 Submission 26472 pymc Sep 2023 github.com Official leaderboard
361 xq_uclai_small_s230825a_v3_5 8.60 Submission 26371 mc Aug 2023 github.com Official leaderboard
362 uclai_small_s230905b_p230904b_flashatt 8.53 Submission 26414 mc_9 Sep 2023 github.com Official leaderboard
363 1 8.53 Submission 15404 1 Aug 2022 Official leaderboard
364 la_7b_30bt_ww 8.49 Submission 24565 wen Apr 2023 github.com Official leaderboard
365 test 8.46 Submission 14528 test Jun 2022 Official leaderboard
366 chat-stream-small-1_ww 8.41 Submission 24673 wen Apr 2023 github.com Official leaderboard
367 uclai_small_s231214a_p231213a 8.41 Submission 26568 mc2312152 Dec 2023 github.com Official leaderboard
368 stm-s-v2-3 8.40 Submission 24727 mc Apr 2023 github.com Official leaderboard
369 stm-s-v2-5 8.28 Submission 24731 mc Apr 2023 github.com Official leaderboard
370 stm-s-v2-4 8.22 Submission 24730 mc Apr 2023 github.com Official leaderboard
371 py_medium_d231027a_s231014a 8.22 Submission 26528 pymc Nov 2023 github.com Official leaderboard
372 t5-zeroshot-5t3 8.19 Submission 24525 yimiao Apr 2023 github.com Official leaderboard
373 la_7b_30b_sft_ww 8.19 Submission 24574 wen Apr 2023 github.com Official leaderboard
374 ul-sm-v2-11 8.16 Submission 26025 mc May 2023 github.com Official leaderboard
375 stm-l-v2-8 8.13 Submission 24984 mc Apr 2023 github.com Official leaderboard
376 t5-zeroshot-5t2 8.10 Submission 24524 yimiao Apr 2023 github.com Official leaderboard
377 la_7bm_30bt_sft_2bt_ww 8.07 Submission 24575 wen Apr 2023 github.com Official leaderboard
378 la_7b_20t_ww 8.06 Submission 24493 wen Mar 2023 github.com Official leaderboard
379 stm-s-v2-6 8.02 Submission 24781 mc Apr 2023 github.com Official leaderboard
380 stm-s-v2-7 7.97 Submission 24985 mc Apr 2023 github.com Official leaderboard
381 wj_u-s-2-11 7.96 Submission 26198 mc Jul 2023 github.com Official leaderboard
382 stm-l-v2-4 7.88 Submission 24735 mc Apr 2023 github.com Official leaderboard
383 tantan 7.83 Submission 14881 tantanbaobao Jul 2022 github.com Official leaderboard
384 pai-bert-tiny-xnli_zh-nli 7.82 Submission 26726 forrest Feb 2024 Official leaderboard
385 pai-bert-tiny 7.82 Submission 26762 forrest Mar 2024 Official leaderboard
386 wj_uc-s-p1-0-v1 7.67 Submission 26273 mc Jul 2023 github.com Official leaderboard
387 stm-l-v2-5 7.62 Submission 24782 mc Apr 2023 github.com Official leaderboard
388 eprstmt 7.40 Submission 26075 sss Jun 2023 github.com Official leaderboard
389 uclai_small_s230914a_p230904b 7.32 Submission 26466 mc_14 Sep 2023 github.com Official leaderboard
390 uclai-chat-stream-small-v2-6-0905-FT 7.29 Submission 26413 mc_9 Sep 2023 github.com Official leaderboard
391 cccc 7.25 Submission 26020 kkkkk May 2023 github.com Official leaderboard
392 cluewscf 7.20 Submission 26073 sss Jun 2023 github.com Official leaderboard
393 fly-20 7.04 Submission 25813 fly-20 May 2023 github.com Official leaderboard
394 uclai_small_l230920a_s230905b 7.02 Submission 26481 mc_25 Sep 2023 github.com Official leaderboard
395 ul-wj14 6.95 Submission 25919 mc May 2023 github.com Official leaderboard
396 csl-214 6.95 Submission 25921 mc May 2023 github.com Official leaderboard
397 stm-l-v2-7 6.92 Submission 24983 mc Apr 2023 github.com Official leaderboard
398 gpt-3.5 6.82 Submission 26763 forrest Mar 2024 Official leaderboard
399 hanhan 6.81 Submission 14886 hanhanbaobao Jul 2022 github.com Official leaderboard
400 uclai_700m_v3_9_onlytext_sft 6.81 Submission 26473 mc_14 Sep 2023 github.com Official leaderboard
401 la_30b_1t_ww 6.80 Submission 24501 wen Apr 2023 github.com Official leaderboard
402 bbbbbb 6.72 Submission 26065 ccc Jun 2023 github.com Official leaderboard
403 fly-75 6.63 Submission 25815 fly-75 May 2023 github.com Official leaderboard
404 mc 6.63 Submission 26533 mc2311204 Nov 2023 github.com Official leaderboard
405 qwe 6.62 Submission 15106 qwe Jul 2022 github.com Official leaderboard
406 tantan1 6.62 Submission 15179 tantanbaobao1 Jul 2022 github.com Official leaderboard
407 hhh 6.57 Submission 14889 tantanbaobao Jul 2022 github.com Official leaderboard
408 cslf 6.57 Submission 26074 sss Jun 2023 github.com Official leaderboard
409 gpt3.5 6.51 Submission 26764 forrest Mar 2024 Official leaderboard
410 fly-47 6.48 Submission 25814 fly-47 May 2023 github.com Official leaderboard
411 csl-213 6.46 Submission 25918 mc May 2023 github.com Official leaderboard
412 ul-wj13 6.46 Submission 25917 mc May 2023 github.com Official leaderboard
413 ul-lg-v2-15-qianhai 6.46 Submission 26010 mc May 2023 github.com Official leaderboard
414 uclai_700m_v3_9_polly_sft 6.41 Submission 26442 mc_12 Sep 2023 github.com Official leaderboard
415 la_7b_15bt_sft_4_5_ww 6.39 Submission 24566 wen Apr 2023 github.com Official leaderboard
416 bbbbbb-c 6.21 Submission 26069 ccc Jun 2023 github.com Official leaderboard
417 uclai_small_l230921a_s230905b 6.16 Submission 26482 mc_25 Sep 2023 github.com Official leaderboard
418 ul-wj15 6.04 Submission 25920 mc May 2023 github.com Official leaderboard
419 csl-215 6.04 Submission 25935 mc May 2023 github.com Official leaderboard
420 ul-wj15-1 6.04 Submission 25938 mc May 2023 github.com Official leaderboard
421 ul-wj15-2 6.04 Submission 25962 mc May 2023 github.com Official leaderboard
422 gpt2_350M_ns231113a_np231111a 6.03 Submission 26530 mc2311202 Nov 2023 github.com Official leaderboard
423 stream-small-v2-2_ww 5.96 Submission 24679 wen Apr 2023 github.com Official leaderboard
424 uclai_small_l231102a_s230905b 5.91 Submission 26529 mc11201 Nov 2023 github.com Official leaderboard
425 xq_0822 5.76 Submission 26357 mcdd Aug 2023 github.com Official leaderboard
426 uclai_chat_stream_large_s2_16_v5 5.76 Submission 26494 mc2310172 Oct 2023 github.com Official leaderboard
427 xq_uclai_chat_stream_large_s2_16_v5_safety 5.75 Submission 26355 mcdd Aug 2023 github.com Official leaderboard
428 hhhhh 5.61 Submission 15197 tantanbaobao Jul 2022 github.com Official leaderboard
429 cpm-test-1 5.33 Submission 26173 cpm-test Jul 2023 Official leaderboard
430 cpm-test-2 5.33 Submission 26172 cpm-test Jul 2023 github.com Official leaderboard
431 chat-stream-small_ww 5.04 Submission 24637 wen Apr 2023 github.com Official leaderboard
432 xq_uclai_tiny_v1_2 4.81 Submission 26125 mc Jun 2023 github.com Official leaderboard
433 47-2task 4.80 Submission 25754 sodier511 May 2023 github.com Official leaderboard
434 llama2_13B_chat_hf 4.80 Submission 26397 mc_8 Aug 2023 github.com Official leaderboard
435 xq_uclai_chat-stream-tiny_v1_2 4.65 Submission 26138 mc Jul 2023 github.com Official leaderboard
436 q1 4.45 Submission 14530 q1 Jun 2022 Official leaderboard
437 xq_uclai_chat-stream-tiny_v1_1 4.31 Submission 26139 mc Jul 2023 github.com Official leaderboard
438 llama2_7B_chat_hf 4.18 Submission 26391 mc_lq_new Aug 2023 github.com Official leaderboard
439 20-2task 4.17 Submission 25753 sodier511 May 2023 github.com Official leaderboard
440 xq_uclai_tiny_v1_1 4.08 Submission 26124 mc Jun 2023 github.com Official leaderboard
441 ocnlif 3.81 Submission 26076 sss Jun 2023 github.com Official leaderboard
442 xq_uclai_chat_stream_large_s2_16_v2_0717_2 3.49 Submission 26186 mc Jul 2023 github.com Official leaderboard
443 llama_7B_hf_ww 3.21 Submission 24492 wen Mar 2023 github.com Official leaderboard
444 la_7b_sft_4_1_ww 2.93 Submission 24511 wen Apr 2023 github.com Official leaderboard
445 uclai_large_v1_7 2.53 Submission 26131 mc Jun 2023 github.com Official leaderboard
446 ul_large_v1_7_0703 2.53 Submission 26134 mc Jul 2023 github.com Official leaderboard
447 wj_u-l-2-16 2.52 Submission 26200 mc Jul 2023 github.com Official leaderboard
448 gpt2-large-test 2.29 Submission 26457 mc_14 Sep 2023 github.com Official leaderboard
449 xq_uclai-chat-stream-small-p3-5-v1-2 1.93 Submission 26368 mcdd Aug 2023 github.com Official leaderboard
450 test-ot5-tnews-20221017 0.01 Submission 17200 test-ot5-tnews-20221017 Oct 2022 github.com Official leaderboard
#ModelScoreSettingSubmitted byReleasedRun onLinkSource
1 ChatGLM-6B 30.9 Submission 26053 CCC Mar 2023 Jun 2023 github.com Official leaderboard

Number one over time

Lab claims count from the day the card came out, independent runs from the model’s release.

Z.ai
Own leaderboard Not tested since Mar 2023
ChatGLM-6B 30.9

Source: Official ZeroCLUE leaderboard

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

Plot with other benchmarks
On the benchmark’s own leaderboard
30.5 30.6 30.7 30.8 30.9 2023 30.5 30.6 30.7 30.8 30.9 2023

Source: Official ZeroCLUE leaderboard

No lab model card reports it yet

We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.

More in Multilingual

All 545 in Multilingual
  • MMMLU In use MMLU professionally translated into 14 languages. Multiple-choice accuracy. Claude Mythos Preview 92.7%
  • WMT24++ In use English-to-55-language translation of WMT24 test data. Scored with automatic metrics such as MetricX or xCOMET. K-EXAONE 90.5%
  • MMLU-ProX In use MMLU-Pro translated into up to 29 languages with expert review. Multiple-choice accuracy per language. Qwen3.7-Max 87%
  • CLIcK In use Models answer 1,995 multiple-choice questions on Korean language and culture. Questions come from official Korean exams and textbooks in eleven categories. Solar Open 2 90.7%
  • Global MMLU Lite 3.0 In use Models answer 400 human-translated MMLU questions per language in 23 languages. Version 3.0 adds Czech, Hungarian, Oriya, Slovak and Tajik and updates Italian. Accuracy. Claude Opus 5 95.7%
  • MMMB In use Models answer multiple-choice questions about images in six languages across 15 categories. The set has about 12,000 questions. LFM2.5-VL-3B 83%

Data audit

8 of 9 checks pass, 1 warning. Look first at the Newest score check. The newest came 3 years ago, in March 2023, for ChatGLM-6B. Every benchmark

Catalog record 2 pass
  • Pass Task access All tasks are public.
  • Pass Confidence Checked against a primary source.
Scores 1 warning 2 pass 2 notes
  • Pass Independent runs Scores from the official leaderboard (450 entries).
  • Pass Models scored 1 model we track, plus 449 other entries on its leaderboard.
  • Warning Newest score The newest came 3 years ago, in March 2023, for ChatGLM-6B.
  • Note Frontier models None of its models are on the capabilities index.
  • Note Headroom Scored as a plain number, with no fixed ceiling.
Leaderboard import 3 pass
  • Pass Importer We read the board on cluebenchmarks.com: 4 rows for models we track and 449 other entries at the last read.
  • Pass Last read November 20th, 2026.
  • Pass Read worked The last read worked.
Consistency 1 pass 1 note
  • Note Lab claims No model has both a lab number and an independent run.
  • Pass Known issues No published audit found problems.

How we check