ZeroCLUE
Models perform Chinese language tasks without training on labeled examples from the target task.
The repository reports baseline results.
- Made by
- CLUE benchmark team
- Kind
- Reading in many languages
- Level
- School
- Scored
- Checked automatically
- Answers
- Short answer
- Tasks
- All public
- Measures
- Capability
- Subject
- Languages and literature
- Language
- Chinese
- Interaction
- Single turn
- Items from
- Another benchmark, Real work and use
- Refresh
- One fixed set
- Run by
- A host
- Based on
- CLUE
- Last model added
- March 2023
- Scores refreshed
- November 20th, 2026
CPM-Bee tops the leaderboard with 78.2 ChatGLM-6B leads with 30.9
Best score per entry from the benchmark's own leaderboard, read on November 20th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. The best model we track is ChatGLM-6B, at 30.9. This view shows only models we track, each at its best.
- 78.2 CPM-Bee
- 76.2 Ctyun_Big_Model
- 70.5 PaddleNLP-UTC
- 70.3 二郎神-UnifiedMC
- 69.5 GPT-MoE
- 69.2 Randeng-T5-784M-MultiTask
- 68.9 Mengzi-T5-MT
- 67.7 asdf
- 65.9 assistant
- 63.8 XXXX-Test
- 63.5 二郎神-MRC
- 61.5 abtest03
- 61.5 bumble-75
- 61.2 4731
- 60.4 XXXXRoberta
- 60.1 bumble-20
- 60.0 t5_wu
- 59.3 UniCU
- 59.0 源1.0
- 58.6 abtest01
- 58.0 zero-t5
- 56.8 jjtest01
- 56.6 XT5
- 55.9 t5-gp
- 55.4 T5-zeroshot-V2-0
- 54.3 T5
- 54.1 test_rf
- 51.9 needle
- 51.1 200
- 50.1 needle9
- 50.0 bumble-20w
- 49.9 OBERT-C-base.Zero-shot
- 49.6 needle10
- 49.2 T5-ZeroShot-V2
- 48.9 test_rt
- 48.3 gpt2
- 48.0 test1122
- 47.5 T5-test-4-zero-shot
- 47.0 RoBERTa_wwm.Zero-shot
- 46.9 jjtest05
- 46.8 bumble-47
- 45.5 bert
- 45.5 BT5-test2
- 45.4 ChatCPM
- 44.9 t5
- 44.2 NEZHA-Gen.Zero-shot
- 44.0 XXXXZC
- 43.9 Robbberta
- 42.9 BD-Test
- 42.0 cpm-bee
- 42.0 bb-75
- 41.7 gpt
- 40.4 fi
- 40.2 jjtest04
- 40.0 1600
- 39.8 mmtest01
- 37.4 jjtest02
- 36.1 2888
- 35.1 Baichuan2-7B-Chat
- 35.1 VILLM-0.5-tiny-11.8M
- 34.9 5211
- 34.8 Z_BERT
- 34.3 MOSS
- 34.2 VILLM_0.3
- 33.7 09
- 33.7 qw
- 33.7 cadfs
- 33.7 jjtest03
- 33.6 0510-11-1
- 33.5 123
- 33.5 yeee
- 33.4 ZeroCLUE.M
- 33.3 VILLM-0.10-320M
- 33.3 17
- 32.8 18
- 32.8 CC
- 32.8 ff
- 32.7 VILLM-0.3
- 32.7 ma
- 32.7 metaseq.bloom.1b3
- 32.6 ai
- 32.5 22
- 32.5 220
- 32.5 lm
- 32.5 521
- 32.4 ck
- 32.3 VILLM_0.3_982M
- 32.2 ByBloom-1B6
- 32.0 VILLM-0.3-327M
- 32.0 lll
- 31.9 ChatCPM1
- 31.9 20
- 31.7 ByBloom-303M
- 31.7 VILLM-0.9-50M
- 31.5 75-41
- 31.4 ByBloom-303M-R2
- 31.3 NN-MAC3
- 31.2 12421
- 30.9 耳畔
- 30.9 ChatGLM-6B
- 30.8 B-1
- 30.6 VILLM_0.3_0914
- 30.4 请问
- 30.2 VILLM-0.4
- 30.2 Chinese-RoBERTa-wwm-ext-large
- 30.1 Test47
- 29.8 metaseq.opt.6B
- 29.6 yaaaa
- 29.1 前文
- 29.1 啊是
- 29.1 177
- 29.0 we
- 29.0 188
- 29.0 casdf
- 29.0 sadf
- 29.0 fiiii
- 28.9 ByBloom-303M-R3
- 28.9 Supervised pre-trainning
- 28.8 1233
- 28.7 2001
- 28.6 二炮
- 28.6 cpmb
- 28.5 mammam
- 28.5 220000
- 28.5 mll
- 28.4 mmmm
- 28.4 aiiii
- 28.4 fff
- 28.2 222
- 27.9 75-42
- 27.5 chhhhh
- 27.1 Model.Zero-shot
- 26.7 bb-47
- 26.3 BertForCLS
- 24.4 needle4
- 24.3 BD-Chinese-Roberta-Large
- 23.6 needle2
- 22.7 needle5
- 22.0 091
- 21.1 1666
- 19.6 tantan4
- 18.8 hhhh
- 18.5 just_test
- 18.3 ckkk
- 18.3 just_test2
- 18.2 A9
- 17.8 S-Bert
- 17.7 nene
- 17.5 12322
- 17.5 1777
- 17.5 aaaaay
- 17.4 18888
- 17.4 dsfccc
- 17.3 needle3
- 17.2 canser
- 17.2 er
- 17.2 dsfsdf
- 17.2 0002222
- 17.2 lmlmlm
- 17.1 nannan
- 17.1 baa
- 17.1 fuuu
- 17.1 15656
- 17.0 mmtest02
- 16.9 2222
- 16.8 201
- 16.4 S-Bert-V2
- 15.6 1055
- 15.6 pre-trainning
- 15.3 as
- 15.3 前往
- 14.8 CSL
- 14.7 恩平
- 11.7 0510-11-2
- 11.5 tantan3
- 11.4 uclai_xlarge_p231003a
- 11.4 uclai_xlarge_p231007a
- 11.3 uclai_medium_p230917b
- 11.3 uclai_medium_p230917a
- 11.3 0508aa
- 11.3 xq_uclai_small_p230901b
- 11.2 uclai_small_p230827b
- 11.2 uclai_medium_p230913b
- 11.2 ul-sm-v1-7
- 11.2 xq_uclai_large_v3_3
- 11.1 zeroclue_ll
- 11.1 ul_small_v3_5
- 11.1 small_p1_0_v1
- 11.1 small_p3_5_v3
- 11.1 uclai_small_p230829b
- 11.1 zy-zeroclue
- 11.1 ul_large_v1_4_w
- 11.1 uclai_small_p230814a
- 11.1 ul-sm-v2-9
- 11.1 ul-vs5
- 11.1 uclai-231012
- 11.1 xq_uclai_small_p230901a
- 11.1 0510-11-3
- 11.0 B-2
- 11.0 uclai_medium_p230913a
- 11.0 ul_large_v1_4_12
- 11.0 uclai_small_p230827a
- 11.0 uclai_small_p230910b
- 11.0 uclai_small_s230821a_p3_5_1
- 11.0 uclai_small_v3_8
- 11.0 xq_uclai_small_s230817a_p3_5_flatatt
- 11.0 xq_0823_1
- 11.0 uclai_large_v1_14
- 11.0 xq_uclai_small_s230817a_p3_5
- 11.0 xq_uclai_small_s230818a_p3_5
- 11.0 xq_uclai_small_s230818a_p3_5_flatatt
- 11.0 s230814a_p230814a
- 10.9 uclai-chat-stream-small-p3-6-v1
- 10.9 xq_uclai_large_v3_2
- 10.9 uclai_small_p230814b
- 10.9 uclai_small_p230829a
- 10.9 uclai_small_p230823a
- 10.8 uclai_small_p230910a
- 10.8 uclai_small_p230904b
- 10.8 xq_uclai_small_v3_5
- 10.8 xq_uclai_chat_stream_large_p3_3_v1
- 10.8 xq_uclai_chat_stream_large_s2_16_v2
- 10.7 xq_uclai_small_v3_3
- 10.7 xq_uclai_small_v3_4
- 10.7 uclai_small_v1_11
- 10.7 ul-sm-v1-6
- 10.7 Test
- 10.7 test56
- 10.7 test_chid
- 10.6 uclai_small_p230822a
- 10.6 uclai-chat-stream-small-p3-5-v1
- 10.6 uclai_small_p230904a
- 10.6 uclai_large_v3_1_0703
- 10.6 uclai_small_v1_10
- 10.6 uclai_small_v1_13
- 10.5 ul_large_v1_10
- 10.5 uclai_small_v3_2
- 10.5 pardon
- 10.5 pai-ckbert-base-xnli_zh-nli
- 10.4 xq_0825_uclai-chat-stream-small-p3-5-v1-3
- 10.4 uclai_chat_stream_xlarge_p3_1_v1
- 10.4 textcnn-shopping
- 10.3 pai-bert-base-xnli_zh-nli
- 10.3 pai-ckbert-large-nli
- 10.2 wj_ul-s-p3-5-v3
- 10.1 opt_6bm_60bt_ww
- 10.1 opt_6bm_50bt_ww
- 10.0 zero-bustm
- 10.0 xq_uclai_1B_p230825b
- 10.0 uclai_1B_p230825b
- 9.99 py_xlarge_s231110a_p231107a
- 9.93 uclai_small_v3_1
- 9.93 uclai_xlarge_s231127a_s231016a
- 9.91 uclai_xlarge_s231009a_p231007a
- 9.90 nalll
- 9.89 opt_6bm_40bt_ww
- 9.89 xq_uclai_1B_p230825a
- 9.89 uclai_1B_p230825a
- 9.88 opt_6B_60T_3_2_1k_ww
- 9.87 xq_uclai_small_s230902b_p230901b
- 9.85 ocnli
- 9.84 uclai_medium_s231120a_p231013a
- 9.82 sft_20230327_ww
- 9.81 ul-v16
- 9.80 xq_uclai_small_s230902a_p230827b
- 9.77 uclai_700m_p230821a
- 9.77 xq_uclai_small_s230902c_p230829b
- 9.74 ul-v17
- 9.74 ul_large_v1_7_0703_2
- 9.74 ul-l-v1-7
- 9.74 ul-l-v1-7-new
- 9.73 u-wj8
- 9.72 uclai_xlarge_s231016a_p231007a
- 9.70 pul-v15
- 9.70 520
- 9.69 ul-sm-v2-10
- 9.67 uclai_small_s230906a_p3_5
- 9.66 bustm
- 9.66 py_xlarge_s231016a_p231007a-2
- 9.66 py_xlarge_s231016a_p231007a-sys
- 9.66 py_xlarge_s231016a_p231007a-sys2
- 9.66 uclai_xlarge_s231016a_p231007a-3
- 9.65 zeroclue_llll
- 9.65 uclai_xlarge_s230907a_v3_2
- 9.64 uuuu
- 9.63 uclai_small_s230822a_p3_5
- 9.63 uc_large_v1_3_ww
- 9.61 xq_uclai_700m_p230816c
- 9.59 xq_uclai_700m_p230818a
- 9.59 py_xlarge_d231108a_s231016a
- 9.59 uclai_small_s230817a_p3_5_flashatt
- 9.56 uclai-chat-stream-small_p3_5_v2
- 9.51 xa_uclai_small_s230831a_p3_5
- 9.51 xq_uclai_small_s230902d_p230823a
- 9.50 uclai_small_s230818a_p3_5_flashatt
- 9.49 ≈
- 9.49 xq_uclai_xlarge_s230830a
- 9.48 t5-zeroshot-5t
- 9.47 xq_uclai_small_s230823c_v3_5
- 9.47 xq_uclai-chat-stream-small-p3-5-v1-2_0825
- 9.47 uclai_1B_s231218f_p231208a
- 9.47 uclai_medium_s231014a_p231013a
- 9.46 uclai_small_s230823b_v3_5
- 9.46 uclai_small_s230905c_p230904b
- 9.46 small_s231114b_p231113a
- 9.44 uclai_small_s230823d_v3_5
- 9.43 uclai_700m_v3_9
- 9.41 lake_large_20bt_ww
- 9.41 xq_uclai_small_s230901a_p3_5
- 9.39 py_medium_s231026a_p230917c
- 9.39 uclai_medium_s230914a_p230913c
- 9.38 uclai_large_s230915a_s2_16
- 9.38 stm-l-v2-3
- 9.38 uclai_1B_s231208a_p231208a
- 9.36 py_medium_d231030a_s231014a
- 9.36 small_s231114a_p231113a
- 9.35 t5-zeroshot-5t1
- 9.34 csl-212
- 9.34 ul-wj12
- 9.34 tt
- 9.31 uclai_small_s230905a_p230904b
- 9.31 uclai_chat_stream_700m_p3_9_v1
- 9.29 py_small_s231029a_p230910c
- 9.22 csl-211
- 9.21 lake_large_15bt_ww
- 9.17 py_small_s231030a_p230910c
- 9.13 uclai_small_d20230828b
- 9.12 uclai_small_s231007a_p230910c
- 9.11 medium_s230918b_p230917c
- 9.11 uclai_small_s231012a_p230910c
- 9.10 uclai_small_l230914a_s230905b
- 9.07 uclai_small_d20230828a
- 9.02 uclai_700m_v3_8
- 9.01 py_medium_s230918b_p230917c-2
- 9.00 uclai_medium_s230914b_p230913c
- 8.96 uclai_small_s230915a_p230910c
- 8.94 uclai_small_s231005a_p230910c
- 8.94 uclai_small_s231013a_p230910c
- 8.94 uclai_small_s20231129_p230910c
- 8.93 uclai_small_d20230824a
- 8.91 uclai_small_s230911a_p3_5
- 8.91 uclai_small_s230920c_p230904b
- 8.91 uclai_large_s230814_s2_16_v5
- 8.89 lake_small_70bt_ww
- 8.89 uclai-small-v1_0
- 8.88 stm-large-v2-1_ww
- 8.87 lake_small_60bt_ww
- 8.84 lake_small_50bt_ww
- 8.84 la_30b_10bt_ww
- 8.79 uclai_small_s230922a_p230904c
- 8.78 la_7b_40bt_ww
- 8.75 uclai_small_s230828a_p3_5
- 8.72 s230814b_p230814b_1
- 8.70 uclai_large_s231207a_p231202a
- 8.68 uclai_small_s230917a_p230904b
- 8.68 uclai_small_s230925a_p230904c
- 8.67 uclai_small_s230912b_p3_5
- 8.66 zyc_test
- 8.63 stm-l-v2-10
- 8.63 small_s230919a_p230904b
- 8.60 xq_uclai_small_s230825a_v3_5
- 8.53 uclai_small_s230905b_p230904b_flashatt
- 8.53 1
- 8.49 la_7b_30bt_ww
- 8.46 test
- 8.41 chat-stream-small-1_ww
- 8.41 uclai_small_s231214a_p231213a
- 8.40 stm-s-v2-3
- 8.28 stm-s-v2-5
- 8.22 stm-s-v2-4
- 8.22 py_medium_d231027a_s231014a
- 8.19 t5-zeroshot-5t3
- 8.19 la_7b_30b_sft_ww
- 8.16 ul-sm-v2-11
- 8.13 stm-l-v2-8
- 8.10 t5-zeroshot-5t2
- 8.07 la_7bm_30bt_sft_2bt_ww
- 8.06 la_7b_20t_ww
- 8.02 stm-s-v2-6
- 7.97 stm-s-v2-7
- 7.96 wj_u-s-2-11
- 7.88 stm-l-v2-4
- 7.83 tantan
- 7.82 pai-bert-tiny-xnli_zh-nli
- 7.82 pai-bert-tiny
- 7.67 wj_uc-s-p1-0-v1
- 7.62 stm-l-v2-5
- 7.40 eprstmt
- 7.32 uclai_small_s230914a_p230904b
- 7.29 uclai-chat-stream-small-v2-6-0905-FT
- 7.25 cccc
- 7.20 cluewscf
- 7.04 fly-20
- 7.02 uclai_small_l230920a_s230905b
- 6.95 ul-wj14
- 6.95 csl-214
- 6.92 stm-l-v2-7
- 6.82 gpt-3.5
- 6.81 hanhan
- 6.81 uclai_700m_v3_9_onlytext_sft
- 6.80 la_30b_1t_ww
- 6.72 bbbbbb
- 6.63 fly-75
- 6.63 mc
- 6.62 qwe
- 6.62 tantan1
- 6.57 hhh
- 6.57 cslf
- 6.51 gpt3.5
- 6.48 fly-47
- 6.46 csl-213
- 6.46 ul-wj13
- 6.46 ul-lg-v2-15-qianhai
- 6.41 uclai_700m_v3_9_polly_sft
- 6.39 la_7b_15bt_sft_4_5_ww
- 6.21 bbbbbb-c
- 6.16 uclai_small_l230921a_s230905b
- 6.04 ul-wj15
- 6.04 csl-215
- 6.04 ul-wj15-1
- 6.04 ul-wj15-2
- 6.03 gpt2_350M_ns231113a_np231111a
- 5.96 stream-small-v2-2_ww
- 5.91 uclai_small_l231102a_s230905b
- 5.76 xq_0822
- 5.76 uclai_chat_stream_large_s2_16_v5
- 5.75 xq_uclai_chat_stream_large_s2_16_v5_safety
- 5.61 hhhhh
- 5.33 cpm-test-1
- 5.33 cpm-test-2
- 5.04 chat-stream-small_ww
- 4.81 xq_uclai_tiny_v1_2
- 4.80 47-2task
- 4.80 llama2_13B_chat_hf
- 4.65 xq_uclai_chat-stream-tiny_v1_2
- 4.45 q1
- 4.31 xq_uclai_chat-stream-tiny_v1_1
- 4.18 llama2_7B_chat_hf
- 4.17 20-2task
- 4.08 xq_uclai_tiny_v1_1
- 3.81 ocnlif
- 3.49 xq_uclai_chat_stream_large_s2_16_v2_0717_2
- 3.21 llama_7B_hf_ww
- 2.93 la_7b_sft_4_1_ww
- 2.53 uclai_large_v1_7
- 2.53 ul_large_v1_7_0703
- 2.52 wj_u-l-2-16
- 2.29 gpt2-large-test
- 1.93 xq_uclai-chat-stream-small-p3-5-v1-2
- 0.01 test-ot5-tnews-20221017
- 1 CPM-Bee Submission 26012 78.2
- 2 Ctyun_Big_Model Submission 23753 76.2
- 3 PaddleNLP-UTC Submission 210742 70.5
- 4 二郎神-UnifiedMC Submission 15715 70.3
- 5 GPT-MoE Submission 15603 69.5
- 6 Randeng-T5-784M-MultiTask Submission 22479 69.2
- 7 Mengzi-T5-MT Submission 15602 68.9
- 8 asdf Submission 25263 67.7
- 9 assistant Submission 25829 65.9
- 10 XXXX-Test Submission 20636 63.8
- 11 二郎神-MRC Submission 10590 63.5
- 12 abtest03 Submission 22870 61.5
- 13 bumble-75 Submission 25432 61.5
- 14 4731 Submission 25817 61.2
- 15 XXXXRoberta Submission 20708 60.4
- 16 bumble-20 Submission 25431 60.1
- 17 t5_wu Submission 20481 60.0
- 18 UniCU Submission 20069 59.3
- 19 源1.0 Submission 7618 59.0
- 20 abtest01 Submission 22871 58.6
- 21 zero-t5 Submission 25122 58.0
- 22 jjtest01 Submission 22770 56.8
- 23 XT5 Submission 20851 56.6
- 24 t5-gp Submission 24601 55.9
- 25 T5-zeroshot-V2-0 Submission 24497 55.4
- 26 T5 Submission 17151 54.3
- 27 test_rf Submission 15237 54.1
- 28 needle Submission 20511 51.9
- 29 200 Submission 25949 51.1
- 30 needle9 Submission 21095 50.1
- 31 bumble-20w Submission 25430 50.0
- 32 OBERT-C-base.Zero-shot Submission 8277 49.9
- 33 needle10 Submission 21085 49.6
- 34 T5-ZeroShot-V2 Submission 24495 49.2
- 35 test_rt Submission 15232 48.9
- 36 gpt2 Submission 15444 48.3
- 37 test1122 Submission 15589 48.0
- 38 T5-test-4-zero-shot Submission 26104 47.5
- 39 RoBERTa_wwm.Zero-shot Submission 8124 ✓ 47.0
- 40 jjtest05 Submission 22764 46.9
- 41 bumble-47 Submission 25270 46.8
- 42 bert Submission 15440 45.5
- 43 BT5-test2 Submission 26382 45.5
- 44 ChatCPM Submission 25825 45.4
- 45 t5 Submission 15302 44.9
- 46 NEZHA-Gen.Zero-shot Submission 6033 ✓ 44.2
- 47 XXXXZC Submission 19776 44.0
- 48 Robbberta Submission 19778 43.9
- 49 BD-Test Submission 19052 42.9
- 50 cpm-bee Submission 25260 42.0
- 51 bb-75 Submission 25273 42.0
- 52 gpt Submission 15224 41.7
- 53 fi Submission 25990 40.4
- 54 jjtest04 Submission 22769 40.2
- 55 1600 Submission 25993 40.0
- 56 mmtest01 Submission 23107 39.8
- 57 jjtest02 Submission 22772 37.4
- 58 2888 Submission 25937 36.1
- 59 Baichuan2-7B-Chat Submission 26474 35.1
- 60 VILLM-0.5-tiny-11.8M Submission 26476 35.1
- 61 5211 Submission 25965 34.9
- 62 Z_BERT Submission 12804 34.8
- 63 MOSS Submission 26044 34.3
- 64 VILLM_0.3 Submission 26428 34.2
- 65 09 Submission 25770 33.7
- 66 qw Submission 25922 33.7
- 67 cadfs Submission 25959 33.7
- 68 jjtest03 Submission 22767 33.7
- 69 0510-11-1 Submission 25488 33.6
- 70 123 Submission 25773 33.5
- 71 yeee Submission 25985 33.5
- 72 ZeroCLUE.M Submission 18945 33.4
- 73 VILLM-0.10-320M Submission 26634 33.3
- 74 17 Submission 25927 33.3
- 75 18 Submission 25932 32.8
- 76 CC Submission 25956 32.8
- 77 ff Submission 25973 32.8
- 78 VILLM-0.3 Submission 26443 32.7
- 79 ma Submission 26018 32.7
- 80 metaseq.bloom.1b3 Submission 15300 32.7
- 81 ai Submission 25980 32.6
- 82 22 Submission 25970 32.5
- 83 220 Submission 26027 32.5
- 84 lm Submission 26031 32.5
- 85 521 Submission 25964 32.5
- 86 ck Submission 26002 32.4
- 87 VILLM_0.3_982M Submission 26459 32.3
- 88 ByBloom-1B6 Submission 26425 32.2
- 89 VILLM-0.3-327M Submission 26424 32.0
- 90 lll Submission 26034 32.0
- 91 ChatCPM1 Submission 25810 31.9
- 92 20 Submission 25953 31.9
- 93 ByBloom-303M Submission 26433 31.7
- 94 VILLM-0.9-50M Submission 26506 31.7
- 95 75-41 Submission 25755 31.5
- 96 ByBloom-303M-R2 Submission 26456 31.4
- 97 NN-MAC3 Submission 12794 31.3
- 98 12421 Submission 25264 31.2
- 99 耳畔 Submission 25818 30.9
- 100 ChatGLM-6B Submission 26053 30.9
- 101 B-1 Submission 25691 30.8
- 102 VILLM_0.3_0914 Submission 26453 30.6
- 103 请问 Submission 25821 30.4
- 104 VILLM-0.4 Submission 26463 30.2
- 105 Chinese-RoBERTa-wwm-ext-large Submission 18914 30.2
- 106 Test47 Submission 25485 30.1
- 107 metaseq.opt.6B Submission 15221 29.8
- 108 yaaaa Submission 25986 29.6
- 109 前文 Submission 25822 29.1
- 110 啊是 Submission 25827 29.1
- 111 177 Submission 25928 29.1
- 112 we Submission 25923 29.0
- 113 188 Submission 25933 29.0
- 114 casdf Submission 25960 29.0
- 115 sadf Submission 25957 29.0
- 116 fiiii Submission 25991 29.0
- 117 ByBloom-303M-R3 Submission 26434 28.9
- 118 Supervised pre-trainning Submission 8430 28.9
- 119 1233 Submission 25774 28.8
- 120 2001 Submission 25950 28.7
- 121 二炮 Submission 25819 28.6
- 122 cpmb Submission 26055 28.6
- 123 mammam Submission 26019 28.5
- 124 220000 Submission 26028 28.5
- 125 mll Submission 26032 28.5
- 126 mmmm Submission 26035 28.4
- 127 aiiii Submission 25981 28.4
- 128 fff Submission 25974 28.4
- 129 222 Submission 25971 28.2
- 130 75-42 Submission 25756 27.9
- 131 chhhhh Submission 26004 27.5
- 132 Model.Zero-shot Submission 5525 27.1
- 133 bb-47 Submission 25272 26.7
- 134 BertForCLS Submission 6092 26.3
- 135 needle4 Submission 20674 24.4
- 136 BD-Chinese-Roberta-Large Submission 19044 24.3
- 137 needle2 Submission 20637 23.6
- 138 needle5 Submission 20676 22.7
- 139 091 Submission 25771 22.0
- 140 1666 Submission 25994 21.1
- 141 tantan4 Submission 15378 19.6
- 142 hhhh Submission 15158 18.8
- 143 just_test Submission 14899 18.5
- 144 ckkk Submission 26003 18.3
- 145 just_test2 Submission 14901 18.3
- 146 A9 Submission 25772 18.2
- 147 S-Bert Submission 6139 17.8
- 148 nene Submission 14904 17.7
- 149 12322 Submission 25775 17.5
- 150 1777 Submission 25929 17.5
- 151 aaaaay Submission 25987 17.5
- 152 18888 Submission 25934 17.4
- 153 dsfccc Submission 25958 17.4
- 154 needle3 Submission 20657 17.3
- 155 canser Submission 26036 17.2
- 156 er Submission 25924 17.2
- 157 dsfsdf Submission 25961 17.2
- 158 0002222 Submission 26029 17.2
- 159 lmlmlm Submission 26033 17.2
- 160 nannan Submission 14903 17.1
- 161 baa Submission 25982 17.1
- 162 fuuu Submission 25975 17.1
- 163 15656 Submission 25995 17.1
- 164 mmtest02 Submission 23108 17.0
- 165 2222 Submission 25972 16.9
- 166 201 Submission 25955 16.8
- 167 S-Bert-V2 Submission 6145 16.4
- 168 1055 Submission 25694 15.6
- 169 pre-trainning Submission 8429 15.6
- 170 as Submission 25828 15.3
- 171 前往 Submission 25823 15.3
- 172 CSL Submission 25705 14.8
- 173 恩平 Submission 25820 14.7
- 174 0510-11-2 Submission 25489 11.7
- 175 tantan3 Submission 15373 11.5
- 176 uclai_xlarge_p231003a Submission 26485 11.4
- 177 uclai_xlarge_p231007a Submission 26486 11.4
- 178 uclai_medium_p230917b Submission 26471 11.3
- 179 uclai_medium_p230917a Submission 26470 11.3
- 180 0508aa Submission 25707 11.3
- 181 xq_uclai_small_p230901b Submission 26404 11.3
- 182 uclai_small_p230827b Submission 26385 11.2
- 183 uclai_medium_p230913b Submission 26450 11.2
- 184 ul-sm-v1-7 Submission 26022 11.2
- 185 xq_uclai_large_v3_3 Submission 26178 11.2
- 186 zeroclue_ll Submission 7849 11.1
- 187 ul_small_v3_5 Submission 26169 11.1
- 188 small_p1_0_v1 Submission 26270 11.1
- 189 small_p3_5_v3 Submission 26268 11.1
- 190 uclai_small_p230829b Submission 26396 11.1
- 191 zy-zeroclue Submission 13090 11.1
- 192 ul_large_v1_4_w Submission 26038 11.1
- 193 uclai_small_p230814a Submission 26341 11.1
- 194 ul-sm-v2-9 Submission 25984 11.1
- 195 ul-vs5 Submission 25977 11.1
- 196 uclai-231012 Submission 26487 11.1
- 197 xq_uclai_small_p230901a Submission 26403 11.1
- 198 0510-11-3 Submission 25490 11.1
- 199 B-2 Submission 25692 11.0
- 200 uclai_medium_p230913a Submission 26449 11.0
- 201 ul_large_v1_4_12 Submission 26096 11.0
- 202 uclai_small_p230827a Submission 26384 11.0
- 203 uclai_small_p230910b Submission 26426 11.0
- 204 uclai_small_s230821a_p3_5_1 Submission 26356 11.0
- 205 uclai_small_v3_8 Submission 26333 11.0
- 206 xq_uclai_small_s230817a_p3_5_flatatt Submission 26352 11.0
- 207 xq_0823_1 Submission 26362 11.0
- 208 uclai_large_v1_14 Submission 26110 11.0
- 209 xq_uclai_small_s230817a_p3_5 Submission 26353 11.0
- 210 xq_uclai_small_s230818a_p3_5 Submission 26348 11.0
- 211 xq_uclai_small_s230818a_p3_5_flatatt Submission 26351 11.0
- 212 s230814a_p230814a Submission 26344 11.0
- 213 uclai-chat-stream-small-p3-6-v1 Submission 26170 10.9
- 214 xq_uclai_large_v3_2 Submission 26156 10.9
- 215 uclai_small_p230814b Submission 26343 10.9
- 216 uclai_small_p230829a Submission 26395 10.9
- 217 uclai_small_p230823a Submission 26367 10.9
- 218 uclai_small_p230910a Submission 26420 10.8
- 219 uclai_small_p230904b Submission 26411 10.8
- 220 xq_uclai_small_v3_5 Submission 26158 10.8
- 221 xq_uclai_chat_stream_large_p3_3_v1 Submission 26216 10.8
- 222 xq_uclai_chat_stream_large_s2_16_v2 Submission 26215 10.8
- 223 xq_uclai_small_v3_3 Submission 26146 10.7
- 224 xq_uclai_small_v3_4 Submission 26157 10.7
- 225 uclai_small_v1_11 Submission 26081 10.7
- 226 ul-sm-v1-6 Submission 26008 10.7
- 227 Test Submission 25479 10.7
- 228 test56 Submission 25486 10.7
- 229 test_chid Submission 14898 10.7
- 230 uclai_small_p230822a Submission 26366 10.6
- 231 uclai-chat-stream-small-p3-5-v1 Submission 26166 10.6
- 232 uclai_small_p230904a Submission 26410 10.6
- 233 uclai_large_v3_1_0703 Submission 26135 10.6
- 234 uclai_small_v1_10 Submission 26047 10.6
- 235 uclai_small_v1_13 Submission 26083 10.6
- 236 ul_large_v1_10 Submission 26085 10.5
- 237 uclai_small_v3_2 Submission 26132 10.5
- 238 pardon Submission 26006 10.5
- 239 pai-ckbert-base-xnli_zh-nli Submission 26724 10.5
- 240 xq_0825_uclai-chat-stream-small-p3-5-v1-3 Submission 26370 10.4
- 241 uclai_chat_stream_xlarge_p3_1_v1 Submission 26269 10.4
- 242 textcnn-shopping Submission 26767 10.4
- 243 pai-bert-base-xnli_zh-nli Submission 26725 10.3
- 244 pai-ckbert-large-nli Submission 26761 10.3
- 245 wj_ul-s-p3-5-v3 Submission 26274 10.2
- 246 opt_6bm_60bt_ww Submission 23870 10.1
- 247 opt_6bm_50bt_ww Submission 23869 10.1
- 248 zero-bustm Submission 25120 10.0
- 249 xq_uclai_1B_p230825b Submission 26374 10.0
- 250 uclai_1B_p230825b Submission 26390 10.0
- 251 py_xlarge_s231110a_p231107a Submission 26518 9.99
- 252 uclai_small_v3_1 Submission 26126 9.93
- 253 uclai_xlarge_s231127a_s231016a Submission 26536 9.93
- 254 uclai_xlarge_s231009a_p231007a Submission 26493 9.91
- 255 nalll Submission 25992 9.90
- 256 opt_6bm_40bt_ww Submission 23342 9.89
- 257 xq_uclai_1B_p230825a Submission 26373 9.89
- 258 uclai_1B_p230825a Submission 26383 9.89
- 259 opt_6B_60T_3_2_1k_ww Submission 24185 9.88
- 260 xq_uclai_small_s230902b_p230901b Submission 26406 9.87
- 261 ocnli Submission 26021 9.85
- 262 uclai_medium_s231120a_p231013a Submission 26534 9.84
- 263 sft_20230327_ww Submission 24512 9.82
- 264 ul-v16 Submission 25414 9.81
- 265 xq_uclai_small_s230902a_p230827b Submission 26405 9.80
- 266 uclai_700m_p230821a Submission 26358 9.77
- 267 xq_uclai_small_s230902c_p230829b Submission 26407 9.77
- 268 ul-v17 Submission 25481 9.74
- 269 ul_large_v1_7_0703_2 Submission 26136 9.74
- 270 ul-l-v1-7 Submission 26141 9.74
- 271 ul-l-v1-7-new Submission 26149 9.74
- 272 u-wj8 Submission 25939 9.73
- 273 uclai_xlarge_s231016a_p231007a Submission 26491 9.72
- 274 pul-v15 Submission 25312 9.70
- 275 520 Submission 25966 9.70
- 276 ul-sm-v2-10 Submission 26009 9.69
- 277 uclai_small_s230906a_p3_5 Submission 26469 9.67
- 278 bustm Submission 25484 9.66
- 279 py_xlarge_s231016a_p231007a-2 Submission 26522 9.66
- 280 py_xlarge_s231016a_p231007a-sys Submission 26521 9.66
- 281 py_xlarge_s231016a_p231007a-sys2 Submission 26520 9.66
- 282 uclai_xlarge_s231016a_p231007a-3 Submission 26535 9.66
- 283 zeroclue_llll Submission 7582 9.65
- 284 uclai_xlarge_s230907a_v3_2 Submission 26419 9.65
- 285 uuuu Submission 26509 9.64
- 286 uclai_small_s230822a_p3_5 Submission 26361 9.63
- 287 uc_large_v1_3_ww Submission 24685 9.63
- 288 xq_uclai_700m_p230816c Submission 26349 9.61
- 289 xq_uclai_700m_p230818a Submission 26350 9.59
- 290 py_xlarge_d231108a_s231016a Submission 26519 9.59
- 291 uclai_small_s230817a_p3_5_flashatt Submission 26393 9.59
- 292 uclai-chat-stream-small_p3_5_v2 Submission 26272 9.56
- 293 xa_uclai_small_s230831a_p3_5 Submission 26402 9.51
- 294 xq_uclai_small_s230902d_p230823a Submission 26408 9.51
- 295 uclai_small_s230818a_p3_5_flashatt Submission 26394 9.50
- 296 ≈ Submission 26400 9.49
- 297 xq_uclai_xlarge_s230830a Submission 26399 9.49
- 298 t5-zeroshot-5t Submission 24522 9.48
- 299 xq_uclai_small_s230823c_v3_5 Submission 26372 9.47
- 300 xq_uclai-chat-stream-small-p3-5-v1-2_0825 Submission 26369 9.47
- 301 uclai_1B_s231218f_p231208a Submission 26595 9.47
- 302 uclai_medium_s231014a_p231013a Submission 26490 9.47
- 303 uclai_small_s230823b_v3_5 Submission 26364 9.46
- 304 uclai_small_s230905c_p230904b Submission 26422 9.46
- 305 small_s231114b_p231113a Submission 26517 9.46
- 306 uclai_small_s230823d_v3_5 Submission 26365 9.44
- 307 uclai_700m_v3_9 Submission 26331 9.43
- 308 lake_large_20bt_ww Submission 24618 9.41
- 309 xq_uclai_small_s230901a_p3_5 Submission 26401 9.41
- 310 py_medium_s231026a_p230917c Submission 26527 9.39
- 311 uclai_medium_s230914a_p230913c Submission 26451 9.39
- 312 uclai_large_s230915a_s2_16 Submission 26464 9.38
- 313 stm-l-v2-3 Submission 24729 9.38
- 314 uclai_1B_s231208a_p231208a Submission 26549 9.38
- 315 py_medium_d231030a_s231014a Submission 26525 9.36
- 316 small_s231114a_p231113a Submission 26516 9.36
- 317 t5-zeroshot-5t1 Submission 24523 9.35
- 318 csl-212 Submission 25468 9.34
- 319 ul-wj12 Submission 25926 9.34
- 320 tt Submission 15304 9.34
- 321 uclai_small_s230905a_p230904b Submission 26412 9.31
- 322 uclai_chat_stream_700m_p3_9_v1 Submission 26334 9.31
- 323 py_small_s231029a_p230910c Submission 26526 9.29
- 324 csl-211 Submission 25265 9.22
- 325 lake_large_15bt_ww Submission 24593 9.21
- 326 py_small_s231030a_p230910c Submission 26524 9.17
- 327 uclai_small_d20230828b Submission 26387 9.13
- 328 uclai_small_s231007a_p230910c Submission 26484 9.12
- 329 medium_s230918b_p230917c Submission 26465 9.11
- 330 uclai_small_s231012a_p230910c Submission 26489 9.11
- 331 uclai_small_l230914a_s230905b Submission 26446 9.10
- 332 uclai_small_d20230828a Submission 26386 9.07
- 333 uclai_700m_v3_8 Submission 26332 9.02
- 334 py_medium_s230918b_p230917c-2 Submission 26523 9.01
- 335 uclai_medium_s230914b_p230913c Submission 26448 9.00
- 336 uclai_small_s230915a_p230910c Submission 26455 8.96
- 337 uclai_small_s231005a_p230910c Submission 26483 8.94
- 338 uclai_small_s231013a_p230910c Submission 26492 8.94
- 339 uclai_small_s20231129_p230910c Submission 26567 8.94
- 340 uclai_small_d20230824a Submission 26375 8.93
- 341 uclai_small_s230911a_p3_5 Submission 26429 8.91
- 342 uclai_small_s230920c_p230904b Submission 26475 8.91
- 343 uclai_large_s230814_s2_16_v5 Submission 26392 8.91
- 344 lake_small_70bt_ww Submission 24598 8.89
- 345 uclai-small-v1_0 Submission 26127 8.89
- 346 stm-large-v2-1_ww Submission 24693 8.88
- 347 lake_small_60bt_ww Submission 24597 8.87
- 348 lake_small_50bt_ww Submission 24589 8.84
- 349 la_30b_10bt_ww Submission 24570 8.84
- 350 uclai_small_s230922a_p230904c Submission 26480 8.79
- 351 la_7b_40bt_ww Submission 24587 8.78
- 352 uclai_small_s230828a_p3_5 Submission 26388 8.75
- 353 s230814b_p230814b_1 Submission 26345 8.72
- 354 uclai_large_s231207a_p231202a Submission 26550 8.70
- 355 uclai_small_s230917a_p230904b Submission 26467 8.68
- 356 uclai_small_s230925a_p230904c Submission 26479 8.68
- 357 uclai_small_s230912b_p3_5 Submission 26441 8.67
- 358 zyc_test Submission 24510 8.66
- 359 stm-l-v2-10 Submission 25083 8.63
- 360 small_s230919a_p230904b Submission 26472 8.63
- 361 xq_uclai_small_s230825a_v3_5 Submission 26371 8.60
- 362 uclai_small_s230905b_p230904b_flashatt Submission 26414 8.53
- 363 1 Submission 15404 8.53
- 364 la_7b_30bt_ww Submission 24565 8.49
- 365 test Submission 14528 8.46
- 366 chat-stream-small-1_ww Submission 24673 8.41
- 367 uclai_small_s231214a_p231213a Submission 26568 8.41
- 368 stm-s-v2-3 Submission 24727 8.40
- 369 stm-s-v2-5 Submission 24731 8.28
- 370 stm-s-v2-4 Submission 24730 8.22
- 371 py_medium_d231027a_s231014a Submission 26528 8.22
- 372 t5-zeroshot-5t3 Submission 24525 8.19
- 373 la_7b_30b_sft_ww Submission 24574 8.19
- 374 ul-sm-v2-11 Submission 26025 8.16
- 375 stm-l-v2-8 Submission 24984 8.13
- 376 t5-zeroshot-5t2 Submission 24524 8.10
- 377 la_7bm_30bt_sft_2bt_ww Submission 24575 8.07
- 378 la_7b_20t_ww Submission 24493 8.06
- 379 stm-s-v2-6 Submission 24781 8.02
- 380 stm-s-v2-7 Submission 24985 7.97
- 381 wj_u-s-2-11 Submission 26198 7.96
- 382 stm-l-v2-4 Submission 24735 7.88
- 383 tantan Submission 14881 7.83
- 384 pai-bert-tiny-xnli_zh-nli Submission 26726 7.82
- 385 pai-bert-tiny Submission 26762 7.82
- 386 wj_uc-s-p1-0-v1 Submission 26273 7.67
- 387 stm-l-v2-5 Submission 24782 7.62
- 388 eprstmt Submission 26075 7.40
- 389 uclai_small_s230914a_p230904b Submission 26466 7.32
- 390 uclai-chat-stream-small-v2-6-0905-FT Submission 26413 7.29
- 391 cccc Submission 26020 7.25
- 392 cluewscf Submission 26073 7.20
- 393 fly-20 Submission 25813 7.04
- 394 uclai_small_l230920a_s230905b Submission 26481 7.02
- 395 ul-wj14 Submission 25919 6.95
- 396 csl-214 Submission 25921 6.95
- 397 stm-l-v2-7 Submission 24983 6.92
- 398 gpt-3.5 Submission 26763 6.82
- 399 hanhan Submission 14886 6.81
- 400 uclai_700m_v3_9_onlytext_sft Submission 26473 6.81
- 401 la_30b_1t_ww Submission 24501 6.80
- 402 bbbbbb Submission 26065 6.72
- 403 fly-75 Submission 25815 6.63
- 404 mc Submission 26533 6.63
- 405 qwe Submission 15106 6.62
- 406 tantan1 Submission 15179 6.62
- 407 hhh Submission 14889 6.57
- 408 cslf Submission 26074 6.57
- 409 gpt3.5 Submission 26764 6.51
- 410 fly-47 Submission 25814 6.48
- 411 csl-213 Submission 25918 6.46
- 412 ul-wj13 Submission 25917 6.46
- 413 ul-lg-v2-15-qianhai Submission 26010 6.46
- 414 uclai_700m_v3_9_polly_sft Submission 26442 6.41
- 415 la_7b_15bt_sft_4_5_ww Submission 24566 6.39
- 416 bbbbbb-c Submission 26069 6.21
- 417 uclai_small_l230921a_s230905b Submission 26482 6.16
- 418 ul-wj15 Submission 25920 6.04
- 419 csl-215 Submission 25935 6.04
- 420 ul-wj15-1 Submission 25938 6.04
- 421 ul-wj15-2 Submission 25962 6.04
- 422 gpt2_350M_ns231113a_np231111a Submission 26530 6.03
- 423 stream-small-v2-2_ww Submission 24679 5.96
- 424 uclai_small_l231102a_s230905b Submission 26529 5.91
- 425 xq_0822 Submission 26357 5.76
- 426 uclai_chat_stream_large_s2_16_v5 Submission 26494 5.76
- 427 xq_uclai_chat_stream_large_s2_16_v5_safety Submission 26355 5.75
- 428 hhhhh Submission 15197 5.61
- 429 cpm-test-1 Submission 26173 5.33
- 430 cpm-test-2 Submission 26172 5.33
- 431 chat-stream-small_ww Submission 24637 5.04
- 432 xq_uclai_tiny_v1_2 Submission 26125 4.81
- 433 47-2task Submission 25754 4.80
- 434 llama2_13B_chat_hf Submission 26397 4.80
- 435 xq_uclai_chat-stream-tiny_v1_2 Submission 26138 4.65
- 436 q1 Submission 14530 4.45
- 437 xq_uclai_chat-stream-tiny_v1_1 Submission 26139 4.31
- 438 llama2_7B_chat_hf Submission 26391 4.18
- 439 20-2task Submission 25753 4.17
- 440 xq_uclai_tiny_v1_1 Submission 26124 4.08
- 441 ocnlif Submission 26076 3.81
- 442 xq_uclai_chat_stream_large_s2_16_v2_0717_2 Submission 26186 3.49
- 443 llama_7B_hf_ww Submission 24492 3.21
- 444 la_7b_sft_4_1_ww Submission 24511 2.93
- 445 uclai_large_v1_7 Submission 26131 2.53
- 446 ul_large_v1_7_0703 Submission 26134 2.53
- 447 wj_u-l-2-16 Submission 26200 2.52
- 448 gpt2-large-test Submission 26457 2.29
- 449 xq_uclai-chat-stream-small-p3-5-v1-2 Submission 26368 1.93
- 450 test-ot5-tnews-20221017 Submission 17200 0.01
Source: Official ZeroCLUE leaderboard
Source: Official ZeroCLUE leaderboard
| # | Entry | Score | Setting | Submitted by | Released | Run on | Link | Source |
|---|---|---|---|---|---|---|---|---|
| 1 | CPM-Bee | 78.2 | Submission 26012 | OpenBMB&面壁智能 | May 2023 | github.com | Official leaderboard | |
| 2 | Ctyun_Big_Model | 76.2 | Submission 23753 | 天翼云AI | Feb 2023 | github.com | Official leaderboard | |
| 3 | PaddleNLP-UTC | 70.5 | Submission 210742 | 飞桨PaddleNLP | Jan 2023 | Official leaderboard | ||
| 4 | 二郎神-UnifiedMC | 70.3 | Submission 15715 | IDEA研究院 | Aug 2022 | github.com | Official leaderboard | |
| 5 | GPT-MoE | 69.5 | Submission 15603 | 阿里云机器学习平台PAI | Aug 2022 | github.com | Official leaderboard | |
| 6 | Randeng-T5-784M-MultiTask | 69.2 | Submission 22479 | IDEA研究院 | Dec 2022 | github.com | Official leaderboard | |
| 7 | Mengzi-T5-MT | 68.9 | Submission 15602 | 澜舟科技 | Aug 2022 | github.com | Official leaderboard | |
| 8 | asdf | 67.7 | Submission 25263 | 11 | Apr 2023 | Official leaderboard | ||
| 9 | assistant | 65.9 | Submission 25829 | zz | May 2023 | live.openbmb.org | Official leaderboard | |
| 10 | XXXX-Test | 63.8 | Submission 20636 | XXXX-Test | Nov 2022 | Official leaderboard | ||
| 11 | 二郎神-MRC | 63.5 | Submission 10590 | IDEA研究院 | Jan 2022 | github.com | Official leaderboard | |
| 12 | abtest03 | 61.5 | Submission 22870 | abtest03 | Dec 2022 | Official leaderboard | ||
| 13 | bumble-75 | 61.5 | Submission 25432 | lpnhtu | May 2023 | github.com | Official leaderboard | |
| 14 | 4731 | 61.2 | Submission 25817 | 4731 | May 2023 | live.openbmb.org | Official leaderboard | |
| 15 | XXXXRoberta | 60.4 | Submission 20708 | XXXXRoberta | Nov 2022 | Official leaderboard | ||
| 16 | bumble-20 | 60.1 | Submission 25431 | plnuht | May 2023 | github.com | Official leaderboard | |
| 17 | t5_wu | 60.0 | Submission 20481 | t5_wu | Nov 2022 | github.com | Official leaderboard | |
| 18 | UniCU | 59.3 | Submission 20069 | UniCU | Nov 2022 | Official leaderboard | ||
| 19 | 源1.0 | 59.0 | Submission 7618 | 浪潮人工智能研究院 | Sep 2021 | github.com | Official leaderboard | |
| 20 | abtest01 | 58.6 | Submission 22871 | abtest01 | Dec 2022 | Official leaderboard | ||
| 21 | zero-t5 | 58.0 | Submission 25122 | just_try | Apr 2023 | github.com | Official leaderboard | |
| 22 | jjtest01 | 56.8 | Submission 22770 | jjtest01 | Dec 2022 | Official leaderboard | ||
| 23 | XT5 | 56.6 | Submission 20851 | XT5 | Nov 2022 | Official leaderboard | ||
| 24 | t5-gp | 55.9 | Submission 24601 | yimiao | Apr 2023 | github.com | Official leaderboard | |
| 25 | T5-zeroshot-V2-0 | 55.4 | Submission 24497 | test | Mar 2023 | github.com | Official leaderboard | |
| 26 | T5 | 54.3 | Submission 17151 | T5 | Oct 2022 | Official leaderboard | ||
| 27 | test_rf | 54.1 | Submission 15237 | test_rf | Jul 2022 | github.com | Official leaderboard | |
| 28 | needle | 51.9 | Submission 20511 | needle | Nov 2022 | github.com | Official leaderboard | |
| 29 | 200 | 51.1 | Submission 25949 | 20018 | May 2023 | github.com | Official leaderboard | |
| 30 | needle9 | 50.1 | Submission 21095 | needle9 | Nov 2022 | arxiv.org | Official leaderboard | |
| 31 | bumble-20w | 50.0 | Submission 25430 | sodier58 | May 2023 | github.com | Official leaderboard | |
| 32 | OBERT-C-base.Zero-shot | 49.9 | Submission 8277 | OPPO小布助手 | Oct 2021 | github.com | Official leaderboard | |
| 33 | needle10 | 49.6 | Submission 21085 | needle10 | Nov 2022 | arxiv.org | Official leaderboard | |
| 34 | T5-ZeroShot-V2 | 49.2 | Submission 24495 | test | Mar 2023 | github.com | Official leaderboard | |
| 35 | test_rt | 48.9 | Submission 15232 | test_rt | Jul 2022 | github.com | Official leaderboard | |
| 36 | gpt2 | 48.3 | Submission 15444 | 水果 | Aug 2022 | github.com | Official leaderboard | |
| 37 | test1122 | 48.0 | Submission 15589 | test1122 | Aug 2022 | github.com | Official leaderboard | |
| 38 | T5-test-4-zero-shot | 47.5 | Submission 26104 | try | Jun 2023 | github.com | Official leaderboard | |
| 39 | RoBERTa_wwm.Zero-shot ✓ | 47.0 | Submission 8124 | CLUE | Jun 2021 | github.com | Official leaderboard | |
| 40 | jjtest05 | 46.9 | Submission 22764 | jjtest05 | Dec 2022 | Official leaderboard | ||
| 41 | bumble-47 | 46.8 | Submission 25270 | plnhut | Apr 2023 | github.com | Official leaderboard | |
| 42 | bert | 45.5 | Submission 15440 | perrier | Aug 2022 | github.com | Official leaderboard | |
| 43 | BT5-test2 | 45.5 | Submission 26382 | sdgrtd | Aug 2023 | Official leaderboard | ||
| 44 | ChatCPM | 45.4 | Submission 25825 | zz | May 2023 | live.openbmb.org | Official leaderboard | |
| 45 | t5 | 44.9 | Submission 15302 | 红豆 | Aug 2022 | Official leaderboard | ||
| 46 | NEZHA-Gen.Zero-shot ✓ | 44.2 | Submission 6033 | CLUE | Jun 2021 | github.com | Official leaderboard | |
| 47 | XXXXZC | 44.0 | Submission 19776 | XXXXZC | Nov 2022 | Official leaderboard | ||
| 48 | Robbberta | 43.9 | Submission 19778 | Robbberta | Nov 2022 | Official leaderboard | ||
| 49 | BD-Test | 42.9 | Submission 19052 | BD-Test | Oct 2022 | Official leaderboard | ||
| 50 | cpm-bee | 42.0 | Submission 25260 | Modelbest | Apr 2023 | github.com | Official leaderboard | |
| 51 | bb-75 | 42.0 | Submission 25273 | sodier77 | Apr 2023 | github.com | Official leaderboard | |
| 52 | gpt | 41.7 | Submission 15224 | perrier | Jul 2022 | github.com | Official leaderboard | |
| 53 | fi | 40.4 | Submission 25990 | nal | May 2023 | github.com | Official leaderboard | |
| 54 | jjtest04 | 40.2 | Submission 22769 | jjtest04 | Dec 2022 | Official leaderboard | ||
| 55 | 1600 | 40.0 | Submission 25993 | succcccc | May 2023 | github.com | Official leaderboard | |
| 56 | mmtest01 | 39.8 | Submission 23107 | mmtest01 | Dec 2022 | Official leaderboard | ||
| 57 | jjtest02 | 37.4 | Submission 22772 | jjtest02 | Dec 2022 | Official leaderboard | ||
| 58 | 2888 | 36.1 | Submission 25937 | 123123 | May 2023 | github.com | Official leaderboard | |
| 59 | Baichuan2-7B-Chat | 35.1 | Submission 26474 | Tibok | Sep 2023 | huggingface.co | Official leaderboard | |
| 60 | VILLM-0.5-tiny-11.8M | 35.1 | Submission 26476 | Tibok | Sep 2023 | huggingface.co | Official leaderboard | |
| 61 | 5211 | 34.9 | Submission 25965 | dog | May 2023 | github.com | Official leaderboard | |
| 62 | Z_BERT | 34.8 | Submission 12804 | zzttll | Apr 2022 | github.com | Official leaderboard | |
| 63 | MOSS | 34.3 | Submission 26044 | GDL | Jun 2023 | github.com | Official leaderboard | |
| 64 | VILLM_0.3 | 34.2 | Submission 26428 | Tibok | Sep 2023 | huggingface.co | Official leaderboard | |
| 65 | 09 | 33.7 | Submission 25770 | TTT | May 2023 | github.com | Official leaderboard | |
| 66 | qw | 33.7 | Submission 25922 | qw | May 2023 | github.com | Official leaderboard | |
| 67 | cadfs | 33.7 | Submission 25959 | aaaadd | May 2023 | github.com | Official leaderboard | |
| 68 | jjtest03 | 33.7 | Submission 22767 | jjtest03 | Dec 2022 | Official leaderboard | ||
| 69 | 0510-11-1 | 33.6 | Submission 25488 | 0510-11 | May 2023 | github.com | Official leaderboard | |
| 70 | 123 | 33.5 | Submission 25773 | 123 | May 2023 | github.com | Official leaderboard | |
| 71 | yeee | 33.5 | Submission 25985 | uuuu | May 2023 | github.com | Official leaderboard | |
| 72 | ZeroCLUE.M | 33.4 | Submission 18945 | ZeroCLUE.M | Oct 2022 | github.com | Official leaderboard | |
| 73 | VILLM-0.10-320M | 33.3 | Submission 26634 | Tibok | Jan 2024 | huggingface.co | Official leaderboard | |
| 74 | 17 | 33.3 | Submission 25927 | 1111 | May 2023 | github.com | Official leaderboard | |
| 75 | 18 | 32.8 | Submission 25932 | 188 | May 2023 | github.com | Official leaderboard | |
| 76 | CC | 32.8 | Submission 25956 | 差差差 | May 2023 | github.com | Official leaderboard | |
| 77 | ff | 32.8 | Submission 25973 | fu | May 2023 | github.com | Official leaderboard | |
| 78 | VILLM-0.3 | 32.7 | Submission 26443 | Tibok | Sep 2023 | huggingface.co | Official leaderboard | |
| 79 | ma | 32.7 | Submission 26018 | maaa | May 2023 | github.com | Official leaderboard | |
| 80 | metaseq.bloom.1b3 | 32.7 | Submission 15300 | optfree | Aug 2022 | huggingface.co | Official leaderboard | |
| 81 | ai | 32.6 | Submission 25980 | aiii | May 2023 | github.com | Official leaderboard | |
| 82 | 22 | 32.5 | Submission 25970 | 233 | May 2023 | github.com | Official leaderboard | |
| 83 | 220 | 32.5 | Submission 26027 | aggg | May 2023 | github.com | Official leaderboard | |
| 84 | lm | 32.5 | Submission 26031 | lmmmmmmm | May 2023 | github.com | Official leaderboard | |
| 85 | 521 | 32.5 | Submission 25964 | dog | May 2023 | github.com | Official leaderboard | |
| 86 | ck | 32.4 | Submission 26002 | hhhhhh | May 2023 | github.com | Official leaderboard | |
| 87 | VILLM_0.3_982M | 32.3 | Submission 26459 | Tibok | Sep 2023 | huggingface.co | Official leaderboard | |
| 88 | ByBloom-1B6 | 32.2 | Submission 26425 | Tibok | Sep 2023 | huggingface.co | Official leaderboard | |
| 89 | VILLM-0.3-327M | 32.0 | Submission 26424 | Tibok | Sep 2023 | huggingface.co | Official leaderboard | |
| 90 | lll | 32.0 | Submission 26034 | mmmmm | May 2023 | github.com | Official leaderboard | |
| 91 | ChatCPM1 | 31.9 | Submission 25810 | zz | May 2023 | live.openbmb.org | Official leaderboard | |
| 92 | 20 | 31.9 | Submission 25953 | fsdf | May 2023 | github.com | Official leaderboard | |
| 93 | ByBloom-303M | 31.7 | Submission 26433 | Tibok | Sep 2023 | huggingface.co | Official leaderboard | |
| 94 | VILLM-0.9-50M | 31.7 | Submission 26506 | Tibok | Oct 2023 | huggingface.co | Official leaderboard | |
| 95 | 75-41 | 31.5 | Submission 25755 | sodier511 | May 2023 | github.com | Official leaderboard | |
| 96 | ByBloom-303M-R2 | 31.4 | Submission 26456 | Tibok | Sep 2023 | huggingface.co | Official leaderboard | |
| 97 | NN-MAC3 | 31.3 | Submission 12794 | 开心一点 | Apr 2022 | github.com | Official leaderboard | |
| 98 | 12421 | 31.2 | Submission 25264 | 11 | Apr 2023 | Official leaderboard | ||
| 99 | 耳畔 | 30.9 | Submission 25818 | 耳畔 | May 2023 | github.com | Official leaderboard | |
| 100 | ChatGLM-6B | 30.9 | Submission 26053 | CCC | Mar 2023 | Jun 2023 | github.com | Official leaderboard |
| 101 | B-1 | 30.8 | Submission 25691 | B | May 2023 | github.com | Official leaderboard | |
| 102 | VILLM_0.3_0914 | 30.6 | Submission 26453 | Tibok | Sep 2023 | huggingface.co | Official leaderboard | |
| 103 | 请问 | 30.4 | Submission 25821 | 请问 | May 2023 | github.com | Official leaderboard | |
| 104 | VILLM-0.4 | 30.2 | Submission 26463 | Tibok | Sep 2023 | huggingface.co | Official leaderboard | |
| 105 | Chinese-RoBERTa-wwm-ext-large | 30.2 | Submission 18914 | XXXXZC | Oct 2022 | github.com | Official leaderboard | |
| 106 | Test47 | 30.1 | Submission 25485 | test47 | May 2023 | github.com | Official leaderboard | |
| 107 | metaseq.opt.6B | 29.8 | Submission 15221 | optfree | Jul 2022 | github.com | Official leaderboard | |
| 108 | yaaaa | 29.6 | Submission 25986 | uuuuu | May 2023 | github.com | Official leaderboard | |
| 109 | 前文 | 29.1 | Submission 25822 | 前文 | May 2023 | github.com | Official leaderboard | |
| 110 | 啊是 | 29.1 | Submission 25827 | 啊是 | May 2023 | github.com | Official leaderboard | |
| 111 | 177 | 29.1 | Submission 25928 | 1111 | May 2023 | github.com | Official leaderboard | |
| 112 | we | 29.0 | Submission 25923 | we | May 2023 | github.com | Official leaderboard | |
| 113 | 188 | 29.0 | Submission 25933 | 123123 | May 2023 | github.com | Official leaderboard | |
| 114 | casdf | 29.0 | Submission 25960 | ccccccaaa | May 2023 | github.com | Official leaderboard | |
| 115 | sadf | 29.0 | Submission 25957 | sdaf | May 2023 | github.com | Official leaderboard | |
| 116 | fiiii | 29.0 | Submission 25991 | nalll | May 2023 | github.com | Official leaderboard | |
| 117 | ByBloom-303M-R3 | 28.9 | Submission 26434 | Tibok | Sep 2023 | huggingface.co | Official leaderboard | |
| 118 | Supervised pre-trainning | 28.9 | Submission 8430 | Zero-Shot | Oct 2021 | github.com | Official leaderboard | |
| 119 | 1233 | 28.8 | Submission 25774 | 2333 | May 2023 | github.com | Official leaderboard | |
| 120 | 2001 | 28.7 | Submission 25950 | 2008 | May 2023 | github.com | Official leaderboard | |
| 121 | 二炮 | 28.6 | Submission 25819 | 二炮 | May 2023 | github.com | Official leaderboard | |
| 122 | cpmb | 28.6 | Submission 26055 | ccc | Jun 2023 | github.com | Official leaderboard | |
| 123 | mammam | 28.5 | Submission 26019 | fffuuuu | May 2023 | github.com | Official leaderboard | |
| 124 | 220000 | 28.5 | Submission 26028 | aaagggg | May 2023 | github.com | Official leaderboard | |
| 125 | mll | 28.5 | Submission 26032 | mllllllll | May 2023 | github.com | Official leaderboard | |
| 126 | mmmm | 28.4 | Submission 26035 | markkkkk | May 2023 | github.com | Official leaderboard | |
| 127 | aiiii | 28.4 | Submission 25981 | aiiiii | May 2023 | github.com | Official leaderboard | |
| 128 | fff | 28.4 | Submission 25974 | fu | May 2023 | github.com | Official leaderboard | |
| 129 | 222 | 28.2 | Submission 25971 | 2333 | May 2023 | github.com | Official leaderboard | |
| 130 | 75-42 | 27.9 | Submission 25756 | sodier511 | May 2023 | github.com | Official leaderboard | |
| 131 | chhhhh | 27.5 | Submission 26004 | hhhhhh | May 2023 | github.com | Official leaderboard | |
| 132 | Model.Zero-shot | 27.1 | Submission 5525 | ZeroCLUE.M | Aug 2021 | github.com | Official leaderboard | |
| 133 | bb-47 | 26.7 | Submission 25272 | sodier76 | Apr 2023 | github.com | Official leaderboard | |
| 134 | BertForCLS | 26.3 | Submission 6092 | bert | Aug 2021 | github.com | Official leaderboard | |
| 135 | needle4 | 24.4 | Submission 20674 | needle4 | Nov 2022 | arxiv.org | Official leaderboard | |
| 136 | BD-Chinese-Roberta-Large | 24.3 | Submission 19044 | BD-Chinese-Roberta-Large | Oct 2022 | github.com | Official leaderboard | |
| 137 | needle2 | 23.6 | Submission 20637 | needle2 | Nov 2022 | github.com | Official leaderboard | |
| 138 | needle5 | 22.7 | Submission 20676 | needle5 | Nov 2022 | arxiv.org | Official leaderboard | |
| 139 | 091 | 22.0 | Submission 25771 | TTT | May 2023 | github.com | Official leaderboard | |
| 140 | 1666 | 21.1 | Submission 25994 | succcccc | May 2023 | github.com | Official leaderboard | |
| 141 | tantan4 | 19.6 | Submission 15378 | tantanbaobao4 | Aug 2022 | github.com | Official leaderboard | |
| 142 | hhhh | 18.8 | Submission 15158 | tantanbaobao | Jul 2022 | github.com | Official leaderboard | |
| 143 | just_test | 18.5 | Submission 14899 | just_test | Jul 2022 | github.com | Official leaderboard | |
| 144 | ckkk | 18.3 | Submission 26003 | hhhhhh | May 2023 | github.com | Official leaderboard | |
| 145 | just_test2 | 18.3 | Submission 14901 | just_test2 | Jul 2022 | github.com | Official leaderboard | |
| 146 | A9 | 18.2 | Submission 25772 | sadfsdf | May 2023 | github.com | Official leaderboard | |
| 147 | S-Bert | 17.8 | Submission 6139 | Sysu | Aug 2021 | github.com | Official leaderboard | |
| 148 | nene | 17.7 | Submission 14904 | nene | Jul 2022 | github.com | Official leaderboard | |
| 149 | 12322 | 17.5 | Submission 25775 | 23333 | May 2023 | github.com | Official leaderboard | |
| 150 | 1777 | 17.5 | Submission 25929 | B777 | May 2023 | github.com | Official leaderboard | |
| 151 | aaaaay | 17.5 | Submission 25987 | kkkkk | May 2023 | github.com | Official leaderboard | |
| 152 | 18888 | 17.4 | Submission 25934 | 23rwer | May 2023 | github.com | Official leaderboard | |
| 153 | dsfccc | 17.4 | Submission 25958 | dsaf | May 2023 | github.com | Official leaderboard | |
| 154 | needle3 | 17.3 | Submission 20657 | needle3 | Nov 2022 | arxiv.org | Official leaderboard | |
| 155 | canser | 17.2 | Submission 26036 | ffffff | May 2023 | github.com | Official leaderboard | |
| 156 | er | 17.2 | Submission 25924 | er | May 2023 | github.com | Official leaderboard | |
| 157 | dsfsdf | 17.2 | Submission 25961 | hjhhhh | May 2023 | github.com | Official leaderboard | |
| 158 | 0002222 | 17.2 | Submission 26029 | ggggggggg | May 2023 | github.com | Official leaderboard | |
| 159 | lmlmlm | 17.2 | Submission 26033 | lmlmlmlmlmlmlm | May 2023 | github.com | Official leaderboard | |
| 160 | nannan | 17.1 | Submission 14903 | nannan | Jul 2022 | github.com | Official leaderboard | |
| 161 | baa | 17.1 | Submission 25982 | TTT | May 2023 | github.com | Official leaderboard | |
| 162 | fuuu | 17.1 | Submission 25975 | ff | May 2023 | github.com | Official leaderboard | |
| 163 | 15656 | 17.1 | Submission 25995 | cesss | May 2023 | github.com | Official leaderboard | |
| 164 | mmtest02 | 17.0 | Submission 23108 | mmtest02 | Dec 2022 | Official leaderboard | ||
| 165 | 2222 | 16.9 | Submission 25972 | 2323 | May 2023 | github.com | Official leaderboard | |
| 166 | 201 | 16.8 | Submission 25955 | 23234 | May 2023 | github.com | Official leaderboard | |
| 167 | S-Bert-V2 | 16.4 | Submission 6145 | Sysu | Aug 2021 | github.com | Official leaderboard | |
| 168 | 1055 | 15.6 | Submission 25694 | 1055 | May 2023 | github.com | Official leaderboard | |
| 169 | pre-trainning | 15.6 | Submission 8429 | Zero-Shot | Oct 2021 | github.com | Official leaderboard | |
| 170 | as | 15.3 | Submission 25828 | as | May 2023 | github.com | Official leaderboard | |
| 171 | 前往 | 15.3 | Submission 25823 | 前往 | May 2023 | github.com | Official leaderboard | |
| 172 | CSL | 14.8 | Submission 25705 | CSL | May 2023 | github.com | Official leaderboard | |
| 173 | 恩平 | 14.7 | Submission 25820 | 恩平 | May 2023 | github.com | Official leaderboard | |
| 174 | 0510-11-2 | 11.7 | Submission 25489 | 0510-11 | May 2023 | github.com | Official leaderboard | |
| 175 | tantan3 | 11.5 | Submission 15373 | tantanbaobao3 | Aug 2022 | github.com | Official leaderboard | |
| 176 | uclai_xlarge_p231003a | 11.4 | Submission 26485 | mc_10 | Oct 2023 | github.com | Official leaderboard | |
| 177 | uclai_xlarge_p231007a | 11.4 | Submission 26486 | mc_10 | Oct 2023 | github.com | Official leaderboard | |
| 178 | uclai_medium_p230917b | 11.3 | Submission 26471 | mc_14 | Sep 2023 | github.com | Official leaderboard | |
| 179 | uclai_medium_p230917a | 11.3 | Submission 26470 | mc_14 | Sep 2023 | github.com | Official leaderboard | |
| 180 | 0508aa | 11.3 | Submission 25707 | fansile | May 2023 | github.com | Official leaderboard | |
| 181 | xq_uclai_small_p230901b | 11.3 | Submission 26404 | mc09032 | Sep 2023 | github.com | Official leaderboard | |
| 182 | uclai_small_p230827b | 11.2 | Submission 26385 | mc_lq | Aug 2023 | github.com | Official leaderboard | |
| 183 | uclai_medium_p230913b | 11.2 | Submission 26450 | mc_14 | Sep 2023 | github.com | Official leaderboard | |
| 184 | ul-sm-v1-7 | 11.2 | Submission 26022 | mc | May 2023 | github.com | Official leaderboard | |
| 185 | xq_uclai_large_v3_3 | 11.2 | Submission 26178 | mc | Jul 2023 | github.com | Official leaderboard | |
| 186 | zeroclue_ll | 11.1 | Submission 7849 | lhl | Sep 2021 | github.com | Official leaderboard | |
| 187 | ul_small_v3_5 | 11.1 | Submission 26169 | mc | Jul 2023 | github.com | Official leaderboard | |
| 188 | small_p1_0_v1 | 11.1 | Submission 26270 | mc | Jul 2023 | github.com | Official leaderboard | |
| 189 | small_p3_5_v3 | 11.1 | Submission 26268 | mc | Jul 2023 | github.com | Official leaderboard | |
| 190 | uclai_small_p230829b | 11.1 | Submission 26396 | mc_8 | Aug 2023 | github.com | Official leaderboard | |
| 191 | zy-zeroclue | 11.1 | Submission 13090 | zy | Apr 2022 | github.com | Official leaderboard | |
| 192 | ul_large_v1_4_w | 11.1 | Submission 26038 | mc | Jun 2023 | github.com | Official leaderboard | |
| 193 | uclai_small_p230814a | 11.1 | Submission 26341 | mc_lq | Aug 2023 | github.com | Official leaderboard | |
| 194 | ul-sm-v2-9 | 11.1 | Submission 25984 | mc | May 2023 | github.com | Official leaderboard | |
| 195 | ul-vs5 | 11.1 | Submission 25977 | mc | May 2023 | github.com | Official leaderboard | |
| 196 | uclai-231012 | 11.1 | Submission 26487 | mc | Oct 2023 | github.com | Official leaderboard | |
| 197 | xq_uclai_small_p230901a | 11.1 | Submission 26403 | mc09031 | Sep 2023 | github.com | Official leaderboard | |
| 198 | 0510-11-3 | 11.1 | Submission 25490 | 0510-11 | May 2023 | github.com | Official leaderboard | |
| 199 | B-2 | 11.0 | Submission 25692 | B | May 2023 | github.com | Official leaderboard | |
| 200 | uclai_medium_p230913a | 11.0 | Submission 26449 | mc_14 | Sep 2023 | github.com | Official leaderboard | |
| 201 | ul_large_v1_4_12 | 11.0 | Submission 26096 | mc | Jun 2023 | github.com | Official leaderboard | |
| 202 | uclai_small_p230827a | 11.0 | Submission 26384 | mc_lq | Aug 2023 | github.com | Official leaderboard | |
| 203 | uclai_small_p230910b | 11.0 | Submission 26426 | mc_12 | Sep 2023 | github.com | Official leaderboard | |
| 204 | uclai_small_s230821a_p3_5_1 | 11.0 | Submission 26356 | mcpy | Aug 2023 | github.com | Official leaderboard | |
| 205 | uclai_small_v3_8 | 11.0 | Submission 26333 | mc_lq | Aug 2023 | github.com | Official leaderboard | |
| 206 | xq_uclai_small_s230817a_p3_5_flatatt | 11.0 | Submission 26352 | mcdd | Aug 2023 | github.com | Official leaderboard | |
| 207 | xq_0823_1 | 11.0 | Submission 26362 | mcdd | Aug 2023 | github.com | Official leaderboard | |
| 208 | uclai_large_v1_14 | 11.0 | Submission 26110 | mc | Jun 2023 | github.com | Official leaderboard | |
| 209 | xq_uclai_small_s230817a_p3_5 | 11.0 | Submission 26353 | mcdd | Aug 2023 | github.com | Official leaderboard | |
| 210 | xq_uclai_small_s230818a_p3_5 | 11.0 | Submission 26348 | mcdd | Aug 2023 | github.com | Official leaderboard | |
| 211 | xq_uclai_small_s230818a_p3_5_flatatt | 11.0 | Submission 26351 | mcdd | Aug 2023 | github.com | Official leaderboard | |
| 212 | s230814a_p230814a | 11.0 | Submission 26344 | mcpy | Aug 2023 | github.com | Official leaderboard | |
| 213 | uclai-chat-stream-small-p3-6-v1 | 10.9 | Submission 26170 | mc_lq | Jul 2023 | github.com | Official leaderboard | |
| 214 | xq_uclai_large_v3_2 | 10.9 | Submission 26156 | mc | Jul 2023 | github.com | Official leaderboard | |
| 215 | uclai_small_p230814b | 10.9 | Submission 26343 | mc_lq | Aug 2023 | github.com | Official leaderboard | |
| 216 | uclai_small_p230829a | 10.9 | Submission 26395 | mc_8 | Aug 2023 | github.com | Official leaderboard | |
| 217 | uclai_small_p230823a | 10.9 | Submission 26367 | mc_lq | Aug 2023 | github.com | Official leaderboard | |
| 218 | uclai_small_p230910a | 10.8 | Submission 26420 | mc_11 | Sep 2023 | github.com | Official leaderboard | |
| 219 | uclai_small_p230904b | 10.8 | Submission 26411 | mc_9 | Sep 2023 | github.com | Official leaderboard | |
| 220 | xq_uclai_small_v3_5 | 10.8 | Submission 26158 | mc | Jul 2023 | github.com | Official leaderboard | |
| 221 | xq_uclai_chat_stream_large_p3_3_v1 | 10.8 | Submission 26216 | mc | Jul 2023 | github.com | Official leaderboard | |
| 222 | xq_uclai_chat_stream_large_s2_16_v2 | 10.8 | Submission 26215 | mc | Jul 2023 | github.com | Official leaderboard | |
| 223 | xq_uclai_small_v3_3 | 10.7 | Submission 26146 | mc | Jul 2023 | github.com | Official leaderboard | |
| 224 | xq_uclai_small_v3_4 | 10.7 | Submission 26157 | mc | Jul 2023 | github.com | Official leaderboard | |
| 225 | uclai_small_v1_11 | 10.7 | Submission 26081 | mc | Jun 2023 | github.com | Official leaderboard | |
| 226 | ul-sm-v1-6 | 10.7 | Submission 26008 | mc | May 2023 | github.com | Official leaderboard | |
| 227 | Test | 10.7 | Submission 25479 | Bee | May 2023 | github.com | Official leaderboard | |
| 228 | test56 | 10.7 | Submission 25486 | test56 | May 2023 | github.com | Official leaderboard | |
| 229 | test_chid | 10.7 | Submission 14898 | test_chid | Jul 2022 | github.com | Official leaderboard | |
| 230 | uclai_small_p230822a | 10.6 | Submission 26366 | mc_lq | Aug 2023 | github.com | Official leaderboard | |
| 231 | uclai-chat-stream-small-p3-5-v1 | 10.6 | Submission 26166 | mc_lq | Jul 2023 | github.com | Official leaderboard | |
| 232 | uclai_small_p230904a | 10.6 | Submission 26410 | mc_9 | Sep 2023 | github.com | Official leaderboard | |
| 233 | uclai_large_v3_1_0703 | 10.6 | Submission 26135 | mc | Jul 2023 | github.com | Official leaderboard | |
| 234 | uclai_small_v1_10 | 10.6 | Submission 26047 | mc | Jun 2023 | github.com | Official leaderboard | |
| 235 | uclai_small_v1_13 | 10.6 | Submission 26083 | mc | Jun 2023 | github.com | Official leaderboard | |
| 236 | ul_large_v1_10 | 10.5 | Submission 26085 | mc | Jun 2023 | github.com | Official leaderboard | |
| 237 | uclai_small_v3_2 | 10.5 | Submission 26132 | mc | Jun 2023 | github.com | Official leaderboard | |
| 238 | pardon | 10.5 | Submission 26006 | bustmpardon | May 2023 | github.com | Official leaderboard | |
| 239 | pai-ckbert-base-xnli_zh-nli | 10.5 | Submission 26724 | forrest | Feb 2024 | Official leaderboard | ||
| 240 | xq_0825_uclai-chat-stream-small-p3-5-v1-3 | 10.4 | Submission 26370 | mcdd_0825 | Aug 2023 | github.com | Official leaderboard | |
| 241 | uclai_chat_stream_xlarge_p3_1_v1 | 10.4 | Submission 26269 | mc_lq | Jul 2023 | github.com | Official leaderboard | |
| 242 | textcnn-shopping | 10.4 | Submission 26767 | forrest | Mar 2024 | Official leaderboard | ||
| 243 | pai-bert-base-xnli_zh-nli | 10.3 | Submission 26725 | forrest | Feb 2024 | Official leaderboard | ||
| 244 | pai-ckbert-large-nli | 10.3 | Submission 26761 | forrest | Mar 2024 | baidu.com | Official leaderboard | |
| 245 | wj_ul-s-p3-5-v3 | 10.2 | Submission 26274 | mc | Jul 2023 | github.com | Official leaderboard | |
| 246 | opt_6bm_60bt_ww | 10.1 | Submission 23870 | wen | Feb 2023 | github.com | Official leaderboard | |
| 247 | opt_6bm_50bt_ww | 10.1 | Submission 23869 | wen | Feb 2023 | github.com | Official leaderboard | |
| 248 | zero-bustm | 10.0 | Submission 25120 | just_try | Apr 2023 | Official leaderboard | ||
| 249 | xq_uclai_1B_p230825b | 10.0 | Submission 26374 | mc08254 | Aug 2023 | github.com | Official leaderboard | |
| 250 | uclai_1B_p230825b | 10.0 | Submission 26390 | mc_lq_new | Aug 2023 | github.com | Official leaderboard | |
| 251 | py_xlarge_s231110a_p231107a | 9.99 | Submission 26518 | pymc | Nov 2023 | github.com | Official leaderboard | |
| 252 | uclai_small_v3_1 | 9.93 | Submission 26126 | mc | Jun 2023 | github.com | Official leaderboard | |
| 253 | uclai_xlarge_s231127a_s231016a | 9.93 | Submission 26536 | mc2311291 | Nov 2023 | github.com | Official leaderboard | |
| 254 | uclai_xlarge_s231009a_p231007a | 9.91 | Submission 26493 | mc231017 | Oct 2023 | github.com | Official leaderboard | |
| 255 | nalll | 9.90 | Submission 25992 | fiiiiii | May 2023 | github.com | Official leaderboard | |
| 256 | opt_6bm_40bt_ww | 9.89 | Submission 23342 | wen | Feb 2023 | github.com | Official leaderboard | |
| 257 | xq_uclai_1B_p230825a | 9.89 | Submission 26373 | mc08253 | Aug 2023 | github.com | Official leaderboard | |
| 258 | uclai_1B_p230825a | 9.89 | Submission 26383 | mc_lq | Aug 2023 | github.com | Official leaderboard | |
| 259 | opt_6B_60T_3_2_1k_ww | 9.88 | Submission 24185 | wen | Mar 2023 | github.com | Official leaderboard | |
| 260 | xq_uclai_small_s230902b_p230901b | 9.87 | Submission 26406 | mc09034 | Sep 2023 | github.com | Official leaderboard | |
| 261 | ocnli | 9.85 | Submission 26021 | ocnliiiii | May 2023 | github.com | Official leaderboard | |
| 262 | uclai_medium_s231120a_p231013a | 9.84 | Submission 26534 | mc2311211 | Nov 2023 | github.com | Official leaderboard | |
| 263 | sft_20230327_ww | 9.82 | Submission 24512 | wen | Apr 2023 | github.com | Official leaderboard | |
| 264 | ul-v16 | 9.81 | Submission 25414 | mc | May 2023 | github.com | Official leaderboard | |
| 265 | xq_uclai_small_s230902a_p230827b | 9.80 | Submission 26405 | mc09033 | Sep 2023 | github.com | Official leaderboard | |
| 266 | uclai_700m_p230821a | 9.77 | Submission 26358 | mc_lq | Aug 2023 | github.com | Official leaderboard | |
| 267 | xq_uclai_small_s230902c_p230829b | 9.77 | Submission 26407 | mc09035 | Sep 2023 | github.com | Official leaderboard | |
| 268 | ul-v17 | 9.74 | Submission 25481 | mc | May 2023 | github.com | Official leaderboard | |
| 269 | ul_large_v1_7_0703_2 | 9.74 | Submission 26136 | mc | Jul 2023 | github.com | Official leaderboard | |
| 270 | ul-l-v1-7 | 9.74 | Submission 26141 | mc | Jul 2023 | github.com | Official leaderboard | |
| 271 | ul-l-v1-7-new | 9.74 | Submission 26149 | mc | Jul 2023 | github.com | Official leaderboard | |
| 272 | u-wj8 | 9.73 | Submission 25939 | mc | May 2023 | github.com | Official leaderboard | |
| 273 | uclai_xlarge_s231016a_p231007a | 9.72 | Submission 26491 | mc2310162 | Oct 2023 | github.com | Official leaderboard | |
| 274 | pul-v15 | 9.70 | Submission 25312 | mc | May 2023 | github.com | Official leaderboard | |
| 275 | 520 | 9.70 | Submission 25966 | dog | May 2023 | github.com | Official leaderboard | |
| 276 | ul-sm-v2-10 | 9.69 | Submission 26009 | mc | May 2023 | github.com | Official leaderboard | |
| 277 | uclai_small_s230906a_p3_5 | 9.67 | Submission 26469 | mc_14 | Sep 2023 | github.com | Official leaderboard | |
| 278 | bustm | 9.66 | Submission 25484 | bustm | May 2023 | github.com | Official leaderboard | |
| 279 | py_xlarge_s231016a_p231007a-2 | 9.66 | Submission 26522 | pymc | Nov 2023 | github.com | Official leaderboard | |
| 280 | py_xlarge_s231016a_p231007a-sys | 9.66 | Submission 26521 | pymc | Nov 2023 | github.com | Official leaderboard | |
| 281 | py_xlarge_s231016a_p231007a-sys2 | 9.66 | Submission 26520 | pymc | Nov 2023 | github.com | Official leaderboard | |
| 282 | uclai_xlarge_s231016a_p231007a-3 | 9.66 | Submission 26535 | mc202311281 | Nov 2023 | github.com | Official leaderboard | |
| 283 | zeroclue_llll | 9.65 | Submission 7582 | lhl | Sep 2021 | github.com | Official leaderboard | |
| 284 | uclai_xlarge_s230907a_v3_2 | 9.65 | Submission 26419 | mc_11 | Sep 2023 | github.com | Official leaderboard | |
| 285 | uuuu | 9.64 | Submission 26509 | mcdd | Oct 2023 | github.com | Official leaderboard | |
| 286 | uclai_small_s230822a_p3_5 | 9.63 | Submission 26361 | mc_lq | Aug 2023 | github.com | Official leaderboard | |
| 287 | uc_large_v1_3_ww | 9.63 | Submission 24685 | wen | Apr 2023 | github.com | Official leaderboard | |
| 288 | xq_uclai_700m_p230816c | 9.61 | Submission 26349 | mcdd | Aug 2023 | github.com | Official leaderboard | |
| 289 | xq_uclai_700m_p230818a | 9.59 | Submission 26350 | mcdd | Aug 2023 | github.com | Official leaderboard | |
| 290 | py_xlarge_d231108a_s231016a | 9.59 | Submission 26519 | pymc | Nov 2023 | github.com | Official leaderboard | |
| 291 | uclai_small_s230817a_p3_5_flashatt | 9.59 | Submission 26393 | mc_8 | Aug 2023 | github.com | Official leaderboard | |
| 292 | uclai-chat-stream-small_p3_5_v2 | 9.56 | Submission 26272 | mc_lq | Jul 2023 | github.com | Official leaderboard | |
| 293 | xa_uclai_small_s230831a_p3_5 | 9.51 | Submission 26402 | mc09012 | Sep 2023 | github.com | Official leaderboard | |
| 294 | xq_uclai_small_s230902d_p230823a | 9.51 | Submission 26408 | mc009036 | Sep 2023 | github.com | Official leaderboard | |
| 295 | uclai_small_s230818a_p3_5_flashatt | 9.50 | Submission 26394 | mc_8 | Aug 2023 | github.com | Official leaderboard | |
| 296 | ≈ | 9.49 | Submission 26400 | mc0831 | Aug 2023 | github.com | Official leaderboard | |
| 297 | xq_uclai_xlarge_s230830a | 9.49 | Submission 26399 | mc0831 | Aug 2023 | github.com | Official leaderboard | |
| 298 | t5-zeroshot-5t | 9.48 | Submission 24522 | yimiao | Apr 2023 | github.com | Official leaderboard | |
| 299 | xq_uclai_small_s230823c_v3_5 | 9.47 | Submission 26372 | mc08252 | Aug 2023 | github.com | Official leaderboard | |
| 300 | xq_uclai-chat-stream-small-p3-5-v1-2_0825 | 9.47 | Submission 26369 | mcdd | Aug 2023 | github.com | Official leaderboard | |
| 301 | uclai_1B_s231218f_p231208a | 9.47 | Submission 26595 | mc2312201 | Dec 2023 | github.com | Official leaderboard | |
| 302 | uclai_medium_s231014a_p231013a | 9.47 | Submission 26490 | mc231016 | Oct 2023 | github.com | Official leaderboard | |
| 303 | uclai_small_s230823b_v3_5 | 9.46 | Submission 26364 | mc_lq | Aug 2023 | github.com | Official leaderboard | |
| 304 | uclai_small_s230905c_p230904b | 9.46 | Submission 26422 | mc_11 | Sep 2023 | github.com | Official leaderboard | |
| 305 | small_s231114b_p231113a | 9.46 | Submission 26517 | pymc | Nov 2023 | github.com | Official leaderboard | |
| 306 | uclai_small_s230823d_v3_5 | 9.44 | Submission 26365 | mc_lq | Aug 2023 | github.com | Official leaderboard | |
| 307 | uclai_700m_v3_9 | 9.43 | Submission 26331 | mc_lq | Aug 2023 | github.com | Official leaderboard | |
| 308 | lake_large_20bt_ww | 9.41 | Submission 24618 | wen | Apr 2023 | github.com | Official leaderboard | |
| 309 | xq_uclai_small_s230901a_p3_5 | 9.41 | Submission 26401 | mc09011 | Sep 2023 | github.com | Official leaderboard | |
| 310 | py_medium_s231026a_p230917c | 9.39 | Submission 26527 | pymc | Nov 2023 | github.com | Official leaderboard | |
| 311 | uclai_medium_s230914a_p230913c | 9.39 | Submission 26451 | mc_14 | Sep 2023 | github.com | Official leaderboard | |
| 312 | uclai_large_s230915a_s2_16 | 9.38 | Submission 26464 | mc_14 | Sep 2023 | github.com | Official leaderboard | |
| 313 | stm-l-v2-3 | 9.38 | Submission 24729 | mc | Apr 2023 | github.com | Official leaderboard | |
| 314 | uclai_1B_s231208a_p231208a | 9.38 | Submission 26549 | mc231211a | Dec 2023 | github.com | Official leaderboard | |
| 315 | py_medium_d231030a_s231014a | 9.36 | Submission 26525 | pymc | Nov 2023 | github.com | Official leaderboard | |
| 316 | small_s231114a_p231113a | 9.36 | Submission 26516 | pymc | Nov 2023 | github.com | Official leaderboard | |
| 317 | t5-zeroshot-5t1 | 9.35 | Submission 24523 | yimiao | Apr 2023 | github.com | Official leaderboard | |
| 318 | csl-212 | 9.34 | Submission 25468 | mc | May 2023 | github.com | Official leaderboard | |
| 319 | ul-wj12 | 9.34 | Submission 25926 | mc | May 2023 | github.com | Official leaderboard | |
| 320 | tt | 9.34 | Submission 15304 | 火龙果 | Aug 2022 | Official leaderboard | ||
| 321 | uclai_small_s230905a_p230904b | 9.31 | Submission 26412 | mc_9 | Sep 2023 | github.com | Official leaderboard | |
| 322 | uclai_chat_stream_700m_p3_9_v1 | 9.31 | Submission 26334 | mc_lq | Aug 2023 | github.com | Official leaderboard | |
| 323 | py_small_s231029a_p230910c | 9.29 | Submission 26526 | pymc | Nov 2023 | github.com | Official leaderboard | |
| 324 | csl-211 | 9.22 | Submission 25265 | mc | Apr 2023 | github.com | Official leaderboard | |
| 325 | lake_large_15bt_ww | 9.21 | Submission 24593 | wen | Apr 2023 | github.com | Official leaderboard | |
| 326 | py_small_s231030a_p230910c | 9.17 | Submission 26524 | pymc | Nov 2023 | github.com | Official leaderboard | |
| 327 | uclai_small_d20230828b | 9.13 | Submission 26387 | mc_lq_new | Aug 2023 | github.com | Official leaderboard | |
| 328 | uclai_small_s231007a_p230910c | 9.12 | Submission 26484 | mc_10 | Oct 2023 | github.com | Official leaderboard | |
| 329 | medium_s230918b_p230917c | 9.11 | Submission 26465 | pymc | Sep 2023 | github.com | Official leaderboard | |
| 330 | uclai_small_s231012a_p230910c | 9.11 | Submission 26489 | mc2310132 | Oct 2023 | github.com | Official leaderboard | |
| 331 | uclai_small_l230914a_s230905b | 9.10 | Submission 26446 | mc_14 | Sep 2023 | github.com | Official leaderboard | |
| 332 | uclai_small_d20230828a | 9.07 | Submission 26386 | mc_lq_new | Aug 2023 | github.com | Official leaderboard | |
| 333 | uclai_700m_v3_8 | 9.02 | Submission 26332 | mc_lq | Aug 2023 | github.com | Official leaderboard | |
| 334 | py_medium_s230918b_p230917c-2 | 9.01 | Submission 26523 | pymc | Nov 2023 | github.com | Official leaderboard | |
| 335 | uclai_medium_s230914b_p230913c | 9.00 | Submission 26448 | mc_14 | Sep 2023 | github.com | Official leaderboard | |
| 336 | uclai_small_s230915a_p230910c | 8.96 | Submission 26455 | mc_14 | Sep 2023 | github.com | Official leaderboard | |
| 337 | uclai_small_s231005a_p230910c | 8.94 | Submission 26483 | mc_10 | Oct 2023 | github.com | Official leaderboard | |
| 338 | uclai_small_s231013a_p230910c | 8.94 | Submission 26492 | mc2310163 | Oct 2023 | github.com | Official leaderboard | |
| 339 | uclai_small_s20231129_p230910c | 8.94 | Submission 26567 | mc2312151 | Dec 2023 | github.com | Official leaderboard | |
| 340 | uclai_small_d20230824a | 8.93 | Submission 26375 | mc_lq | Aug 2023 | github.com | Official leaderboard | |
| 341 | uclai_small_s230911a_p3_5 | 8.91 | Submission 26429 | mc_12 | Sep 2023 | github.com | Official leaderboard | |
| 342 | uclai_small_s230920c_p230904b | 8.91 | Submission 26475 | mc_14 | Sep 2023 | github.com | Official leaderboard | |
| 343 | uclai_large_s230814_s2_16_v5 | 8.91 | Submission 26392 | mc_8 | Aug 2023 | github.com | Official leaderboard | |
| 344 | lake_small_70bt_ww | 8.89 | Submission 24598 | wen | Apr 2023 | github.com | Official leaderboard | |
| 345 | uclai-small-v1_0 | 8.89 | Submission 26127 | mc | Jun 2023 | github.com | Official leaderboard | |
| 346 | stm-large-v2-1_ww | 8.88 | Submission 24693 | wen | Apr 2023 | github.com | Official leaderboard | |
| 347 | lake_small_60bt_ww | 8.87 | Submission 24597 | wen | Apr 2023 | github.com | Official leaderboard | |
| 348 | lake_small_50bt_ww | 8.84 | Submission 24589 | wen | Apr 2023 | github.com | Official leaderboard | |
| 349 | la_30b_10bt_ww | 8.84 | Submission 24570 | wen | Apr 2023 | github.com | Official leaderboard | |
| 350 | uclai_small_s230922a_p230904c | 8.79 | Submission 26480 | mc_25 | Sep 2023 | github.com | Official leaderboard | |
| 351 | la_7b_40bt_ww | 8.78 | Submission 24587 | wen | Apr 2023 | github.com | Official leaderboard | |
| 352 | uclai_small_s230828a_p3_5 | 8.75 | Submission 26388 | mc_lq_new | Aug 2023 | lil.nlp.cornell.edu | Official leaderboard | |
| 353 | s230814b_p230814b_1 | 8.72 | Submission 26345 | mcpy | Aug 2023 | github.com | Official leaderboard | |
| 354 | uclai_large_s231207a_p231202a | 8.70 | Submission 26550 | mc2312121 | Dec 2023 | github.com | Official leaderboard | |
| 355 | uclai_small_s230917a_p230904b | 8.68 | Submission 26467 | mc_14 | Sep 2023 | github.com | Official leaderboard | |
| 356 | uclai_small_s230925a_p230904c | 8.68 | Submission 26479 | mc_25 | Sep 2023 | github.com | Official leaderboard | |
| 357 | uclai_small_s230912b_p3_5 | 8.67 | Submission 26441 | mc_12 | Sep 2023 | lil.nlp.cornell.edu | Official leaderboard | |
| 358 | zyc_test | 8.66 | Submission 24510 | zyc_test | Apr 2023 | github.com | Official leaderboard | |
| 359 | stm-l-v2-10 | 8.63 | Submission 25083 | mc | Apr 2023 | github.com | Official leaderboard | |
| 360 | small_s230919a_p230904b | 8.63 | Submission 26472 | pymc | Sep 2023 | github.com | Official leaderboard | |
| 361 | xq_uclai_small_s230825a_v3_5 | 8.60 | Submission 26371 | mc | Aug 2023 | github.com | Official leaderboard | |
| 362 | uclai_small_s230905b_p230904b_flashatt | 8.53 | Submission 26414 | mc_9 | Sep 2023 | github.com | Official leaderboard | |
| 363 | 1 | 8.53 | Submission 15404 | 1 | Aug 2022 | Official leaderboard | ||
| 364 | la_7b_30bt_ww | 8.49 | Submission 24565 | wen | Apr 2023 | github.com | Official leaderboard | |
| 365 | test | 8.46 | Submission 14528 | test | Jun 2022 | Official leaderboard | ||
| 366 | chat-stream-small-1_ww | 8.41 | Submission 24673 | wen | Apr 2023 | github.com | Official leaderboard | |
| 367 | uclai_small_s231214a_p231213a | 8.41 | Submission 26568 | mc2312152 | Dec 2023 | github.com | Official leaderboard | |
| 368 | stm-s-v2-3 | 8.40 | Submission 24727 | mc | Apr 2023 | github.com | Official leaderboard | |
| 369 | stm-s-v2-5 | 8.28 | Submission 24731 | mc | Apr 2023 | github.com | Official leaderboard | |
| 370 | stm-s-v2-4 | 8.22 | Submission 24730 | mc | Apr 2023 | github.com | Official leaderboard | |
| 371 | py_medium_d231027a_s231014a | 8.22 | Submission 26528 | pymc | Nov 2023 | github.com | Official leaderboard | |
| 372 | t5-zeroshot-5t3 | 8.19 | Submission 24525 | yimiao | Apr 2023 | github.com | Official leaderboard | |
| 373 | la_7b_30b_sft_ww | 8.19 | Submission 24574 | wen | Apr 2023 | github.com | Official leaderboard | |
| 374 | ul-sm-v2-11 | 8.16 | Submission 26025 | mc | May 2023 | github.com | Official leaderboard | |
| 375 | stm-l-v2-8 | 8.13 | Submission 24984 | mc | Apr 2023 | github.com | Official leaderboard | |
| 376 | t5-zeroshot-5t2 | 8.10 | Submission 24524 | yimiao | Apr 2023 | github.com | Official leaderboard | |
| 377 | la_7bm_30bt_sft_2bt_ww | 8.07 | Submission 24575 | wen | Apr 2023 | github.com | Official leaderboard | |
| 378 | la_7b_20t_ww | 8.06 | Submission 24493 | wen | Mar 2023 | github.com | Official leaderboard | |
| 379 | stm-s-v2-6 | 8.02 | Submission 24781 | mc | Apr 2023 | github.com | Official leaderboard | |
| 380 | stm-s-v2-7 | 7.97 | Submission 24985 | mc | Apr 2023 | github.com | Official leaderboard | |
| 381 | wj_u-s-2-11 | 7.96 | Submission 26198 | mc | Jul 2023 | github.com | Official leaderboard | |
| 382 | stm-l-v2-4 | 7.88 | Submission 24735 | mc | Apr 2023 | github.com | Official leaderboard | |
| 383 | tantan | 7.83 | Submission 14881 | tantanbaobao | Jul 2022 | github.com | Official leaderboard | |
| 384 | pai-bert-tiny-xnli_zh-nli | 7.82 | Submission 26726 | forrest | Feb 2024 | Official leaderboard | ||
| 385 | pai-bert-tiny | 7.82 | Submission 26762 | forrest | Mar 2024 | Official leaderboard | ||
| 386 | wj_uc-s-p1-0-v1 | 7.67 | Submission 26273 | mc | Jul 2023 | github.com | Official leaderboard | |
| 387 | stm-l-v2-5 | 7.62 | Submission 24782 | mc | Apr 2023 | github.com | Official leaderboard | |
| 388 | eprstmt | 7.40 | Submission 26075 | sss | Jun 2023 | github.com | Official leaderboard | |
| 389 | uclai_small_s230914a_p230904b | 7.32 | Submission 26466 | mc_14 | Sep 2023 | github.com | Official leaderboard | |
| 390 | uclai-chat-stream-small-v2-6-0905-FT | 7.29 | Submission 26413 | mc_9 | Sep 2023 | github.com | Official leaderboard | |
| 391 | cccc | 7.25 | Submission 26020 | kkkkk | May 2023 | github.com | Official leaderboard | |
| 392 | cluewscf | 7.20 | Submission 26073 | sss | Jun 2023 | github.com | Official leaderboard | |
| 393 | fly-20 | 7.04 | Submission 25813 | fly-20 | May 2023 | github.com | Official leaderboard | |
| 394 | uclai_small_l230920a_s230905b | 7.02 | Submission 26481 | mc_25 | Sep 2023 | github.com | Official leaderboard | |
| 395 | ul-wj14 | 6.95 | Submission 25919 | mc | May 2023 | github.com | Official leaderboard | |
| 396 | csl-214 | 6.95 | Submission 25921 | mc | May 2023 | github.com | Official leaderboard | |
| 397 | stm-l-v2-7 | 6.92 | Submission 24983 | mc | Apr 2023 | github.com | Official leaderboard | |
| 398 | gpt-3.5 | 6.82 | Submission 26763 | forrest | Mar 2024 | Official leaderboard | ||
| 399 | hanhan | 6.81 | Submission 14886 | hanhanbaobao | Jul 2022 | github.com | Official leaderboard | |
| 400 | uclai_700m_v3_9_onlytext_sft | 6.81 | Submission 26473 | mc_14 | Sep 2023 | github.com | Official leaderboard | |
| 401 | la_30b_1t_ww | 6.80 | Submission 24501 | wen | Apr 2023 | github.com | Official leaderboard | |
| 402 | bbbbbb | 6.72 | Submission 26065 | ccc | Jun 2023 | github.com | Official leaderboard | |
| 403 | fly-75 | 6.63 | Submission 25815 | fly-75 | May 2023 | github.com | Official leaderboard | |
| 404 | mc | 6.63 | Submission 26533 | mc2311204 | Nov 2023 | github.com | Official leaderboard | |
| 405 | qwe | 6.62 | Submission 15106 | qwe | Jul 2022 | github.com | Official leaderboard | |
| 406 | tantan1 | 6.62 | Submission 15179 | tantanbaobao1 | Jul 2022 | github.com | Official leaderboard | |
| 407 | hhh | 6.57 | Submission 14889 | tantanbaobao | Jul 2022 | github.com | Official leaderboard | |
| 408 | cslf | 6.57 | Submission 26074 | sss | Jun 2023 | github.com | Official leaderboard | |
| 409 | gpt3.5 | 6.51 | Submission 26764 | forrest | Mar 2024 | Official leaderboard | ||
| 410 | fly-47 | 6.48 | Submission 25814 | fly-47 | May 2023 | github.com | Official leaderboard | |
| 411 | csl-213 | 6.46 | Submission 25918 | mc | May 2023 | github.com | Official leaderboard | |
| 412 | ul-wj13 | 6.46 | Submission 25917 | mc | May 2023 | github.com | Official leaderboard | |
| 413 | ul-lg-v2-15-qianhai | 6.46 | Submission 26010 | mc | May 2023 | github.com | Official leaderboard | |
| 414 | uclai_700m_v3_9_polly_sft | 6.41 | Submission 26442 | mc_12 | Sep 2023 | github.com | Official leaderboard | |
| 415 | la_7b_15bt_sft_4_5_ww | 6.39 | Submission 24566 | wen | Apr 2023 | github.com | Official leaderboard | |
| 416 | bbbbbb-c | 6.21 | Submission 26069 | ccc | Jun 2023 | github.com | Official leaderboard | |
| 417 | uclai_small_l230921a_s230905b | 6.16 | Submission 26482 | mc_25 | Sep 2023 | github.com | Official leaderboard | |
| 418 | ul-wj15 | 6.04 | Submission 25920 | mc | May 2023 | github.com | Official leaderboard | |
| 419 | csl-215 | 6.04 | Submission 25935 | mc | May 2023 | github.com | Official leaderboard | |
| 420 | ul-wj15-1 | 6.04 | Submission 25938 | mc | May 2023 | github.com | Official leaderboard | |
| 421 | ul-wj15-2 | 6.04 | Submission 25962 | mc | May 2023 | github.com | Official leaderboard | |
| 422 | gpt2_350M_ns231113a_np231111a | 6.03 | Submission 26530 | mc2311202 | Nov 2023 | github.com | Official leaderboard | |
| 423 | stream-small-v2-2_ww | 5.96 | Submission 24679 | wen | Apr 2023 | github.com | Official leaderboard | |
| 424 | uclai_small_l231102a_s230905b | 5.91 | Submission 26529 | mc11201 | Nov 2023 | github.com | Official leaderboard | |
| 425 | xq_0822 | 5.76 | Submission 26357 | mcdd | Aug 2023 | github.com | Official leaderboard | |
| 426 | uclai_chat_stream_large_s2_16_v5 | 5.76 | Submission 26494 | mc2310172 | Oct 2023 | github.com | Official leaderboard | |
| 427 | xq_uclai_chat_stream_large_s2_16_v5_safety | 5.75 | Submission 26355 | mcdd | Aug 2023 | github.com | Official leaderboard | |
| 428 | hhhhh | 5.61 | Submission 15197 | tantanbaobao | Jul 2022 | github.com | Official leaderboard | |
| 429 | cpm-test-1 | 5.33 | Submission 26173 | cpm-test | Jul 2023 | Official leaderboard | ||
| 430 | cpm-test-2 | 5.33 | Submission 26172 | cpm-test | Jul 2023 | github.com | Official leaderboard | |
| 431 | chat-stream-small_ww | 5.04 | Submission 24637 | wen | Apr 2023 | github.com | Official leaderboard | |
| 432 | xq_uclai_tiny_v1_2 | 4.81 | Submission 26125 | mc | Jun 2023 | github.com | Official leaderboard | |
| 433 | 47-2task | 4.80 | Submission 25754 | sodier511 | May 2023 | github.com | Official leaderboard | |
| 434 | llama2_13B_chat_hf | 4.80 | Submission 26397 | mc_8 | Aug 2023 | github.com | Official leaderboard | |
| 435 | xq_uclai_chat-stream-tiny_v1_2 | 4.65 | Submission 26138 | mc | Jul 2023 | github.com | Official leaderboard | |
| 436 | q1 | 4.45 | Submission 14530 | q1 | Jun 2022 | Official leaderboard | ||
| 437 | xq_uclai_chat-stream-tiny_v1_1 | 4.31 | Submission 26139 | mc | Jul 2023 | github.com | Official leaderboard | |
| 438 | llama2_7B_chat_hf | 4.18 | Submission 26391 | mc_lq_new | Aug 2023 | github.com | Official leaderboard | |
| 439 | 20-2task | 4.17 | Submission 25753 | sodier511 | May 2023 | github.com | Official leaderboard | |
| 440 | xq_uclai_tiny_v1_1 | 4.08 | Submission 26124 | mc | Jun 2023 | github.com | Official leaderboard | |
| 441 | ocnlif | 3.81 | Submission 26076 | sss | Jun 2023 | github.com | Official leaderboard | |
| 442 | xq_uclai_chat_stream_large_s2_16_v2_0717_2 | 3.49 | Submission 26186 | mc | Jul 2023 | github.com | Official leaderboard | |
| 443 | llama_7B_hf_ww | 3.21 | Submission 24492 | wen | Mar 2023 | github.com | Official leaderboard | |
| 444 | la_7b_sft_4_1_ww | 2.93 | Submission 24511 | wen | Apr 2023 | github.com | Official leaderboard | |
| 445 | uclai_large_v1_7 | 2.53 | Submission 26131 | mc | Jun 2023 | github.com | Official leaderboard | |
| 446 | ul_large_v1_7_0703 | 2.53 | Submission 26134 | mc | Jul 2023 | github.com | Official leaderboard | |
| 447 | wj_u-l-2-16 | 2.52 | Submission 26200 | mc | Jul 2023 | github.com | Official leaderboard | |
| 448 | gpt2-large-test | 2.29 | Submission 26457 | mc_14 | Sep 2023 | github.com | Official leaderboard | |
| 449 | xq_uclai-chat-stream-small-p3-5-v1-2 | 1.93 | Submission 26368 | mcdd | Aug 2023 | github.com | Official leaderboard | |
| 450 | test-ot5-tnews-20221017 | 0.01 | Submission 17200 | test-ot5-tnews-20221017 | Oct 2022 | github.com | Official leaderboard |
| # | Model | Score | Setting | Submitted by | Released | Run on | Link | Source |
|---|---|---|---|---|---|---|---|---|
| 1 | ChatGLM-6B | 30.9 | Submission 26053 | CCC | Mar 2023 | Jun 2023 | github.com | Official leaderboard |
Number one over time
Lab claims count from the day the card came out, independent runs from the model’s release.
Source: Official ZeroCLUE leaderboard
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
Source: Official ZeroCLUE leaderboard
No lab model card reports it yet
We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.
More in Multilingual
- MMMLU In use MMLU professionally translated into 14 languages. Multiple-choice accuracy. Claude Mythos Preview 92.7%
- WMT24++ In use English-to-55-language translation of WMT24 test data. Scored with automatic metrics such as MetricX or xCOMET.
K-EXAONE 90.5%
- MMLU-ProX In use MMLU-Pro translated into up to 29 languages with expert review. Multiple-choice accuracy per language.
Qwen3.7-Max 87%
- CLIcK In use Models answer 1,995 multiple-choice questions on Korean language and culture. Questions come from official Korean exams and textbooks in eleven categories.
Solar Open 2 90.7%
- Global MMLU Lite 3.0 In use Models answer 400 human-translated MMLU questions per language in 23 languages. Version 3.0 adds Czech, Hungarian, Oriya, Slovak and Tajik and updates Italian. Accuracy. Claude Opus 5 95.7%
- MMMB In use Models answer multiple-choice questions about images in six languages across 15 categories. The set has about 12,000 questions. LFM2.5-VL-3B 83%
Data audit
8 of 9 checks pass, 1 warning. Look first at the Newest score check. The newest came 3 years ago, in March 2023, for ChatGLM-6B. Every benchmark
Catalog record 2 pass
- Pass Task access All tasks are public.
- Pass Confidence Checked against a primary source.
Scores 1 warning 2 pass 2 notes
- Pass Independent runs Scores from the official leaderboard (450 entries).
- Pass Models scored 1 model we track, plus 449 other entries on its leaderboard.
- Warning Newest score The newest came 3 years ago, in March 2023, for ChatGLM-6B.
- Note Frontier models None of its models are on the capabilities index.
- Note Headroom Scored as a plain number, with no fixed ceiling.
Leaderboard import 3 pass
- Pass Importer We read the board on cluebenchmarks.com: 4 rows for models we track and 449 other entries at the last read.
- Pass Last read November 20th, 2026.
- Pass Read worked The last read worked.
Consistency 1 pass 1 note
- Note Lab claims No model has both a lab number and an independent run.
- Pass Known issues No published audit found problems.