Benchmark Almanac

Korean Sarcasm Dataset

ICT-TIME-and-Querit/BOOM_4B_v1 81.9% tops its leaderboard Qwen3-Embedding-8B 62.1% leads the models we track
Not in model cards

Models identify sarcasm in Korean text using labeled examples.

MTEB scores the task using accuracy.

Made by
Kocasm project
Kind
Reading in many languages
Level
Everyday
Scored
Checked automatically
Answers
Prediction
Tasks
All public
Measures
Capability
Language
Korean
In and out
Text → Text
Interaction
Single turn
Refresh
One fixed set
Run by
Anyone
Last model added
October 2026
Scores refreshed
November 21st, 2026
193
Entries on its own leaderboard, 4 models we track

ICT-TIME-and-Querit/BOOM_4B_v1 tops the leaderboard with 81.9% Qwen3-Embedding-8B leads with 62.1% among models released by October 2026

Best score per entry from the benchmark's own leaderboard, read on November 21st, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. The best model we track is Qwen3-Embedding-8B, at 62.1%. This view shows only models we track, each at its best.

The newest model with a score here came out in October 2026, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:

193 entries. Scroll sideways for the rest.

  1. 81.9 ICT-TIME-and-Querit/BOOM_4B_v1
  2. 76.3 ICT-TIME-and-Querit/ICT-TIME-and-Querit-embedding-v1
  3. 71.1 microsoft/harrier-oss-v1-27b
  4. 68.1 microsoft/harrier-oss-v1-0.6b
  5. 64.8 tencent/KaLM-Embedding-Gemma3-12B-2511
  6. 63.9 nvidia/llama-embed-nemotron-8b
  7. 62.1 Qwen3-Embedding-8B
  8. 61.1 Qwen3-Embedding-4B
  9. 61.1 codefuse-ai/F2LLM-v2-8B
  10. 60.5 google/gemini-embedding-001
  11. 59.7 GritLM/GritLM-7B
  12. 59.7 Alibaba-NLP/gte-Qwen2-7B-instruct
  13. 59.7 Octen/Octen-Embedding-8B
  14. 59.5 zeroentropy/zembed-1
  15. 59.4 openai/text-embedding-3-small
  16. 59.4 Linq-AI-Research/Linq-Embed-Mistral
  17. 59.4 openai/text-embedding-3-large
  18. 58.9 codefuse-ai/F2LLM-v2-14B
  19. 58.8 GritLM/GritLM-8x7B
  20. 58.5 ai-sage/Giga-Embeddings-instruct-10B-A1.8B-0826
  21. 58.5 BidirLM/BidirLM-Omni-2.5B-Embedding
  22. 58.5 BidirLM/BidirLM-1B-Embedding
  23. 58.4 Snowflake/snowflake-arctic-embed-l-v2.0
  24. 58.2 google/text-multilingual-embedding-002
  25. 58.2 intfloat/multilingual-e5-large-instruct
  26. 58.1 codefuse-ai/F2LLM-v2-4B
  27. 58.1 google/embeddinggemma-300m
  28. 57.9 mongodb/voyage-3-lite
  29. 57.8 EmbeddingGemma 2
  30. 57.6 mongodb/voyage-large-2-instruct
  31. 57.6 Salesforce/SFR-Embedding-Mistral
  32. 57.4 BidirLM/BidirLM-1.7B-Embedding
  33. 57.4 OrdalieTech/Solon-embeddings-large-0.1
  34. 57.4 ai-sage/Giga-Embeddings-instruct-3B-0826
  35. 57.3 mongodb/voyage-3.5
  36. 57.3 mongodb/voyage-3
  37. 57.1 Lajavaness/bilingual-embedding-large
  38. 57.1 Lajavaness/bilingual-embedding-base
  39. 57.0 intfloat/e5-mistral-7b-instruct
  40. 57.0 codefuse-ai/F2LLM-v2-1.7B
  41. 57.0 mongodb/voyage-multilingual-2
  42. 57.0 omarelshehy/arabic-english-sts-matryoshka
  43. 56.9 Omartificial-Intelligence-Space/Arabic-labse-Matryoshka
  44. 56.8 intfloat/multilingual-e5-large
  45. 56.7 BAAI/bge-m3
  46. 56.7 Omartificial-Intelligence-Space/Arabic-MiniLM-L12-v2-all-nli-triplet
  47. 56.6 manu/bge-m3-custom-fr
  48. 56.6 Lajavaness/bilingual-embedding-small
  49. 56.5 Cohere/Cohere-embed-multilingual-v3.0
  50. 56.4 nvidia/NV-Embed-v2
  51. 56.3 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-supervised
  52. 56.3 Alibaba-NLP/gte-Qwen2-1.5B-instruct
  53. 56.2 codefuse-ai/F2LLM-v2-0.6B
  54. 56.2 jinaai/jina-embeddings-v3
  55. 56.1 sentence-transformers/LaBSE
  56. 56.0 Jaume/gemma-2b-embeddings
  57. 55.9 Qwen3-Embedding-0.6B
  58. 55.8 Salesforce/SFR-Embedding-2_R
  59. 55.8 microsoft/harrier-oss-v1-270m
  60. 55.7 Alibaba-NLP/gte-Qwen1.5-7B-instruct
  61. 55.7 sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2
  62. 55.6 ai-forever/sbert_large_mt_nlu_ru
  63. 55.6 sentence-transformers/paraphrase-multilingual-mpnet-base-v2
  64. 55.5 Cohere/Cohere-embed-multilingual-light-v3.0
  65. 55.5 hotchpotch/bekko-embedding-v1-a25m
  66. 55.4 Snowflake/snowflake-arctic-embed-m-v1.5
  67. 55.4 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-unsup-simcse
  68. 55.3 codefuse-ai/F2LLM-v2-330M
  69. 55.3 minishlab/M2V_base_glove
  70. 55.3 Haon-Chen/speed-embedding-7b-instruct
  71. 55.2 jinaai/jina-embeddings-v5-omni-small
  72. 55.2 jinaai/jina-embeddings-v5-text-small
  73. 55.2 BidirLM/BidirLM-0.6B-Embedding
  74. 55.1 ai-forever/ru-en-RoSBERTa
  75. 55.1 consciousAI/cai-lunaris-text-embeddings
  76. 55.1 intfloat/multilingual-e5-small
  77. 55.1 Bytedance/Seed1.6-embedding-1215
  78. 55.0 DeepPavlov/rubert-base-cased-sentence
  79. 55.0 Snowflake/snowflake-arctic-embed-m-v2.0
  80. 55.0 Omartificial-Intelligence-Space/Arabert-all-nli-triplet-Matryoshka
  81. 54.9 Alibaba-NLP/gte-multilingual-base
  82. 54.9 HIT-TMG/KaLM-embedding-multilingual-mini-v1
  83. 54.9 nvidia/NV-Embed-v1
  84. 54.8 nomic-ai/nomic-embed-text-v1
  85. 54.8 ibm-granite/granite-embedding-311m-multilingual-r2
  86. 54.8 mixedbread-ai/mxbai-embed-large-v1
  87. 54.8 NovaSearch/stella_en_400M_v5
  88. 54.7 intfloat/multilingual-e5-base
  89. 54.7 nomic-ai/nomic-embed-text-v2-moe
  90. 54.7 cointegrated/LaBSE-en-ru
  91. 54.6 cointegrated/rubert-tiny2
  92. 54.6 BidirLM/BidirLM-270M-Embedding
  93. 54.6 Cohere/Cohere-embed-english-light-v3.0
  94. 54.6 Mihaiii/gte-micro-v4
  95. 54.6 hotchpotch/bekko-embedding-v1-a8m
  96. 54.6 nomic-ai/nomic-embed-text-v1.5
  97. 54.6 HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1
  98. 54.6 minishlab/potion-multilingual-128M
  99. 54.6 intfloat/e5-base
  100. 54.5 Gameselo/STS-multilingual-mpnet-base-v2
  101. 54.5 intfloat/e5-small
  102. 54.5 ai-forever/sbert_large_nlu_ru
  103. 54.5 Omartificial-Intelligence-Space/Arabic-all-nli-triplet-Matryoshka
  104. 54.5 DeepPavlov/distilrubert-small-cased-conversational
  105. 54.4 avsolatorio/GIST-all-MiniLM-L6-v2
  106. 54.4 cnmoro/static-nomic-384-pten-v2-st
  107. 54.4 WhereIsAI/UAE-Large-V1
  108. 54.4 hotchpotch/bekko-static-embedding-v1
  109. 54.4 sentence-transformers/all-MiniLM-L12-v2
  110. 54.4 Mihaiii/Ivysaur
  111. 54.2 deepfile/embedder-100p
  112. 54.2 intfloat/e5-small-v2
  113. 54.1 cointegrated/rubert-tiny
  114. 54.1 sentence-transformers/all-mpnet-base-v2
  115. 54.1 ibm-granite/granite-embedding-278m-multilingual
  116. 54.0 deepvk/USER-base
  117. 54.0 dwzhu/e5-base-4k
  118. 53.9 ibm-granite/granite-embedding-125m-english
  119. 53.9 nomic-ai/nomic-embed-text-v1-ablated
  120. 53.8 NovaSearch/stella_en_1.5B_v5
  121. 53.8 shibing624/text2vec-base-multilingual
  122. 53.7 brahmairesearch/slx-v0.1
  123. 53.7 sentence-transformers/all-MiniLM-L6-v2
  124. 53.7 izhx/udever-bloom-7b1
  125. 53.7 sdadas/mmlw-e5-large
  126. 53.7 avsolatorio/NoInstruct-small-Embedding-v0
  127. 53.7 jinaai/jina-embeddings-v5-omni-nano
  128. 53.7 jinaai/jina-embeddings-v5-text-nano
  129. 53.7 izhx/udever-bloom-3b
  130. 53.7 ibm-granite/granite-embedding-97m-multilingual-r2
  131. 53.6 thenlper/gte-small
  132. 53.6 codefuse-ai/F2LLM-v2-160M
  133. 53.5 ibm-granite/granite-embedding-107m-multilingual
  134. 53.5 Mihaiii/Bulbasaur
  135. 53.5 sentence-transformers/static-similarity-mrl-multilingual-v1
  136. 53.4 aari1995/German_Semantic_STS_V2
  137. 53.4 intfloat/e5-large-v2
  138. 53.4 ibm-granite/granite-embedding-30m-english
  139. 53.4 sergeyzh/rubert-tiny-turbo
  140. 53.3 codefuse-ai/F2LLM-v2-80M
  141. 53.2 intfloat/e5-large
  142. 53.2 avsolatorio/GIST-small-Embedding-v0
  143. 53.2 Mihaiii/Venusaur
  144. 53.1 DeepPavlov/rubert-base-cased
  145. 53.1 abhinand/MedEmbed-small-v0.1
  146. 53.1 Omartificial-Intelligence-Space/Marbert-all-nli-triplet-Matryoshka
  147. 53.1 BAAI/bge-small-en-v1.5
  148. 53.1 BAAI/bge-large-en-v1.5
  149. 53.1 nomic-ai/nomic-embed-text-v1-unsupervised
  150. 53.1 Snowflake/snowflake-arctic-embed-xs
  151. 53.0 NovaSearch/jasper_en_vision_language_v1
  152. 53.0 thenlper/gte-large
  153. 53.0 bigscience/sgpt-bloom-7b1-msmarco
  154. 53.0 sdadas/mmlw-e5-base
  155. 53.0 silma-ai/silma-embeddding-matryoshka-v0.1
  156. 53.0 sergeyzh/LaBSE-ru-turbo
  157. 52.9 manu/sentence_croissant_alpha_v0.2
  158. 52.9 Snowflake/snowflake-arctic-embed-m
  159. 52.8 sdadas/mmlw-e5-small
  160. 52.8 jinaai/jina-embeddings-v2-small-en
  161. 52.8 Cohere/Cohere-embed-english-v3.0
  162. 52.7 izhx/udever-bloom-1b1
  163. 52.7 intfloat/e5-base-v2
  164. 52.6 sdadas/mmlw-roberta-base
  165. 52.5 thenlper/gte-base
  166. 52.5 Snowflake/snowflake-arctic-embed-l
  167. 52.5 deepvk/deberta-v1-base
  168. 52.4 avsolatorio/GIST-large-Embedding-v0
  169. 52.4 sdadas/mmlw-roberta-large
  170. 52.4 Snowflake/snowflake-arctic-embed-s
  171. 52.4 Mihaiii/gte-micro
  172. 52.3 infgrad/stella-base-en-v2
  173. 52.3 Mihaiii/Wartortle
  174. 52.2 deepvk/USER-bge-m3
  175. 52.1 manu/sentence_croissant_alpha_v0.4
  176. 52.0 izhx/udever-bloom-560m
  177. 52.0 manu/sentence_croissant_alpha_v0.3
  178. 52.0 Omartificial-Intelligence-Space/Arabic-mpnet-base-all-nli-triplet
  179. 52.0 minishlab/potion-base-8M
  180. 51.9 BAAI/bge-base-en-v1.5
  181. 51.8 avsolatorio/GIST-Embedding-v0
  182. 51.8 minishlab/potion-base-4M
  183. 51.6 minishlab/M2V_base_output
  184. 51.5 Snowflake/snowflake-arctic-embed-m-long
  185. 51.5 malenia1/ternary-weight-embedding
  186. 51.5 minishlab/potion-base-2M
  187. 51.5 minishlab/M2V_base_glove_subword
  188. 51.1 Mihaiii/Squirtle
  189. 50.9 jinaai/jina-embedding-b-en-v1
  190. 50.8 Hum-Works/lodestone-base-4096-v1
  191. 50.4 mteb/baseline-random-encoder
  192. 50.3 jinaai/jina-embeddings-v2-base-en
  193. 49.8 jinaai/jina-embedding-s-en-v1
  1. 1 ICT-TIME-and-Querit/BOOM_4B_v1 81.9%
  2. 2 ICT-TIME-and-Querit/ICT-TIME-and-Querit-embedding-v1 76.3%
  3. 3 microsoft/harrier-oss-v1-27b 71.1%
  4. 4 microsoft/harrier-oss-v1-0.6b 68.1%
  5. 5 tencent/KaLM-Embedding-Gemma3-12B-2511 64.8%
  6. 6 nvidia/llama-embed-nemotron-8b 63.9%
  7. 7 Qwen3-Embedding-8B 62.1%
  8. 8 Qwen3-Embedding-4B 61.1%
  9. 9 codefuse-ai/F2LLM-v2-8B 61.1%
  10. 10 google/gemini-embedding-001 60.5%
  11. 11 GritLM/GritLM-7B 59.7%
  12. 12 Alibaba-NLP/gte-Qwen2-7B-instruct 59.7%
  13. 13 Octen/Octen-Embedding-8B 59.7%
  14. 14 zeroentropy/zembed-1 59.5%
  15. 15 openai/text-embedding-3-small 59.4%
  16. 16 Linq-AI-Research/Linq-Embed-Mistral 59.4%
  17. 17 openai/text-embedding-3-large 59.4%
  18. 18 codefuse-ai/F2LLM-v2-14B 58.9%
  19. 19 GritLM/GritLM-8x7B 58.8%
  20. 20 ai-sage/Giga-Embeddings-instruct-10B-A1.8B-0826 58.5%
  21. 21 BidirLM/BidirLM-Omni-2.5B-Embedding 58.5%
  22. 22 BidirLM/BidirLM-1B-Embedding 58.5%
  23. 23 Snowflake/snowflake-arctic-embed-l-v2.0 58.4%
  24. 24 google/text-multilingual-embedding-002 58.2%
  25. 25 intfloat/multilingual-e5-large-instruct 58.2%
  26. 26 codefuse-ai/F2LLM-v2-4B 58.1%
  27. 27 google/embeddinggemma-300m 58.1%
  28. 28 mongodb/voyage-3-lite 57.9%
  29. 29 EmbeddingGemma 2 57.8%
  30. 30 mongodb/voyage-large-2-instruct 57.6%
  31. 31 Salesforce/SFR-Embedding-Mistral 57.6%
  32. 32 BidirLM/BidirLM-1.7B-Embedding 57.4%
  33. 33 OrdalieTech/Solon-embeddings-large-0.1 57.4%
  34. 34 ai-sage/Giga-Embeddings-instruct-3B-0826 57.4%
  35. 35 mongodb/voyage-3.5 57.3%
  36. 36 mongodb/voyage-3 57.3%
  37. 37 Lajavaness/bilingual-embedding-large 57.1%
  38. 38 Lajavaness/bilingual-embedding-base 57.1%
  39. 39 intfloat/e5-mistral-7b-instruct 57%
  40. 40 codefuse-ai/F2LLM-v2-1.7B 57%
  41. 41 mongodb/voyage-multilingual-2 57%
  42. 42 omarelshehy/arabic-english-sts-matryoshka 57%
  43. 43 Omartificial-Intelligence-Space/Arabic-labse-Matryoshka 56.9%
  44. 44 intfloat/multilingual-e5-large 56.8%
  45. 45 BAAI/bge-m3 56.7%
  46. 46 Omartificial-Intelligence-Space/Arabic-MiniLM-L12-v2-all-nli-triplet 56.7%
  47. 47 manu/bge-m3-custom-fr 56.6%
  48. 48 Lajavaness/bilingual-embedding-small 56.6%
  49. 49 Cohere/Cohere-embed-multilingual-v3.0 56.5%
  50. 50 nvidia/NV-Embed-v2 56.4%
  51. 51 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-supervised 56.3%
  52. 52 Alibaba-NLP/gte-Qwen2-1.5B-instruct 56.3%
  53. 53 codefuse-ai/F2LLM-v2-0.6B 56.2%
  54. 54 jinaai/jina-embeddings-v3 56.2%
  55. 55 sentence-transformers/LaBSE 56.1%
  56. 56 Jaume/gemma-2b-embeddings 56%
  57. 57 Qwen3-Embedding-0.6B 55.9%
  58. 58 Salesforce/SFR-Embedding-2_R 55.8%
  59. 59 microsoft/harrier-oss-v1-270m 55.8%
  60. 60 Alibaba-NLP/gte-Qwen1.5-7B-instruct 55.7%
  61. 61 sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 55.7%
  62. 62 ai-forever/sbert_large_mt_nlu_ru 55.6%
  63. 63 sentence-transformers/paraphrase-multilingual-mpnet-base-v2 55.6%
  64. 64 Cohere/Cohere-embed-multilingual-light-v3.0 55.5%
  65. 65 hotchpotch/bekko-embedding-v1-a25m 55.5%
  66. 66 Snowflake/snowflake-arctic-embed-m-v1.5 55.4%
  67. 67 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-unsup-simcse 55.4%
  68. 68 codefuse-ai/F2LLM-v2-330M 55.3%
  69. 69 minishlab/M2V_base_glove 55.3%
  70. 70 Haon-Chen/speed-embedding-7b-instruct 55.3%
  71. 71 jinaai/jina-embeddings-v5-omni-small 55.2%
  72. 72 jinaai/jina-embeddings-v5-text-small 55.2%
  73. 73 BidirLM/BidirLM-0.6B-Embedding 55.2%
  74. 74 ai-forever/ru-en-RoSBERTa 55.1%
  75. 75 consciousAI/cai-lunaris-text-embeddings 55.1%
  76. 76 intfloat/multilingual-e5-small 55.1%
  77. 77 Bytedance/Seed1.6-embedding-1215 55.1%
  78. 78 DeepPavlov/rubert-base-cased-sentence 55%
  79. 79 Snowflake/snowflake-arctic-embed-m-v2.0 55%
  80. 80 Omartificial-Intelligence-Space/Arabert-all-nli-triplet-Matryoshka 55%
  81. 81 Alibaba-NLP/gte-multilingual-base 54.9%
  82. 82 HIT-TMG/KaLM-embedding-multilingual-mini-v1 54.9%
  83. 83 nvidia/NV-Embed-v1 54.9%
  84. 84 nomic-ai/nomic-embed-text-v1 54.8%
  85. 85 ibm-granite/granite-embedding-311m-multilingual-r2 54.8%
  86. 86 mixedbread-ai/mxbai-embed-large-v1 54.8%
  87. 87 NovaSearch/stella_en_400M_v5 54.8%
  88. 88 intfloat/multilingual-e5-base 54.7%
  89. 89 nomic-ai/nomic-embed-text-v2-moe 54.7%
  90. 90 cointegrated/LaBSE-en-ru 54.7%
  91. 91 cointegrated/rubert-tiny2 54.6%
  92. 92 BidirLM/BidirLM-270M-Embedding 54.6%
  93. 93 Cohere/Cohere-embed-english-light-v3.0 54.6%
  94. 94 Mihaiii/gte-micro-v4 54.6%
  95. 95 hotchpotch/bekko-embedding-v1-a8m 54.6%
  96. 96 nomic-ai/nomic-embed-text-v1.5 54.6%
  97. 97 HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1 54.6%
  98. 98 minishlab/potion-multilingual-128M 54.6%
  99. 99 intfloat/e5-base 54.6%
  100. 100 Gameselo/STS-multilingual-mpnet-base-v2 54.5%
  101. 101 intfloat/e5-small 54.5%
  102. 102 ai-forever/sbert_large_nlu_ru 54.5%
  103. 103 Omartificial-Intelligence-Space/Arabic-all-nli-triplet-Matryoshka 54.5%
  104. 104 DeepPavlov/distilrubert-small-cased-conversational 54.5%
  105. 105 avsolatorio/GIST-all-MiniLM-L6-v2 54.4%
  106. 106 cnmoro/static-nomic-384-pten-v2-st 54.4%
  107. 107 WhereIsAI/UAE-Large-V1 54.4%
  108. 108 hotchpotch/bekko-static-embedding-v1 54.4%
  109. 109 sentence-transformers/all-MiniLM-L12-v2 54.4%
  110. 110 Mihaiii/Ivysaur 54.4%
  111. 111 deepfile/embedder-100p 54.2%
  112. 112 intfloat/e5-small-v2 54.2%
  113. 113 cointegrated/rubert-tiny 54.1%
  114. 114 sentence-transformers/all-mpnet-base-v2 54.1%
  115. 115 ibm-granite/granite-embedding-278m-multilingual 54.1%
  116. 116 deepvk/USER-base 54%
  117. 117 dwzhu/e5-base-4k 54%
  118. 118 ibm-granite/granite-embedding-125m-english 53.9%
  119. 119 nomic-ai/nomic-embed-text-v1-ablated 53.9%
  120. 120 NovaSearch/stella_en_1.5B_v5 53.8%
  121. 121 shibing624/text2vec-base-multilingual 53.8%
  122. 122 brahmairesearch/slx-v0.1 53.7%
  123. 123 sentence-transformers/all-MiniLM-L6-v2 53.7%
  124. 124 izhx/udever-bloom-7b1 53.7%
  125. 125 sdadas/mmlw-e5-large 53.7%
  126. 126 avsolatorio/NoInstruct-small-Embedding-v0 53.7%
  127. 127 jinaai/jina-embeddings-v5-omni-nano 53.7%
  128. 128 jinaai/jina-embeddings-v5-text-nano 53.7%
  129. 129 izhx/udever-bloom-3b 53.7%
  130. 130 ibm-granite/granite-embedding-97m-multilingual-r2 53.7%
  131. 131 thenlper/gte-small 53.6%
  132. 132 codefuse-ai/F2LLM-v2-160M 53.6%
  133. 133 ibm-granite/granite-embedding-107m-multilingual 53.5%
  134. 134 Mihaiii/Bulbasaur 53.5%
  135. 135 sentence-transformers/static-similarity-mrl-multilingual-v1 53.5%
  136. 136 aari1995/German_Semantic_STS_V2 53.4%
  137. 137 intfloat/e5-large-v2 53.4%
  138. 138 ibm-granite/granite-embedding-30m-english 53.4%
  139. 139 sergeyzh/rubert-tiny-turbo 53.4%
  140. 140 codefuse-ai/F2LLM-v2-80M 53.3%
  141. 141 intfloat/e5-large 53.2%
  142. 142 avsolatorio/GIST-small-Embedding-v0 53.2%
  143. 143 Mihaiii/Venusaur 53.2%
  144. 144 DeepPavlov/rubert-base-cased 53.1%
  145. 145 abhinand/MedEmbed-small-v0.1 53.1%
  146. 146 Omartificial-Intelligence-Space/Marbert-all-nli-triplet-Matryoshka 53.1%
  147. 147 BAAI/bge-small-en-v1.5 53.1%
  148. 148 BAAI/bge-large-en-v1.5 53.1%
  149. 149 nomic-ai/nomic-embed-text-v1-unsupervised 53.1%
  150. 150 Snowflake/snowflake-arctic-embed-xs 53.1%
  151. 151 NovaSearch/jasper_en_vision_language_v1 53%
  152. 152 thenlper/gte-large 53%
  153. 153 bigscience/sgpt-bloom-7b1-msmarco 53%
  154. 154 sdadas/mmlw-e5-base 53%
  155. 155 silma-ai/silma-embeddding-matryoshka-v0.1 53%
  156. 156 sergeyzh/LaBSE-ru-turbo 53%
  157. 157 manu/sentence_croissant_alpha_v0.2 52.9%
  158. 158 Snowflake/snowflake-arctic-embed-m 52.9%
  159. 159 sdadas/mmlw-e5-small 52.8%
  160. 160 jinaai/jina-embeddings-v2-small-en 52.8%
  161. 161 Cohere/Cohere-embed-english-v3.0 52.8%
  162. 162 izhx/udever-bloom-1b1 52.7%
  163. 163 intfloat/e5-base-v2 52.7%
  164. 164 sdadas/mmlw-roberta-base 52.6%
  165. 165 thenlper/gte-base 52.5%
  166. 166 Snowflake/snowflake-arctic-embed-l 52.5%
  167. 167 deepvk/deberta-v1-base 52.5%
  168. 168 avsolatorio/GIST-large-Embedding-v0 52.4%
  169. 169 sdadas/mmlw-roberta-large 52.4%
  170. 170 Snowflake/snowflake-arctic-embed-s 52.4%
  171. 171 Mihaiii/gte-micro 52.4%
  172. 172 infgrad/stella-base-en-v2 52.3%
  173. 173 Mihaiii/Wartortle 52.3%
  174. 174 deepvk/USER-bge-m3 52.2%
  175. 175 manu/sentence_croissant_alpha_v0.4 52.1%
  176. 176 izhx/udever-bloom-560m 52%
  177. 177 manu/sentence_croissant_alpha_v0.3 52%
  178. 178 Omartificial-Intelligence-Space/Arabic-mpnet-base-all-nli-triplet 52%
  179. 179 minishlab/potion-base-8M 52%
  180. 180 BAAI/bge-base-en-v1.5 51.9%
  181. 181 avsolatorio/GIST-Embedding-v0 51.8%
  182. 182 minishlab/potion-base-4M 51.8%
  183. 183 minishlab/M2V_base_output 51.6%
  184. 184 Snowflake/snowflake-arctic-embed-m-long 51.5%
  185. 185 malenia1/ternary-weight-embedding 51.5%
  186. 186 minishlab/potion-base-2M 51.5%
  187. 187 minishlab/M2V_base_glove_subword 51.5%
  188. 188 Mihaiii/Squirtle 51.1%
  189. 189 jinaai/jina-embedding-b-en-v1 50.9%
  190. 190 Hum-Works/lodestone-base-4096-v1 50.8%
  191. 191 mteb/baseline-random-encoder 50.4%
  192. 192 jinaai/jina-embeddings-v2-base-en 50.3%
  193. 193 jinaai/jina-embedding-s-en-v1 49.8%

Source: Official Korean Sarcasm Dataset leaderboard

#EntryScoreSettingDateSource
1 ICT-TIME-and-Querit/BOOM_4B_v1 81.9% Official leaderboard
2 ICT-TIME-and-Querit/ICT-TIME-and-Querit-embedding-v1 76.3% Official leaderboard
3 microsoft/harrier-oss-v1-27b 71.1% Official leaderboard
4 microsoft/harrier-oss-v1-0.6b 68.1% Official leaderboard
5 tencent/KaLM-Embedding-Gemma3-12B-2511 64.8% Official leaderboard
6 nvidia/llama-embed-nemotron-8b 63.9% Official leaderboard
7 Qwen3-Embedding-8B 62.1% Jun 2025 Official leaderboard
8 Qwen3-Embedding-4B 61.1% Jun 2025 Official leaderboard
9 codefuse-ai/F2LLM-v2-8B 61.1% Official leaderboard
10 google/gemini-embedding-001 60.5% Official leaderboard
11 GritLM/GritLM-7B 59.7% Official leaderboard
12 Alibaba-NLP/gte-Qwen2-7B-instruct 59.7% Official leaderboard
13 Octen/Octen-Embedding-8B 59.7% Official leaderboard
14 zeroentropy/zembed-1 59.5% Official leaderboard
15 openai/text-embedding-3-small 59.4% Official leaderboard
16 Linq-AI-Research/Linq-Embed-Mistral 59.4% Official leaderboard
17 openai/text-embedding-3-large 59.4% Official leaderboard
18 codefuse-ai/F2LLM-v2-14B 58.9% Official leaderboard
19 GritLM/GritLM-8x7B 58.8% Official leaderboard
20 ai-sage/Giga-Embeddings-instruct-10B-A1.8B-0826 58.5% Official leaderboard
21 BidirLM/BidirLM-Omni-2.5B-Embedding 58.5% Official leaderboard
22 BidirLM/BidirLM-1B-Embedding 58.5% Official leaderboard
23 Snowflake/snowflake-arctic-embed-l-v2.0 58.4% Official leaderboard
24 google/text-multilingual-embedding-002 58.2% Official leaderboard
25 intfloat/multilingual-e5-large-instruct 58.2% Official leaderboard
26 codefuse-ai/F2LLM-v2-4B 58.1% Official leaderboard
27 google/embeddinggemma-300m 58.1% Official leaderboard
28 mongodb/voyage-3-lite 57.9% Official leaderboard
29 EmbeddingGemma 2 57.8% Oct 2026 Official leaderboard
30 mongodb/voyage-large-2-instruct 57.6% Official leaderboard
31 Salesforce/SFR-Embedding-Mistral 57.6% Official leaderboard
32 BidirLM/BidirLM-1.7B-Embedding 57.4% Official leaderboard
33 OrdalieTech/Solon-embeddings-large-0.1 57.4% Official leaderboard
34 ai-sage/Giga-Embeddings-instruct-3B-0826 57.4% Official leaderboard
35 mongodb/voyage-3.5 57.3% Official leaderboard
36 mongodb/voyage-3 57.3% Official leaderboard
37 Lajavaness/bilingual-embedding-large 57.1% Official leaderboard
38 Lajavaness/bilingual-embedding-base 57.1% Official leaderboard
39 intfloat/e5-mistral-7b-instruct 57% Official leaderboard
40 codefuse-ai/F2LLM-v2-1.7B 57% Official leaderboard
41 mongodb/voyage-multilingual-2 57% Official leaderboard
42 omarelshehy/arabic-english-sts-matryoshka 57% Official leaderboard
43 Omartificial-Intelligence-Space/Arabic-labse-Matryoshka 56.9% Official leaderboard
44 intfloat/multilingual-e5-large 56.8% Official leaderboard
45 BAAI/bge-m3 56.7% Official leaderboard
46 Omartificial-Intelligence-Space/Arabic-MiniLM-L12-v2-all-nli-triplet 56.7% Official leaderboard
47 manu/bge-m3-custom-fr 56.6% Official leaderboard
48 Lajavaness/bilingual-embedding-small 56.6% Official leaderboard
49 Cohere/Cohere-embed-multilingual-v3.0 56.5% Official leaderboard
50 nvidia/NV-Embed-v2 56.4% Official leaderboard
51 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-supervised 56.3% Official leaderboard
52 Alibaba-NLP/gte-Qwen2-1.5B-instruct 56.3% Official leaderboard
53 codefuse-ai/F2LLM-v2-0.6B 56.2% Official leaderboard
54 jinaai/jina-embeddings-v3 56.2% Official leaderboard
55 sentence-transformers/LaBSE 56.1% Official leaderboard
56 Jaume/gemma-2b-embeddings 56% Official leaderboard
57 Qwen3-Embedding-0.6B 55.9% Jun 2025 Official leaderboard
58 Salesforce/SFR-Embedding-2_R 55.8% Official leaderboard
59 microsoft/harrier-oss-v1-270m 55.8% Official leaderboard
60 Alibaba-NLP/gte-Qwen1.5-7B-instruct 55.7% Official leaderboard
61 sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 55.7% Official leaderboard
62 ai-forever/sbert_large_mt_nlu_ru 55.6% Official leaderboard
63 sentence-transformers/paraphrase-multilingual-mpnet-base-v2 55.6% Official leaderboard
64 Cohere/Cohere-embed-multilingual-light-v3.0 55.5% Official leaderboard
65 hotchpotch/bekko-embedding-v1-a25m 55.5% Official leaderboard
66 Snowflake/snowflake-arctic-embed-m-v1.5 55.4% Official leaderboard
67 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-unsup-simcse 55.4% Official leaderboard
68 codefuse-ai/F2LLM-v2-330M 55.3% Official leaderboard
69 minishlab/M2V_base_glove 55.3% Official leaderboard
70 Haon-Chen/speed-embedding-7b-instruct 55.3% Official leaderboard
71 jinaai/jina-embeddings-v5-omni-small 55.2% Official leaderboard
72 jinaai/jina-embeddings-v5-text-small 55.2% Official leaderboard
73 BidirLM/BidirLM-0.6B-Embedding 55.2% Official leaderboard
74 ai-forever/ru-en-RoSBERTa 55.1% Official leaderboard
75 consciousAI/cai-lunaris-text-embeddings 55.1% Official leaderboard
76 intfloat/multilingual-e5-small 55.1% Official leaderboard
77 Bytedance/Seed1.6-embedding-1215 55.1% Official leaderboard
78 DeepPavlov/rubert-base-cased-sentence 55% Official leaderboard
79 Snowflake/snowflake-arctic-embed-m-v2.0 55% Official leaderboard
80 Omartificial-Intelligence-Space/Arabert-all-nli-triplet-Matryoshka 55% Official leaderboard
81 Alibaba-NLP/gte-multilingual-base 54.9% Official leaderboard
82 HIT-TMG/KaLM-embedding-multilingual-mini-v1 54.9% Official leaderboard
83 nvidia/NV-Embed-v1 54.9% Official leaderboard
84 nomic-ai/nomic-embed-text-v1 54.8% Official leaderboard
85 ibm-granite/granite-embedding-311m-multilingual-r2 54.8% Official leaderboard
86 mixedbread-ai/mxbai-embed-large-v1 54.8% Official leaderboard
87 NovaSearch/stella_en_400M_v5 54.8% Official leaderboard
88 intfloat/multilingual-e5-base 54.7% Official leaderboard
89 nomic-ai/nomic-embed-text-v2-moe 54.7% Official leaderboard
90 cointegrated/LaBSE-en-ru 54.7% Official leaderboard
91 cointegrated/rubert-tiny2 54.6% Official leaderboard
92 BidirLM/BidirLM-270M-Embedding 54.6% Official leaderboard
93 Cohere/Cohere-embed-english-light-v3.0 54.6% Official leaderboard
94 Mihaiii/gte-micro-v4 54.6% Official leaderboard
95 hotchpotch/bekko-embedding-v1-a8m 54.6% Official leaderboard
96 nomic-ai/nomic-embed-text-v1.5 54.6% Official leaderboard
97 HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1 54.6% Official leaderboard
98 minishlab/potion-multilingual-128M 54.6% Official leaderboard
99 intfloat/e5-base 54.6% Official leaderboard
100 Gameselo/STS-multilingual-mpnet-base-v2 54.5% Official leaderboard
101 intfloat/e5-small 54.5% Official leaderboard
102 ai-forever/sbert_large_nlu_ru 54.5% Official leaderboard
103 Omartificial-Intelligence-Space/Arabic-all-nli-triplet-Matryoshka 54.5% Official leaderboard
104 DeepPavlov/distilrubert-small-cased-conversational 54.5% Official leaderboard
105 avsolatorio/GIST-all-MiniLM-L6-v2 54.4% Official leaderboard
106 cnmoro/static-nomic-384-pten-v2-st 54.4% Official leaderboard
107 WhereIsAI/UAE-Large-V1 54.4% Official leaderboard
108 hotchpotch/bekko-static-embedding-v1 54.4% Official leaderboard
109 sentence-transformers/all-MiniLM-L12-v2 54.4% Official leaderboard
110 Mihaiii/Ivysaur 54.4% Official leaderboard
111 deepfile/embedder-100p 54.2% Official leaderboard
112 intfloat/e5-small-v2 54.2% Official leaderboard
113 cointegrated/rubert-tiny 54.1% Official leaderboard
114 sentence-transformers/all-mpnet-base-v2 54.1% Official leaderboard
115 ibm-granite/granite-embedding-278m-multilingual 54.1% Official leaderboard
116 deepvk/USER-base 54% Official leaderboard
117 dwzhu/e5-base-4k 54% Official leaderboard
118 ibm-granite/granite-embedding-125m-english 53.9% Official leaderboard
119 nomic-ai/nomic-embed-text-v1-ablated 53.9% Official leaderboard
120 NovaSearch/stella_en_1.5B_v5 53.8% Official leaderboard
121 shibing624/text2vec-base-multilingual 53.8% Official leaderboard
122 brahmairesearch/slx-v0.1 53.7% Official leaderboard
123 sentence-transformers/all-MiniLM-L6-v2 53.7% Official leaderboard
124 izhx/udever-bloom-7b1 53.7% Official leaderboard
125 sdadas/mmlw-e5-large 53.7% Official leaderboard
126 avsolatorio/NoInstruct-small-Embedding-v0 53.7% Official leaderboard
127 jinaai/jina-embeddings-v5-omni-nano 53.7% Official leaderboard
128 jinaai/jina-embeddings-v5-text-nano 53.7% Official leaderboard
129 izhx/udever-bloom-3b 53.7% Official leaderboard
130 ibm-granite/granite-embedding-97m-multilingual-r2 53.7% Official leaderboard
131 thenlper/gte-small 53.6% Official leaderboard
132 codefuse-ai/F2LLM-v2-160M 53.6% Official leaderboard
133 ibm-granite/granite-embedding-107m-multilingual 53.5% Official leaderboard
134 Mihaiii/Bulbasaur 53.5% Official leaderboard
135 sentence-transformers/static-similarity-mrl-multilingual-v1 53.5% Official leaderboard
136 aari1995/German_Semantic_STS_V2 53.4% Official leaderboard
137 intfloat/e5-large-v2 53.4% Official leaderboard
138 ibm-granite/granite-embedding-30m-english 53.4% Official leaderboard
139 sergeyzh/rubert-tiny-turbo 53.4% Official leaderboard
140 codefuse-ai/F2LLM-v2-80M 53.3% Official leaderboard
141 intfloat/e5-large 53.2% Official leaderboard
142 avsolatorio/GIST-small-Embedding-v0 53.2% Official leaderboard
143 Mihaiii/Venusaur 53.2% Official leaderboard
144 DeepPavlov/rubert-base-cased 53.1% Official leaderboard
145 abhinand/MedEmbed-small-v0.1 53.1% Official leaderboard
146 Omartificial-Intelligence-Space/Marbert-all-nli-triplet-Matryoshka 53.1% Official leaderboard
147 BAAI/bge-small-en-v1.5 53.1% Official leaderboard
148 BAAI/bge-large-en-v1.5 53.1% Official leaderboard
149 nomic-ai/nomic-embed-text-v1-unsupervised 53.1% Official leaderboard
150 Snowflake/snowflake-arctic-embed-xs 53.1% Official leaderboard
151 NovaSearch/jasper_en_vision_language_v1 53% Official leaderboard
152 thenlper/gte-large 53% Official leaderboard
153 bigscience/sgpt-bloom-7b1-msmarco 53% Official leaderboard
154 sdadas/mmlw-e5-base 53% Official leaderboard
155 silma-ai/silma-embeddding-matryoshka-v0.1 53% Official leaderboard
156 sergeyzh/LaBSE-ru-turbo 53% Official leaderboard
157 manu/sentence_croissant_alpha_v0.2 52.9% Official leaderboard
158 Snowflake/snowflake-arctic-embed-m 52.9% Official leaderboard
159 sdadas/mmlw-e5-small 52.8% Official leaderboard
160 jinaai/jina-embeddings-v2-small-en 52.8% Official leaderboard
161 Cohere/Cohere-embed-english-v3.0 52.8% Official leaderboard
162 izhx/udever-bloom-1b1 52.7% Official leaderboard
163 intfloat/e5-base-v2 52.7% Official leaderboard
164 sdadas/mmlw-roberta-base 52.6% Official leaderboard
165 thenlper/gte-base 52.5% Official leaderboard
166 Snowflake/snowflake-arctic-embed-l 52.5% Official leaderboard
167 deepvk/deberta-v1-base 52.5% Official leaderboard
168 avsolatorio/GIST-large-Embedding-v0 52.4% Official leaderboard
169 sdadas/mmlw-roberta-large 52.4% Official leaderboard
170 Snowflake/snowflake-arctic-embed-s 52.4% Official leaderboard
171 Mihaiii/gte-micro 52.4% Official leaderboard
172 infgrad/stella-base-en-v2 52.3% Official leaderboard
173 Mihaiii/Wartortle 52.3% Official leaderboard
174 deepvk/USER-bge-m3 52.2% Official leaderboard
175 manu/sentence_croissant_alpha_v0.4 52.1% Official leaderboard
176 izhx/udever-bloom-560m 52% Official leaderboard
177 manu/sentence_croissant_alpha_v0.3 52% Official leaderboard
178 Omartificial-Intelligence-Space/Arabic-mpnet-base-all-nli-triplet 52% Official leaderboard
179 minishlab/potion-base-8M 52% Official leaderboard
180 BAAI/bge-base-en-v1.5 51.9% Official leaderboard
181 avsolatorio/GIST-Embedding-v0 51.8% Official leaderboard
182 minishlab/potion-base-4M 51.8% Official leaderboard
183 minishlab/M2V_base_output 51.6% Official leaderboard
184 Snowflake/snowflake-arctic-embed-m-long 51.5% Official leaderboard
185 malenia1/ternary-weight-embedding 51.5% Official leaderboard
186 minishlab/potion-base-2M 51.5% Official leaderboard
187 minishlab/M2V_base_glove_subword 51.5% Official leaderboard
188 Mihaiii/Squirtle 51.1% Official leaderboard
189 jinaai/jina-embedding-b-en-v1 50.9% Official leaderboard
190 Hum-Works/lodestone-base-4096-v1 50.8% Official leaderboard
191 mteb/baseline-random-encoder 50.4% Official leaderboard
192 jinaai/jina-embeddings-v2-base-en 50.3% Official leaderboard
193 jinaai/jina-embedding-s-en-v1 49.8% Official leaderboard
#ModelScoreSettingDateSource
1 Qwen3-Embedding-8B 62.1% Jun 2025 Official leaderboard
2 Qwen3-Embedding-4B 61.1% Jun 2025 Official leaderboard
3 EmbeddingGemma 2 57.8% Oct 2026 Official leaderboard
4 Qwen3-Embedding-0.6B 55.9% Jun 2025 Official leaderboard

Number one over time

Lab claims count from the day the card came out, independent runs from the model’s release.

Qwen
Own leaderboard Not tested since Oct 2026

Source: Official Korean Sarcasm Dataset leaderboard

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

Plot with other benchmarks
On the benchmark’s own leaderboard
0% 20% 40% 60% 80% 100% 2025 2026 Near the ceiling (85%) Qwen3-Embedding-8B 0% 20% 40% 60% 80% 100% 2025 2026 Near the ceiling (85%) Qwen3-Embedding-8B

Source: Official Korean Sarcasm Dataset leaderboard

No lab model card reports it yet

We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.

More in Multilingual

All 545 in Multilingual
  • MMMLU In use MMLU professionally translated into 14 languages. Multiple-choice accuracy. Claude Mythos Preview 92.7%
  • WMT24++ In use English-to-55-language translation of WMT24 test data. Scored with automatic metrics such as MetricX or xCOMET. K-EXAONE 90.5%
  • MMLU-ProX In use MMLU-Pro translated into up to 29 languages with expert review. Multiple-choice accuracy per language. Qwen3.7-Max 87%
  • CLIcK In use Models answer 1,995 multiple-choice questions on Korean language and culture. Questions come from official Korean exams and textbooks in eleven categories. Solar Open 2 90.7%
  • Global MMLU Lite 3.0 In use Models answer 400 human-translated MMLU questions per language in 23 languages. Version 3.0 adds Czech, Hungarian, Oriya, Slovak and Tajik and updates Italian. Accuracy. Claude Opus 5 95.7%
  • MMMB In use Models answer multiple-choice questions about images in six languages across 15 categories. The set has about 12,000 questions. LFM2.5-VL-3B 83%

Data audit

All 10 checks pass. Every benchmark

Catalog record 2 pass
  • Pass Task access All tasks are public.
  • Pass Confidence Checked against a primary source.
Scores 4 pass 1 note
  • Pass Independent runs Scores from the official leaderboard (193 entries).
  • Pass Models scored 4 models we track, plus 189 other entries on its leaderboard.
  • Pass Newest score The newest is from October 2026, for EmbeddingGemma 2.
  • Note Frontier models None of its models are on the capabilities index.
  • Pass Headroom The best is 62.1%, under 85%, so it still separates models.
Leaderboard import 3 pass
  • Pass Importer We read the board on huggingface.co: 4 rows for models we track and 189 other entries at the last read.
  • Pass Last read November 21st, 2026.
  • Pass Read worked The last read worked.
Consistency 1 pass 1 note
  • Note Lab claims No model has both a lab number and an independent run.
  • Pass Known issues No published audit found problems.

How we check