Korean Sarcasm Dataset
Models identify sarcasm in Korean text using labeled examples.
MTEB scores the task using accuracy.
- Made by
- Kocasm project
- Kind
- Reading in many languages
- Level
- Everyday
- Scored
- Checked automatically
- Answers
- Prediction
- Tasks
- All public
- Measures
- Capability
- Language
- Korean
- Interaction
- Single turn
- Refresh
- One fixed set
- Run by
- Anyone
- Last model added
- October 2026
- Scores refreshed
- November 21st, 2026
ICT-TIME-and-Querit/BOOM_4B_v1 tops the leaderboard with 81.9% Qwen3-Embedding-8B leads with 62.1% among models released by October 2026
Best score per entry from the benchmark's own leaderboard, read on November 21st, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. The best model we track is Qwen3-Embedding-8B, at 62.1%. This view shows only models we track, each at its best.
The newest model with a score here came out in October 2026, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:
- GPT-6.2 Astra
- Claude Fable 5.2
-
Gemini 4 Carbon
- GPT-6.1 Terra
- and 16 more
- 81.9 ICT-TIME-and-Querit/BOOM_4B_v1
- 76.3 ICT-TIME-and-Querit/ICT-TIME-and-Querit-embedding-v1
- 71.1 microsoft/harrier-oss-v1-27b
- 68.1 microsoft/harrier-oss-v1-0.6b
- 64.8 tencent/KaLM-Embedding-Gemma3-12B-2511
- 63.9 nvidia/llama-embed-nemotron-8b
- 62.1
Qwen3-Embedding-8B
- 61.1
Qwen3-Embedding-4B
- 61.1 codefuse-ai/F2LLM-v2-8B
- 60.5 google/gemini-embedding-001
- 59.7 GritLM/GritLM-7B
- 59.7 Alibaba-NLP/gte-Qwen2-7B-instruct
- 59.7 Octen/Octen-Embedding-8B
- 59.5 zeroentropy/zembed-1
- 59.4 openai/text-embedding-3-small
- 59.4 Linq-AI-Research/Linq-Embed-Mistral
- 59.4 openai/text-embedding-3-large
- 58.9 codefuse-ai/F2LLM-v2-14B
- 58.8 GritLM/GritLM-8x7B
- 58.5 ai-sage/Giga-Embeddings-instruct-10B-A1.8B-0826
- 58.5 BidirLM/BidirLM-Omni-2.5B-Embedding
- 58.5 BidirLM/BidirLM-1B-Embedding
- 58.4 Snowflake/snowflake-arctic-embed-l-v2.0
- 58.2 google/text-multilingual-embedding-002
- 58.2 intfloat/multilingual-e5-large-instruct
- 58.1 codefuse-ai/F2LLM-v2-4B
- 58.1 google/embeddinggemma-300m
- 57.9 mongodb/voyage-3-lite
- 57.8
EmbeddingGemma 2
- 57.6 mongodb/voyage-large-2-instruct
- 57.6 Salesforce/SFR-Embedding-Mistral
- 57.4 BidirLM/BidirLM-1.7B-Embedding
- 57.4 OrdalieTech/Solon-embeddings-large-0.1
- 57.4 ai-sage/Giga-Embeddings-instruct-3B-0826
- 57.3 mongodb/voyage-3.5
- 57.3 mongodb/voyage-3
- 57.1 Lajavaness/bilingual-embedding-large
- 57.1 Lajavaness/bilingual-embedding-base
- 57.0 intfloat/e5-mistral-7b-instruct
- 57.0 codefuse-ai/F2LLM-v2-1.7B
- 57.0 mongodb/voyage-multilingual-2
- 57.0 omarelshehy/arabic-english-sts-matryoshka
- 56.9 Omartificial-Intelligence-Space/Arabic-labse-Matryoshka
- 56.8 intfloat/multilingual-e5-large
- 56.7 BAAI/bge-m3
- 56.7 Omartificial-Intelligence-Space/Arabic-MiniLM-L12-v2-all-nli-triplet
- 56.6 manu/bge-m3-custom-fr
- 56.6 Lajavaness/bilingual-embedding-small
- 56.5 Cohere/Cohere-embed-multilingual-v3.0
- 56.4 nvidia/NV-Embed-v2
- 56.3 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-supervised
- 56.3 Alibaba-NLP/gte-Qwen2-1.5B-instruct
- 56.2 codefuse-ai/F2LLM-v2-0.6B
- 56.2 jinaai/jina-embeddings-v3
- 56.1 sentence-transformers/LaBSE
- 56.0 Jaume/gemma-2b-embeddings
- 55.9
Qwen3-Embedding-0.6B
- 55.8 Salesforce/SFR-Embedding-2_R
- 55.8 microsoft/harrier-oss-v1-270m
- 55.7 Alibaba-NLP/gte-Qwen1.5-7B-instruct
- 55.7 sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2
- 55.6 ai-forever/sbert_large_mt_nlu_ru
- 55.6 sentence-transformers/paraphrase-multilingual-mpnet-base-v2
- 55.5 Cohere/Cohere-embed-multilingual-light-v3.0
- 55.5 hotchpotch/bekko-embedding-v1-a25m
- 55.4 Snowflake/snowflake-arctic-embed-m-v1.5
- 55.4 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-unsup-simcse
- 55.3 codefuse-ai/F2LLM-v2-330M
- 55.3 minishlab/M2V_base_glove
- 55.3 Haon-Chen/speed-embedding-7b-instruct
- 55.2 jinaai/jina-embeddings-v5-omni-small
- 55.2 jinaai/jina-embeddings-v5-text-small
- 55.2 BidirLM/BidirLM-0.6B-Embedding
- 55.1 ai-forever/ru-en-RoSBERTa
- 55.1 consciousAI/cai-lunaris-text-embeddings
- 55.1 intfloat/multilingual-e5-small
- 55.1 Bytedance/Seed1.6-embedding-1215
- 55.0 DeepPavlov/rubert-base-cased-sentence
- 55.0 Snowflake/snowflake-arctic-embed-m-v2.0
- 55.0 Omartificial-Intelligence-Space/Arabert-all-nli-triplet-Matryoshka
- 54.9 Alibaba-NLP/gte-multilingual-base
- 54.9 HIT-TMG/KaLM-embedding-multilingual-mini-v1
- 54.9 nvidia/NV-Embed-v1
- 54.8 nomic-ai/nomic-embed-text-v1
- 54.8 ibm-granite/granite-embedding-311m-multilingual-r2
- 54.8 mixedbread-ai/mxbai-embed-large-v1
- 54.8 NovaSearch/stella_en_400M_v5
- 54.7 intfloat/multilingual-e5-base
- 54.7 nomic-ai/nomic-embed-text-v2-moe
- 54.7 cointegrated/LaBSE-en-ru
- 54.6 cointegrated/rubert-tiny2
- 54.6 BidirLM/BidirLM-270M-Embedding
- 54.6 Cohere/Cohere-embed-english-light-v3.0
- 54.6 Mihaiii/gte-micro-v4
- 54.6 hotchpotch/bekko-embedding-v1-a8m
- 54.6 nomic-ai/nomic-embed-text-v1.5
- 54.6 HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1
- 54.6 minishlab/potion-multilingual-128M
- 54.6 intfloat/e5-base
- 54.5 Gameselo/STS-multilingual-mpnet-base-v2
- 54.5 intfloat/e5-small
- 54.5 ai-forever/sbert_large_nlu_ru
- 54.5 Omartificial-Intelligence-Space/Arabic-all-nli-triplet-Matryoshka
- 54.5 DeepPavlov/distilrubert-small-cased-conversational
- 54.4 avsolatorio/GIST-all-MiniLM-L6-v2
- 54.4 cnmoro/static-nomic-384-pten-v2-st
- 54.4 WhereIsAI/UAE-Large-V1
- 54.4 hotchpotch/bekko-static-embedding-v1
- 54.4 sentence-transformers/all-MiniLM-L12-v2
- 54.4 Mihaiii/Ivysaur
- 54.2 deepfile/embedder-100p
- 54.2 intfloat/e5-small-v2
- 54.1 cointegrated/rubert-tiny
- 54.1 sentence-transformers/all-mpnet-base-v2
- 54.1 ibm-granite/granite-embedding-278m-multilingual
- 54.0 deepvk/USER-base
- 54.0 dwzhu/e5-base-4k
- 53.9 ibm-granite/granite-embedding-125m-english
- 53.9 nomic-ai/nomic-embed-text-v1-ablated
- 53.8 NovaSearch/stella_en_1.5B_v5
- 53.8 shibing624/text2vec-base-multilingual
- 53.7 brahmairesearch/slx-v0.1
- 53.7 sentence-transformers/all-MiniLM-L6-v2
- 53.7 izhx/udever-bloom-7b1
- 53.7 sdadas/mmlw-e5-large
- 53.7 avsolatorio/NoInstruct-small-Embedding-v0
- 53.7 jinaai/jina-embeddings-v5-omni-nano
- 53.7 jinaai/jina-embeddings-v5-text-nano
- 53.7 izhx/udever-bloom-3b
- 53.7 ibm-granite/granite-embedding-97m-multilingual-r2
- 53.6 thenlper/gte-small
- 53.6 codefuse-ai/F2LLM-v2-160M
- 53.5 ibm-granite/granite-embedding-107m-multilingual
- 53.5 Mihaiii/Bulbasaur
- 53.5 sentence-transformers/static-similarity-mrl-multilingual-v1
- 53.4 aari1995/German_Semantic_STS_V2
- 53.4 intfloat/e5-large-v2
- 53.4 ibm-granite/granite-embedding-30m-english
- 53.4 sergeyzh/rubert-tiny-turbo
- 53.3 codefuse-ai/F2LLM-v2-80M
- 53.2 intfloat/e5-large
- 53.2 avsolatorio/GIST-small-Embedding-v0
- 53.2 Mihaiii/Venusaur
- 53.1 DeepPavlov/rubert-base-cased
- 53.1 abhinand/MedEmbed-small-v0.1
- 53.1 Omartificial-Intelligence-Space/Marbert-all-nli-triplet-Matryoshka
- 53.1 BAAI/bge-small-en-v1.5
- 53.1 BAAI/bge-large-en-v1.5
- 53.1 nomic-ai/nomic-embed-text-v1-unsupervised
- 53.1 Snowflake/snowflake-arctic-embed-xs
- 53.0 NovaSearch/jasper_en_vision_language_v1
- 53.0 thenlper/gte-large
- 53.0 bigscience/sgpt-bloom-7b1-msmarco
- 53.0 sdadas/mmlw-e5-base
- 53.0 silma-ai/silma-embeddding-matryoshka-v0.1
- 53.0 sergeyzh/LaBSE-ru-turbo
- 52.9 manu/sentence_croissant_alpha_v0.2
- 52.9 Snowflake/snowflake-arctic-embed-m
- 52.8 sdadas/mmlw-e5-small
- 52.8 jinaai/jina-embeddings-v2-small-en
- 52.8 Cohere/Cohere-embed-english-v3.0
- 52.7 izhx/udever-bloom-1b1
- 52.7 intfloat/e5-base-v2
- 52.6 sdadas/mmlw-roberta-base
- 52.5 thenlper/gte-base
- 52.5 Snowflake/snowflake-arctic-embed-l
- 52.5 deepvk/deberta-v1-base
- 52.4 avsolatorio/GIST-large-Embedding-v0
- 52.4 sdadas/mmlw-roberta-large
- 52.4 Snowflake/snowflake-arctic-embed-s
- 52.4 Mihaiii/gte-micro
- 52.3 infgrad/stella-base-en-v2
- 52.3 Mihaiii/Wartortle
- 52.2 deepvk/USER-bge-m3
- 52.1 manu/sentence_croissant_alpha_v0.4
- 52.0 izhx/udever-bloom-560m
- 52.0 manu/sentence_croissant_alpha_v0.3
- 52.0 Omartificial-Intelligence-Space/Arabic-mpnet-base-all-nli-triplet
- 52.0 minishlab/potion-base-8M
- 51.9 BAAI/bge-base-en-v1.5
- 51.8 avsolatorio/GIST-Embedding-v0
- 51.8 minishlab/potion-base-4M
- 51.6 minishlab/M2V_base_output
- 51.5 Snowflake/snowflake-arctic-embed-m-long
- 51.5 malenia1/ternary-weight-embedding
- 51.5 minishlab/potion-base-2M
- 51.5 minishlab/M2V_base_glove_subword
- 51.1 Mihaiii/Squirtle
- 50.9 jinaai/jina-embedding-b-en-v1
- 50.8 Hum-Works/lodestone-base-4096-v1
- 50.4 mteb/baseline-random-encoder
- 50.3 jinaai/jina-embeddings-v2-base-en
- 49.8 jinaai/jina-embedding-s-en-v1
- 1 ICT-TIME-and-Querit/BOOM_4B_v1 81.9%
- 2 ICT-TIME-and-Querit/ICT-TIME-and-Querit-embedding-v1 76.3%
- 3 microsoft/harrier-oss-v1-27b 71.1%
- 4 microsoft/harrier-oss-v1-0.6b 68.1%
- 5 tencent/KaLM-Embedding-Gemma3-12B-2511 64.8%
- 6 nvidia/llama-embed-nemotron-8b 63.9%
- 7
Qwen3-Embedding-8B 62.1%
- 8
Qwen3-Embedding-4B 61.1%
- 9 codefuse-ai/F2LLM-v2-8B 61.1%
- 10 google/gemini-embedding-001 60.5%
- 11 GritLM/GritLM-7B 59.7%
- 12 Alibaba-NLP/gte-Qwen2-7B-instruct 59.7%
- 13 Octen/Octen-Embedding-8B 59.7%
- 14 zeroentropy/zembed-1 59.5%
- 15 openai/text-embedding-3-small 59.4%
- 16 Linq-AI-Research/Linq-Embed-Mistral 59.4%
- 17 openai/text-embedding-3-large 59.4%
- 18 codefuse-ai/F2LLM-v2-14B 58.9%
- 19 GritLM/GritLM-8x7B 58.8%
- 20 ai-sage/Giga-Embeddings-instruct-10B-A1.8B-0826 58.5%
- 21 BidirLM/BidirLM-Omni-2.5B-Embedding 58.5%
- 22 BidirLM/BidirLM-1B-Embedding 58.5%
- 23 Snowflake/snowflake-arctic-embed-l-v2.0 58.4%
- 24 google/text-multilingual-embedding-002 58.2%
- 25 intfloat/multilingual-e5-large-instruct 58.2%
- 26 codefuse-ai/F2LLM-v2-4B 58.1%
- 27 google/embeddinggemma-300m 58.1%
- 28 mongodb/voyage-3-lite 57.9%
- 29
EmbeddingGemma 2 57.8%
- 30 mongodb/voyage-large-2-instruct 57.6%
- 31 Salesforce/SFR-Embedding-Mistral 57.6%
- 32 BidirLM/BidirLM-1.7B-Embedding 57.4%
- 33 OrdalieTech/Solon-embeddings-large-0.1 57.4%
- 34 ai-sage/Giga-Embeddings-instruct-3B-0826 57.4%
- 35 mongodb/voyage-3.5 57.3%
- 36 mongodb/voyage-3 57.3%
- 37 Lajavaness/bilingual-embedding-large 57.1%
- 38 Lajavaness/bilingual-embedding-base 57.1%
- 39 intfloat/e5-mistral-7b-instruct 57%
- 40 codefuse-ai/F2LLM-v2-1.7B 57%
- 41 mongodb/voyage-multilingual-2 57%
- 42 omarelshehy/arabic-english-sts-matryoshka 57%
- 43 Omartificial-Intelligence-Space/Arabic-labse-Matryoshka 56.9%
- 44 intfloat/multilingual-e5-large 56.8%
- 45 BAAI/bge-m3 56.7%
- 46 Omartificial-Intelligence-Space/Arabic-MiniLM-L12-v2-all-nli-triplet 56.7%
- 47 manu/bge-m3-custom-fr 56.6%
- 48 Lajavaness/bilingual-embedding-small 56.6%
- 49 Cohere/Cohere-embed-multilingual-v3.0 56.5%
- 50 nvidia/NV-Embed-v2 56.4%
- 51 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-supervised 56.3%
- 52 Alibaba-NLP/gte-Qwen2-1.5B-instruct 56.3%
- 53 codefuse-ai/F2LLM-v2-0.6B 56.2%
- 54 jinaai/jina-embeddings-v3 56.2%
- 55 sentence-transformers/LaBSE 56.1%
- 56 Jaume/gemma-2b-embeddings 56%
- 57
Qwen3-Embedding-0.6B 55.9%
- 58 Salesforce/SFR-Embedding-2_R 55.8%
- 59 microsoft/harrier-oss-v1-270m 55.8%
- 60 Alibaba-NLP/gte-Qwen1.5-7B-instruct 55.7%
- 61 sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 55.7%
- 62 ai-forever/sbert_large_mt_nlu_ru 55.6%
- 63 sentence-transformers/paraphrase-multilingual-mpnet-base-v2 55.6%
- 64 Cohere/Cohere-embed-multilingual-light-v3.0 55.5%
- 65 hotchpotch/bekko-embedding-v1-a25m 55.5%
- 66 Snowflake/snowflake-arctic-embed-m-v1.5 55.4%
- 67 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-unsup-simcse 55.4%
- 68 codefuse-ai/F2LLM-v2-330M 55.3%
- 69 minishlab/M2V_base_glove 55.3%
- 70 Haon-Chen/speed-embedding-7b-instruct 55.3%
- 71 jinaai/jina-embeddings-v5-omni-small 55.2%
- 72 jinaai/jina-embeddings-v5-text-small 55.2%
- 73 BidirLM/BidirLM-0.6B-Embedding 55.2%
- 74 ai-forever/ru-en-RoSBERTa 55.1%
- 75 consciousAI/cai-lunaris-text-embeddings 55.1%
- 76 intfloat/multilingual-e5-small 55.1%
- 77 Bytedance/Seed1.6-embedding-1215 55.1%
- 78 DeepPavlov/rubert-base-cased-sentence 55%
- 79 Snowflake/snowflake-arctic-embed-m-v2.0 55%
- 80 Omartificial-Intelligence-Space/Arabert-all-nli-triplet-Matryoshka 55%
- 81 Alibaba-NLP/gte-multilingual-base 54.9%
- 82 HIT-TMG/KaLM-embedding-multilingual-mini-v1 54.9%
- 83 nvidia/NV-Embed-v1 54.9%
- 84 nomic-ai/nomic-embed-text-v1 54.8%
- 85 ibm-granite/granite-embedding-311m-multilingual-r2 54.8%
- 86 mixedbread-ai/mxbai-embed-large-v1 54.8%
- 87 NovaSearch/stella_en_400M_v5 54.8%
- 88 intfloat/multilingual-e5-base 54.7%
- 89 nomic-ai/nomic-embed-text-v2-moe 54.7%
- 90 cointegrated/LaBSE-en-ru 54.7%
- 91 cointegrated/rubert-tiny2 54.6%
- 92 BidirLM/BidirLM-270M-Embedding 54.6%
- 93 Cohere/Cohere-embed-english-light-v3.0 54.6%
- 94 Mihaiii/gte-micro-v4 54.6%
- 95 hotchpotch/bekko-embedding-v1-a8m 54.6%
- 96 nomic-ai/nomic-embed-text-v1.5 54.6%
- 97 HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1 54.6%
- 98 minishlab/potion-multilingual-128M 54.6%
- 99 intfloat/e5-base 54.6%
- 100 Gameselo/STS-multilingual-mpnet-base-v2 54.5%
- 101 intfloat/e5-small 54.5%
- 102 ai-forever/sbert_large_nlu_ru 54.5%
- 103 Omartificial-Intelligence-Space/Arabic-all-nli-triplet-Matryoshka 54.5%
- 104 DeepPavlov/distilrubert-small-cased-conversational 54.5%
- 105 avsolatorio/GIST-all-MiniLM-L6-v2 54.4%
- 106 cnmoro/static-nomic-384-pten-v2-st 54.4%
- 107 WhereIsAI/UAE-Large-V1 54.4%
- 108 hotchpotch/bekko-static-embedding-v1 54.4%
- 109 sentence-transformers/all-MiniLM-L12-v2 54.4%
- 110 Mihaiii/Ivysaur 54.4%
- 111 deepfile/embedder-100p 54.2%
- 112 intfloat/e5-small-v2 54.2%
- 113 cointegrated/rubert-tiny 54.1%
- 114 sentence-transformers/all-mpnet-base-v2 54.1%
- 115 ibm-granite/granite-embedding-278m-multilingual 54.1%
- 116 deepvk/USER-base 54%
- 117 dwzhu/e5-base-4k 54%
- 118 ibm-granite/granite-embedding-125m-english 53.9%
- 119 nomic-ai/nomic-embed-text-v1-ablated 53.9%
- 120 NovaSearch/stella_en_1.5B_v5 53.8%
- 121 shibing624/text2vec-base-multilingual 53.8%
- 122 brahmairesearch/slx-v0.1 53.7%
- 123 sentence-transformers/all-MiniLM-L6-v2 53.7%
- 124 izhx/udever-bloom-7b1 53.7%
- 125 sdadas/mmlw-e5-large 53.7%
- 126 avsolatorio/NoInstruct-small-Embedding-v0 53.7%
- 127 jinaai/jina-embeddings-v5-omni-nano 53.7%
- 128 jinaai/jina-embeddings-v5-text-nano 53.7%
- 129 izhx/udever-bloom-3b 53.7%
- 130 ibm-granite/granite-embedding-97m-multilingual-r2 53.7%
- 131 thenlper/gte-small 53.6%
- 132 codefuse-ai/F2LLM-v2-160M 53.6%
- 133 ibm-granite/granite-embedding-107m-multilingual 53.5%
- 134 Mihaiii/Bulbasaur 53.5%
- 135 sentence-transformers/static-similarity-mrl-multilingual-v1 53.5%
- 136 aari1995/German_Semantic_STS_V2 53.4%
- 137 intfloat/e5-large-v2 53.4%
- 138 ibm-granite/granite-embedding-30m-english 53.4%
- 139 sergeyzh/rubert-tiny-turbo 53.4%
- 140 codefuse-ai/F2LLM-v2-80M 53.3%
- 141 intfloat/e5-large 53.2%
- 142 avsolatorio/GIST-small-Embedding-v0 53.2%
- 143 Mihaiii/Venusaur 53.2%
- 144 DeepPavlov/rubert-base-cased 53.1%
- 145 abhinand/MedEmbed-small-v0.1 53.1%
- 146 Omartificial-Intelligence-Space/Marbert-all-nli-triplet-Matryoshka 53.1%
- 147 BAAI/bge-small-en-v1.5 53.1%
- 148 BAAI/bge-large-en-v1.5 53.1%
- 149 nomic-ai/nomic-embed-text-v1-unsupervised 53.1%
- 150 Snowflake/snowflake-arctic-embed-xs 53.1%
- 151 NovaSearch/jasper_en_vision_language_v1 53%
- 152 thenlper/gte-large 53%
- 153 bigscience/sgpt-bloom-7b1-msmarco 53%
- 154 sdadas/mmlw-e5-base 53%
- 155 silma-ai/silma-embeddding-matryoshka-v0.1 53%
- 156 sergeyzh/LaBSE-ru-turbo 53%
- 157 manu/sentence_croissant_alpha_v0.2 52.9%
- 158 Snowflake/snowflake-arctic-embed-m 52.9%
- 159 sdadas/mmlw-e5-small 52.8%
- 160 jinaai/jina-embeddings-v2-small-en 52.8%
- 161 Cohere/Cohere-embed-english-v3.0 52.8%
- 162 izhx/udever-bloom-1b1 52.7%
- 163 intfloat/e5-base-v2 52.7%
- 164 sdadas/mmlw-roberta-base 52.6%
- 165 thenlper/gte-base 52.5%
- 166 Snowflake/snowflake-arctic-embed-l 52.5%
- 167 deepvk/deberta-v1-base 52.5%
- 168 avsolatorio/GIST-large-Embedding-v0 52.4%
- 169 sdadas/mmlw-roberta-large 52.4%
- 170 Snowflake/snowflake-arctic-embed-s 52.4%
- 171 Mihaiii/gte-micro 52.4%
- 172 infgrad/stella-base-en-v2 52.3%
- 173 Mihaiii/Wartortle 52.3%
- 174 deepvk/USER-bge-m3 52.2%
- 175 manu/sentence_croissant_alpha_v0.4 52.1%
- 176 izhx/udever-bloom-560m 52%
- 177 manu/sentence_croissant_alpha_v0.3 52%
- 178 Omartificial-Intelligence-Space/Arabic-mpnet-base-all-nli-triplet 52%
- 179 minishlab/potion-base-8M 52%
- 180 BAAI/bge-base-en-v1.5 51.9%
- 181 avsolatorio/GIST-Embedding-v0 51.8%
- 182 minishlab/potion-base-4M 51.8%
- 183 minishlab/M2V_base_output 51.6%
- 184 Snowflake/snowflake-arctic-embed-m-long 51.5%
- 185 malenia1/ternary-weight-embedding 51.5%
- 186 minishlab/potion-base-2M 51.5%
- 187 minishlab/M2V_base_glove_subword 51.5%
- 188 Mihaiii/Squirtle 51.1%
- 189 jinaai/jina-embedding-b-en-v1 50.9%
- 190 Hum-Works/lodestone-base-4096-v1 50.8%
- 191 mteb/baseline-random-encoder 50.4%
- 192 jinaai/jina-embeddings-v2-base-en 50.3%
- 193 jinaai/jina-embedding-s-en-v1 49.8%
Source: Official Korean Sarcasm Dataset leaderboard
- 1
Qwen3-Embedding-8B 62.1%
- 2
Qwen3-Embedding-4B 61.1%
- 3
EmbeddingGemma 2 57.8%
- 4
Qwen3-Embedding-0.6B 55.9%
Source: Official Korean Sarcasm Dataset leaderboard
| # | Entry | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | ICT-TIME-and-Querit/BOOM_4B_v1 | 81.9% | Official leaderboard | ||
| 2 | ICT-TIME-and-Querit/ICT-TIME-and-Querit-embedding-v1 | 76.3% | Official leaderboard | ||
| 3 | microsoft/harrier-oss-v1-27b | 71.1% | Official leaderboard | ||
| 4 | microsoft/harrier-oss-v1-0.6b | 68.1% | Official leaderboard | ||
| 5 | tencent/KaLM-Embedding-Gemma3-12B-2511 | 64.8% | Official leaderboard | ||
| 6 | nvidia/llama-embed-nemotron-8b | 63.9% | Official leaderboard | ||
| 7 | | 62.1% | Jun 2025 | Official leaderboard | |
| 8 | | 61.1% | Jun 2025 | Official leaderboard | |
| 9 | codefuse-ai/F2LLM-v2-8B | 61.1% | Official leaderboard | ||
| 10 | google/gemini-embedding-001 | 60.5% | Official leaderboard | ||
| 11 | GritLM/GritLM-7B | 59.7% | Official leaderboard | ||
| 12 | Alibaba-NLP/gte-Qwen2-7B-instruct | 59.7% | Official leaderboard | ||
| 13 | Octen/Octen-Embedding-8B | 59.7% | Official leaderboard | ||
| 14 | zeroentropy/zembed-1 | 59.5% | Official leaderboard | ||
| 15 | openai/text-embedding-3-small | 59.4% | Official leaderboard | ||
| 16 | Linq-AI-Research/Linq-Embed-Mistral | 59.4% | Official leaderboard | ||
| 17 | openai/text-embedding-3-large | 59.4% | Official leaderboard | ||
| 18 | codefuse-ai/F2LLM-v2-14B | 58.9% | Official leaderboard | ||
| 19 | GritLM/GritLM-8x7B | 58.8% | Official leaderboard | ||
| 20 | ai-sage/Giga-Embeddings-instruct-10B-A1.8B-0826 | 58.5% | Official leaderboard | ||
| 21 | BidirLM/BidirLM-Omni-2.5B-Embedding | 58.5% | Official leaderboard | ||
| 22 | BidirLM/BidirLM-1B-Embedding | 58.5% | Official leaderboard | ||
| 23 | Snowflake/snowflake-arctic-embed-l-v2.0 | 58.4% | Official leaderboard | ||
| 24 | google/text-multilingual-embedding-002 | 58.2% | Official leaderboard | ||
| 25 | intfloat/multilingual-e5-large-instruct | 58.2% | Official leaderboard | ||
| 26 | codefuse-ai/F2LLM-v2-4B | 58.1% | Official leaderboard | ||
| 27 | google/embeddinggemma-300m | 58.1% | Official leaderboard | ||
| 28 | mongodb/voyage-3-lite | 57.9% | Official leaderboard | ||
| 29 | | 57.8% | Oct 2026 | Official leaderboard | |
| 30 | mongodb/voyage-large-2-instruct | 57.6% | Official leaderboard | ||
| 31 | Salesforce/SFR-Embedding-Mistral | 57.6% | Official leaderboard | ||
| 32 | BidirLM/BidirLM-1.7B-Embedding | 57.4% | Official leaderboard | ||
| 33 | OrdalieTech/Solon-embeddings-large-0.1 | 57.4% | Official leaderboard | ||
| 34 | ai-sage/Giga-Embeddings-instruct-3B-0826 | 57.4% | Official leaderboard | ||
| 35 | mongodb/voyage-3.5 | 57.3% | Official leaderboard | ||
| 36 | mongodb/voyage-3 | 57.3% | Official leaderboard | ||
| 37 | Lajavaness/bilingual-embedding-large | 57.1% | Official leaderboard | ||
| 38 | Lajavaness/bilingual-embedding-base | 57.1% | Official leaderboard | ||
| 39 | intfloat/e5-mistral-7b-instruct | 57% | Official leaderboard | ||
| 40 | codefuse-ai/F2LLM-v2-1.7B | 57% | Official leaderboard | ||
| 41 | mongodb/voyage-multilingual-2 | 57% | Official leaderboard | ||
| 42 | omarelshehy/arabic-english-sts-matryoshka | 57% | Official leaderboard | ||
| 43 | Omartificial-Intelligence-Space/Arabic-labse-Matryoshka | 56.9% | Official leaderboard | ||
| 44 | intfloat/multilingual-e5-large | 56.8% | Official leaderboard | ||
| 45 | BAAI/bge-m3 | 56.7% | Official leaderboard | ||
| 46 | Omartificial-Intelligence-Space/Arabic-MiniLM-L12-v2-all-nli-triplet | 56.7% | Official leaderboard | ||
| 47 | manu/bge-m3-custom-fr | 56.6% | Official leaderboard | ||
| 48 | Lajavaness/bilingual-embedding-small | 56.6% | Official leaderboard | ||
| 49 | Cohere/Cohere-embed-multilingual-v3.0 | 56.5% | Official leaderboard | ||
| 50 | nvidia/NV-Embed-v2 | 56.4% | Official leaderboard | ||
| 51 | McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-supervised | 56.3% | Official leaderboard | ||
| 52 | Alibaba-NLP/gte-Qwen2-1.5B-instruct | 56.3% | Official leaderboard | ||
| 53 | codefuse-ai/F2LLM-v2-0.6B | 56.2% | Official leaderboard | ||
| 54 | jinaai/jina-embeddings-v3 | 56.2% | Official leaderboard | ||
| 55 | sentence-transformers/LaBSE | 56.1% | Official leaderboard | ||
| 56 | Jaume/gemma-2b-embeddings | 56% | Official leaderboard | ||
| 57 | | 55.9% | Jun 2025 | Official leaderboard | |
| 58 | Salesforce/SFR-Embedding-2_R | 55.8% | Official leaderboard | ||
| 59 | microsoft/harrier-oss-v1-270m | 55.8% | Official leaderboard | ||
| 60 | Alibaba-NLP/gte-Qwen1.5-7B-instruct | 55.7% | Official leaderboard | ||
| 61 | sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 | 55.7% | Official leaderboard | ||
| 62 | ai-forever/sbert_large_mt_nlu_ru | 55.6% | Official leaderboard | ||
| 63 | sentence-transformers/paraphrase-multilingual-mpnet-base-v2 | 55.6% | Official leaderboard | ||
| 64 | Cohere/Cohere-embed-multilingual-light-v3.0 | 55.5% | Official leaderboard | ||
| 65 | hotchpotch/bekko-embedding-v1-a25m | 55.5% | Official leaderboard | ||
| 66 | Snowflake/snowflake-arctic-embed-m-v1.5 | 55.4% | Official leaderboard | ||
| 67 | McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-unsup-simcse | 55.4% | Official leaderboard | ||
| 68 | codefuse-ai/F2LLM-v2-330M | 55.3% | Official leaderboard | ||
| 69 | minishlab/M2V_base_glove | 55.3% | Official leaderboard | ||
| 70 | Haon-Chen/speed-embedding-7b-instruct | 55.3% | Official leaderboard | ||
| 71 | jinaai/jina-embeddings-v5-omni-small | 55.2% | Official leaderboard | ||
| 72 | jinaai/jina-embeddings-v5-text-small | 55.2% | Official leaderboard | ||
| 73 | BidirLM/BidirLM-0.6B-Embedding | 55.2% | Official leaderboard | ||
| 74 | ai-forever/ru-en-RoSBERTa | 55.1% | Official leaderboard | ||
| 75 | consciousAI/cai-lunaris-text-embeddings | 55.1% | Official leaderboard | ||
| 76 | intfloat/multilingual-e5-small | 55.1% | Official leaderboard | ||
| 77 | Bytedance/Seed1.6-embedding-1215 | 55.1% | Official leaderboard | ||
| 78 | DeepPavlov/rubert-base-cased-sentence | 55% | Official leaderboard | ||
| 79 | Snowflake/snowflake-arctic-embed-m-v2.0 | 55% | Official leaderboard | ||
| 80 | Omartificial-Intelligence-Space/Arabert-all-nli-triplet-Matryoshka | 55% | Official leaderboard | ||
| 81 | Alibaba-NLP/gte-multilingual-base | 54.9% | Official leaderboard | ||
| 82 | HIT-TMG/KaLM-embedding-multilingual-mini-v1 | 54.9% | Official leaderboard | ||
| 83 | nvidia/NV-Embed-v1 | 54.9% | Official leaderboard | ||
| 84 | nomic-ai/nomic-embed-text-v1 | 54.8% | Official leaderboard | ||
| 85 | ibm-granite/granite-embedding-311m-multilingual-r2 | 54.8% | Official leaderboard | ||
| 86 | mixedbread-ai/mxbai-embed-large-v1 | 54.8% | Official leaderboard | ||
| 87 | NovaSearch/stella_en_400M_v5 | 54.8% | Official leaderboard | ||
| 88 | intfloat/multilingual-e5-base | 54.7% | Official leaderboard | ||
| 89 | nomic-ai/nomic-embed-text-v2-moe | 54.7% | Official leaderboard | ||
| 90 | cointegrated/LaBSE-en-ru | 54.7% | Official leaderboard | ||
| 91 | cointegrated/rubert-tiny2 | 54.6% | Official leaderboard | ||
| 92 | BidirLM/BidirLM-270M-Embedding | 54.6% | Official leaderboard | ||
| 93 | Cohere/Cohere-embed-english-light-v3.0 | 54.6% | Official leaderboard | ||
| 94 | Mihaiii/gte-micro-v4 | 54.6% | Official leaderboard | ||
| 95 | hotchpotch/bekko-embedding-v1-a8m | 54.6% | Official leaderboard | ||
| 96 | nomic-ai/nomic-embed-text-v1.5 | 54.6% | Official leaderboard | ||
| 97 | HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1 | 54.6% | Official leaderboard | ||
| 98 | minishlab/potion-multilingual-128M | 54.6% | Official leaderboard | ||
| 99 | intfloat/e5-base | 54.6% | Official leaderboard | ||
| 100 | Gameselo/STS-multilingual-mpnet-base-v2 | 54.5% | Official leaderboard | ||
| 101 | intfloat/e5-small | 54.5% | Official leaderboard | ||
| 102 | ai-forever/sbert_large_nlu_ru | 54.5% | Official leaderboard | ||
| 103 | Omartificial-Intelligence-Space/Arabic-all-nli-triplet-Matryoshka | 54.5% | Official leaderboard | ||
| 104 | DeepPavlov/distilrubert-small-cased-conversational | 54.5% | Official leaderboard | ||
| 105 | avsolatorio/GIST-all-MiniLM-L6-v2 | 54.4% | Official leaderboard | ||
| 106 | cnmoro/static-nomic-384-pten-v2-st | 54.4% | Official leaderboard | ||
| 107 | WhereIsAI/UAE-Large-V1 | 54.4% | Official leaderboard | ||
| 108 | hotchpotch/bekko-static-embedding-v1 | 54.4% | Official leaderboard | ||
| 109 | sentence-transformers/all-MiniLM-L12-v2 | 54.4% | Official leaderboard | ||
| 110 | Mihaiii/Ivysaur | 54.4% | Official leaderboard | ||
| 111 | deepfile/embedder-100p | 54.2% | Official leaderboard | ||
| 112 | intfloat/e5-small-v2 | 54.2% | Official leaderboard | ||
| 113 | cointegrated/rubert-tiny | 54.1% | Official leaderboard | ||
| 114 | sentence-transformers/all-mpnet-base-v2 | 54.1% | Official leaderboard | ||
| 115 | ibm-granite/granite-embedding-278m-multilingual | 54.1% | Official leaderboard | ||
| 116 | deepvk/USER-base | 54% | Official leaderboard | ||
| 117 | dwzhu/e5-base-4k | 54% | Official leaderboard | ||
| 118 | ibm-granite/granite-embedding-125m-english | 53.9% | Official leaderboard | ||
| 119 | nomic-ai/nomic-embed-text-v1-ablated | 53.9% | Official leaderboard | ||
| 120 | NovaSearch/stella_en_1.5B_v5 | 53.8% | Official leaderboard | ||
| 121 | shibing624/text2vec-base-multilingual | 53.8% | Official leaderboard | ||
| 122 | brahmairesearch/slx-v0.1 | 53.7% | Official leaderboard | ||
| 123 | sentence-transformers/all-MiniLM-L6-v2 | 53.7% | Official leaderboard | ||
| 124 | izhx/udever-bloom-7b1 | 53.7% | Official leaderboard | ||
| 125 | sdadas/mmlw-e5-large | 53.7% | Official leaderboard | ||
| 126 | avsolatorio/NoInstruct-small-Embedding-v0 | 53.7% | Official leaderboard | ||
| 127 | jinaai/jina-embeddings-v5-omni-nano | 53.7% | Official leaderboard | ||
| 128 | jinaai/jina-embeddings-v5-text-nano | 53.7% | Official leaderboard | ||
| 129 | izhx/udever-bloom-3b | 53.7% | Official leaderboard | ||
| 130 | ibm-granite/granite-embedding-97m-multilingual-r2 | 53.7% | Official leaderboard | ||
| 131 | thenlper/gte-small | 53.6% | Official leaderboard | ||
| 132 | codefuse-ai/F2LLM-v2-160M | 53.6% | Official leaderboard | ||
| 133 | ibm-granite/granite-embedding-107m-multilingual | 53.5% | Official leaderboard | ||
| 134 | Mihaiii/Bulbasaur | 53.5% | Official leaderboard | ||
| 135 | sentence-transformers/static-similarity-mrl-multilingual-v1 | 53.5% | Official leaderboard | ||
| 136 | aari1995/German_Semantic_STS_V2 | 53.4% | Official leaderboard | ||
| 137 | intfloat/e5-large-v2 | 53.4% | Official leaderboard | ||
| 138 | ibm-granite/granite-embedding-30m-english | 53.4% | Official leaderboard | ||
| 139 | sergeyzh/rubert-tiny-turbo | 53.4% | Official leaderboard | ||
| 140 | codefuse-ai/F2LLM-v2-80M | 53.3% | Official leaderboard | ||
| 141 | intfloat/e5-large | 53.2% | Official leaderboard | ||
| 142 | avsolatorio/GIST-small-Embedding-v0 | 53.2% | Official leaderboard | ||
| 143 | Mihaiii/Venusaur | 53.2% | Official leaderboard | ||
| 144 | DeepPavlov/rubert-base-cased | 53.1% | Official leaderboard | ||
| 145 | abhinand/MedEmbed-small-v0.1 | 53.1% | Official leaderboard | ||
| 146 | Omartificial-Intelligence-Space/Marbert-all-nli-triplet-Matryoshka | 53.1% | Official leaderboard | ||
| 147 | BAAI/bge-small-en-v1.5 | 53.1% | Official leaderboard | ||
| 148 | BAAI/bge-large-en-v1.5 | 53.1% | Official leaderboard | ||
| 149 | nomic-ai/nomic-embed-text-v1-unsupervised | 53.1% | Official leaderboard | ||
| 150 | Snowflake/snowflake-arctic-embed-xs | 53.1% | Official leaderboard | ||
| 151 | NovaSearch/jasper_en_vision_language_v1 | 53% | Official leaderboard | ||
| 152 | thenlper/gte-large | 53% | Official leaderboard | ||
| 153 | bigscience/sgpt-bloom-7b1-msmarco | 53% | Official leaderboard | ||
| 154 | sdadas/mmlw-e5-base | 53% | Official leaderboard | ||
| 155 | silma-ai/silma-embeddding-matryoshka-v0.1 | 53% | Official leaderboard | ||
| 156 | sergeyzh/LaBSE-ru-turbo | 53% | Official leaderboard | ||
| 157 | manu/sentence_croissant_alpha_v0.2 | 52.9% | Official leaderboard | ||
| 158 | Snowflake/snowflake-arctic-embed-m | 52.9% | Official leaderboard | ||
| 159 | sdadas/mmlw-e5-small | 52.8% | Official leaderboard | ||
| 160 | jinaai/jina-embeddings-v2-small-en | 52.8% | Official leaderboard | ||
| 161 | Cohere/Cohere-embed-english-v3.0 | 52.8% | Official leaderboard | ||
| 162 | izhx/udever-bloom-1b1 | 52.7% | Official leaderboard | ||
| 163 | intfloat/e5-base-v2 | 52.7% | Official leaderboard | ||
| 164 | sdadas/mmlw-roberta-base | 52.6% | Official leaderboard | ||
| 165 | thenlper/gte-base | 52.5% | Official leaderboard | ||
| 166 | Snowflake/snowflake-arctic-embed-l | 52.5% | Official leaderboard | ||
| 167 | deepvk/deberta-v1-base | 52.5% | Official leaderboard | ||
| 168 | avsolatorio/GIST-large-Embedding-v0 | 52.4% | Official leaderboard | ||
| 169 | sdadas/mmlw-roberta-large | 52.4% | Official leaderboard | ||
| 170 | Snowflake/snowflake-arctic-embed-s | 52.4% | Official leaderboard | ||
| 171 | Mihaiii/gte-micro | 52.4% | Official leaderboard | ||
| 172 | infgrad/stella-base-en-v2 | 52.3% | Official leaderboard | ||
| 173 | Mihaiii/Wartortle | 52.3% | Official leaderboard | ||
| 174 | deepvk/USER-bge-m3 | 52.2% | Official leaderboard | ||
| 175 | manu/sentence_croissant_alpha_v0.4 | 52.1% | Official leaderboard | ||
| 176 | izhx/udever-bloom-560m | 52% | Official leaderboard | ||
| 177 | manu/sentence_croissant_alpha_v0.3 | 52% | Official leaderboard | ||
| 178 | Omartificial-Intelligence-Space/Arabic-mpnet-base-all-nli-triplet | 52% | Official leaderboard | ||
| 179 | minishlab/potion-base-8M | 52% | Official leaderboard | ||
| 180 | BAAI/bge-base-en-v1.5 | 51.9% | Official leaderboard | ||
| 181 | avsolatorio/GIST-Embedding-v0 | 51.8% | Official leaderboard | ||
| 182 | minishlab/potion-base-4M | 51.8% | Official leaderboard | ||
| 183 | minishlab/M2V_base_output | 51.6% | Official leaderboard | ||
| 184 | Snowflake/snowflake-arctic-embed-m-long | 51.5% | Official leaderboard | ||
| 185 | malenia1/ternary-weight-embedding | 51.5% | Official leaderboard | ||
| 186 | minishlab/potion-base-2M | 51.5% | Official leaderboard | ||
| 187 | minishlab/M2V_base_glove_subword | 51.5% | Official leaderboard | ||
| 188 | Mihaiii/Squirtle | 51.1% | Official leaderboard | ||
| 189 | jinaai/jina-embedding-b-en-v1 | 50.9% | Official leaderboard | ||
| 190 | Hum-Works/lodestone-base-4096-v1 | 50.8% | Official leaderboard | ||
| 191 | mteb/baseline-random-encoder | 50.4% | Official leaderboard | ||
| 192 | jinaai/jina-embeddings-v2-base-en | 50.3% | Official leaderboard | ||
| 193 | jinaai/jina-embedding-s-en-v1 | 49.8% | Official leaderboard |
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | | 62.1% | Jun 2025 | Official leaderboard | |
| 2 | | 61.1% | Jun 2025 | Official leaderboard | |
| 3 | | 57.8% | Oct 2026 | Official leaderboard | |
| 4 | | 55.9% | Jun 2025 | Official leaderboard |
Number one over time
Lab claims count from the day the card came out, independent runs from the model’s release.
Source: Official Korean Sarcasm Dataset leaderboard
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
Source: Official Korean Sarcasm Dataset leaderboard
No lab model card reports it yet
We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.
More in Multilingual
- MMMLU In use MMLU professionally translated into 14 languages. Multiple-choice accuracy. Claude Mythos Preview 92.7%
- WMT24++ In use English-to-55-language translation of WMT24 test data. Scored with automatic metrics such as MetricX or xCOMET.
K-EXAONE 90.5%
- MMLU-ProX In use MMLU-Pro translated into up to 29 languages with expert review. Multiple-choice accuracy per language.
Qwen3.7-Max 87%
- CLIcK In use Models answer 1,995 multiple-choice questions on Korean language and culture. Questions come from official Korean exams and textbooks in eleven categories.
Solar Open 2 90.7%
- Global MMLU Lite 3.0 In use Models answer 400 human-translated MMLU questions per language in 23 languages. Version 3.0 adds Czech, Hungarian, Oriya, Slovak and Tajik and updates Italian. Accuracy. Claude Opus 5 95.7%
- MMMB In use Models answer multiple-choice questions about images in six languages across 15 categories. The set has about 12,000 questions. LFM2.5-VL-3B 83%
Data audit
All 10 checks pass. Every benchmark
Catalog record 2 pass
- Pass Task access All tasks are public.
- Pass Confidence Checked against a primary source.
Scores 4 pass 1 note
- Pass Independent runs Scores from the official leaderboard (193 entries).
- Pass Models scored 4 models we track, plus 189 other entries on its leaderboard.
- Pass Newest score The newest is from October 2026, for EmbeddingGemma 2.
- Note Frontier models None of its models are on the capabilities index.
- Pass Headroom The best is 62.1%, under 85%, so it still separates models.
Leaderboard import 3 pass
- Pass Importer We read the board on huggingface.co: 4 rows for models we track and 189 other entries at the last read.
- Pass Last read November 21st, 2026.
- Pass Read worked The last read worked.
Consistency 1 pass 1 note
- Note Lab claims No model has both a lab number and an independent run.
- Pass Known issues No published audit found problems.