Amazon Counterfactual Detection
Models identify customer reviews that describe an alternative to what actually happened.
The benchmark includes reviews in multiple languages.
- Made by
- James O'Neill and colleagues
- Released
- April 2021
- Kind
- Reading in many languages
- Level
- School
- Scored
- Checked automatically
- Answers
- Prediction
- Tasks
- All public
- Measures
- Capability
- Interaction
- Single turn
- Items from
- Real work and use
- Refresh
- One fixed set
- Run by
- Anyone
- Last model added
- October 2026
- Scores refreshed
- November 20th, 2026
Bytedance/Seed1.6-embedding-1215 tops the leaderboard with 96.8% Qwen3-Embedding-8B leads with 93.2% among models released by October 2026
Best score per entry from MTEB’s leaderboard, read on November 20th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. The best model we track is Qwen3-Embedding-8B, at 93.2%. This view shows only models we track, each at its best.
The newest model with a score here came out in October 2026, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:
- GPT-6.2 Astra
- Claude Fable 5.2
-
Gemini 4 Carbon
- GPT-6.1 Terra
- and 16 more
- 96.8 Bytedance/Seed1.6-embedding-1215
- 94.7 jinaai/jina-embeddings-v5-omni-small
- 94.1 jinaai/jina-embeddings-v5-omni-nano
- 94.1 jinaai/jina-embeddings-v5-text-nano
- 93.3 microsoft/harrier-oss-v1-0.6b
- 93.2 microsoft/harrier-oss-v1-27b
- 93.2
Qwen3-Embedding-8B
- 93.1 Kingsoft-LLM/QZhou-Embedding
- 93.0 jinaai/jina-embeddings-v3
- 93.0 Octen/Octen-Embedding-8B
- 92.9 microsoft/harrier-oss-v1-270m
- 92.9
Qwen3-Embedding-4B
- 92.9 codefuse-ai/F2LLM-v2-4B
- 92.5 codefuse-ai/F2LLM-v2-8B
- 92.4 codefuse-ai/F2LLM-v2-14B
- 92.4 ai-sage/Giga-Embeddings-instruct-3B-0826
- 92.0 codefuse-ai/F2LLM-v2-1.7B
- 91.7 tencent/KaLM-Embedding-Gemma3-12B-2511
- 91.3 ai-sage/Giga-Embeddings-instruct-10B-A1.8B-0826
- 91.1 codefuse-ai/F2LLM-v2-0.6B
- 90.9
Qwen3-Embedding-0.6B
- 90.6 codefuse-ai/F2LLM-v2-330M
- 90.5 ICT-TIME-and-Querit/BOOM_4B_v1
- 89.9 ICT-TIME-and-Querit/ICT-TIME-and-Querit-embedding-v1
- 89.4 google/gemini-embedding-001
- 87.8 Salesforce/SFR-Embedding-2_R
- 87.1 Alibaba-NLP/gte-Qwen2-7B-instruct
- 86.9 codefuse-ai/F2LLM-v2-160M
- 86.8 NovaSearch/jasper_en_vision_language_v1
- 86.3
EmbeddingGemma 2
- 85.3 codefuse-ai/F2LLM-v2-80M
- 85.1 NovaSearch/stella_en_1.5B_v5
- 84.9 google/embeddinggemma-300m
- 84.7 nvidia/llama-embed-nemotron-8b
- 83.8 Linq-AI-Research/Linq-Embed-Mistral
- 82.8 Alibaba-NLP/gte-Qwen2-1.5B-instruct
- 80.5 Alibaba-NLP/gte-Qwen1.5-7B-instruct
- 80.4 BidirLM/BidirLM-Omni-2.5B-Embedding
- 80.3 GritLM/GritLM-7B
- 79.8 HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1
- 79.6 LCO-Embedding/LCO-Embedding-Omni-7B
- 79.3 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-supervised
- 79.0 LCO-Embedding/LCO-Embedding-Omni-3B
- 78.7 BidirLM/BidirLM-1.7B-Embedding
- 78.6 nvidia/NV-Embed-v2
- 78.2 openai/text-embedding-3-large
- 77.9 BidirLM/BidirLM-1B-Embedding
- 77.9 mongodb/voyage-large-2-instruct
- 77.3 GritLM/GritLM-8x7B
- 77.2 Lajavaness/bilingual-embedding-large
- 76.6 google/text-multilingual-embedding-002
- 76.0 Cohere/Cohere-embed-multilingual-v3.0
- 75.8 Omartificial-Intelligence-Space/Arabic-all-nli-triplet-Matryoshka
- 75.8 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-unsup-simcse
- 75.8 sentence-transformers/LaBSE
- 75.6 BAAI/bge-m3
- 75.5 OrdalieTech/Solon-embeddings-large-0.1
- 75.4 Lajavaness/bilingual-embedding-base
- 74.9 intfloat/multilingual-e5-base
- 74.7 Salesforce/SFR-Embedding-Mistral
- 74.6 BidirLM/BidirLM-0.6B-Embedding
- 74.6 hotchpotch/bekko-static-embedding-v1
- 74.5 intfloat/e5-mistral-7b-instruct
- 74.5 NovaSearch/stella_en_400M_v5
- 74.0 manu/bge-m3-custom-fr
- 74.0 nomic-ai/nomic-embed-text-v2-moe
- 73.5 Omartificial-Intelligence-Space/Arabic-labse-Matryoshka
- 73.5 sentence-transformers/paraphrase-multilingual-mpnet-base-v2
- 73.4 HIT-TMG/KaLM-embedding-multilingual-mini-v1
- 72.8 hotchpotch/bekko-embedding-v1-a25m
- 72.7 Omartificial-Intelligence-Space/Arabic-MiniLM-L12-v2-all-nli-triplet
- 72.3 cnmoro/static-nomic-384-pten-v2-st
- 72.3 Lajavaness/bilingual-embedding-small
- 72.1 BidirLM/BidirLM-270M-Embedding
- 72.1 ibm-granite/granite-embedding-278m-multilingual
- 71.9 Alibaba-NLP/gte-multilingual-base
- 71.8 ibm-granite/granite-embedding-107m-multilingual
- 71.8 Haon-Chen/speed-embedding-7b-instruct
- 71.7 mongodb/voyage-multilingual-2
- 70.7 JMullings/spectral-embed-v1-140m
- 70.3 Gameselo/STS-multilingual-mpnet-base-v2
- 70.3 izhx/udever-bloom-3b
- 70.2 hotchpotch/bekko-embedding-v1-a8m
- 69.7 omarelshehy/arabic-english-sts-matryoshka
- 69.7 izhx/udever-bloom-7b1
- 69.4 nomic-ai/nomic-embed-text-v1-ablated
- 69.4 Mihaiii/Venusaur
- 69.2 intfloat/multilingual-e5-large-instruct
- 69.0 Mihaiii/Bulbasaur
- 69.0 Cohere/Cohere-embed-english-light-v3.0
- 68.8 intfloat/e5-large-v2
- 68.8 sentence-transformers/static-similarity-mrl-multilingual-v1
- 68.7 intfloat/e5-base
- 68.6 intfloat/e5-small-v2
- 68.6 sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2
- 68.6 Mihaiii/gte-micro-v4
- 68.3 Mihaiii/Wartortle
- 68.3 nvidia/NV-Embed-v1
- 68.3 deepvk/USER-bge-m3
- 68.1 Mihaiii/gte-micro
- 68.0 Cohere/Cohere-embed-english-v3.0
- 68.0 nomic-ai/nomic-embed-text-v1-unsupervised
- 67.8 intfloat/e5-base-v2
- 67.6 infgrad/stella-base-en-v2
- 67.6 Mihaiii/Squirtle
- 67.5 dwzhu/e5-base-4k
- 67.5 mongodb/voyage-3.5
- 67.5 Cohere/Cohere-embed-multilingual-light-v3.0
- 67.1 Mihaiii/Ivysaur
- 67.1 Jaume/gemma-2b-embeddings
- 67.1 nomic-ai/nomic-embed-text-v1
- 67.0 intfloat/e5-small
- 66.8 sdadas/mmlw-e5-base
- 66.7 minishlab/potion-base-8M
- 66.7 avsolatorio/NoInstruct-small-Embedding-v0
- 66.7 DeepPavlov/distilrubert-small-cased-conversational
- 66.5 BAAI/bge-base-en-v1.5
- 66.5 WhereIsAI/UAE-Large-V1
- 66.5 avsolatorio/GIST-all-MiniLM-L6-v2
- 66.5 minishlab/M2V_base_output
- 66.3 avsolatorio/GIST-Embedding-v0
- 66.3 intfloat/e5-large
- 66.2 mixedbread-ai/mxbai-embed-large-v1
- 66.1 avsolatorio/GIST-large-Embedding-v0
- 66.1 sdadas/mmlw-roberta-base
- 66.0 cointegrated/LaBSE-en-ru
- 66.0 thenlper/gte-base
- 66.0 avsolatorio/GIST-small-Embedding-v0
- 65.7 thenlper/gte-small
- 65.6 nomic-ai/nomic-embed-text-v1.5
- 65.5 BAAI/bge-large-en-v1.5
- 65.5 sdadas/mmlw-roberta-large
- 65.4 minishlab/potion-multilingual-128M
- 65.4 sdadas/mmlw-e5-large
- 65.3 Snowflake/snowflake-arctic-embed-l-v2.0
- 65.3 mongodb/voyage-3-lite
- 65.3 BAAI/bge-small-en-v1.5
- 65.2 manu/sentence_croissant_alpha_v0.3
- 65.0 abhinand/MedEmbed-small-v0.1
- 64.9 minishlab/M2V_base_glove_subword
- 64.9 sergeyzh/LaBSE-ru-turbo
- 64.9 Tevatron/OmniEmbed-v0.1
- 64.8 zeroentropy/zembed-1
- 64.6 RiverRider/motherlode-code-small-en-v0.1
- 64.6 Snowflake/snowflake-arctic-embed-m-v2.0
- 64.5 sdadas/mmlw-e5-small
- 64.5 thenlper/gte-large
- 64.5 sergeyzh/rubert-tiny-turbo
- 64.3 ibm-granite/granite-embedding-311m-multilingual-r2
- 64.2 minishlab/potion-base-4M
- 63.9 deepfile/embedder-100p
- 63.7 cointegrated/rubert-tiny
- 63.5 Omartificial-Intelligence-Space/Marbert-all-nli-triplet-Matryoshka
- 63.5 manu/sentence_croissant_alpha_v0.2
- 63.4 manu/sentence_croissant_alpha_v0.4
- 63.3 jinaai/jina-embeddings-v2-small-en
- 63.1 minishlab/M2V_base_glove
- 62.7 DeepPavlov/rubert-base-cased
- 62.6 Omartificial-Intelligence-Space/Arabic-mpnet-base-all-nli-triplet
- 62.6 malenia1/ternary-weight-embedding
- 62.5 ai-forever/ru-en-RoSBERTa
- 62.5 ibm-granite/granite-embedding-97m-multilingual-r2
- 62.4 aari1995/German_Semantic_STS_V2
- 62.4 minishlab/potion-base-2M
- 62.2 mongodb/voyage-3
- 62.2 cointegrated/rubert-tiny2
- 62.0 sentence-transformers/all-MiniLM-L6-v2
- 61.8 deepvk/deberta-v1-base
- 61.6 ibm-granite/granite-embedding-125m-english
- 61.5 sentence-transformers/multi-qa-MiniLM-L6-cos-v1
- 61.4 jinaai/jina-embedding-b-en-v1
- 61.2 Snowflake/snowflake-arctic-embed-m-v1.5
- 60.7 Haon-Chen/e5-omni-7B
- 60.4 deepvk/USER-base
- 60.3 Haon-Chen/e5-omni-3B
- 60.2 Snowflake/snowflake-arctic-embed-s
- 60.1 silma-ai/silma-embeddding-matryoshka-v0.1
- 60.1 ibm-granite/granite-embedding-30m-english
- 60.0 lakinekaki/all-MiniLM-L6-v2-genbais
- 59.7 Snowflake/snowflake-arctic-embed-xs
- 59.0 Snowflake/snowflake-arctic-embed-m
- 58.8 Snowflake/snowflake-arctic-embed-l
- 58.7 Snowflake/snowflake-arctic-embed-m-long
- 58.5 ai-forever/sbert_large_mt_nlu_ru
- 58.5 jinaai/jina-embedding-s-en-v1
- 58.2 DeepPavlov/rubert-base-cased-sentence
- 58.2 Omartificial-Intelligence-Space/Arabert-all-nli-triplet-Matryoshka
- 57.8 ai-forever/sbert_large_nlu_ru
- 57.4 Hum-Works/lodestone-base-4096-v1
- 57.1 encord-team/ebind-full
- 53.8 consciousAI/cai-lunaris-text-embeddings
- 52.1 jinaai/jina-embeddings-v2-base-en
- 49.8 mteb/baseline-random-encoder
- 40.1 sentence-transformers/sentence-t5-base
- 1 Bytedance/Seed1.6-embedding-1215 96.8%
- 2 jinaai/jina-embeddings-v5-omni-small 94.7%
- 3 jinaai/jina-embeddings-v5-omni-nano 94.1%
- 4 jinaai/jina-embeddings-v5-text-nano 94.1%
- 5 microsoft/harrier-oss-v1-0.6b 93.3%
- 6 microsoft/harrier-oss-v1-27b 93.2%
- 7
Qwen3-Embedding-8B 93.2%
- 8 Kingsoft-LLM/QZhou-Embedding 93.1%
- 9 jinaai/jina-embeddings-v3 93%
- 10 Octen/Octen-Embedding-8B 93%
- 11 microsoft/harrier-oss-v1-270m 92.9%
- 12
Qwen3-Embedding-4B 92.9%
- 13 codefuse-ai/F2LLM-v2-4B 92.9%
- 14 codefuse-ai/F2LLM-v2-8B 92.5%
- 15 codefuse-ai/F2LLM-v2-14B 92.4%
- 16 ai-sage/Giga-Embeddings-instruct-3B-0826 92.4%
- 17 codefuse-ai/F2LLM-v2-1.7B 92%
- 18 tencent/KaLM-Embedding-Gemma3-12B-2511 91.7%
- 19 ai-sage/Giga-Embeddings-instruct-10B-A1.8B-0826 91.3%
- 20 codefuse-ai/F2LLM-v2-0.6B 91.1%
- 21
Qwen3-Embedding-0.6B 90.9%
- 22 codefuse-ai/F2LLM-v2-330M 90.6%
- 23 ICT-TIME-and-Querit/BOOM_4B_v1 90.5%
- 24 ICT-TIME-and-Querit/ICT-TIME-and-Querit-embedding-v1 89.9%
- 25 google/gemini-embedding-001 89.4%
- 26 Salesforce/SFR-Embedding-2_R 87.8%
- 27 Alibaba-NLP/gte-Qwen2-7B-instruct 87.1%
- 28 codefuse-ai/F2LLM-v2-160M 86.9%
- 29 NovaSearch/jasper_en_vision_language_v1 86.8%
- 30
EmbeddingGemma 2 86.3%
- 31 codefuse-ai/F2LLM-v2-80M 85.3%
- 32 NovaSearch/stella_en_1.5B_v5 85.1%
- 33 google/embeddinggemma-300m 84.9%
- 34 nvidia/llama-embed-nemotron-8b 84.7%
- 35 Linq-AI-Research/Linq-Embed-Mistral 83.8%
- 36 Alibaba-NLP/gte-Qwen2-1.5B-instruct 82.8%
- 37 Alibaba-NLP/gte-Qwen1.5-7B-instruct 80.5%
- 38 BidirLM/BidirLM-Omni-2.5B-Embedding 80.4%
- 39 GritLM/GritLM-7B 80.3%
- 40 HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1 79.8%
- 41 LCO-Embedding/LCO-Embedding-Omni-7B 79.6%
- 42 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-supervised 79.3%
- 43 LCO-Embedding/LCO-Embedding-Omni-3B 79%
- 44 BidirLM/BidirLM-1.7B-Embedding 78.7%
- 45 nvidia/NV-Embed-v2 78.6%
- 46 openai/text-embedding-3-large 78.2%
- 47 BidirLM/BidirLM-1B-Embedding 77.9%
- 48 mongodb/voyage-large-2-instruct 77.9%
- 49 GritLM/GritLM-8x7B 77.3%
- 50 Lajavaness/bilingual-embedding-large 77.2%
- 51 google/text-multilingual-embedding-002 76.6%
- 52 Cohere/Cohere-embed-multilingual-v3.0 76%
- 53 Omartificial-Intelligence-Space/Arabic-all-nli-triplet-Matryoshka 75.8%
- 54 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-unsup-simcse 75.8%
- 55 sentence-transformers/LaBSE 75.8%
- 56 BAAI/bge-m3 75.6%
- 57 OrdalieTech/Solon-embeddings-large-0.1 75.5%
- 58 Lajavaness/bilingual-embedding-base 75.4%
- 59 intfloat/multilingual-e5-base 74.9%
- 60 Salesforce/SFR-Embedding-Mistral 74.7%
- 61 BidirLM/BidirLM-0.6B-Embedding 74.6%
- 62 hotchpotch/bekko-static-embedding-v1 74.6%
- 63 intfloat/e5-mistral-7b-instruct 74.5%
- 64 NovaSearch/stella_en_400M_v5 74.5%
- 65 manu/bge-m3-custom-fr 74%
- 66 nomic-ai/nomic-embed-text-v2-moe 74%
- 67 Omartificial-Intelligence-Space/Arabic-labse-Matryoshka 73.5%
- 68 sentence-transformers/paraphrase-multilingual-mpnet-base-v2 73.5%
- 69 HIT-TMG/KaLM-embedding-multilingual-mini-v1 73.4%
- 70 hotchpotch/bekko-embedding-v1-a25m 72.8%
- 71 Omartificial-Intelligence-Space/Arabic-MiniLM-L12-v2-all-nli-triplet 72.7%
- 72 cnmoro/static-nomic-384-pten-v2-st 72.3%
- 73 Lajavaness/bilingual-embedding-small 72.3%
- 74 BidirLM/BidirLM-270M-Embedding 72.1%
- 75 ibm-granite/granite-embedding-278m-multilingual 72.1%
- 76 Alibaba-NLP/gte-multilingual-base 71.9%
- 77 ibm-granite/granite-embedding-107m-multilingual 71.8%
- 78 Haon-Chen/speed-embedding-7b-instruct 71.8%
- 79 mongodb/voyage-multilingual-2 71.7%
- 80 JMullings/spectral-embed-v1-140m 70.7%
- 81 Gameselo/STS-multilingual-mpnet-base-v2 70.3%
- 82 izhx/udever-bloom-3b 70.3%
- 83 hotchpotch/bekko-embedding-v1-a8m 70.2%
- 84 omarelshehy/arabic-english-sts-matryoshka 69.7%
- 85 izhx/udever-bloom-7b1 69.7%
- 86 nomic-ai/nomic-embed-text-v1-ablated 69.4%
- 87 Mihaiii/Venusaur 69.4%
- 88 intfloat/multilingual-e5-large-instruct 69.2%
- 89 Mihaiii/Bulbasaur 69%
- 90 Cohere/Cohere-embed-english-light-v3.0 69%
- 91 intfloat/e5-large-v2 68.8%
- 92 sentence-transformers/static-similarity-mrl-multilingual-v1 68.8%
- 93 intfloat/e5-base 68.7%
- 94 intfloat/e5-small-v2 68.6%
- 95 sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 68.6%
- 96 Mihaiii/gte-micro-v4 68.6%
- 97 Mihaiii/Wartortle 68.3%
- 98 nvidia/NV-Embed-v1 68.3%
- 99 deepvk/USER-bge-m3 68.3%
- 100 Mihaiii/gte-micro 68.1%
- 101 Cohere/Cohere-embed-english-v3.0 68%
- 102 nomic-ai/nomic-embed-text-v1-unsupervised 68%
- 103 intfloat/e5-base-v2 67.8%
- 104 infgrad/stella-base-en-v2 67.6%
- 105 Mihaiii/Squirtle 67.6%
- 106 dwzhu/e5-base-4k 67.5%
- 107 mongodb/voyage-3.5 67.5%
- 108 Cohere/Cohere-embed-multilingual-light-v3.0 67.5%
- 109 Mihaiii/Ivysaur 67.1%
- 110 Jaume/gemma-2b-embeddings 67.1%
- 111 nomic-ai/nomic-embed-text-v1 67.1%
- 112 intfloat/e5-small 67%
- 113 sdadas/mmlw-e5-base 66.8%
- 114 minishlab/potion-base-8M 66.7%
- 115 avsolatorio/NoInstruct-small-Embedding-v0 66.7%
- 116 DeepPavlov/distilrubert-small-cased-conversational 66.7%
- 117 BAAI/bge-base-en-v1.5 66.5%
- 118 WhereIsAI/UAE-Large-V1 66.5%
- 119 avsolatorio/GIST-all-MiniLM-L6-v2 66.5%
- 120 minishlab/M2V_base_output 66.5%
- 121 avsolatorio/GIST-Embedding-v0 66.3%
- 122 intfloat/e5-large 66.3%
- 123 mixedbread-ai/mxbai-embed-large-v1 66.2%
- 124 avsolatorio/GIST-large-Embedding-v0 66.1%
- 125 sdadas/mmlw-roberta-base 66.1%
- 126 cointegrated/LaBSE-en-ru 66%
- 127 thenlper/gte-base 66%
- 128 avsolatorio/GIST-small-Embedding-v0 66%
- 129 thenlper/gte-small 65.7%
- 130 nomic-ai/nomic-embed-text-v1.5 65.6%
- 131 BAAI/bge-large-en-v1.5 65.5%
- 132 sdadas/mmlw-roberta-large 65.5%
- 133 minishlab/potion-multilingual-128M 65.4%
- 134 sdadas/mmlw-e5-large 65.4%
- 135 Snowflake/snowflake-arctic-embed-l-v2.0 65.3%
- 136 mongodb/voyage-3-lite 65.3%
- 137 BAAI/bge-small-en-v1.5 65.3%
- 138 manu/sentence_croissant_alpha_v0.3 65.2%
- 139 abhinand/MedEmbed-small-v0.1 65%
- 140 minishlab/M2V_base_glove_subword 64.9%
- 141 sergeyzh/LaBSE-ru-turbo 64.9%
- 142 Tevatron/OmniEmbed-v0.1 64.9%
- 143 zeroentropy/zembed-1 64.8%
- 144 RiverRider/motherlode-code-small-en-v0.1 64.6%
- 145 Snowflake/snowflake-arctic-embed-m-v2.0 64.6%
- 146 sdadas/mmlw-e5-small 64.5%
- 147 thenlper/gte-large 64.5%
- 148 sergeyzh/rubert-tiny-turbo 64.5%
- 149 ibm-granite/granite-embedding-311m-multilingual-r2 64.3%
- 150 minishlab/potion-base-4M 64.2%
- 151 deepfile/embedder-100p 63.9%
- 152 cointegrated/rubert-tiny 63.7%
- 153 Omartificial-Intelligence-Space/Marbert-all-nli-triplet-Matryoshka 63.5%
- 154 manu/sentence_croissant_alpha_v0.2 63.5%
- 155 manu/sentence_croissant_alpha_v0.4 63.4%
- 156 jinaai/jina-embeddings-v2-small-en 63.3%
- 157 minishlab/M2V_base_glove 63.1%
- 158 DeepPavlov/rubert-base-cased 62.7%
- 159 Omartificial-Intelligence-Space/Arabic-mpnet-base-all-nli-triplet 62.6%
- 160 malenia1/ternary-weight-embedding 62.6%
- 161 ai-forever/ru-en-RoSBERTa 62.5%
- 162 ibm-granite/granite-embedding-97m-multilingual-r2 62.5%
- 163 aari1995/German_Semantic_STS_V2 62.4%
- 164 minishlab/potion-base-2M 62.4%
- 165 mongodb/voyage-3 62.2%
- 166 cointegrated/rubert-tiny2 62.2%
- 167 sentence-transformers/all-MiniLM-L6-v2 62%
- 168 deepvk/deberta-v1-base 61.8%
- 169 ibm-granite/granite-embedding-125m-english 61.6%
- 170 sentence-transformers/multi-qa-MiniLM-L6-cos-v1 61.5%
- 171 jinaai/jina-embedding-b-en-v1 61.4%
- 172 Snowflake/snowflake-arctic-embed-m-v1.5 61.2%
- 173 Haon-Chen/e5-omni-7B 60.7%
- 174 deepvk/USER-base 60.4%
- 175 Haon-Chen/e5-omni-3B 60.3%
- 176 Snowflake/snowflake-arctic-embed-s 60.2%
- 177 silma-ai/silma-embeddding-matryoshka-v0.1 60.1%
- 178 ibm-granite/granite-embedding-30m-english 60.1%
- 179 lakinekaki/all-MiniLM-L6-v2-genbais 60%
- 180 Snowflake/snowflake-arctic-embed-xs 59.7%
- 181 Snowflake/snowflake-arctic-embed-m 59%
- 182 Snowflake/snowflake-arctic-embed-l 58.8%
- 183 Snowflake/snowflake-arctic-embed-m-long 58.7%
- 184 ai-forever/sbert_large_mt_nlu_ru 58.5%
- 185 jinaai/jina-embedding-s-en-v1 58.5%
- 186 DeepPavlov/rubert-base-cased-sentence 58.2%
- 187 Omartificial-Intelligence-Space/Arabert-all-nli-triplet-Matryoshka 58.2%
- 188 ai-forever/sbert_large_nlu_ru 57.8%
- 189 Hum-Works/lodestone-base-4096-v1 57.4%
- 190 encord-team/ebind-full 57.1%
- 191 consciousAI/cai-lunaris-text-embeddings 53.8%
- 192 jinaai/jina-embeddings-v2-base-en 52.1%
- 193 mteb/baseline-random-encoder 49.8%
- 194 sentence-transformers/sentence-t5-base 40.1%
Source: MTEB’s leaderboard
- 1
Qwen3-Embedding-8B 93.2%
- 2
Qwen3-Embedding-4B 92.9%
- 3
Qwen3-Embedding-0.6B 90.9%
- 4
EmbeddingGemma 2 86.3%
Source: MTEB’s leaderboard
| # | Entry | Score | Setting | Date | Link | Source |
|---|---|---|---|---|---|---|
| 1 | Bytedance/Seed1.6-embedding-1215 closed weights | 96.8% | console.volcengine.com | Official leaderboard | ||
| 2 | jinaai/jina-embeddings-v5-omni-small open weights, 1.6B | 94.7% | huggingface.co | Official leaderboard | ||
| 3 | jinaai/jina-embeddings-v5-omni-nano open weights, 1B | 94.1% | huggingface.co | Official leaderboard | ||
| 4 | jinaai/jina-embeddings-v5-text-nano open weights, 0.2B | 94.1% | huggingface.co | Official leaderboard | ||
| 5 | microsoft/harrier-oss-v1-0.6b open weights, 0.6B | 93.3% | huggingface.co | Official leaderboard | ||
| 6 | microsoft/harrier-oss-v1-27b open weights, 27B | 93.2% | huggingface.co | Official leaderboard | ||
| 7 | | 93.2% | Jun 2025 | huggingface.co | Official leaderboard | |
| 8 | Kingsoft-LLM/QZhou-Embedding open weights, 7.1B | 93.1% | huggingface.co | Official leaderboard | ||
| 9 | jinaai/jina-embeddings-v3 open weights, 0.6B | 93% | huggingface.co | Official leaderboard | ||
| 10 | Octen/Octen-Embedding-8B open weights, 7.6B | 93% | huggingface.co | Official leaderboard | ||
| 11 | microsoft/harrier-oss-v1-270m open weights, 0.3B | 92.9% | huggingface.co | Official leaderboard | ||
| 12 | | 92.9% | Jun 2025 | huggingface.co | Official leaderboard | |
| 13 | codefuse-ai/F2LLM-v2-4B open weights, 4B | 92.9% | huggingface.co | Official leaderboard | ||
| 14 | codefuse-ai/F2LLM-v2-8B open weights, 7.6B | 92.5% | huggingface.co | Official leaderboard | ||
| 15 | codefuse-ai/F2LLM-v2-14B open weights, 14B | 92.4% | huggingface.co | Official leaderboard | ||
| 16 | ai-sage/Giga-Embeddings-instruct-3B-0826 open weights, 3.2B | 92.4% | huggingface.co | Official leaderboard | ||
| 17 | codefuse-ai/F2LLM-v2-1.7B open weights, 1.7B | 92% | huggingface.co | Official leaderboard | ||
| 18 | tencent/KaLM-Embedding-Gemma3-12B-2511 open weights, 11.8B | 91.7% | huggingface.co | Official leaderboard | ||
| 19 | ai-sage/Giga-Embeddings-instruct-10B-A1.8B-0826 open weights, 10.5B | 91.3% | huggingface.co | Official leaderboard | ||
| 20 | codefuse-ai/F2LLM-v2-0.6B open weights, 0.6B | 91.1% | huggingface.co | Official leaderboard | ||
| 21 | | 90.9% | Jun 2025 | huggingface.co | Official leaderboard | |
| 22 | codefuse-ai/F2LLM-v2-330M open weights, 0.3B | 90.6% | huggingface.co | Official leaderboard | ||
| 23 | ICT-TIME-and-Querit/BOOM_4B_v1 open weights, 4B | 90.5% | huggingface.co | Official leaderboard | ||
| 24 | ICT-TIME-and-Querit/ICT-TIME-and-Querit-embedding-v1 open weights, 4B | 89.9% | huggingface.co | Official leaderboard | ||
| 25 | google/gemini-embedding-001 closed weights | 89.4% | ai.google.dev | Official leaderboard | ||
| 26 | Salesforce/SFR-Embedding-2_R open weights, 7.1B | 87.8% | huggingface.co | Official leaderboard | ||
| 27 | Alibaba-NLP/gte-Qwen2-7B-instruct open weights, 7.1B | 87.1% | huggingface.co | Official leaderboard | ||
| 28 | codefuse-ai/F2LLM-v2-160M open weights, 0.2B | 86.9% | huggingface.co | Official leaderboard | ||
| 29 | NovaSearch/jasper_en_vision_language_v1 open weights, 1.6B | 86.8% | huggingface.co | Official leaderboard | ||
| 30 | | 86.3% | Oct 2026 | huggingface.co | Official leaderboard | |
| 31 | codefuse-ai/F2LLM-v2-80M open weights, 0.1B | 85.3% | huggingface.co | Official leaderboard | ||
| 32 | NovaSearch/stella_en_1.5B_v5 open weights, 1.5B | 85.1% | huggingface.co | Official leaderboard | ||
| 33 | google/embeddinggemma-300m open weights, 0.3B | 84.9% | ai.google.dev | Official leaderboard | ||
| 34 | nvidia/llama-embed-nemotron-8b open weights, 7.5B | 84.7% | huggingface.co | Official leaderboard | ||
| 35 | Linq-AI-Research/Linq-Embed-Mistral open weights, 7.1B | 83.8% | huggingface.co | Official leaderboard | ||
| 36 | Alibaba-NLP/gte-Qwen2-1.5B-instruct open weights, 1.5B | 82.8% | huggingface.co | Official leaderboard | ||
| 37 | Alibaba-NLP/gte-Qwen1.5-7B-instruct open weights, 7.1B | 80.5% | huggingface.co | Official leaderboard | ||
| 38 | BidirLM/BidirLM-Omni-2.5B-Embedding open weights, 2.4B | 80.4% | huggingface.co | Official leaderboard | ||
| 39 | GritLM/GritLM-7B open weights, 7.2B | 80.3% | huggingface.co | Official leaderboard | ||
| 40 | HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1 open weights, 0.5B | 79.8% | huggingface.co | Official leaderboard | ||
| 41 | LCO-Embedding/LCO-Embedding-Omni-7B open weights, 8.9B | 79.6% | huggingface.co | Official leaderboard | ||
| 42 | McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-supervised open weights, 7.2B | 79.3% | huggingface.co | Official leaderboard | ||
| 43 | LCO-Embedding/LCO-Embedding-Omni-3B open weights, 4.7B | 79% | huggingface.co | Official leaderboard | ||
| 44 | BidirLM/BidirLM-1.7B-Embedding open weights, 1.7B | 78.7% | huggingface.co | Official leaderboard | ||
| 45 | nvidia/NV-Embed-v2 open weights, 7.9B | 78.6% | huggingface.co | Official leaderboard | ||
| 46 | openai/text-embedding-3-large closed weights | 78.2% | openai.com | Official leaderboard | ||
| 47 | BidirLM/BidirLM-1B-Embedding open weights, 1B | 77.9% | huggingface.co | Official leaderboard | ||
| 48 | mongodb/voyage-large-2-instruct closed weights | 77.9% | blog.voyageai.com | Official leaderboard | ||
| 49 | GritLM/GritLM-8x7B open weights, 57.9B | 77.3% | huggingface.co | Official leaderboard | ||
| 50 | Lajavaness/bilingual-embedding-large open weights, 0.6B | 77.2% | huggingface.co | Official leaderboard | ||
| 51 | google/text-multilingual-embedding-002 closed weights | 76.6% | cloud.google.com | Official leaderboard | ||
| 52 | Cohere/Cohere-embed-multilingual-v3.0 closed weights | 76% | cohere.com | Official leaderboard | ||
| 53 | Omartificial-Intelligence-Space/Arabic-all-nli-triplet-Matryoshka open weights, 0.3B | 75.8% | huggingface.co | Official leaderboard | ||
| 54 | McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-unsup-simcse open weights, 7.2B | 75.8% | huggingface.co | Official leaderboard | ||
| 55 | sentence-transformers/LaBSE open weights, 0.5B | 75.8% | huggingface.co | Official leaderboard | ||
| 56 | BAAI/bge-m3 open weights, 0.6B | 75.6% | huggingface.co | Official leaderboard | ||
| 57 | OrdalieTech/Solon-embeddings-large-0.1 open weights, 0.6B | 75.5% | huggingface.co | Official leaderboard | ||
| 58 | Lajavaness/bilingual-embedding-base open weights, 0.3B | 75.4% | huggingface.co | Official leaderboard | ||
| 59 | intfloat/multilingual-e5-base open weights, 0.3B | 74.9% | huggingface.co | Official leaderboard | ||
| 60 | Salesforce/SFR-Embedding-Mistral open weights, 7.1B | 74.7% | huggingface.co | Official leaderboard | ||
| 61 | BidirLM/BidirLM-0.6B-Embedding open weights, 0.6B | 74.6% | huggingface.co | Official leaderboard | ||
| 62 | hotchpotch/bekko-static-embedding-v1 open weights, 0.2B | 74.6% | huggingface.co | Official leaderboard | ||
| 63 | intfloat/e5-mistral-7b-instruct open weights, 7.1B | 74.5% | huggingface.co | Official leaderboard | ||
| 64 | NovaSearch/stella_en_400M_v5 open weights, 0.4B | 74.5% | huggingface.co | Official leaderboard | ||
| 65 | manu/bge-m3-custom-fr open weights, 0.6B | 74% | huggingface.co | Official leaderboard | ||
| 66 | nomic-ai/nomic-embed-text-v2-moe open weights, 0.5B | 74% | huggingface.co | Official leaderboard | ||
| 67 | Omartificial-Intelligence-Space/Arabic-labse-Matryoshka open weights, 0.5B | 73.5% | huggingface.co | Official leaderboard | ||
| 68 | sentence-transformers/paraphrase-multilingual-mpnet-base-v2 open weights, 0.3B | 73.5% | huggingface.co | Official leaderboard | ||
| 69 | HIT-TMG/KaLM-embedding-multilingual-mini-v1 open weights, 0.5B | 73.4% | huggingface.co | Official leaderboard | ||
| 70 | hotchpotch/bekko-embedding-v1-a25m open weights, 0.1B | 72.8% | huggingface.co | Official leaderboard | ||
| 71 | Omartificial-Intelligence-Space/Arabic-MiniLM-L12-v2-all-nli-triplet open weights, 0.1B | 72.7% | huggingface.co | Official leaderboard | ||
| 72 | cnmoro/static-nomic-384-pten-v2-st open weights, 0.1B | 72.3% | huggingface.co | Official leaderboard | ||
| 73 | Lajavaness/bilingual-embedding-small open weights, 0.1B | 72.3% | huggingface.co | Official leaderboard | ||
| 74 | BidirLM/BidirLM-270M-Embedding open weights, 0.3B | 72.1% | huggingface.co | Official leaderboard | ||
| 75 | ibm-granite/granite-embedding-278m-multilingual open weights, 0.3B | 72.1% | huggingface.co | Official leaderboard | ||
| 76 | Alibaba-NLP/gte-multilingual-base open weights, 0.3B | 71.9% | huggingface.co | Official leaderboard | ||
| 77 | ibm-granite/granite-embedding-107m-multilingual open weights, 0.1B | 71.8% | huggingface.co | Official leaderboard | ||
| 78 | Haon-Chen/speed-embedding-7b-instruct open weights, 7.1B | 71.8% | huggingface.co | Official leaderboard | ||
| 79 | mongodb/voyage-multilingual-2 closed weights | 71.7% | blog.voyageai.com | Official leaderboard | ||
| 80 | JMullings/spectral-embed-v1-140m open weights, 0.1B | 70.7% | huggingface.co | Official leaderboard | ||
| 81 | Gameselo/STS-multilingual-mpnet-base-v2 open weights, 0.3B | 70.3% | huggingface.co | Official leaderboard | ||
| 82 | izhx/udever-bloom-3b open weights, 3B | 70.3% | huggingface.co | Official leaderboard | ||
| 83 | hotchpotch/bekko-embedding-v1-a8m open weights, 0.1B | 70.2% | huggingface.co | Official leaderboard | ||
| 84 | omarelshehy/arabic-english-sts-matryoshka open weights, 0.6B | 69.7% | huggingface.co | Official leaderboard | ||
| 85 | izhx/udever-bloom-7b1 open weights | 69.7% | huggingface.co | Official leaderboard | ||
| 86 | nomic-ai/nomic-embed-text-v1-ablated open weights, 0.1B | 69.4% | huggingface.co | Official leaderboard | ||
| 87 | Mihaiii/Venusaur open weights, 0B | 69.4% | huggingface.co | Official leaderboard | ||
| 88 | intfloat/multilingual-e5-large-instruct open weights, 0.6B | 69.2% | huggingface.co | Official leaderboard | ||
| 89 | Mihaiii/Bulbasaur open weights, 0B | 69% | huggingface.co | Official leaderboard | ||
| 90 | Cohere/Cohere-embed-english-light-v3.0 closed weights | 69% | cohere.com | Official leaderboard | ||
| 91 | intfloat/e5-large-v2 open weights, 0.3B | 68.8% | huggingface.co | Official leaderboard | ||
| 92 | sentence-transformers/static-similarity-mrl-multilingual-v1 open weights, 0.1B | 68.8% | huggingface.co | Official leaderboard | ||
| 93 | intfloat/e5-base open weights, 0.1B | 68.7% | huggingface.co | Official leaderboard | ||
| 94 | intfloat/e5-small-v2 open weights, 0B | 68.6% | huggingface.co | Official leaderboard | ||
| 95 | sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 open weights, 0.1B | 68.6% | huggingface.co | Official leaderboard | ||
| 96 | Mihaiii/gte-micro-v4 open weights, 0B | 68.6% | huggingface.co | Official leaderboard | ||
| 97 | Mihaiii/Wartortle open weights, 0B | 68.3% | huggingface.co | Official leaderboard | ||
| 98 | nvidia/NV-Embed-v1 open weights, 7.9B | 68.3% | huggingface.co | Official leaderboard | ||
| 99 | deepvk/USER-bge-m3 open weights, 0.4B | 68.3% | huggingface.co | Official leaderboard | ||
| 100 | Mihaiii/gte-micro open weights, 0B | 68.1% | huggingface.co | Official leaderboard | ||
| 101 | Cohere/Cohere-embed-english-v3.0 closed weights | 68% | cohere.com | Official leaderboard | ||
| 102 | nomic-ai/nomic-embed-text-v1-unsupervised open weights, 0.1B | 68% | huggingface.co | Official leaderboard | ||
| 103 | intfloat/e5-base-v2 open weights, 0.1B | 67.8% | huggingface.co | Official leaderboard | ||
| 104 | infgrad/stella-base-en-v2 open weights, 0.1B | 67.6% | huggingface.co | Official leaderboard | ||
| 105 | Mihaiii/Squirtle open weights, 0B | 67.6% | huggingface.co | Official leaderboard | ||
| 106 | dwzhu/e5-base-4k open weights, 0.1B | 67.5% | huggingface.co | Official leaderboard | ||
| 107 | mongodb/voyage-3.5 closed weights | 67.5% | blog.voyageai.com | Official leaderboard | ||
| 108 | Cohere/Cohere-embed-multilingual-light-v3.0 closed weights | 67.5% | cohere.com | Official leaderboard | ||
| 109 | Mihaiii/Ivysaur open weights, 0B | 67.1% | huggingface.co | Official leaderboard | ||
| 110 | Jaume/gemma-2b-embeddings open weights, 2.5B | 67.1% | huggingface.co | Official leaderboard | ||
| 111 | nomic-ai/nomic-embed-text-v1 open weights, 0.1B | 67.1% | huggingface.co | Official leaderboard | ||
| 112 | intfloat/e5-small open weights, 0B | 67% | huggingface.co | Official leaderboard | ||
| 113 | sdadas/mmlw-e5-base open weights, 0.3B | 66.8% | huggingface.co | Official leaderboard | ||
| 114 | minishlab/potion-base-8M open weights, 0B | 66.7% | huggingface.co | Official leaderboard | ||
| 115 | avsolatorio/NoInstruct-small-Embedding-v0 open weights, 0B | 66.7% | huggingface.co | Official leaderboard | ||
| 116 | DeepPavlov/distilrubert-small-cased-conversational open weights, 0.1B | 66.7% | huggingface.co | Official leaderboard | ||
| 117 | BAAI/bge-base-en-v1.5 open weights, 0.1B | 66.5% | huggingface.co | Official leaderboard | ||
| 118 | WhereIsAI/UAE-Large-V1 open weights, 0.3B | 66.5% | huggingface.co | Official leaderboard | ||
| 119 | avsolatorio/GIST-all-MiniLM-L6-v2 open weights, 0B | 66.5% | huggingface.co | Official leaderboard | ||
| 120 | minishlab/M2V_base_output open weights, 0B | 66.5% | huggingface.co | Official leaderboard | ||
| 121 | avsolatorio/GIST-Embedding-v0 open weights, 0.1B | 66.3% | huggingface.co | Official leaderboard | ||
| 122 | intfloat/e5-large open weights, 0.3B | 66.3% | huggingface.co | Official leaderboard | ||
| 123 | mixedbread-ai/mxbai-embed-large-v1 open weights, 0.3B | 66.2% | huggingface.co | Official leaderboard | ||
| 124 | avsolatorio/GIST-large-Embedding-v0 open weights, 0.3B | 66.1% | huggingface.co | Official leaderboard | ||
| 125 | sdadas/mmlw-roberta-base open weights, 0.1B | 66.1% | huggingface.co | Official leaderboard | ||
| 126 | cointegrated/LaBSE-en-ru open weights, 0.1B | 66% | huggingface.co | Official leaderboard | ||
| 127 | thenlper/gte-base open weights, 0.1B | 66% | huggingface.co | Official leaderboard | ||
| 128 | avsolatorio/GIST-small-Embedding-v0 open weights, 0B | 66% | huggingface.co | Official leaderboard | ||
| 129 | thenlper/gte-small open weights, 0B | 65.7% | huggingface.co | Official leaderboard | ||
| 130 | nomic-ai/nomic-embed-text-v1.5 open weights, 0.1B | 65.6% | huggingface.co | Official leaderboard | ||
| 131 | BAAI/bge-large-en-v1.5 open weights, 0.3B | 65.5% | huggingface.co | Official leaderboard | ||
| 132 | sdadas/mmlw-roberta-large open weights, 0.4B | 65.5% | huggingface.co | Official leaderboard | ||
| 133 | minishlab/potion-multilingual-128M open weights, 0.1B | 65.4% | huggingface.co | Official leaderboard | ||
| 134 | sdadas/mmlw-e5-large open weights, 0.6B | 65.4% | huggingface.co | Official leaderboard | ||
| 135 | Snowflake/snowflake-arctic-embed-l-v2.0 open weights, 0.6B | 65.3% | huggingface.co | Official leaderboard | ||
| 136 | mongodb/voyage-3-lite closed weights | 65.3% | blog.voyageai.com | Official leaderboard | ||
| 137 | BAAI/bge-small-en-v1.5 open weights, 0B | 65.3% | huggingface.co | Official leaderboard | ||
| 138 | manu/sentence_croissant_alpha_v0.3 open weights, 1.3B | 65.2% | huggingface.co | Official leaderboard | ||
| 139 | abhinand/MedEmbed-small-v0.1 open weights, 0B | 65% | huggingface.co | Official leaderboard | ||
| 140 | minishlab/M2V_base_glove_subword open weights, 0.1B | 64.9% | huggingface.co | Official leaderboard | ||
| 141 | sergeyzh/LaBSE-ru-turbo open weights, 0.1B | 64.9% | huggingface.co | Official leaderboard | ||
| 142 | Tevatron/OmniEmbed-v0.1 open weights, 8.9B | 64.9% | huggingface.co | Official leaderboard | ||
| 143 | zeroentropy/zembed-1 open weights, 4B | 64.8% | huggingface.co | Official leaderboard | ||
| 144 | RiverRider/motherlode-code-small-en-v0.1 open weights, 0B | 64.6% | huggingface.co | Official leaderboard | ||
| 145 | Snowflake/snowflake-arctic-embed-m-v2.0 open weights, 0.3B | 64.6% | huggingface.co | Official leaderboard | ||
| 146 | sdadas/mmlw-e5-small open weights, 0.1B | 64.5% | huggingface.co | Official leaderboard | ||
| 147 | thenlper/gte-large open weights, 0.3B | 64.5% | huggingface.co | Official leaderboard | ||
| 148 | sergeyzh/rubert-tiny-turbo open weights, 0B | 64.5% | huggingface.co | Official leaderboard | ||
| 149 | ibm-granite/granite-embedding-311m-multilingual-r2 open weights, 0.3B | 64.3% | huggingface.co | Official leaderboard | ||
| 150 | minishlab/potion-base-4M open weights, 0B | 64.2% | huggingface.co | Official leaderboard | ||
| 151 | deepfile/embedder-100p open weights, 0.3B | 63.9% | huggingface.co | Official leaderboard | ||
| 152 | cointegrated/rubert-tiny open weights, 0B | 63.7% | huggingface.co | Official leaderboard | ||
| 153 | Omartificial-Intelligence-Space/Marbert-all-nli-triplet-Matryoshka open weights, 0.2B | 63.5% | huggingface.co | Official leaderboard | ||
| 154 | manu/sentence_croissant_alpha_v0.2 open weights, 1.3B | 63.5% | huggingface.co | Official leaderboard | ||
| 155 | manu/sentence_croissant_alpha_v0.4 open weights, 1.3B | 63.4% | huggingface.co | Official leaderboard | ||
| 156 | jinaai/jina-embeddings-v2-small-en open weights, 0B | 63.3% | huggingface.co | Official leaderboard | ||
| 157 | minishlab/M2V_base_glove open weights, 0.1B | 63.1% | huggingface.co | Official leaderboard | ||
| 158 | DeepPavlov/rubert-base-cased open weights, 1.3B | 62.7% | huggingface.co | Official leaderboard | ||
| 159 | Omartificial-Intelligence-Space/Arabic-mpnet-base-all-nli-triplet open weights, 0.1B | 62.6% | huggingface.co | Official leaderboard | ||
| 160 | malenia1/ternary-weight-embedding open weights, 0.1B | 62.6% | huggingface.co | Official leaderboard | ||
| 161 | ai-forever/ru-en-RoSBERTa open weights, 0.4B | 62.5% | huggingface.co | Official leaderboard | ||
| 162 | ibm-granite/granite-embedding-97m-multilingual-r2 open weights, 0.1B | 62.5% | huggingface.co | Official leaderboard | ||
| 163 | aari1995/German_Semantic_STS_V2 open weights, 0.3B | 62.4% | huggingface.co | Official leaderboard | ||
| 164 | minishlab/potion-base-2M open weights, 0B | 62.4% | huggingface.co | Official leaderboard | ||
| 165 | mongodb/voyage-3 closed weights | 62.2% | blog.voyageai.com | Official leaderboard | ||
| 166 | cointegrated/rubert-tiny2 open weights, 0B | 62.2% | huggingface.co | Official leaderboard | ||
| 167 | sentence-transformers/all-MiniLM-L6-v2 open weights, 0B | 62% | huggingface.co | Official leaderboard | ||
| 168 | deepvk/deberta-v1-base open weights, 0.1B | 61.8% | huggingface.co | Official leaderboard | ||
| 169 | ibm-granite/granite-embedding-125m-english open weights, 0.1B | 61.6% | huggingface.co | Official leaderboard | ||
| 170 | sentence-transformers/multi-qa-MiniLM-L6-cos-v1 open weights, 0B | 61.5% | huggingface.co | Official leaderboard | ||
| 171 | jinaai/jina-embedding-b-en-v1 open weights, 0.1B | 61.4% | huggingface.co | Official leaderboard | ||
| 172 | Snowflake/snowflake-arctic-embed-m-v1.5 open weights, 0.1B | 61.2% | huggingface.co | Official leaderboard | ||
| 173 | Haon-Chen/e5-omni-7B open weights, 8.9B | 60.7% | huggingface.co | Official leaderboard | ||
| 174 | deepvk/USER-base open weights, 0.4B | 60.4% | huggingface.co | Official leaderboard | ||
| 175 | Haon-Chen/e5-omni-3B open weights, 4.7B | 60.3% | huggingface.co | Official leaderboard | ||
| 176 | Snowflake/snowflake-arctic-embed-s open weights, 0B | 60.2% | huggingface.co | Official leaderboard | ||
| 177 | silma-ai/silma-embeddding-matryoshka-v0.1 open weights, 0.1B | 60.1% | huggingface.co | Official leaderboard | ||
| 178 | ibm-granite/granite-embedding-30m-english open weights, 0B | 60.1% | huggingface.co | Official leaderboard | ||
| 179 | lakinekaki/all-MiniLM-L6-v2-genbais open weights, 0B | 60% | huggingface.co | Official leaderboard | ||
| 180 | Snowflake/snowflake-arctic-embed-xs open weights, 0B | 59.7% | huggingface.co | Official leaderboard | ||
| 181 | Snowflake/snowflake-arctic-embed-m open weights, 0.1B | 59% | huggingface.co | Official leaderboard | ||
| 182 | Snowflake/snowflake-arctic-embed-l open weights, 0.3B | 58.8% | huggingface.co | Official leaderboard | ||
| 183 | Snowflake/snowflake-arctic-embed-m-long open weights, 0.1B | 58.7% | huggingface.co | Official leaderboard | ||
| 184 | ai-forever/sbert_large_mt_nlu_ru open weights, 0.4B | 58.5% | huggingface.co | Official leaderboard | ||
| 185 | jinaai/jina-embedding-s-en-v1 open weights, 0B | 58.5% | huggingface.co | Official leaderboard | ||
| 186 | DeepPavlov/rubert-base-cased-sentence open weights, 0.1B | 58.2% | huggingface.co | Official leaderboard | ||
| 187 | Omartificial-Intelligence-Space/Arabert-all-nli-triplet-Matryoshka open weights, 0.1B | 58.2% | huggingface.co | Official leaderboard | ||
| 188 | ai-forever/sbert_large_nlu_ru open weights, 0.4B | 57.8% | huggingface.co | Official leaderboard | ||
| 189 | Hum-Works/lodestone-base-4096-v1 open weights, 0.1B | 57.4% | huggingface.co | Official leaderboard | ||
| 190 | encord-team/ebind-full open weights, 1.8B | 57.1% | huggingface.co | Official leaderboard | ||
| 191 | consciousAI/cai-lunaris-text-embeddings open weights, 0.3B | 53.8% | huggingface.co | Official leaderboard | ||
| 192 | jinaai/jina-embeddings-v2-base-en open weights, 0.1B | 52.1% | huggingface.co | Official leaderboard | ||
| 193 | mteb/baseline-random-encoder open weights | 49.8% | Official leaderboard | |||
| 194 | sentence-transformers/sentence-t5-base open weights, 0.2B | 40.1% | huggingface.co | Official leaderboard |
| # | Model | Score | Setting | Date | Link | Source |
|---|---|---|---|---|---|---|
| 1 | | 93.2% | Jun 2025 | huggingface.co | Official leaderboard | |
| 2 | | 92.9% | Jun 2025 | huggingface.co | Official leaderboard | |
| 3 | | 90.9% | Jun 2025 | huggingface.co | Official leaderboard | |
| 4 | | 86.3% | Oct 2026 | huggingface.co | Official leaderboard |
Rankings by part
We read 8 parts from MTEB’s leaderboard in 4 groups: german, english, english (extended) and japanese. Each ranks models on one part of the test. Qwen3-Embedding-8B leads 4 of them, and 2 other models lead the rest. Arrows show how far a model moved from its overall rank among the models we track.
Test
4 models we track have a score here.
- 1
Qwen3-Embedding-4B ↑1 90.2%
- 2
Qwen3-Embedding-8B ↓1 89.7%
- 3
Qwen3-Embedding-0.6B 89.6%
- 4
EmbeddingGemma 2 81.7%
Validation
4 models we track have a score here.
- 1
Qwen3-Embedding-0.6B ↑2 90.8%
- 2
Qwen3-Embedding-8B ↓1 90.3%
- 3
Qwen3-Embedding-4B ↓1 90.1%
- 4
EmbeddingGemma 2 82.9%
Test
4 models we track have a score here.
- 1
Qwen3-Embedding-8B 93.9%
- 2
Qwen3-Embedding-4B 93.7%
- 3
Qwen3-Embedding-0.6B 91.5%
- 4
EmbeddingGemma 2 91.1%
Validation
4 models we track have a score here.
- 1
Qwen3-Embedding-8B 92.9%
- 2
Qwen3-Embedding-4B 92.2%
- 3
Qwen3-Embedding-0.6B 90.4%
- 4
EmbeddingGemma 2 89.9%
Test
4 models we track have a score here.
- 1
Qwen3-Embedding-8B 95.7%
- 2
Qwen3-Embedding-4B 95.3%
- 3
Qwen3-Embedding-0.6B 94%
- 4
EmbeddingGemma 2 92.2%
Validation
4 models we track have a score here.
- 1
Qwen3-Embedding-4B ↑1 95.1%
- 2
Qwen3-Embedding-8B ↓1 95%
- 3
Qwen3-Embedding-0.6B 93.6%
- 4
EmbeddingGemma 2 91.2%
Test
4 models we track have a score here.
- 1
Qwen3-Embedding-8B 92.8%
- 2
Qwen3-Embedding-4B 92.5%
- 3
Qwen3-Embedding-0.6B 87.2%
- 4
EmbeddingGemma 2 78.4%
Validation
4 models we track have a score here.
- 1
Qwen3-Embedding-4B ↑1 91.4%
- 2
Qwen3-Embedding-8B ↓1 90.5%
- 3
Qwen3-Embedding-0.6B 86.4%
- 4
EmbeddingGemma 2 79.1%
Number one over time
Lab claims count from the day the card came out, independent runs from the model’s release.
Source: MTEB’s leaderboard
Qwen3-Embedding-8B on the official leaderboard passed 85% in June 2025
That was 50 months after its release. All the scores we have, one dot each, so a model tested at several settings appears more than once.
Source: MTEB’s leaderboard
No lab model card reports it yet
We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.
More in Multilingual
- MMMLU In use MMLU professionally translated into 14 languages. Multiple-choice accuracy. Claude Mythos Preview 92.7%
- WMT24++ In use English-to-55-language translation of WMT24 test data. Scored with automatic metrics such as MetricX or xCOMET.
K-EXAONE 90.5%
- MMLU-ProX In use MMLU-Pro translated into up to 29 languages with expert review. Multiple-choice accuracy per language.
Qwen3.7-Max 87%
- CLIcK In use Models answer 1,995 multiple-choice questions on Korean language and culture. Questions come from official Korean exams and textbooks in eleven categories.
Solar Open 2 90.7%
- Global MMLU Lite 3.0 In use Models answer 400 human-translated MMLU questions per language in 23 languages. Version 3.0 adds Czech, Hungarian, Oriya, Slovak and Tajik and updates Italian. Accuracy. Claude Opus 5 95.7%
- MMMB In use Models answer multiple-choice questions about images in six languages across 15 categories. The set has about 12,000 questions. LFM2.5-VL-3B 83%
Data audit
All 9 checks pass. Every benchmark
Catalog record 2 pass
- Pass Task access All tasks are public.
- Pass Confidence Checked against a primary source.
Scores 3 pass 2 notes
- Pass Independent runs Scores from the official leaderboard (194 entries).
- Pass Models scored 4 models we track, plus 190 other entries on its leaderboard.
- Pass Newest score The newest is from October 2026, for EmbeddingGemma 2.
- Note Frontier models None of its models are on the capabilities index.
- Note Headroom Saturated. The best is 93.2%, past 85% since June 2025.
Leaderboard import 3 pass
- Pass Importer We read the board on MTEB: 4 rows for models we track and 190 other entries at the last read.
- Pass Last read November 20th, 2026.
- Pass Read worked The last read worked.
Consistency 1 pass 1 note
- Note Lab claims No model has both a lab number and an independent run.
- Pass Known issues No published audit found problems.