Benchmark Almanac

Italian-Administrative-CaseHold

bigscience/sgpt-bloom-7b1-msmarco 94.4% tops its leaderboard EmbeddingGemma 2 68.9% leads the models we track
Not in model cards

Models classify Italian administrative judgments paired with their official holdings by legal subject.

MTEB scores the task using accuracy.

Kind
Law
Level
University
Scored
Checked automatically
Answers
Prediction
Tasks
All public
Measures
Capability
Subject
Law
Language
Italian
In and out
Text → Text
Interaction
Single turn
Items from
Real work and use
Refresh
One fixed set
Run by
Anyone
In views
Law and finance
Last model added
October 2026
Scores refreshed
November 20th, 2026
192
Entries on its own leaderboard, 4 models we track

bigscience/sgpt-bloom-7b1-msmarco tops the leaderboard with 94.4% EmbeddingGemma 2 leads with 68.9% among models released by October 2026

Best score per entry from the benchmark's own leaderboard, read on November 20th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. The best model we track is EmbeddingGemma 2, at 68.9%. This view shows only models we track, each at its best.

The newest model with a score here came out in October 2026, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:

192 entries. Scroll sideways for the rest.

  1. 94.4 bigscience/sgpt-bloom-7b1-msmarco
  2. 92.1 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-supervised
  3. 91.7 WhereIsAI/UAE-Large-V1
  4. 91.0 jinaai/jina-embeddings-v5-omni-small
  5. 91.0 jinaai/jina-embeddings-v5-text-small
  6. 89.8 mixedbread-ai/mxbai-embed-large-v1
  7. 88.5 izhx/udever-bloom-7b1
  8. 87.4 jinaai/jina-embeddings-v5-omni-nano
  9. 87.4 jinaai/jina-embeddings-v5-text-nano
  10. 85.5 BidirLM/BidirLM-Omni-2.5B-Embedding
  11. 85.3 Bytedance/Seed1.6-embedding-1215
  12. 85.0 sdadas/mmlw-e5-large
  13. 85.0 tencent/KaLM-Embedding-Gemma3-12B-2511
  14. 85.0 sdadas/mmlw-e5-base
  15. 84.4 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-unsup-simcse
  16. 84.2 sdadas/mmlw-roberta-base
  17. 84.0 sdadas/mmlw-roberta-large
  18. 82.5 Mihaiii/Ivysaur
  19. 81.6 sdadas/mmlw-e5-small
  20. 80.3 avsolatorio/NoInstruct-small-Embedding-v0
  21. 79.3 izhx/udever-bloom-3b
  22. 79.3 Lajavaness/bilingual-embedding-small
  23. 79.2 microsoft/harrier-oss-v1-27b
  24. 78.8 microsoft/harrier-oss-v1-0.6b
  25. 78.7 Omartificial-Intelligence-Space/Arabic-all-nli-triplet-Matryoshka
  26. 78.0 izhx/udever-bloom-1b1
  27. 78.0 BidirLM/BidirLM-1.7B-Embedding
  28. 76.6 microsoft/harrier-oss-v1-270m
  29. 76.2 BidirLM/BidirLM-0.6B-Embedding
  30. 76.0 Haon-Chen/speed-embedding-7b-instruct
  31. 75.9 BAAI/bge-large-en-v1.5
  32. 75.1 GritLM/GritLM-8x7B
  33. 74.6 avsolatorio/GIST-large-Embedding-v0
  34. 73.5 GritLM/GritLM-7B
  35. 73.3 google/gemini-embedding-001
  36. 73.2 nvidia/llama-embed-nemotron-8b
  37. 73.0 codefuse-ai/F2LLM-v2-14B
  38. 72.8 Cohere/Cohere-embed-multilingual-light-v3.0
  39. 72.5 thenlper/gte-large
  40. 72.4 Mira190/Euler-Legal-Embedding-V1
  41. 72.4 Alibaba-NLP/gte-Qwen1.5-7B-instruct
  42. 72.2 codefuse-ai/F2LLM-v2-8B
  43. 72.2 ICT-TIME-and-Querit/BOOM_4B_v1
  44. 72.0 ibm-granite/granite-embedding-278m-multilingual
  45. 72.0 ai-sage/Giga-Embeddings-instruct-10B-A1.8B-0826
  46. 71.8 sentence-transformers/paraphrase-multilingual-mpnet-base-v2
  47. 71.6 Octen/Octen-Embedding-8B
  48. 71.6 Alibaba-NLP/gte-Qwen2-7B-instruct
  49. 71.6 NovaSearch/stella_en_1.5B_v5
  50. 71.5 codefuse-ai/F2LLM-v2-4B
  51. 71.4 Snowflake/snowflake-arctic-embed-m-v2.0
  52. 71.3 Salesforce/SFR-Embedding-Mistral
  53. 71.0 Linq-AI-Research/Linq-Embed-Mistral
  54. 70.9 BidirLM/BidirLM-1B-Embedding
  55. 70.7 infgrad/stella-base-en-v2
  56. 70.5 ICT-TIME-and-Querit/ICT-TIME-and-Querit-embedding-v1
  57. 70.4 google/embeddinggemma-300m
  58. 70.1 openai/text-embedding-3-large
  59. 70.1 Alibaba-NLP/gte-Qwen2-1.5B-instruct
  60. 69.9 manu/sentence_croissant_alpha_v0.2
  61. 69.7 BAAI/bge-base-en-v1.5
  62. 69.7 thenlper/gte-base
  63. 69.6 OrdalieTech/Solon-embeddings-large-0.1
  64. 69.4 ai-sage/Giga-Embeddings-instruct-3B-0826
  65. 69.4 nomic-ai/nomic-embed-text-v2-moe
  66. 69.3 intfloat/e5-base-v2
  67. 68.9 EmbeddingGemma 2
  68. 68.8 BAAI/bge-small-en-v1.5
  69. 68.8 NovaSearch/stella_en_400M_v5
  70. 68.4 Lajavaness/bilingual-embedding-large
  71. 68.3 mongodb/voyage-3-lite
  72. 68.3 Mihaiii/gte-micro-v4
  73. 68.1 Snowflake/snowflake-arctic-embed-l-v2.0
  74. 68.0 Cohere/Cohere-embed-multilingual-v3.0
  75. 68.0 NovaSearch/jasper_en_vision_language_v1
  76. 67.9 codefuse-ai/F2LLM-v2-1.7B
  77. 67.9 intfloat/e5-mistral-7b-instruct
  78. 67.8 abhinand/MedEmbed-small-v0.1
  79. 67.7 BAAI/bge-m3
  80. 67.6 HIT-TMG/KaLM-embedding-multilingual-mini-v1
  81. 67.2 sentence-transformers/all-MiniLM-L12-v2
  82. 67.0 Snowflake/snowflake-arctic-embed-m-v1.5
  83. 67.0 Cohere/Cohere-embed-english-v3.0
  84. 66.8 thenlper/gte-small
  85. 66.8 intfloat/multilingual-e5-large
  86. 66.7 Qwen3-Embedding-4B
  87. 66.5 mongodb/voyage-3
  88. 66.5 Snowflake/snowflake-arctic-embed-m
  89. 66.3 hotchpotch/bekko-embedding-v1-a25m
  90. 66.2 Snowflake/snowflake-arctic-embed-l
  91. 66.2 jinaai/jina-embedding-s-en-v1
  92. 66.2 hotchpotch/bekko-embedding-v1-a8m
  93. 66.1 Qwen3-Embedding-8B
  94. 65.9 intfloat/multilingual-e5-small
  95. 65.7 manu/sentence_croissant_alpha_v0.4
  96. 65.5 avsolatorio/GIST-Embedding-v0
  97. 65.5 manu/bge-m3-custom-fr
  98. 65.4 izhx/udever-bloom-560m
  99. 65.3 albertobarnabo/bge-m3-italian
  100. 65.3 zeroentropy/zembed-1
  101. 65.1 intfloat/e5-small-v2
  102. 64.9 deepvk/USER-bge-m3
  103. 64.8 Lajavaness/bilingual-embedding-base
  104. 64.7 Omartificial-Intelligence-Space/Arabic-MiniLM-L12-v2-all-nli-triplet
  105. 64.5 codefuse-ai/F2LLM-v2-330M
  106. 64.3 dwzhu/e5-base-4k
  107. 64.2 Snowflake/snowflake-arctic-embed-s
  108. 64.1 Salesforce/SFR-Embedding-2_R
  109. 64.0 intfloat/e5-large-v2
  110. 63.6 intfloat/e5-base
  111. 63.4 ibm-granite/granite-embedding-107m-multilingual
  112. 63.0 BidirLM/BidirLM-270M-Embedding
  113. 63.0 openai/text-embedding-3-small
  114. 62.9 intfloat/multilingual-e5-large-instruct
  115. 62.9 nomic-ai/nomic-embed-text-v1-ablated
  116. 62.9 Alibaba-NLP/gte-multilingual-base
  117. 62.9 nomic-ai/nomic-embed-text-v1
  118. 62.8 jinaai/jina-embeddings-v3
  119. 62.4 Mihaiii/Bulbasaur
  120. 62.4 nomic-ai/nomic-embed-text-v1-unsupervised
  121. 62.3 deepfile/embedder-100p
  122. 62.2 codefuse-ai/F2LLM-v2-0.6B
  123. 62.1 mongodb/voyage-3.5
  124. 62.0 codefuse-ai/F2LLM-v2-160M
  125. 62.0 manu/sentence_croissant_alpha_v0.3
  126. 61.7 Qwen3-Embedding-0.6B
  127. 61.5 intfloat/multilingual-e5-base
  128. 61.4 Snowflake/snowflake-arctic-embed-xs
  129. 61.3 avsolatorio/GIST-small-Embedding-v0
  130. 61.2 google/text-multilingual-embedding-002
  131. 60.7 avsolatorio/GIST-all-MiniLM-L6-v2
  132. 60.5 HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1
  133. 60.4 Cohere/Cohere-embed-english-light-v3.0
  134. 59.2 sentence-transformers/all-mpnet-base-v2
  135. 58.9 hotchpotch/bekko-static-embedding-v1
  136. 58.6 ibm-granite/granite-embedding-30m-english
  137. 58.4 Omartificial-Intelligence-Space/Arabic-mpnet-base-all-nli-triplet
  138. 58.0 codefuse-ai/F2LLM-v2-80M
  139. 56.6 Mihaiii/Venusaur
  140. 56.4 Omartificial-Intelligence-Space/Arabic-labse-Matryoshka
  141. 55.7 ibm-granite/granite-embedding-97m-multilingual-r2
  142. 55.4 ibm-granite/granite-embedding-311m-multilingual-r2
  143. 55.4 nomic-ai/nomic-embed-text-v1.5
  144. 55.3 Gameselo/STS-multilingual-mpnet-base-v2
  145. 55.3 Mihaiii/Wartortle
  146. 54.6 sentence-transformers/static-similarity-mrl-multilingual-v1
  147. 54.5 sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2
  148. 54.3 intfloat/e5-large
  149. 53.7 jinaai/jina-embedding-b-en-v1
  150. 53.4 nvidia/NV-Embed-v1
  151. 53.3 sentence-transformers/LaBSE
  152. 53.2 omarelshehy/arabic-english-sts-matryoshka
  153. 53.1 Jaume/gemma-2b-embeddings
  154. 52.4 sergeyzh/LaBSE-ru-turbo
  155. 51.9 minishlab/potion-multilingual-128M
  156. 51.2 brahmairesearch/slx-v0.1
  157. 51.2 sentence-transformers/all-MiniLM-L6-v2
  158. 50.9 shibing624/text2vec-base-multilingual
  159. 50.7 cnmoro/static-nomic-384-pten-v2-st
  160. 50.4 intfloat/e5-small
  161. 50.1 deepvk/USER-base
  162. 49.4 ibm-granite/granite-embedding-125m-english
  163. 48.4 Mihaiii/Squirtle
  164. 48.0 consciousAI/cai-lunaris-text-embeddings
  165. 45.9 Mihaiii/gte-micro
  166. 45.4 ai-forever/ru-en-RoSBERTa
  167. 44.6 aari1995/German_Semantic_STS_V2
  168. 43.7 nvidia/NV-Embed-v2
  169. 42.3 Omartificial-Intelligence-Space/Arabert-all-nli-triplet-Matryoshka
  170. 41.6 Snowflake/snowflake-arctic-embed-m-long
  171. 40.9 cointegrated/LaBSE-en-ru
  172. 40.7 deepvk/deberta-v1-base
  173. 40.7 Omartificial-Intelligence-Space/Marbert-all-nli-triplet-Matryoshka
  174. 40.0 minishlab/M2V_base_glove_subword
  175. 36.3 DeepPavlov/distilrubert-small-cased-conversational
  176. 34.9 minishlab/M2V_base_output
  177. 34.7 DeepPavlov/rubert-base-cased
  178. 33.2 silma-ai/silma-embeddding-matryoshka-v0.1
  179. 32.3 minishlab/M2V_base_glove
  180. 31.6 minishlab/potion-base-8M
  181. 30.5 DeepPavlov/rubert-base-cased-sentence
  182. 30.4 cointegrated/rubert-tiny
  183. 27.4 minishlab/potion-base-4M
  184. 23.3 malenia1/ternary-weight-embedding
  185. 23.1 ai-forever/sbert_large_nlu_ru
  186. 22.9 minishlab/potion-base-2M
  187. 22.9 ai-forever/sbert_large_mt_nlu_ru
  188. 18.2 cointegrated/rubert-tiny2
  189. 18.1 sergeyzh/rubert-tiny-turbo
  190. 16.6 jinaai/jina-embeddings-v2-small-en
  191. 7.33 jinaai/jina-embeddings-v2-base-en
  192. 2.35 mteb/baseline-random-encoder
  1. 1 bigscience/sgpt-bloom-7b1-msmarco 94.4%
  2. 2 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-supervised 92.1%
  3. 3 WhereIsAI/UAE-Large-V1 91.7%
  4. 4 jinaai/jina-embeddings-v5-omni-small 91%
  5. 5 jinaai/jina-embeddings-v5-text-small 91%
  6. 6 mixedbread-ai/mxbai-embed-large-v1 89.8%
  7. 7 izhx/udever-bloom-7b1 88.5%
  8. 8 jinaai/jina-embeddings-v5-omni-nano 87.4%
  9. 9 jinaai/jina-embeddings-v5-text-nano 87.4%
  10. 10 BidirLM/BidirLM-Omni-2.5B-Embedding 85.5%
  11. 11 Bytedance/Seed1.6-embedding-1215 85.3%
  12. 12 sdadas/mmlw-e5-large 85%
  13. 13 tencent/KaLM-Embedding-Gemma3-12B-2511 85%
  14. 14 sdadas/mmlw-e5-base 85%
  15. 15 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-unsup-simcse 84.4%
  16. 16 sdadas/mmlw-roberta-base 84.2%
  17. 17 sdadas/mmlw-roberta-large 84%
  18. 18 Mihaiii/Ivysaur 82.5%
  19. 19 sdadas/mmlw-e5-small 81.6%
  20. 20 avsolatorio/NoInstruct-small-Embedding-v0 80.3%
  21. 21 izhx/udever-bloom-3b 79.3%
  22. 22 Lajavaness/bilingual-embedding-small 79.3%
  23. 23 microsoft/harrier-oss-v1-27b 79.2%
  24. 24 microsoft/harrier-oss-v1-0.6b 78.8%
  25. 25 Omartificial-Intelligence-Space/Arabic-all-nli-triplet-Matryoshka 78.7%
  26. 26 izhx/udever-bloom-1b1 78%
  27. 27 BidirLM/BidirLM-1.7B-Embedding 78%
  28. 28 microsoft/harrier-oss-v1-270m 76.6%
  29. 29 BidirLM/BidirLM-0.6B-Embedding 76.2%
  30. 30 Haon-Chen/speed-embedding-7b-instruct 76%
  31. 31 BAAI/bge-large-en-v1.5 75.9%
  32. 32 GritLM/GritLM-8x7B 75.1%
  33. 33 avsolatorio/GIST-large-Embedding-v0 74.6%
  34. 34 GritLM/GritLM-7B 73.5%
  35. 35 google/gemini-embedding-001 73.3%
  36. 36 nvidia/llama-embed-nemotron-8b 73.2%
  37. 37 codefuse-ai/F2LLM-v2-14B 73%
  38. 38 Cohere/Cohere-embed-multilingual-light-v3.0 72.8%
  39. 39 thenlper/gte-large 72.5%
  40. 40 Mira190/Euler-Legal-Embedding-V1 72.4%
  41. 41 Alibaba-NLP/gte-Qwen1.5-7B-instruct 72.4%
  42. 42 codefuse-ai/F2LLM-v2-8B 72.2%
  43. 43 ICT-TIME-and-Querit/BOOM_4B_v1 72.2%
  44. 44 ibm-granite/granite-embedding-278m-multilingual 72%
  45. 45 ai-sage/Giga-Embeddings-instruct-10B-A1.8B-0826 72%
  46. 46 sentence-transformers/paraphrase-multilingual-mpnet-base-v2 71.8%
  47. 47 Octen/Octen-Embedding-8B 71.6%
  48. 48 Alibaba-NLP/gte-Qwen2-7B-instruct 71.6%
  49. 49 NovaSearch/stella_en_1.5B_v5 71.6%
  50. 50 codefuse-ai/F2LLM-v2-4B 71.5%
  51. 51 Snowflake/snowflake-arctic-embed-m-v2.0 71.4%
  52. 52 Salesforce/SFR-Embedding-Mistral 71.3%
  53. 53 Linq-AI-Research/Linq-Embed-Mistral 71%
  54. 54 BidirLM/BidirLM-1B-Embedding 70.9%
  55. 55 infgrad/stella-base-en-v2 70.7%
  56. 56 ICT-TIME-and-Querit/ICT-TIME-and-Querit-embedding-v1 70.5%
  57. 57 google/embeddinggemma-300m 70.4%
  58. 58 openai/text-embedding-3-large 70.1%
  59. 59 Alibaba-NLP/gte-Qwen2-1.5B-instruct 70.1%
  60. 60 manu/sentence_croissant_alpha_v0.2 69.9%
  61. 61 BAAI/bge-base-en-v1.5 69.7%
  62. 62 thenlper/gte-base 69.7%
  63. 63 OrdalieTech/Solon-embeddings-large-0.1 69.6%
  64. 64 ai-sage/Giga-Embeddings-instruct-3B-0826 69.4%
  65. 65 nomic-ai/nomic-embed-text-v2-moe 69.4%
  66. 66 intfloat/e5-base-v2 69.3%
  67. 67 EmbeddingGemma 2 68.9%
  68. 68 BAAI/bge-small-en-v1.5 68.8%
  69. 69 NovaSearch/stella_en_400M_v5 68.8%
  70. 70 Lajavaness/bilingual-embedding-large 68.4%
  71. 71 mongodb/voyage-3-lite 68.3%
  72. 72 Mihaiii/gte-micro-v4 68.3%
  73. 73 Snowflake/snowflake-arctic-embed-l-v2.0 68.1%
  74. 74 Cohere/Cohere-embed-multilingual-v3.0 68%
  75. 75 NovaSearch/jasper_en_vision_language_v1 68%
  76. 76 codefuse-ai/F2LLM-v2-1.7B 67.9%
  77. 77 intfloat/e5-mistral-7b-instruct 67.9%
  78. 78 abhinand/MedEmbed-small-v0.1 67.8%
  79. 79 BAAI/bge-m3 67.7%
  80. 80 HIT-TMG/KaLM-embedding-multilingual-mini-v1 67.6%
  81. 81 sentence-transformers/all-MiniLM-L12-v2 67.2%
  82. 82 Snowflake/snowflake-arctic-embed-m-v1.5 67%
  83. 83 Cohere/Cohere-embed-english-v3.0 67%
  84. 84 thenlper/gte-small 66.8%
  85. 85 intfloat/multilingual-e5-large 66.8%
  86. 86 Qwen3-Embedding-4B 66.7%
  87. 87 mongodb/voyage-3 66.5%
  88. 88 Snowflake/snowflake-arctic-embed-m 66.5%
  89. 89 hotchpotch/bekko-embedding-v1-a25m 66.3%
  90. 90 Snowflake/snowflake-arctic-embed-l 66.2%
  91. 91 jinaai/jina-embedding-s-en-v1 66.2%
  92. 92 hotchpotch/bekko-embedding-v1-a8m 66.2%
  93. 93 Qwen3-Embedding-8B 66.1%
  94. 94 intfloat/multilingual-e5-small 65.9%
  95. 95 manu/sentence_croissant_alpha_v0.4 65.7%
  96. 96 avsolatorio/GIST-Embedding-v0 65.5%
  97. 97 manu/bge-m3-custom-fr 65.5%
  98. 98 izhx/udever-bloom-560m 65.4%
  99. 99 albertobarnabo/bge-m3-italian 65.3%
  100. 100 zeroentropy/zembed-1 65.3%
  101. 101 intfloat/e5-small-v2 65.1%
  102. 102 deepvk/USER-bge-m3 64.9%
  103. 103 Lajavaness/bilingual-embedding-base 64.8%
  104. 104 Omartificial-Intelligence-Space/Arabic-MiniLM-L12-v2-all-nli-triplet 64.7%
  105. 105 codefuse-ai/F2LLM-v2-330M 64.5%
  106. 106 dwzhu/e5-base-4k 64.3%
  107. 107 Snowflake/snowflake-arctic-embed-s 64.2%
  108. 108 Salesforce/SFR-Embedding-2_R 64.1%
  109. 109 intfloat/e5-large-v2 64%
  110. 110 intfloat/e5-base 63.6%
  111. 111 ibm-granite/granite-embedding-107m-multilingual 63.4%
  112. 112 BidirLM/BidirLM-270M-Embedding 63%
  113. 113 openai/text-embedding-3-small 63%
  114. 114 intfloat/multilingual-e5-large-instruct 62.9%
  115. 115 nomic-ai/nomic-embed-text-v1-ablated 62.9%
  116. 116 Alibaba-NLP/gte-multilingual-base 62.9%
  117. 117 nomic-ai/nomic-embed-text-v1 62.9%
  118. 118 jinaai/jina-embeddings-v3 62.8%
  119. 119 Mihaiii/Bulbasaur 62.4%
  120. 120 nomic-ai/nomic-embed-text-v1-unsupervised 62.4%
  121. 121 deepfile/embedder-100p 62.3%
  122. 122 codefuse-ai/F2LLM-v2-0.6B 62.2%
  123. 123 mongodb/voyage-3.5 62.1%
  124. 124 codefuse-ai/F2LLM-v2-160M 62%
  125. 125 manu/sentence_croissant_alpha_v0.3 62%
  126. 126 Qwen3-Embedding-0.6B 61.7%
  127. 127 intfloat/multilingual-e5-base 61.5%
  128. 128 Snowflake/snowflake-arctic-embed-xs 61.4%
  129. 129 avsolatorio/GIST-small-Embedding-v0 61.3%
  130. 130 google/text-multilingual-embedding-002 61.2%
  131. 131 avsolatorio/GIST-all-MiniLM-L6-v2 60.7%
  132. 132 HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1 60.5%
  133. 133 Cohere/Cohere-embed-english-light-v3.0 60.4%
  134. 134 sentence-transformers/all-mpnet-base-v2 59.2%
  135. 135 hotchpotch/bekko-static-embedding-v1 58.9%
  136. 136 ibm-granite/granite-embedding-30m-english 58.6%
  137. 137 Omartificial-Intelligence-Space/Arabic-mpnet-base-all-nli-triplet 58.4%
  138. 138 codefuse-ai/F2LLM-v2-80M 58%
  139. 139 Mihaiii/Venusaur 56.6%
  140. 140 Omartificial-Intelligence-Space/Arabic-labse-Matryoshka 56.4%
  141. 141 ibm-granite/granite-embedding-97m-multilingual-r2 55.7%
  142. 142 ibm-granite/granite-embedding-311m-multilingual-r2 55.4%
  143. 143 nomic-ai/nomic-embed-text-v1.5 55.4%
  144. 144 Gameselo/STS-multilingual-mpnet-base-v2 55.3%
  145. 145 Mihaiii/Wartortle 55.3%
  146. 146 sentence-transformers/static-similarity-mrl-multilingual-v1 54.6%
  147. 147 sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 54.5%
  148. 148 intfloat/e5-large 54.3%
  149. 149 jinaai/jina-embedding-b-en-v1 53.7%
  150. 150 nvidia/NV-Embed-v1 53.4%
  151. 151 sentence-transformers/LaBSE 53.3%
  152. 152 omarelshehy/arabic-english-sts-matryoshka 53.2%
  153. 153 Jaume/gemma-2b-embeddings 53.1%
  154. 154 sergeyzh/LaBSE-ru-turbo 52.4%
  155. 155 minishlab/potion-multilingual-128M 51.9%
  156. 156 brahmairesearch/slx-v0.1 51.2%
  157. 157 sentence-transformers/all-MiniLM-L6-v2 51.2%
  158. 158 shibing624/text2vec-base-multilingual 50.9%
  159. 159 cnmoro/static-nomic-384-pten-v2-st 50.7%
  160. 160 intfloat/e5-small 50.4%
  161. 161 deepvk/USER-base 50.1%
  162. 162 ibm-granite/granite-embedding-125m-english 49.4%
  163. 163 Mihaiii/Squirtle 48.4%
  164. 164 consciousAI/cai-lunaris-text-embeddings 48%
  165. 165 Mihaiii/gte-micro 45.9%
  166. 166 ai-forever/ru-en-RoSBERTa 45.4%
  167. 167 aari1995/German_Semantic_STS_V2 44.6%
  168. 168 nvidia/NV-Embed-v2 43.7%
  169. 169 Omartificial-Intelligence-Space/Arabert-all-nli-triplet-Matryoshka 42.3%
  170. 170 Snowflake/snowflake-arctic-embed-m-long 41.6%
  171. 171 cointegrated/LaBSE-en-ru 40.9%
  172. 172 deepvk/deberta-v1-base 40.7%
  173. 173 Omartificial-Intelligence-Space/Marbert-all-nli-triplet-Matryoshka 40.7%
  174. 174 minishlab/M2V_base_glove_subword 40%
  175. 175 DeepPavlov/distilrubert-small-cased-conversational 36.3%
  176. 176 minishlab/M2V_base_output 34.9%
  177. 177 DeepPavlov/rubert-base-cased 34.7%
  178. 178 silma-ai/silma-embeddding-matryoshka-v0.1 33.2%
  179. 179 minishlab/M2V_base_glove 32.3%
  180. 180 minishlab/potion-base-8M 31.6%
  181. 181 DeepPavlov/rubert-base-cased-sentence 30.5%
  182. 182 cointegrated/rubert-tiny 30.4%
  183. 183 minishlab/potion-base-4M 27.4%
  184. 184 malenia1/ternary-weight-embedding 23.3%
  185. 185 ai-forever/sbert_large_nlu_ru 23.1%
  186. 186 minishlab/potion-base-2M 22.9%
  187. 187 ai-forever/sbert_large_mt_nlu_ru 22.9%
  188. 188 cointegrated/rubert-tiny2 18.2%
  189. 189 sergeyzh/rubert-tiny-turbo 18.1%
  190. 190 jinaai/jina-embeddings-v2-small-en 16.6%
  191. 191 jinaai/jina-embeddings-v2-base-en 7.33%
  192. 192 mteb/baseline-random-encoder 2.35%

Source: Official Italian-Administrative-CaseHold leaderboard

#EntryScoreSettingDateSource
1 bigscience/sgpt-bloom-7b1-msmarco 94.4% Official leaderboard
2 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-supervised 92.1% Official leaderboard
3 WhereIsAI/UAE-Large-V1 91.7% Official leaderboard
4 jinaai/jina-embeddings-v5-omni-small 91% Official leaderboard
5 jinaai/jina-embeddings-v5-text-small 91% Official leaderboard
6 mixedbread-ai/mxbai-embed-large-v1 89.8% Official leaderboard
7 izhx/udever-bloom-7b1 88.5% Official leaderboard
8 jinaai/jina-embeddings-v5-omni-nano 87.4% Official leaderboard
9 jinaai/jina-embeddings-v5-text-nano 87.4% Official leaderboard
10 BidirLM/BidirLM-Omni-2.5B-Embedding 85.5% Official leaderboard
11 Bytedance/Seed1.6-embedding-1215 85.3% Official leaderboard
12 sdadas/mmlw-e5-large 85% Official leaderboard
13 tencent/KaLM-Embedding-Gemma3-12B-2511 85% Official leaderboard
14 sdadas/mmlw-e5-base 85% Official leaderboard
15 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-unsup-simcse 84.4% Official leaderboard
16 sdadas/mmlw-roberta-base 84.2% Official leaderboard
17 sdadas/mmlw-roberta-large 84% Official leaderboard
18 Mihaiii/Ivysaur 82.5% Official leaderboard
19 sdadas/mmlw-e5-small 81.6% Official leaderboard
20 avsolatorio/NoInstruct-small-Embedding-v0 80.3% Official leaderboard
21 izhx/udever-bloom-3b 79.3% Official leaderboard
22 Lajavaness/bilingual-embedding-small 79.3% Official leaderboard
23 microsoft/harrier-oss-v1-27b 79.2% Official leaderboard
24 microsoft/harrier-oss-v1-0.6b 78.8% Official leaderboard
25 Omartificial-Intelligence-Space/Arabic-all-nli-triplet-Matryoshka 78.7% Official leaderboard
26 izhx/udever-bloom-1b1 78% Official leaderboard
27 BidirLM/BidirLM-1.7B-Embedding 78% Official leaderboard
28 microsoft/harrier-oss-v1-270m 76.6% Official leaderboard
29 BidirLM/BidirLM-0.6B-Embedding 76.2% Official leaderboard
30 Haon-Chen/speed-embedding-7b-instruct 76% Official leaderboard
31 BAAI/bge-large-en-v1.5 75.9% Official leaderboard
32 GritLM/GritLM-8x7B 75.1% Official leaderboard
33 avsolatorio/GIST-large-Embedding-v0 74.6% Official leaderboard
34 GritLM/GritLM-7B 73.5% Official leaderboard
35 google/gemini-embedding-001 73.3% Official leaderboard
36 nvidia/llama-embed-nemotron-8b 73.2% Official leaderboard
37 codefuse-ai/F2LLM-v2-14B 73% Official leaderboard
38 Cohere/Cohere-embed-multilingual-light-v3.0 72.8% Official leaderboard
39 thenlper/gte-large 72.5% Official leaderboard
40 Mira190/Euler-Legal-Embedding-V1 72.4% Official leaderboard
41 Alibaba-NLP/gte-Qwen1.5-7B-instruct 72.4% Official leaderboard
42 codefuse-ai/F2LLM-v2-8B 72.2% Official leaderboard
43 ICT-TIME-and-Querit/BOOM_4B_v1 72.2% Official leaderboard
44 ibm-granite/granite-embedding-278m-multilingual 72% Official leaderboard
45 ai-sage/Giga-Embeddings-instruct-10B-A1.8B-0826 72% Official leaderboard
46 sentence-transformers/paraphrase-multilingual-mpnet-base-v2 71.8% Official leaderboard
47 Octen/Octen-Embedding-8B 71.6% Official leaderboard
48 Alibaba-NLP/gte-Qwen2-7B-instruct 71.6% Official leaderboard
49 NovaSearch/stella_en_1.5B_v5 71.6% Official leaderboard
50 codefuse-ai/F2LLM-v2-4B 71.5% Official leaderboard
51 Snowflake/snowflake-arctic-embed-m-v2.0 71.4% Official leaderboard
52 Salesforce/SFR-Embedding-Mistral 71.3% Official leaderboard
53 Linq-AI-Research/Linq-Embed-Mistral 71% Official leaderboard
54 BidirLM/BidirLM-1B-Embedding 70.9% Official leaderboard
55 infgrad/stella-base-en-v2 70.7% Official leaderboard
56 ICT-TIME-and-Querit/ICT-TIME-and-Querit-embedding-v1 70.5% Official leaderboard
57 google/embeddinggemma-300m 70.4% Official leaderboard
58 openai/text-embedding-3-large 70.1% Official leaderboard
59 Alibaba-NLP/gte-Qwen2-1.5B-instruct 70.1% Official leaderboard
60 manu/sentence_croissant_alpha_v0.2 69.9% Official leaderboard
61 BAAI/bge-base-en-v1.5 69.7% Official leaderboard
62 thenlper/gte-base 69.7% Official leaderboard
63 OrdalieTech/Solon-embeddings-large-0.1 69.6% Official leaderboard
64 ai-sage/Giga-Embeddings-instruct-3B-0826 69.4% Official leaderboard
65 nomic-ai/nomic-embed-text-v2-moe 69.4% Official leaderboard
66 intfloat/e5-base-v2 69.3% Official leaderboard
67 EmbeddingGemma 2 68.9% Oct 2026 Official leaderboard
68 BAAI/bge-small-en-v1.5 68.8% Official leaderboard
69 NovaSearch/stella_en_400M_v5 68.8% Official leaderboard
70 Lajavaness/bilingual-embedding-large 68.4% Official leaderboard
71 mongodb/voyage-3-lite 68.3% Official leaderboard
72 Mihaiii/gte-micro-v4 68.3% Official leaderboard
73 Snowflake/snowflake-arctic-embed-l-v2.0 68.1% Official leaderboard
74 Cohere/Cohere-embed-multilingual-v3.0 68% Official leaderboard
75 NovaSearch/jasper_en_vision_language_v1 68% Official leaderboard
76 codefuse-ai/F2LLM-v2-1.7B 67.9% Official leaderboard
77 intfloat/e5-mistral-7b-instruct 67.9% Official leaderboard
78 abhinand/MedEmbed-small-v0.1 67.8% Official leaderboard
79 BAAI/bge-m3 67.7% Official leaderboard
80 HIT-TMG/KaLM-embedding-multilingual-mini-v1 67.6% Official leaderboard
81 sentence-transformers/all-MiniLM-L12-v2 67.2% Official leaderboard
82 Snowflake/snowflake-arctic-embed-m-v1.5 67% Official leaderboard
83 Cohere/Cohere-embed-english-v3.0 67% Official leaderboard
84 thenlper/gte-small 66.8% Official leaderboard
85 intfloat/multilingual-e5-large 66.8% Official leaderboard
86 Qwen3-Embedding-4B 66.7% Jun 2025 Official leaderboard
87 mongodb/voyage-3 66.5% Official leaderboard
88 Snowflake/snowflake-arctic-embed-m 66.5% Official leaderboard
89 hotchpotch/bekko-embedding-v1-a25m 66.3% Official leaderboard
90 Snowflake/snowflake-arctic-embed-l 66.2% Official leaderboard
91 jinaai/jina-embedding-s-en-v1 66.2% Official leaderboard
92 hotchpotch/bekko-embedding-v1-a8m 66.2% Official leaderboard
93 Qwen3-Embedding-8B 66.1% Jun 2025 Official leaderboard
94 intfloat/multilingual-e5-small 65.9% Official leaderboard
95 manu/sentence_croissant_alpha_v0.4 65.7% Official leaderboard
96 avsolatorio/GIST-Embedding-v0 65.5% Official leaderboard
97 manu/bge-m3-custom-fr 65.5% Official leaderboard
98 izhx/udever-bloom-560m 65.4% Official leaderboard
99 albertobarnabo/bge-m3-italian 65.3% Official leaderboard
100 zeroentropy/zembed-1 65.3% Official leaderboard
101 intfloat/e5-small-v2 65.1% Official leaderboard
102 deepvk/USER-bge-m3 64.9% Official leaderboard
103 Lajavaness/bilingual-embedding-base 64.8% Official leaderboard
104 Omartificial-Intelligence-Space/Arabic-MiniLM-L12-v2-all-nli-triplet 64.7% Official leaderboard
105 codefuse-ai/F2LLM-v2-330M 64.5% Official leaderboard
106 dwzhu/e5-base-4k 64.3% Official leaderboard
107 Snowflake/snowflake-arctic-embed-s 64.2% Official leaderboard
108 Salesforce/SFR-Embedding-2_R 64.1% Official leaderboard
109 intfloat/e5-large-v2 64% Official leaderboard
110 intfloat/e5-base 63.6% Official leaderboard
111 ibm-granite/granite-embedding-107m-multilingual 63.4% Official leaderboard
112 BidirLM/BidirLM-270M-Embedding 63% Official leaderboard
113 openai/text-embedding-3-small 63% Official leaderboard
114 intfloat/multilingual-e5-large-instruct 62.9% Official leaderboard
115 nomic-ai/nomic-embed-text-v1-ablated 62.9% Official leaderboard
116 Alibaba-NLP/gte-multilingual-base 62.9% Official leaderboard
117 nomic-ai/nomic-embed-text-v1 62.9% Official leaderboard
118 jinaai/jina-embeddings-v3 62.8% Official leaderboard
119 Mihaiii/Bulbasaur 62.4% Official leaderboard
120 nomic-ai/nomic-embed-text-v1-unsupervised 62.4% Official leaderboard
121 deepfile/embedder-100p 62.3% Official leaderboard
122 codefuse-ai/F2LLM-v2-0.6B 62.2% Official leaderboard
123 mongodb/voyage-3.5 62.1% Official leaderboard
124 codefuse-ai/F2LLM-v2-160M 62% Official leaderboard
125 manu/sentence_croissant_alpha_v0.3 62% Official leaderboard
126 Qwen3-Embedding-0.6B 61.7% Jun 2025 Official leaderboard
127 intfloat/multilingual-e5-base 61.5% Official leaderboard
128 Snowflake/snowflake-arctic-embed-xs 61.4% Official leaderboard
129 avsolatorio/GIST-small-Embedding-v0 61.3% Official leaderboard
130 google/text-multilingual-embedding-002 61.2% Official leaderboard
131 avsolatorio/GIST-all-MiniLM-L6-v2 60.7% Official leaderboard
132 HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1 60.5% Official leaderboard
133 Cohere/Cohere-embed-english-light-v3.0 60.4% Official leaderboard
134 sentence-transformers/all-mpnet-base-v2 59.2% Official leaderboard
135 hotchpotch/bekko-static-embedding-v1 58.9% Official leaderboard
136 ibm-granite/granite-embedding-30m-english 58.6% Official leaderboard
137 Omartificial-Intelligence-Space/Arabic-mpnet-base-all-nli-triplet 58.4% Official leaderboard
138 codefuse-ai/F2LLM-v2-80M 58% Official leaderboard
139 Mihaiii/Venusaur 56.6% Official leaderboard
140 Omartificial-Intelligence-Space/Arabic-labse-Matryoshka 56.4% Official leaderboard
141 ibm-granite/granite-embedding-97m-multilingual-r2 55.7% Official leaderboard
142 ibm-granite/granite-embedding-311m-multilingual-r2 55.4% Official leaderboard
143 nomic-ai/nomic-embed-text-v1.5 55.4% Official leaderboard
144 Gameselo/STS-multilingual-mpnet-base-v2 55.3% Official leaderboard
145 Mihaiii/Wartortle 55.3% Official leaderboard
146 sentence-transformers/static-similarity-mrl-multilingual-v1 54.6% Official leaderboard
147 sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 54.5% Official leaderboard
148 intfloat/e5-large 54.3% Official leaderboard
149 jinaai/jina-embedding-b-en-v1 53.7% Official leaderboard
150 nvidia/NV-Embed-v1 53.4% Official leaderboard
151 sentence-transformers/LaBSE 53.3% Official leaderboard
152 omarelshehy/arabic-english-sts-matryoshka 53.2% Official leaderboard
153 Jaume/gemma-2b-embeddings 53.1% Official leaderboard
154 sergeyzh/LaBSE-ru-turbo 52.4% Official leaderboard
155 minishlab/potion-multilingual-128M 51.9% Official leaderboard
156 brahmairesearch/slx-v0.1 51.2% Official leaderboard
157 sentence-transformers/all-MiniLM-L6-v2 51.2% Official leaderboard
158 shibing624/text2vec-base-multilingual 50.9% Official leaderboard
159 cnmoro/static-nomic-384-pten-v2-st 50.7% Official leaderboard
160 intfloat/e5-small 50.4% Official leaderboard
161 deepvk/USER-base 50.1% Official leaderboard
162 ibm-granite/granite-embedding-125m-english 49.4% Official leaderboard
163 Mihaiii/Squirtle 48.4% Official leaderboard
164 consciousAI/cai-lunaris-text-embeddings 48% Official leaderboard
165 Mihaiii/gte-micro 45.9% Official leaderboard
166 ai-forever/ru-en-RoSBERTa 45.4% Official leaderboard
167 aari1995/German_Semantic_STS_V2 44.6% Official leaderboard
168 nvidia/NV-Embed-v2 43.7% Official leaderboard
169 Omartificial-Intelligence-Space/Arabert-all-nli-triplet-Matryoshka 42.3% Official leaderboard
170 Snowflake/snowflake-arctic-embed-m-long 41.6% Official leaderboard
171 cointegrated/LaBSE-en-ru 40.9% Official leaderboard
172 deepvk/deberta-v1-base 40.7% Official leaderboard
173 Omartificial-Intelligence-Space/Marbert-all-nli-triplet-Matryoshka 40.7% Official leaderboard
174 minishlab/M2V_base_glove_subword 40% Official leaderboard
175 DeepPavlov/distilrubert-small-cased-conversational 36.3% Official leaderboard
176 minishlab/M2V_base_output 34.9% Official leaderboard
177 DeepPavlov/rubert-base-cased 34.7% Official leaderboard
178 silma-ai/silma-embeddding-matryoshka-v0.1 33.2% Official leaderboard
179 minishlab/M2V_base_glove 32.3% Official leaderboard
180 minishlab/potion-base-8M 31.6% Official leaderboard
181 DeepPavlov/rubert-base-cased-sentence 30.5% Official leaderboard
182 cointegrated/rubert-tiny 30.4% Official leaderboard
183 minishlab/potion-base-4M 27.4% Official leaderboard
184 malenia1/ternary-weight-embedding 23.3% Official leaderboard
185 ai-forever/sbert_large_nlu_ru 23.1% Official leaderboard
186 minishlab/potion-base-2M 22.9% Official leaderboard
187 ai-forever/sbert_large_mt_nlu_ru 22.9% Official leaderboard
188 cointegrated/rubert-tiny2 18.2% Official leaderboard
189 sergeyzh/rubert-tiny-turbo 18.1% Official leaderboard
190 jinaai/jina-embeddings-v2-small-en 16.6% Official leaderboard
191 jinaai/jina-embeddings-v2-base-en 7.33% Official leaderboard
192 mteb/baseline-random-encoder 2.35% Official leaderboard
#ModelScoreSettingDateSource
1 EmbeddingGemma 2 68.9% Oct 2026 Official leaderboard
2 Qwen3-Embedding-4B 66.7% Jun 2025 Official leaderboard
3 Qwen3-Embedding-8B 66.1% Jun 2025 Official leaderboard
4 Qwen3-Embedding-0.6B 61.7% Jun 2025 Official leaderboard

2 models have held number one on the official leaderboard since 2023

Lab claims count from the day the card came out, independent runs from the model’s release.

Qwen Google DeepMind
Own leaderboard Not tested since Oct 2026

Source: Official Italian-Administrative-CaseHold leaderboard

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

Plot with other benchmarks
On the benchmark’s own leaderboard Best so far
0% 20% 40% 60% 80% 100% 2025 2026 Near the ceiling (85%) EmbeddingGemma 2 Qwen3-Embedding-4B 0% 20% 40% 60% 80% 100% 2025 2026 Near the ceiling (85%) EmbeddingGemma 2 Qwen3-Embedding-4B

Source: Official Italian-Administrative-CaseHold leaderboard

No lab model card reports it yet

We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.

More in Law, finance and medicine

All 637 in Law, finance and medicine
  • MedXpertQA-MM In use Models answer expert-level medical exam questions that combine images with clinical records and test results. Scoring is accuracy. Qwen 3.8 Max 80.4%
  • HealthBench Professional In use 525 physician-authored tasks from real clinician chats (care consult, documentation, research) with physician-adjudicated rubrics. Claude Sonnet 5.5 69.2%
  • HealthBench In use 5,000 realistic health conversations graded against physician-written rubrics. A length-adjusted variant penalizes verbosity. GPT-5 67.2%
  • FinSearchComp In use Agents search the web to fetch live financial data, look up history, and run multi-step investigations, across 635 expert-written questions. Scored by answer accuracy. Ling-3.1-flash 81.7%
  • KorMedMCQA In use Models answer 7,469 multiple-choice questions from Korean licensing exams for doctors, nurses, pharmacists and dentists, held from 2012 to 2024. o1-preview 92.7%
  • Harvey LAB-AA v1.1 In use Artificial Analysis's run of Harvey's Legal Agent Benchmark on Harvey's newer private set of 120 tasks across 24 practice areas. A deliverable with a material hallucination scores zero, and the headline is the share of judges who find every rubric criterion passed. GPT-6.2 Astra 15%

Data audit

All 10 checks pass. Every benchmark

Catalog record 2 pass
  • Pass Task access All tasks are public.
  • Pass Confidence Checked against a primary source.
Scores 4 pass 1 note
  • Pass Independent runs Scores from the official leaderboard (192 entries).
  • Pass Models scored 4 models we track, plus 188 other entries on its leaderboard.
  • Pass Newest score The newest is from October 2026, for EmbeddingGemma 2.
  • Note Frontier models None of its models are on the capabilities index.
  • Pass Headroom The best is 68.9%, under 85%, so it still separates models.
Leaderboard import 3 pass
  • Pass Importer We read the board on mteb-leaderboard-backend.hf.space: 4 rows for models we track and 188 other entries at the last read.
  • Pass Last read November 20th, 2026.
  • Pass Read worked The last read worked.
Consistency 1 pass 1 note
  • Note Lab claims No model has both a lab number and an independent run.
  • Pass Known issues No published audit found problems.

How we check