AILA Statute Retrieval
Models retrieve the Indian statutes that apply to a described legal situation.
MTEB scores the task using normalized discounted cumulative gain at rank ten.
- Made by
- Paheli Bhattacharya and colleagues
- Released
- October 2020
- Kind
- Law
- Level
- University
- Scored
- Checked automatically
- Answers
- Prediction
- Tasks
- All public
- Measures
- Capability
- Subject
- Law
- Language
- English
- Interaction
- Single turn
- Items from
- Real work and use
- Refresh
- One fixed set
- Run by
- Anyone
- In views
- Law and finance
- Last model added
- October 2026
- Scores refreshed
- November 20th, 2026
litillabs/octen-law-8b-v1 tops the leaderboard with 0.95 Qwen3-Embedding-8B leads with 0.85 among models released by October 2026
Best score per entry from the benchmark's own leaderboard, read on November 20th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. The best model we track is Qwen3-Embedding-8B, at 0.85. This view shows only models we track, each at its best.
The newest model with a score here came out in October 2026, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:
- GPT-6.2 Astra
- Claude Fable 5.2
-
Gemini 4 Carbon
- GPT-6.1 Terra
- and 16 more
- 0.95 litillabs/octen-law-8b-v1
- 0.95 Octen/Octen-Embedding-8B-INT8
- 0.93 Octen/Octen-Embedding-8B
- 0.91 bflhc/MoD-Embedding
- 0.90 Mira190/Euler-Legal-Embedding-V1
- 0.90 litillabs/litil-embed-0.6b
- 0.87 Octen/Octen-Embedding-4B-INT8
- 0.87 Octen/Octen-Embedding-0.6B
- 0.86 Octen/Octen-Embedding-4B
- 0.85
Qwen3-Embedding-8B
- 0.83 geevec-ai/geevec-embeddings-1.0
- 0.81
Qwen3-Embedding-4B
- 0.79
Qwen3-Embedding-0.6B
- 0.79 Hanno-Labs/dinghy-law-4b-v1
- 0.78 Hanno-Labs/dinghy-law-0.6b-v1
- 0.75 geevec-ai/geevec-embeddings-1.0-lite
- 0.71 IEITYuan/Yuan-embedding-2.0-en
- 0.70 Octen/octen-vl-embedding
- 0.69 Octen/octen-vl-embedding-large
- 0.63 Hanno-Labs/dinghy-law-8b-v1
- 0.61 perplexity-ai/pplx-embed-v1-4b
- 0.60 nlpai-lab/KURE-v3
- 0.60 perplexity-ai/pplx-embed-v1-0.6b
- 0.59 malteos/most-embed-de
- 0.59 judicialmind/greenleaf-law-embed-tiny
- 0.59 minetta/nemotron-3-embed-8b-legal
- 0.58 nvidia/Nemotron-3-Embed-8B-BF16
- 0.57 nvidia/Nemotron-3-Embed-1B-BF16
- 0.56 tencent/KaLM-Embedding-Gemma3-12B-2511
- 0.56 mongodb/voyage-4-large (embed_dim=2048, evolved_prompts=True)
- 0.55 microsoft/harrier-oss-v1-27b
- 0.54 nvidia/llama-embed-nemotron-8b
- 0.53 jinaai/jina-embeddings-v5-omni-small
- 0.53 jinaai/jina-embeddings-v5-text-small
- 0.52 mongodb/voyage-3-large
- 0.52 jinaai/jina-embeddings-v5-omni-nano
- 0.52 jinaai/jina-embeddings-v5-text-nano
- 0.50 mongodb/voyage-4-large (embed_dim=2048)
- 0.50 jinaai/jina-embeddings-v4
- 0.50 mongodb/voyage-4-large
- 0.50 mongodb/voyage-4
- 0.49 google/gemini-embedding-001
- 0.48 codefuse-ai/F2LLM-v2-14B
- 0.48 mongodb/voyage-4-lite
- 0.48 mongodb/voyage-3.5
- 0.48 mongodb/voyage-3.5 (output_dtype=int8)
- 0.47
Gemini Embedding 2
- 0.46 ICT-TIME-and-Querit/ICT-TIME-and-Querit-embedding-v1
- 0.46 mongodb/voyage-law-2
- 0.45 mongodb/voyage-multilingual-2
- 0.45 codefuse-ai/F2LLM-v2-8B
- 0.43 nvidia/NV-Embed-v1
- 0.43 ai-sage/Giga-Embeddings-instruct-10B-A1.8B-0826
- 0.42 mongodb/voyage-3
- 0.42 openai/text-embedding-3-large
- 0.42 GritLM/GritLM-7B
- 0.42 Salesforce/SFR-Embedding-2_R
- 0.42 VPLabs/SearchMap_Preview
- 0.41 mongodb/voyage-3.5 (output_dtype=binary)
- 0.41 google/text-embedding-004
- 0.41 mongodb/voyage-large-2-instruct
- 0.41 BidirLM/BidirLM-Omni-2.5B-Embedding
- 0.40 codefuse-ai/F2LLM-v2-4B
- 0.40 KaLM-Embedding/KaLM-embedding-multilingual-mini-instruct-v2.5
- 0.40 infgrad/Jasper-Token-Compression-600M
- 0.39 Linq-AI-Research/Linq-Embed-Mistral
- 0.39 ICT-TIME-and-Querit/BOOM_4B_v1
- 0.39 GritLM/GritLM-8x7B
- 0.38 zeroentropy/zembed-1
- 0.38 infly/inf-retriever-v1
- 0.38 microsoft/harrier-oss-v1-0.6b
- 0.38 HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1
- 0.38 Cohere/Cohere-embed-v5.0-pro
- 0.37 Salesforce/SFR-Embedding-Mistral
- 0.37 google/embeddinggemma-300m
- 0.37 Cohere/Cohere-embed-v4.0 (output_dtype=binary)
- 0.36 codefuse-ai/F2LLM-4B
- 0.36 ai-sage/Giga-Embeddings-instruct-3B-0826
- 0.36 hotchpotch/bekko-embedding-v1-a25m
- 0.36 microsoft/harrier-oss-v1-270m
- 0.35 google/text-embedding-005
- 0.35 BidirLM/BidirLM-1.7B-Embedding
- 0.35 topk-io/topk-embed-v1-xsmall
- 0.35 mongodb/voyage-3-lite
- 0.35 google/text-multilingual-embedding-002
- 0.35 Alibaba-NLP/gte-Qwen2-1.5B-instruct
- 0.35 BidirLM/BidirLM-1B-Embedding
- 0.35 Cohere/Cohere-embed-v4.0
- 0.35 HIT-TMG/KaLM-embedding-multilingual-mini-v1
- 0.35 infly/inf-retriever-v1-1.5b
- 0.35 intfloat/e5-mistral-7b-instruct
- 0.34 topk-io/topk-embed-v1-small
- 0.34 Cohere/Cohere-embed-v4.0 (output_dtype=int8)
- 0.34 hotchpotch/bekko-embedding-v1-a8m
- 0.34 Alibaba-NLP/gte-Qwen2-7B-instruct
- 0.34 Alibaba-NLP/gte-multilingual-base
- 0.33 codefuse-ai/F2LLM-v2-1.7B
- 0.33 jinaai/jina-embeddings-v3
- 0.32 Cohere/Cohere-embed-v5.0-fast
- 0.32 NovaSearch/jasper_en_vision_language_v1
- 0.32 codefuse-ai/F2LLM-v2-0.6B
- 0.32 avsolatorio/GIST-small-Embedding-v0
- 0.32 NovaSearch/stella_en_400M_v5
- 0.32 nvidia/NV-Embed-v2
- 0.31 Alibaba-NLP/gte-Qwen1.5-7B-instruct
- 0.31 ibm-granite/granite-embedding-125m-english
- 0.30 avsolatorio/GIST-large-Embedding-v0
- 0.30 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-supervised
- 0.30 avsolatorio/GIST-all-MiniLM-L6-v2
- 0.30 ibm-granite/granite-embedding-311m-multilingual-r2
- 0.30 Cohere/Cohere-embed-multilingual-v3.0
- 0.30 intfloat/multilingual-e5-large-instruct
- 0.30 Snowflake/snowflake-arctic-embed-m
- 0.29 Alibaba-NLP/gte-base-en-v1.5
- 0.29 Cohere/Cohere-embed-multilingual-light-v3.0
- 0.29 BAAI/bge-m3
- 0.29 ibm-granite/granite-embedding-97m-multilingual-r2
- 0.29 OrdalieTech/Solon-embeddings-large-0.1
- 0.29 nomic-ai/nomic-embed-text-v2-moe
- 0.28 avsolatorio/NoInstruct-small-Embedding-v0
- 0.28 openai/text-embedding-3-small
- 0.28 ibm-granite/granite-embedding-english-r2
- 0.28 NovaSearch/stella_en_1.5B_v5
- 0.28 Snowflake/snowflake-arctic-embed-m-v2.0
- 0.28 Snowflake/snowflake-arctic-embed-m-v1.5
- 0.28 Mihaiii/Ivysaur
- 0.28 codefuse-ai/F2LLM-1.7B
- 0.28 avsolatorio/GIST-Embedding-v0
- 0.27 Snowflake/snowflake-arctic-embed-l
- 0.27 Snowflake/snowflake-arctic-embed-s
- 0.27 w601sxs/b1ade-embed
- 0.27 BidirLM/BidirLM-0.6B-Embedding
- 0.27 codefuse-ai/F2LLM-v2-160M
- 0.27 Bytedance/Seed1.6-embedding-1215
- 0.27 deepvk/USER-bge-m3
- 0.26 Haon-Chen/speed-embedding-7b-instruct
- 0.26 Cohere/Cohere-embed-english-v3.0
- 0.26 codefuse-ai/F2LLM-v2-330M
- 0.26 telepix/PIXIE-Rune-v1.0
- 0.26 BAAI/bge-m3-unsupervised
- 0.26 RiverRider/motherlode-code-small-en-v0.1
- 0.26 ibm-granite/granite-embedding-278m-multilingual
- 0.26 bigscience/sgpt-bloom-7b1-msmarco
- 0.26 Lajavaness/bilingual-embedding-small
- 0.26 Cohere/Cohere-embed-english-light-v3.0
- 0.26 MongoDB/mdbr-leaf-ir
- 0.25
EmbeddingGemma 2
- 0.25 Lajavaness/bilingual-embedding-large
- 0.25 jinaai/jina-embedding-s-en-v1
- 0.25 hotchpotch/bekko-static-embedding-v1
- 0.25 BidirLM/BidirLM-270M-Embedding
- 0.25 mixedbread-ai/mxbai-embed-large-v1
- 0.24 WhereIsAI/UAE-Large-V1
- 0.24 thenlper/gte-small
- 0.24 izhx/udever-bloom-7b1
- 0.24 abhinand/MedEmbed-small-v0.1
- 0.24 manveertamber/cadet-embed-base-v1
- 0.23 Snowflake/snowflake-arctic-embed-xs
- 0.23 BAAI/bge-base-en-v1.5
- 0.23 thenlper/gte-large
- 0.23 jinaai/jina-embedding-b-en-v1
- 0.23 prdev/mini-gte
- 0.23 BAAI/bge-large-en-v1.5
- 0.23 nomic-ai/nomic-embed-text-v1-unsupervised
- 0.23 BAAI/bge-small-en-v1.5
- 0.23 intfloat/e5-large
- 0.23 Snowflake/snowflake-arctic-embed-l-v2.0
- 0.23 ibm-granite/granite-embedding-small-english-r2
- 0.23 manu/sentence_croissant_alpha_v0.3
- 0.23 manu/sentence_croissant_alpha_v0.4
- 0.22 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-unsup-simcse
- 0.22 Mihaiii/Wartortle
- 0.22 thenlper/gte-base
- 0.22 manu/bge-m3-custom-fr
- 0.22 sentence-transformers/paraphrase-multilingual-mpnet-base-v2
- 0.22 sentence-transformers/static-retrieval-mrl-en-v1
- 0.22 BAAI/bge-large-en
- 0.22 sdadas/mmlw-e5-small
- 0.22 bisectgroup/BiCA-base
- 0.22 sdadas/mmlw-e5-base
- 0.22 Mihaiii/gte-micro-v4
- 0.22 sentence-transformers/multi-qa-MiniLM-L6-cos-v1
- 0.22 omarelshehy/arabic-english-sts-matryoshka
- 0.22 ibm-granite/granite-embedding-107m-multilingual
- 0.22 mteb/baseline-bm25s
- 0.22 Snowflake/snowflake-arctic-embed-m-long
- 0.22 izhx/udever-bloom-3b
- 0.21 Mihaiii/Bulbasaur
- 0.21 Mihaiii/Squirtle
- 0.21 sentence-transformers/all-mpnet-base-v2
- 0.21 dwzhu/e5-base-4k
- 0.21 amgix/static-retrieval-multilingual-69m-v1
- 0.21 izhx/udever-bloom-1b1
- 0.21 intfloat/multilingual-e5-large
- 0.21 intfloat/e5-small
- 0.21 sentence-transformers/all-MiniLM-L12-v2
- 0.21 sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2
- 0.21 brahmairesearch/slx-v0.1
- 0.21 sentence-transformers/all-MiniLM-L6-v2
- 0.20 intfloat/multilingual-e5-base
- 0.20 Omartificial-Intelligence-Space/Arabic-labse-Matryoshka
- 0.20 intfloat/e5-small-v2
- 0.20 manu/sentence_croissant_alpha_v0.2
- 0.20 Gameselo/STS-multilingual-mpnet-base-v2
- 0.20 Lajavaness/bilingual-embedding-base
- 0.20 infgrad/stella-base-en-v2
- 0.20 ibm-granite/granite-embedding-30m-english
- 0.20 intfloat/e5-base-v2
- 0.20 Omartificial-Intelligence-Space/Arabic-all-nli-triplet-Matryoshka
- 0.19 deepfile/embedder-100p
- 0.19 ai-forever/sbert_large_nlu_ru
- 0.19 sdadas/mmlw-e5-large
- 0.19 codefuse-ai/F2LLM-v2-80M
- 0.19 MongoDB/mdbr-leaf-mt
- 0.19 nomic-ai/nomic-embed-text-v1.5
- 0.19 intfloat/multilingual-e5-small
- 0.19 nlpai-lab/KURE-Sparse-nano
- 0.19 ai-forever/ru-en-RoSBERTa
- 0.19 sdadas/mmlw-roberta-base
- 0.18 lightonai/mSlideOn
- 0.18 Omartificial-Intelligence-Space/Arabic-MiniLM-L12-v2-all-nli-triplet
- 0.18 nomic-ai/nomic-embed-text-v1-ablated
- 0.18 BAAI/bge-base-en
- 0.18 sdadas/mmlw-roberta-large
- 0.18 intfloat/e5-base
- 0.18 intfloat/e5-large-v2
- 0.18 Mihaiii/Venusaur
- 0.17 minishlab/potion-base-8M
- 0.17 nlpai-lab/KURE-Sparse-base
- 0.17 aari1995/German_Semantic_STS_V2
- 0.17 consciousAI/cai-lunaris-text-embeddings
- 0.17 minishlab/potion-multilingual-128M
- 0.17 Mihaiii/gte-micro
- 0.17 sentence-transformers/LaBSE
- 0.17 sentence-transformers/static-similarity-mrl-multilingual-v1
- 0.17 minishlab/potion-base-4M
- 0.16 nomic-ai/nomic-embed-text-v1
- 0.16 minishlab/potion-base-32M
- 0.16 BAAI/bge-base-zh-v1.5
- 0.16 cointegrated/LaBSE-en-ru
- 0.16 sergeyzh/LaBSE-ru-turbo
- 0.16 minishlab/potion-base-2M
- 0.16 izhx/udever-bloom-560m
- 0.15 BAAI/bge-large-zh-v1.5
- 0.15 shibing624/text2vec-base-multilingual
- 0.15 minishlab/M2V_multilingual_output
- 0.15 Jaume/gemma-2b-embeddings
- 0.15 BAAI/bge-small-zh-v1.5
- 0.15 malenia1/ternary-weight-embedding
- 0.14 DeepPavlov/rubert-base-cased-sentence
- 0.14 DeepPavlov/distilrubert-small-cased-conversational
- 0.14 cointegrated/rubert-tiny2
- 0.14 sergeyzh/rubert-tiny-turbo
- 0.13 minishlab/M2V_base_glove
- 0.13 jinaai/jina-embeddings-v2-small-en
- 0.13 minishlab/M2V_base_output
- 0.13 cointegrated/rubert-tiny
- 0.12 Omartificial-Intelligence-Space/Arabert-all-nli-triplet-Matryoshka
- 0.12 minishlab/M2V_base_glove_subword
- 0.12 ai-forever/sbert_large_mt_nlu_ru
- 0.12 DeepPavlov/rubert-base-cased
- 0.11 cnmoro/static-nomic-384-pten-v2-st
- 0.11 Omartificial-Intelligence-Space/Arabic-mpnet-base-all-nli-triplet
- 0.10 jinaai/jina-embeddings-v2-base-en
- 0.10 deepvk/USER-base
- 0.10 Omartificial-Intelligence-Space/Marbert-all-nli-triplet-Matryoshka
- 0.10 mteb/baseline-random-encoder
- 0.10 deepvk/deberta-v1-base
- 0.10 shibing624/text2vec-base-chinese
- 0.09 silma-ai/silma-embeddding-matryoshka-v0.1
- 1 litillabs/octen-law-8b-v1 0.95
- 2 Octen/Octen-Embedding-8B-INT8 0.95
- 3 Octen/Octen-Embedding-8B 0.93
- 4 bflhc/MoD-Embedding 0.91
- 5 Mira190/Euler-Legal-Embedding-V1 0.90
- 6 litillabs/litil-embed-0.6b 0.90
- 7 Octen/Octen-Embedding-4B-INT8 0.87
- 8 Octen/Octen-Embedding-0.6B 0.87
- 9 Octen/Octen-Embedding-4B 0.86
- 10
Qwen3-Embedding-8B 0.85
- 11 geevec-ai/geevec-embeddings-1.0 0.83
- 12
Qwen3-Embedding-4B 0.81
- 13
Qwen3-Embedding-0.6B 0.79
- 14 Hanno-Labs/dinghy-law-4b-v1 0.79
- 15 Hanno-Labs/dinghy-law-0.6b-v1 0.78
- 16 geevec-ai/geevec-embeddings-1.0-lite 0.75
- 17 IEITYuan/Yuan-embedding-2.0-en 0.71
- 18 Octen/octen-vl-embedding 0.70
- 19 Octen/octen-vl-embedding-large 0.69
- 20 Hanno-Labs/dinghy-law-8b-v1 0.63
- 21 perplexity-ai/pplx-embed-v1-4b 0.61
- 22 nlpai-lab/KURE-v3 0.60
- 23 perplexity-ai/pplx-embed-v1-0.6b 0.60
- 24 malteos/most-embed-de 0.59
- 25 judicialmind/greenleaf-law-embed-tiny 0.59
- 26 minetta/nemotron-3-embed-8b-legal 0.59
- 27 nvidia/Nemotron-3-Embed-8B-BF16 0.58
- 28 nvidia/Nemotron-3-Embed-1B-BF16 0.57
- 29 tencent/KaLM-Embedding-Gemma3-12B-2511 0.56
- 30 mongodb/voyage-4-large (embed_dim=2048, evolved_prompts=True) 0.56
- 31 microsoft/harrier-oss-v1-27b 0.55
- 32 nvidia/llama-embed-nemotron-8b 0.54
- 33 jinaai/jina-embeddings-v5-omni-small 0.53
- 34 jinaai/jina-embeddings-v5-text-small 0.53
- 35 mongodb/voyage-3-large 0.52
- 36 jinaai/jina-embeddings-v5-omni-nano 0.52
- 37 jinaai/jina-embeddings-v5-text-nano 0.52
- 38 mongodb/voyage-4-large (embed_dim=2048) 0.50
- 39 jinaai/jina-embeddings-v4 0.50
- 40 mongodb/voyage-4-large 0.50
- 41 mongodb/voyage-4 0.50
- 42 google/gemini-embedding-001 0.49
- 43 codefuse-ai/F2LLM-v2-14B 0.48
- 44 mongodb/voyage-4-lite 0.48
- 45 mongodb/voyage-3.5 0.48
- 46 mongodb/voyage-3.5 (output_dtype=int8) 0.48
- 47
Gemini Embedding 2 0.47
- 48 ICT-TIME-and-Querit/ICT-TIME-and-Querit-embedding-v1 0.46
- 49 mongodb/voyage-law-2 0.46
- 50 mongodb/voyage-multilingual-2 0.45
- 51 codefuse-ai/F2LLM-v2-8B 0.45
- 52 nvidia/NV-Embed-v1 0.43
- 53 ai-sage/Giga-Embeddings-instruct-10B-A1.8B-0826 0.43
- 54 mongodb/voyage-3 0.42
- 55 openai/text-embedding-3-large 0.42
- 56 GritLM/GritLM-7B 0.42
- 57 Salesforce/SFR-Embedding-2_R 0.42
- 58 VPLabs/SearchMap_Preview 0.42
- 59 mongodb/voyage-3.5 (output_dtype=binary) 0.41
- 60 google/text-embedding-004 0.41
- 61 mongodb/voyage-large-2-instruct 0.41
- 62 BidirLM/BidirLM-Omni-2.5B-Embedding 0.41
- 63 codefuse-ai/F2LLM-v2-4B 0.40
- 64 KaLM-Embedding/KaLM-embedding-multilingual-mini-instruct-v2.5 0.40
- 65 infgrad/Jasper-Token-Compression-600M 0.40
- 66 Linq-AI-Research/Linq-Embed-Mistral 0.39
- 67 ICT-TIME-and-Querit/BOOM_4B_v1 0.39
- 68 GritLM/GritLM-8x7B 0.39
- 69 zeroentropy/zembed-1 0.38
- 70 infly/inf-retriever-v1 0.38
- 71 microsoft/harrier-oss-v1-0.6b 0.38
- 72 HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1 0.38
- 73 Cohere/Cohere-embed-v5.0-pro 0.38
- 74 Salesforce/SFR-Embedding-Mistral 0.37
- 75 google/embeddinggemma-300m 0.37
- 76 Cohere/Cohere-embed-v4.0 (output_dtype=binary) 0.37
- 77 codefuse-ai/F2LLM-4B 0.36
- 78 ai-sage/Giga-Embeddings-instruct-3B-0826 0.36
- 79 hotchpotch/bekko-embedding-v1-a25m 0.36
- 80 microsoft/harrier-oss-v1-270m 0.36
- 81 google/text-embedding-005 0.35
- 82 BidirLM/BidirLM-1.7B-Embedding 0.35
- 83 topk-io/topk-embed-v1-xsmall 0.35
- 84 mongodb/voyage-3-lite 0.35
- 85 google/text-multilingual-embedding-002 0.35
- 86 Alibaba-NLP/gte-Qwen2-1.5B-instruct 0.35
- 87 BidirLM/BidirLM-1B-Embedding 0.35
- 88 Cohere/Cohere-embed-v4.0 0.35
- 89 HIT-TMG/KaLM-embedding-multilingual-mini-v1 0.35
- 90 infly/inf-retriever-v1-1.5b 0.35
- 91 intfloat/e5-mistral-7b-instruct 0.35
- 92 topk-io/topk-embed-v1-small 0.34
- 93 Cohere/Cohere-embed-v4.0 (output_dtype=int8) 0.34
- 94 hotchpotch/bekko-embedding-v1-a8m 0.34
- 95 Alibaba-NLP/gte-Qwen2-7B-instruct 0.34
- 96 Alibaba-NLP/gte-multilingual-base 0.34
- 97 codefuse-ai/F2LLM-v2-1.7B 0.33
- 98 jinaai/jina-embeddings-v3 0.33
- 99 Cohere/Cohere-embed-v5.0-fast 0.32
- 100 NovaSearch/jasper_en_vision_language_v1 0.32
- 101 codefuse-ai/F2LLM-v2-0.6B 0.32
- 102 avsolatorio/GIST-small-Embedding-v0 0.32
- 103 NovaSearch/stella_en_400M_v5 0.32
- 104 nvidia/NV-Embed-v2 0.32
- 105 Alibaba-NLP/gte-Qwen1.5-7B-instruct 0.31
- 106 ibm-granite/granite-embedding-125m-english 0.31
- 107 avsolatorio/GIST-large-Embedding-v0 0.30
- 108 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-supervised 0.30
- 109 avsolatorio/GIST-all-MiniLM-L6-v2 0.30
- 110 ibm-granite/granite-embedding-311m-multilingual-r2 0.30
- 111 Cohere/Cohere-embed-multilingual-v3.0 0.30
- 112 intfloat/multilingual-e5-large-instruct 0.30
- 113 Snowflake/snowflake-arctic-embed-m 0.30
- 114 Alibaba-NLP/gte-base-en-v1.5 0.29
- 115 Cohere/Cohere-embed-multilingual-light-v3.0 0.29
- 116 BAAI/bge-m3 0.29
- 117 ibm-granite/granite-embedding-97m-multilingual-r2 0.29
- 118 OrdalieTech/Solon-embeddings-large-0.1 0.29
- 119 nomic-ai/nomic-embed-text-v2-moe 0.29
- 120 avsolatorio/NoInstruct-small-Embedding-v0 0.28
- 121 openai/text-embedding-3-small 0.28
- 122 ibm-granite/granite-embedding-english-r2 0.28
- 123 NovaSearch/stella_en_1.5B_v5 0.28
- 124 Snowflake/snowflake-arctic-embed-m-v2.0 0.28
- 125 Snowflake/snowflake-arctic-embed-m-v1.5 0.28
- 126 Mihaiii/Ivysaur 0.28
- 127 codefuse-ai/F2LLM-1.7B 0.28
- 128 avsolatorio/GIST-Embedding-v0 0.28
- 129 Snowflake/snowflake-arctic-embed-l 0.27
- 130 Snowflake/snowflake-arctic-embed-s 0.27
- 131 w601sxs/b1ade-embed 0.27
- 132 BidirLM/BidirLM-0.6B-Embedding 0.27
- 133 codefuse-ai/F2LLM-v2-160M 0.27
- 134 Bytedance/Seed1.6-embedding-1215 0.27
- 135 deepvk/USER-bge-m3 0.27
- 136 Haon-Chen/speed-embedding-7b-instruct 0.26
- 137 Cohere/Cohere-embed-english-v3.0 0.26
- 138 codefuse-ai/F2LLM-v2-330M 0.26
- 139 telepix/PIXIE-Rune-v1.0 0.26
- 140 BAAI/bge-m3-unsupervised 0.26
- 141 RiverRider/motherlode-code-small-en-v0.1 0.26
- 142 ibm-granite/granite-embedding-278m-multilingual 0.26
- 143 bigscience/sgpt-bloom-7b1-msmarco 0.26
- 144 Lajavaness/bilingual-embedding-small 0.26
- 145 Cohere/Cohere-embed-english-light-v3.0 0.26
- 146 MongoDB/mdbr-leaf-ir 0.26
- 147
EmbeddingGemma 2 0.25
- 148 Lajavaness/bilingual-embedding-large 0.25
- 149 jinaai/jina-embedding-s-en-v1 0.25
- 150 hotchpotch/bekko-static-embedding-v1 0.25
- 151 BidirLM/BidirLM-270M-Embedding 0.25
- 152 mixedbread-ai/mxbai-embed-large-v1 0.25
- 153 WhereIsAI/UAE-Large-V1 0.24
- 154 thenlper/gte-small 0.24
- 155 izhx/udever-bloom-7b1 0.24
- 156 abhinand/MedEmbed-small-v0.1 0.24
- 157 manveertamber/cadet-embed-base-v1 0.24
- 158 Snowflake/snowflake-arctic-embed-xs 0.23
- 159 BAAI/bge-base-en-v1.5 0.23
- 160 thenlper/gte-large 0.23
- 161 jinaai/jina-embedding-b-en-v1 0.23
- 162 prdev/mini-gte 0.23
- 163 BAAI/bge-large-en-v1.5 0.23
- 164 nomic-ai/nomic-embed-text-v1-unsupervised 0.23
- 165 BAAI/bge-small-en-v1.5 0.23
- 166 intfloat/e5-large 0.23
- 167 Snowflake/snowflake-arctic-embed-l-v2.0 0.23
- 168 ibm-granite/granite-embedding-small-english-r2 0.23
- 169 manu/sentence_croissant_alpha_v0.3 0.23
- 170 manu/sentence_croissant_alpha_v0.4 0.23
- 171 McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-unsup-simcse 0.22
- 172 Mihaiii/Wartortle 0.22
- 173 thenlper/gte-base 0.22
- 174 manu/bge-m3-custom-fr 0.22
- 175 sentence-transformers/paraphrase-multilingual-mpnet-base-v2 0.22
- 176 sentence-transformers/static-retrieval-mrl-en-v1 0.22
- 177 BAAI/bge-large-en 0.22
- 178 sdadas/mmlw-e5-small 0.22
- 179 bisectgroup/BiCA-base 0.22
- 180 sdadas/mmlw-e5-base 0.22
- 181 Mihaiii/gte-micro-v4 0.22
- 182 sentence-transformers/multi-qa-MiniLM-L6-cos-v1 0.22
- 183 omarelshehy/arabic-english-sts-matryoshka 0.22
- 184 ibm-granite/granite-embedding-107m-multilingual 0.22
- 185 mteb/baseline-bm25s 0.22
- 186 Snowflake/snowflake-arctic-embed-m-long 0.22
- 187 izhx/udever-bloom-3b 0.22
- 188 Mihaiii/Bulbasaur 0.21
- 189 Mihaiii/Squirtle 0.21
- 190 sentence-transformers/all-mpnet-base-v2 0.21
- 191 dwzhu/e5-base-4k 0.21
- 192 amgix/static-retrieval-multilingual-69m-v1 0.21
- 193 izhx/udever-bloom-1b1 0.21
- 194 intfloat/multilingual-e5-large 0.21
- 195 intfloat/e5-small 0.21
- 196 sentence-transformers/all-MiniLM-L12-v2 0.21
- 197 sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 0.21
- 198 brahmairesearch/slx-v0.1 0.21
- 199 sentence-transformers/all-MiniLM-L6-v2 0.21
- 200 intfloat/multilingual-e5-base 0.20
- 201 Omartificial-Intelligence-Space/Arabic-labse-Matryoshka 0.20
- 202 intfloat/e5-small-v2 0.20
- 203 manu/sentence_croissant_alpha_v0.2 0.20
- 204 Gameselo/STS-multilingual-mpnet-base-v2 0.20
- 205 Lajavaness/bilingual-embedding-base 0.20
- 206 infgrad/stella-base-en-v2 0.20
- 207 ibm-granite/granite-embedding-30m-english 0.20
- 208 intfloat/e5-base-v2 0.20
- 209 Omartificial-Intelligence-Space/Arabic-all-nli-triplet-Matryoshka 0.20
- 210 deepfile/embedder-100p 0.19
- 211 ai-forever/sbert_large_nlu_ru 0.19
- 212 sdadas/mmlw-e5-large 0.19
- 213 codefuse-ai/F2LLM-v2-80M 0.19
- 214 MongoDB/mdbr-leaf-mt 0.19
- 215 nomic-ai/nomic-embed-text-v1.5 0.19
- 216 intfloat/multilingual-e5-small 0.19
- 217 nlpai-lab/KURE-Sparse-nano 0.19
- 218 ai-forever/ru-en-RoSBERTa 0.19
- 219 sdadas/mmlw-roberta-base 0.19
- 220 lightonai/mSlideOn 0.18
- 221 Omartificial-Intelligence-Space/Arabic-MiniLM-L12-v2-all-nli-triplet 0.18
- 222 nomic-ai/nomic-embed-text-v1-ablated 0.18
- 223 BAAI/bge-base-en 0.18
- 224 sdadas/mmlw-roberta-large 0.18
- 225 intfloat/e5-base 0.18
- 226 intfloat/e5-large-v2 0.18
- 227 Mihaiii/Venusaur 0.18
- 228 minishlab/potion-base-8M 0.17
- 229 nlpai-lab/KURE-Sparse-base 0.17
- 230 aari1995/German_Semantic_STS_V2 0.17
- 231 consciousAI/cai-lunaris-text-embeddings 0.17
- 232 minishlab/potion-multilingual-128M 0.17
- 233 Mihaiii/gte-micro 0.17
- 234 sentence-transformers/LaBSE 0.17
- 235 sentence-transformers/static-similarity-mrl-multilingual-v1 0.17
- 236 minishlab/potion-base-4M 0.17
- 237 nomic-ai/nomic-embed-text-v1 0.16
- 238 minishlab/potion-base-32M 0.16
- 239 BAAI/bge-base-zh-v1.5 0.16
- 240 cointegrated/LaBSE-en-ru 0.16
- 241 sergeyzh/LaBSE-ru-turbo 0.16
- 242 minishlab/potion-base-2M 0.16
- 243 izhx/udever-bloom-560m 0.16
- 244 BAAI/bge-large-zh-v1.5 0.15
- 245 shibing624/text2vec-base-multilingual 0.15
- 246 minishlab/M2V_multilingual_output 0.15
- 247 Jaume/gemma-2b-embeddings 0.15
- 248 BAAI/bge-small-zh-v1.5 0.15
- 249 malenia1/ternary-weight-embedding 0.15
- 250 DeepPavlov/rubert-base-cased-sentence 0.14
- 251 DeepPavlov/distilrubert-small-cased-conversational 0.14
- 252 cointegrated/rubert-tiny2 0.14
- 253 sergeyzh/rubert-tiny-turbo 0.14
- 254 minishlab/M2V_base_glove 0.13
- 255 jinaai/jina-embeddings-v2-small-en 0.13
- 256 minishlab/M2V_base_output 0.13
- 257 cointegrated/rubert-tiny 0.13
- 258 Omartificial-Intelligence-Space/Arabert-all-nli-triplet-Matryoshka 0.12
- 259 minishlab/M2V_base_glove_subword 0.12
- 260 ai-forever/sbert_large_mt_nlu_ru 0.12
- 261 DeepPavlov/rubert-base-cased 0.12
- 262 cnmoro/static-nomic-384-pten-v2-st 0.11
- 263 Omartificial-Intelligence-Space/Arabic-mpnet-base-all-nli-triplet 0.11
- 264 jinaai/jina-embeddings-v2-base-en 0.10
- 265 deepvk/USER-base 0.10
- 266 Omartificial-Intelligence-Space/Marbert-all-nli-triplet-Matryoshka 0.10
- 267 mteb/baseline-random-encoder 0.10
- 268 deepvk/deberta-v1-base 0.10
- 269 shibing624/text2vec-base-chinese 0.10
- 270 silma-ai/silma-embeddding-matryoshka-v0.1 0.09
Source: Official AILA Statute Retrieval leaderboard
- 1
Qwen3-Embedding-8B 0.85
- 2
Qwen3-Embedding-4B 0.81
- 3
Qwen3-Embedding-0.6B 0.79
- 4
Gemini Embedding 2 0.47
- 5
EmbeddingGemma 2 0.25
Source: Official AILA Statute Retrieval leaderboard
| # | Entry | Score | Setting | Date | Link | Source |
|---|---|---|---|---|---|---|
| 1 | litillabs/octen-law-8b-v1 open weights, 7.6B | 0.95 | huggingface.co | Official leaderboard | ||
| 2 | Octen/Octen-Embedding-8B-INT8 open weights, 7.6B | 0.95 | huggingface.co | Official leaderboard | ||
| 3 | Octen/Octen-Embedding-8B open weights, 7.6B | 0.93 | huggingface.co | Official leaderboard | ||
| 4 | bflhc/MoD-Embedding open weights, 4B | 0.91 | huggingface.co | Official leaderboard | ||
| 5 | Mira190/Euler-Legal-Embedding-V1 open weights, 7.6B | 0.90 | huggingface.co | Official leaderboard | ||
| 6 | litillabs/litil-embed-0.6b open weights, 0.6B | 0.90 | huggingface.co | Official leaderboard | ||
| 7 | Octen/Octen-Embedding-4B-INT8 open weights, 4B | 0.87 | huggingface.co | Official leaderboard | ||
| 8 | Octen/Octen-Embedding-0.6B open weights, 0.6B | 0.87 | huggingface.co | Official leaderboard | ||
| 9 | Octen/Octen-Embedding-4B open weights, 4B | 0.86 | huggingface.co | Official leaderboard | ||
| 10 | | 0.85 | Jun 2025 | huggingface.co | Official leaderboard | |
| 11 | geevec-ai/geevec-embeddings-1.0 closed weights | 0.83 | geevec.com | Official leaderboard | ||
| 12 | | 0.81 | Jun 2025 | huggingface.co | Official leaderboard | |
| 13 | | 0.79 | Jun 2025 | huggingface.co | Official leaderboard | |
| 14 | Hanno-Labs/dinghy-law-4b-v1 open weights, 4B | 0.79 | huggingface.co | Official leaderboard | ||
| 15 | Hanno-Labs/dinghy-law-0.6b-v1 open weights, 0.6B | 0.78 | huggingface.co | Official leaderboard | ||
| 16 | geevec-ai/geevec-embeddings-1.0-lite open weights, 0.4B | 0.75 | huggingface.co | Official leaderboard | ||
| 17 | IEITYuan/Yuan-embedding-2.0-en open weights, 0.6B | 0.71 | huggingface.co | Official leaderboard | ||
| 18 | Octen/octen-vl-embedding closed weights | 0.70 | docs.octen.ai | Official leaderboard | ||
| 19 | Octen/octen-vl-embedding-large closed weights | 0.69 | docs.octen.ai | Official leaderboard | ||
| 20 | Hanno-Labs/dinghy-law-8b-v1 open weights, 8B | 0.63 | huggingface.co | Official leaderboard | ||
| 21 | perplexity-ai/pplx-embed-v1-4b open weights, 4B | 0.61 | huggingface.co | Official leaderboard | ||
| 22 | nlpai-lab/KURE-v3 open weights, 1.1B | 0.60 | huggingface.co | Official leaderboard | ||
| 23 | perplexity-ai/pplx-embed-v1-0.6b open weights, 0.6B | 0.60 | huggingface.co | Official leaderboard | ||
| 24 | malteos/most-embed-de open weights, 1.1B | 0.59 | huggingface.co | Official leaderboard | ||
| 25 | judicialmind/greenleaf-law-embed-tiny open weights, 0.6B | 0.59 | huggingface.co | Official leaderboard | ||
| 26 | minetta/nemotron-3-embed-8b-legal open weights, 8B | 0.59 | huggingface.co | Official leaderboard | ||
| 27 | nvidia/Nemotron-3-Embed-8B-BF16 open weights, 8B | 0.58 | huggingface.co | Official leaderboard | ||
| 28 | nvidia/Nemotron-3-Embed-1B-BF16 open weights, 1.1B | 0.57 | huggingface.co | Official leaderboard | ||
| 29 | tencent/KaLM-Embedding-Gemma3-12B-2511 open weights, 11.8B | 0.56 | huggingface.co | Official leaderboard | ||
| 30 | mongodb/voyage-4-large (embed_dim=2048, evolved_prompts=True) closed weights | 0.56 | blog.voyageai.com | Official leaderboard | ||
| 31 | microsoft/harrier-oss-v1-27b open weights, 27B | 0.55 | huggingface.co | Official leaderboard | ||
| 32 | nvidia/llama-embed-nemotron-8b open weights, 7.5B | 0.54 | huggingface.co | Official leaderboard | ||
| 33 | jinaai/jina-embeddings-v5-omni-small open weights, 1.6B | 0.53 | huggingface.co | Official leaderboard | ||
| 34 | jinaai/jina-embeddings-v5-text-small open weights, 0.6B | 0.53 | huggingface.co | Official leaderboard | ||
| 35 | mongodb/voyage-3-large closed weights | 0.52 | blog.voyageai.com | Official leaderboard | ||
| 36 | jinaai/jina-embeddings-v5-omni-nano open weights, 1B | 0.52 | huggingface.co | Official leaderboard | ||
| 37 | jinaai/jina-embeddings-v5-text-nano open weights, 0.2B | 0.52 | huggingface.co | Official leaderboard | ||
| 38 | mongodb/voyage-4-large (embed_dim=2048) closed weights | 0.50 | blog.voyageai.com | Official leaderboard | ||
| 39 | jinaai/jina-embeddings-v4 open weights, 3.9B | 0.50 | huggingface.co | Official leaderboard | ||
| 40 | mongodb/voyage-4-large closed weights | 0.50 | blog.voyageai.com | Official leaderboard | ||
| 41 | mongodb/voyage-4 closed weights | 0.50 | blog.voyageai.com | Official leaderboard | ||
| 42 | google/gemini-embedding-001 closed weights | 0.49 | ai.google.dev | Official leaderboard | ||
| 43 | codefuse-ai/F2LLM-v2-14B open weights, 14B | 0.48 | huggingface.co | Official leaderboard | ||
| 44 | mongodb/voyage-4-lite closed weights | 0.48 | blog.voyageai.com | Official leaderboard | ||
| 45 | mongodb/voyage-3.5 closed weights | 0.48 | blog.voyageai.com | Official leaderboard | ||
| 46 | mongodb/voyage-3.5 (output_dtype=int8) closed weights | 0.48 | blog.voyageai.com | Official leaderboard | ||
| 47 | | 0.47 | Mar 2026 | ai.google.dev | Official leaderboard | |
| 48 | ICT-TIME-and-Querit/ICT-TIME-and-Querit-embedding-v1 open weights, 4B | 0.46 | huggingface.co | Official leaderboard | ||
| 49 | mongodb/voyage-law-2 closed weights | 0.46 | blog.voyageai.com | Official leaderboard | ||
| 50 | mongodb/voyage-multilingual-2 closed weights | 0.45 | blog.voyageai.com | Official leaderboard | ||
| 51 | codefuse-ai/F2LLM-v2-8B open weights, 7.6B | 0.45 | huggingface.co | Official leaderboard | ||
| 52 | nvidia/NV-Embed-v1 open weights, 7.9B | 0.43 | huggingface.co | Official leaderboard | ||
| 53 | ai-sage/Giga-Embeddings-instruct-10B-A1.8B-0826 open weights, 10.5B | 0.43 | huggingface.co | Official leaderboard | ||
| 54 | mongodb/voyage-3 closed weights | 0.42 | blog.voyageai.com | Official leaderboard | ||
| 55 | openai/text-embedding-3-large closed weights | 0.42 | openai.com | Official leaderboard | ||
| 56 | GritLM/GritLM-7B open weights, 7.2B | 0.42 | huggingface.co | Official leaderboard | ||
| 57 | Salesforce/SFR-Embedding-2_R open weights, 7.1B | 0.42 | huggingface.co | Official leaderboard | ||
| 58 | VPLabs/SearchMap_Preview open weights, 0.4B | 0.42 | huggingface.co | Official leaderboard | ||
| 59 | mongodb/voyage-3.5 (output_dtype=binary) closed weights | 0.41 | blog.voyageai.com | Official leaderboard | ||
| 60 | google/text-embedding-004 closed weights | 0.41 | cloud.google.com | Official leaderboard | ||
| 61 | mongodb/voyage-large-2-instruct closed weights | 0.41 | blog.voyageai.com | Official leaderboard | ||
| 62 | BidirLM/BidirLM-Omni-2.5B-Embedding open weights, 2.4B | 0.41 | huggingface.co | Official leaderboard | ||
| 63 | codefuse-ai/F2LLM-v2-4B open weights, 4B | 0.40 | huggingface.co | Official leaderboard | ||
| 64 | KaLM-Embedding/KaLM-embedding-multilingual-mini-instruct-v2.5 open weights, 0.5B | 0.40 | huggingface.co | Official leaderboard | ||
| 65 | infgrad/Jasper-Token-Compression-600M open weights, 0.6B | 0.40 | huggingface.co | Official leaderboard | ||
| 66 | Linq-AI-Research/Linq-Embed-Mistral open weights, 7.1B | 0.39 | huggingface.co | Official leaderboard | ||
| 67 | ICT-TIME-and-Querit/BOOM_4B_v1 open weights, 4B | 0.39 | huggingface.co | Official leaderboard | ||
| 68 | GritLM/GritLM-8x7B open weights, 57.9B | 0.39 | huggingface.co | Official leaderboard | ||
| 69 | zeroentropy/zembed-1 open weights, 4B | 0.38 | huggingface.co | Official leaderboard | ||
| 70 | infly/inf-retriever-v1 open weights, 7.1B | 0.38 | huggingface.co | Official leaderboard | ||
| 71 | microsoft/harrier-oss-v1-0.6b open weights, 0.6B | 0.38 | huggingface.co | Official leaderboard | ||
| 72 | HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1 open weights, 0.5B | 0.38 | huggingface.co | Official leaderboard | ||
| 73 | Cohere/Cohere-embed-v5.0-pro closed weights | 0.38 | docs.cohere.com | Official leaderboard | ||
| 74 | Salesforce/SFR-Embedding-Mistral open weights, 7.1B | 0.37 | huggingface.co | Official leaderboard | ||
| 75 | google/embeddinggemma-300m open weights, 0.3B | 0.37 | ai.google.dev | Official leaderboard | ||
| 76 | Cohere/Cohere-embed-v4.0 (output_dtype=binary) closed weights | 0.37 | docs.cohere.com | Official leaderboard | ||
| 77 | codefuse-ai/F2LLM-4B open weights, 4B | 0.36 | huggingface.co | Official leaderboard | ||
| 78 | ai-sage/Giga-Embeddings-instruct-3B-0826 open weights, 3.2B | 0.36 | huggingface.co | Official leaderboard | ||
| 79 | hotchpotch/bekko-embedding-v1-a25m open weights, 0.1B | 0.36 | huggingface.co | Official leaderboard | ||
| 80 | microsoft/harrier-oss-v1-270m open weights, 0.3B | 0.36 | huggingface.co | Official leaderboard | ||
| 81 | google/text-embedding-005 closed weights | 0.35 | cloud.google.com | Official leaderboard | ||
| 82 | BidirLM/BidirLM-1.7B-Embedding open weights, 1.7B | 0.35 | huggingface.co | Official leaderboard | ||
| 83 | topk-io/topk-embed-v1-xsmall open weights, 0.9B | 0.35 | huggingface.co | Official leaderboard | ||
| 84 | mongodb/voyage-3-lite closed weights | 0.35 | blog.voyageai.com | Official leaderboard | ||
| 85 | google/text-multilingual-embedding-002 closed weights | 0.35 | cloud.google.com | Official leaderboard | ||
| 86 | Alibaba-NLP/gte-Qwen2-1.5B-instruct open weights, 1.5B | 0.35 | huggingface.co | Official leaderboard | ||
| 87 | BidirLM/BidirLM-1B-Embedding open weights, 1B | 0.35 | huggingface.co | Official leaderboard | ||
| 88 | Cohere/Cohere-embed-v4.0 closed weights | 0.35 | docs.cohere.com | Official leaderboard | ||
| 89 | HIT-TMG/KaLM-embedding-multilingual-mini-v1 open weights, 0.5B | 0.35 | huggingface.co | Official leaderboard | ||
| 90 | infly/inf-retriever-v1-1.5b open weights, 1.5B | 0.35 | huggingface.co | Official leaderboard | ||
| 91 | intfloat/e5-mistral-7b-instruct open weights, 7.1B | 0.35 | huggingface.co | Official leaderboard | ||
| 92 | topk-io/topk-embed-v1-small open weights, 2.2B | 0.34 | huggingface.co | Official leaderboard | ||
| 93 | Cohere/Cohere-embed-v4.0 (output_dtype=int8) closed weights | 0.34 | docs.cohere.com | Official leaderboard | ||
| 94 | hotchpotch/bekko-embedding-v1-a8m open weights, 0.1B | 0.34 | huggingface.co | Official leaderboard | ||
| 95 | Alibaba-NLP/gte-Qwen2-7B-instruct open weights, 7.1B | 0.34 | huggingface.co | Official leaderboard | ||
| 96 | Alibaba-NLP/gte-multilingual-base open weights, 0.3B | 0.34 | huggingface.co | Official leaderboard | ||
| 97 | codefuse-ai/F2LLM-v2-1.7B open weights, 1.7B | 0.33 | huggingface.co | Official leaderboard | ||
| 98 | jinaai/jina-embeddings-v3 open weights, 0.6B | 0.33 | huggingface.co | Official leaderboard | ||
| 99 | Cohere/Cohere-embed-v5.0-fast closed weights | 0.32 | docs.cohere.com | Official leaderboard | ||
| 100 | NovaSearch/jasper_en_vision_language_v1 open weights, 1.6B | 0.32 | huggingface.co | Official leaderboard | ||
| 101 | codefuse-ai/F2LLM-v2-0.6B open weights, 0.6B | 0.32 | huggingface.co | Official leaderboard | ||
| 102 | avsolatorio/GIST-small-Embedding-v0 open weights, 0B | 0.32 | huggingface.co | Official leaderboard | ||
| 103 | NovaSearch/stella_en_400M_v5 open weights, 0.4B | 0.32 | huggingface.co | Official leaderboard | ||
| 104 | nvidia/NV-Embed-v2 open weights, 7.9B | 0.32 | huggingface.co | Official leaderboard | ||
| 105 | Alibaba-NLP/gte-Qwen1.5-7B-instruct open weights, 7.1B | 0.31 | huggingface.co | Official leaderboard | ||
| 106 | ibm-granite/granite-embedding-125m-english open weights, 0.1B | 0.31 | huggingface.co | Official leaderboard | ||
| 107 | avsolatorio/GIST-large-Embedding-v0 open weights, 0.3B | 0.30 | huggingface.co | Official leaderboard | ||
| 108 | McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-supervised open weights, 7.2B | 0.30 | huggingface.co | Official leaderboard | ||
| 109 | avsolatorio/GIST-all-MiniLM-L6-v2 open weights, 0B | 0.30 | huggingface.co | Official leaderboard | ||
| 110 | ibm-granite/granite-embedding-311m-multilingual-r2 open weights, 0.3B | 0.30 | huggingface.co | Official leaderboard | ||
| 111 | Cohere/Cohere-embed-multilingual-v3.0 closed weights | 0.30 | cohere.com | Official leaderboard | ||
| 112 | intfloat/multilingual-e5-large-instruct open weights, 0.6B | 0.30 | huggingface.co | Official leaderboard | ||
| 113 | Snowflake/snowflake-arctic-embed-m open weights, 0.1B | 0.30 | huggingface.co | Official leaderboard | ||
| 114 | Alibaba-NLP/gte-base-en-v1.5 open weights, 0.1B | 0.29 | huggingface.co | Official leaderboard | ||
| 115 | Cohere/Cohere-embed-multilingual-light-v3.0 closed weights | 0.29 | cohere.com | Official leaderboard | ||
| 116 | BAAI/bge-m3 open weights, 0.6B | 0.29 | huggingface.co | Official leaderboard | ||
| 117 | ibm-granite/granite-embedding-97m-multilingual-r2 open weights, 0.1B | 0.29 | huggingface.co | Official leaderboard | ||
| 118 | OrdalieTech/Solon-embeddings-large-0.1 open weights, 0.6B | 0.29 | huggingface.co | Official leaderboard | ||
| 119 | nomic-ai/nomic-embed-text-v2-moe open weights, 0.5B | 0.29 | huggingface.co | Official leaderboard | ||
| 120 | avsolatorio/NoInstruct-small-Embedding-v0 open weights, 0B | 0.28 | huggingface.co | Official leaderboard | ||
| 121 | openai/text-embedding-3-small closed weights | 0.28 | openai.com | Official leaderboard | ||
| 122 | ibm-granite/granite-embedding-english-r2 open weights, 0.1B | 0.28 | huggingface.co | Official leaderboard | ||
| 123 | NovaSearch/stella_en_1.5B_v5 open weights, 1.5B | 0.28 | huggingface.co | Official leaderboard | ||
| 124 | Snowflake/snowflake-arctic-embed-m-v2.0 open weights, 0.3B | 0.28 | huggingface.co | Official leaderboard | ||
| 125 | Snowflake/snowflake-arctic-embed-m-v1.5 open weights, 0.1B | 0.28 | huggingface.co | Official leaderboard | ||
| 126 | Mihaiii/Ivysaur open weights, 0B | 0.28 | huggingface.co | Official leaderboard | ||
| 127 | codefuse-ai/F2LLM-1.7B open weights, 1.7B | 0.28 | huggingface.co | Official leaderboard | ||
| 128 | avsolatorio/GIST-Embedding-v0 open weights, 0.1B | 0.28 | huggingface.co | Official leaderboard | ||
| 129 | Snowflake/snowflake-arctic-embed-l open weights, 0.3B | 0.27 | huggingface.co | Official leaderboard | ||
| 130 | Snowflake/snowflake-arctic-embed-s open weights, 0B | 0.27 | huggingface.co | Official leaderboard | ||
| 131 | w601sxs/b1ade-embed open weights, 0.3B | 0.27 | huggingface.co | Official leaderboard | ||
| 132 | BidirLM/BidirLM-0.6B-Embedding open weights, 0.6B | 0.27 | huggingface.co | Official leaderboard | ||
| 133 | codefuse-ai/F2LLM-v2-160M open weights, 0.2B | 0.27 | huggingface.co | Official leaderboard | ||
| 134 | Bytedance/Seed1.6-embedding-1215 closed weights | 0.27 | console.volcengine.com | Official leaderboard | ||
| 135 | deepvk/USER-bge-m3 open weights, 0.4B | 0.27 | huggingface.co | Official leaderboard | ||
| 136 | Haon-Chen/speed-embedding-7b-instruct open weights, 7.1B | 0.26 | huggingface.co | Official leaderboard | ||
| 137 | Cohere/Cohere-embed-english-v3.0 closed weights | 0.26 | cohere.com | Official leaderboard | ||
| 138 | codefuse-ai/F2LLM-v2-330M open weights, 0.3B | 0.26 | huggingface.co | Official leaderboard | ||
| 139 | telepix/PIXIE-Rune-v1.0 open weights, 0.6B | 0.26 | huggingface.co | Official leaderboard | ||
| 140 | BAAI/bge-m3-unsupervised open weights, 0.6B | 0.26 | huggingface.co | Official leaderboard | ||
| 141 | RiverRider/motherlode-code-small-en-v0.1 open weights, 0B | 0.26 | huggingface.co | Official leaderboard | ||
| 142 | ibm-granite/granite-embedding-278m-multilingual open weights, 0.3B | 0.26 | huggingface.co | Official leaderboard | ||
| 143 | bigscience/sgpt-bloom-7b1-msmarco open weights, 7.1B | 0.26 | huggingface.co | Official leaderboard | ||
| 144 | Lajavaness/bilingual-embedding-small open weights, 0.1B | 0.26 | huggingface.co | Official leaderboard | ||
| 145 | Cohere/Cohere-embed-english-light-v3.0 closed weights | 0.26 | cohere.com | Official leaderboard | ||
| 146 | MongoDB/mdbr-leaf-ir open weights, 0B | 0.26 | huggingface.co | Official leaderboard | ||
| 147 | | 0.25 | Oct 2026 | huggingface.co | Official leaderboard | |
| 148 | Lajavaness/bilingual-embedding-large open weights, 0.6B | 0.25 | huggingface.co | Official leaderboard | ||
| 149 | jinaai/jina-embedding-s-en-v1 open weights, 0B | 0.25 | huggingface.co | Official leaderboard | ||
| 150 | hotchpotch/bekko-static-embedding-v1 open weights, 0.2B | 0.25 | huggingface.co | Official leaderboard | ||
| 151 | BidirLM/BidirLM-270M-Embedding open weights, 0.3B | 0.25 | huggingface.co | Official leaderboard | ||
| 152 | mixedbread-ai/mxbai-embed-large-v1 open weights, 0.3B | 0.25 | huggingface.co | Official leaderboard | ||
| 153 | WhereIsAI/UAE-Large-V1 open weights, 0.3B | 0.24 | huggingface.co | Official leaderboard | ||
| 154 | thenlper/gte-small open weights, 0B | 0.24 | huggingface.co | Official leaderboard | ||
| 155 | izhx/udever-bloom-7b1 open weights | 0.24 | huggingface.co | Official leaderboard | ||
| 156 | abhinand/MedEmbed-small-v0.1 open weights, 0B | 0.24 | huggingface.co | Official leaderboard | ||
| 157 | manveertamber/cadet-embed-base-v1 open weights, 0.1B | 0.24 | huggingface.co | Official leaderboard | ||
| 158 | Snowflake/snowflake-arctic-embed-xs open weights, 0B | 0.23 | huggingface.co | Official leaderboard | ||
| 159 | BAAI/bge-base-en-v1.5 open weights, 0.1B | 0.23 | huggingface.co | Official leaderboard | ||
| 160 | thenlper/gte-large open weights, 0.3B | 0.23 | huggingface.co | Official leaderboard | ||
| 161 | jinaai/jina-embedding-b-en-v1 open weights, 0.1B | 0.23 | huggingface.co | Official leaderboard | ||
| 162 | prdev/mini-gte open weights, 0.1B | 0.23 | huggingface.co | Official leaderboard | ||
| 163 | BAAI/bge-large-en-v1.5 open weights, 0.3B | 0.23 | huggingface.co | Official leaderboard | ||
| 164 | nomic-ai/nomic-embed-text-v1-unsupervised open weights, 0.1B | 0.23 | huggingface.co | Official leaderboard | ||
| 165 | BAAI/bge-small-en-v1.5 open weights, 0B | 0.23 | huggingface.co | Official leaderboard | ||
| 166 | intfloat/e5-large open weights, 0.3B | 0.23 | huggingface.co | Official leaderboard | ||
| 167 | Snowflake/snowflake-arctic-embed-l-v2.0 open weights, 0.6B | 0.23 | huggingface.co | Official leaderboard | ||
| 168 | ibm-granite/granite-embedding-small-english-r2 open weights, 0B | 0.23 | huggingface.co | Official leaderboard | ||
| 169 | manu/sentence_croissant_alpha_v0.3 open weights, 1.3B | 0.23 | huggingface.co | Official leaderboard | ||
| 170 | manu/sentence_croissant_alpha_v0.4 open weights, 1.3B | 0.23 | huggingface.co | Official leaderboard | ||
| 171 | McGill-NLP/LLM2Vec-Mistral-7B-Instruct-v2-mntp-unsup-simcse open weights, 7.2B | 0.22 | huggingface.co | Official leaderboard | ||
| 172 | Mihaiii/Wartortle open weights, 0B | 0.22 | huggingface.co | Official leaderboard | ||
| 173 | thenlper/gte-base open weights, 0.1B | 0.22 | huggingface.co | Official leaderboard | ||
| 174 | manu/bge-m3-custom-fr open weights, 0.6B | 0.22 | huggingface.co | Official leaderboard | ||
| 175 | sentence-transformers/paraphrase-multilingual-mpnet-base-v2 open weights, 0.3B | 0.22 | huggingface.co | Official leaderboard | ||
| 176 | sentence-transformers/static-retrieval-mrl-en-v1 open weights, 0B | 0.22 | huggingface.co | Official leaderboard | ||
| 177 | BAAI/bge-large-en open weights, 0.3B | 0.22 | huggingface.co | Official leaderboard | ||
| 178 | sdadas/mmlw-e5-small open weights, 0.1B | 0.22 | huggingface.co | Official leaderboard | ||
| 179 | bisectgroup/BiCA-base open weights, 0.1B | 0.22 | huggingface.co | Official leaderboard | ||
| 180 | sdadas/mmlw-e5-base open weights, 0.3B | 0.22 | huggingface.co | Official leaderboard | ||
| 181 | Mihaiii/gte-micro-v4 open weights, 0B | 0.22 | huggingface.co | Official leaderboard | ||
| 182 | sentence-transformers/multi-qa-MiniLM-L6-cos-v1 open weights, 0B | 0.22 | huggingface.co | Official leaderboard | ||
| 183 | omarelshehy/arabic-english-sts-matryoshka open weights, 0.6B | 0.22 | huggingface.co | Official leaderboard | ||
| 184 | ibm-granite/granite-embedding-107m-multilingual open weights, 0.1B | 0.22 | huggingface.co | Official leaderboard | ||
| 185 | mteb/baseline-bm25s open weights | 0.22 | github.com | Official leaderboard | ||
| 186 | Snowflake/snowflake-arctic-embed-m-long open weights, 0.1B | 0.22 | huggingface.co | Official leaderboard | ||
| 187 | izhx/udever-bloom-3b open weights, 3B | 0.22 | huggingface.co | Official leaderboard | ||
| 188 | Mihaiii/Bulbasaur open weights, 0B | 0.21 | huggingface.co | Official leaderboard | ||
| 189 | Mihaiii/Squirtle open weights, 0B | 0.21 | huggingface.co | Official leaderboard | ||
| 190 | sentence-transformers/all-mpnet-base-v2 open weights, 0.1B | 0.21 | huggingface.co | Official leaderboard | ||
| 191 | dwzhu/e5-base-4k open weights, 0.1B | 0.21 | huggingface.co | Official leaderboard | ||
| 192 | amgix/static-retrieval-multilingual-69m-v1 open weights, 0.1B | 0.21 | huggingface.co | Official leaderboard | ||
| 193 | izhx/udever-bloom-1b1 open weights, 1.1B | 0.21 | huggingface.co | Official leaderboard | ||
| 194 | intfloat/multilingual-e5-large open weights, 0.6B | 0.21 | huggingface.co | Official leaderboard | ||
| 195 | intfloat/e5-small open weights, 0B | 0.21 | huggingface.co | Official leaderboard | ||
| 196 | sentence-transformers/all-MiniLM-L12-v2 open weights, 0B | 0.21 | huggingface.co | Official leaderboard | ||
| 197 | sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 open weights, 0.1B | 0.21 | huggingface.co | Official leaderboard | ||
| 198 | brahmairesearch/slx-v0.1 open weights, 0B | 0.21 | huggingface.co | Official leaderboard | ||
| 199 | sentence-transformers/all-MiniLM-L6-v2 open weights, 0B | 0.21 | huggingface.co | Official leaderboard | ||
| 200 | intfloat/multilingual-e5-base open weights, 0.3B | 0.20 | huggingface.co | Official leaderboard | ||
| 201 | Omartificial-Intelligence-Space/Arabic-labse-Matryoshka open weights, 0.5B | 0.20 | huggingface.co | Official leaderboard | ||
| 202 | intfloat/e5-small-v2 open weights, 0B | 0.20 | huggingface.co | Official leaderboard | ||
| 203 | manu/sentence_croissant_alpha_v0.2 open weights, 1.3B | 0.20 | huggingface.co | Official leaderboard | ||
| 204 | Gameselo/STS-multilingual-mpnet-base-v2 open weights, 0.3B | 0.20 | huggingface.co | Official leaderboard | ||
| 205 | Lajavaness/bilingual-embedding-base open weights, 0.3B | 0.20 | huggingface.co | Official leaderboard | ||
| 206 | infgrad/stella-base-en-v2 open weights, 0.1B | 0.20 | huggingface.co | Official leaderboard | ||
| 207 | ibm-granite/granite-embedding-30m-english open weights, 0B | 0.20 | huggingface.co | Official leaderboard | ||
| 208 | intfloat/e5-base-v2 open weights, 0.1B | 0.20 | huggingface.co | Official leaderboard | ||
| 209 | Omartificial-Intelligence-Space/Arabic-all-nli-triplet-Matryoshka open weights, 0.3B | 0.20 | huggingface.co | Official leaderboard | ||
| 210 | deepfile/embedder-100p open weights, 0.3B | 0.19 | huggingface.co | Official leaderboard | ||
| 211 | ai-forever/sbert_large_nlu_ru open weights, 0.4B | 0.19 | huggingface.co | Official leaderboard | ||
| 212 | sdadas/mmlw-e5-large open weights, 0.6B | 0.19 | huggingface.co | Official leaderboard | ||
| 213 | codefuse-ai/F2LLM-v2-80M open weights, 0.1B | 0.19 | huggingface.co | Official leaderboard | ||
| 214 | MongoDB/mdbr-leaf-mt open weights, 0B | 0.19 | huggingface.co | Official leaderboard | ||
| 215 | nomic-ai/nomic-embed-text-v1.5 open weights, 0.1B | 0.19 | huggingface.co | Official leaderboard | ||
| 216 | intfloat/multilingual-e5-small open weights, 0.1B | 0.19 | huggingface.co | Official leaderboard | ||
| 217 | nlpai-lab/KURE-Sparse-nano open weights, 0.1B | 0.19 | huggingface.co | Official leaderboard | ||
| 218 | ai-forever/ru-en-RoSBERTa open weights, 0.4B | 0.19 | huggingface.co | Official leaderboard | ||
| 219 | sdadas/mmlw-roberta-base open weights, 0.1B | 0.19 | huggingface.co | Official leaderboard | ||
| 220 | lightonai/mSlideOn open weights, 0.3B | 0.18 | huggingface.co | Official leaderboard | ||
| 221 | Omartificial-Intelligence-Space/Arabic-MiniLM-L12-v2-all-nli-triplet open weights, 0.1B | 0.18 | huggingface.co | Official leaderboard | ||
| 222 | nomic-ai/nomic-embed-text-v1-ablated open weights, 0.1B | 0.18 | huggingface.co | Official leaderboard | ||
| 223 | BAAI/bge-base-en open weights, 0.1B | 0.18 | huggingface.co | Official leaderboard | ||
| 224 | sdadas/mmlw-roberta-large open weights, 0.4B | 0.18 | huggingface.co | Official leaderboard | ||
| 225 | intfloat/e5-base open weights, 0.1B | 0.18 | huggingface.co | Official leaderboard | ||
| 226 | intfloat/e5-large-v2 open weights, 0.3B | 0.18 | huggingface.co | Official leaderboard | ||
| 227 | Mihaiii/Venusaur open weights, 0B | 0.18 | huggingface.co | Official leaderboard | ||
| 228 | minishlab/potion-base-8M open weights, 0B | 0.17 | huggingface.co | Official leaderboard | ||
| 229 | nlpai-lab/KURE-Sparse-base open weights, 0.6B | 0.17 | huggingface.co | Official leaderboard | ||
| 230 | aari1995/German_Semantic_STS_V2 open weights, 0.3B | 0.17 | huggingface.co | Official leaderboard | ||
| 231 | consciousAI/cai-lunaris-text-embeddings open weights, 0.3B | 0.17 | huggingface.co | Official leaderboard | ||
| 232 | minishlab/potion-multilingual-128M open weights, 0.1B | 0.17 | huggingface.co | Official leaderboard | ||
| 233 | Mihaiii/gte-micro open weights, 0B | 0.17 | huggingface.co | Official leaderboard | ||
| 234 | sentence-transformers/LaBSE open weights, 0.5B | 0.17 | huggingface.co | Official leaderboard | ||
| 235 | sentence-transformers/static-similarity-mrl-multilingual-v1 open weights, 0.1B | 0.17 | huggingface.co | Official leaderboard | ||
| 236 | minishlab/potion-base-4M open weights, 0B | 0.17 | huggingface.co | Official leaderboard | ||
| 237 | nomic-ai/nomic-embed-text-v1 open weights, 0.1B | 0.16 | huggingface.co | Official leaderboard | ||
| 238 | minishlab/potion-base-32M open weights, 0B | 0.16 | huggingface.co | Official leaderboard | ||
| 239 | BAAI/bge-base-zh-v1.5 open weights, 0.1B | 0.16 | huggingface.co | Official leaderboard | ||
| 240 | cointegrated/LaBSE-en-ru open weights, 0.1B | 0.16 | huggingface.co | Official leaderboard | ||
| 241 | sergeyzh/LaBSE-ru-turbo open weights, 0.1B | 0.16 | huggingface.co | Official leaderboard | ||
| 242 | minishlab/potion-base-2M open weights, 0B | 0.16 | huggingface.co | Official leaderboard | ||
| 243 | izhx/udever-bloom-560m open weights, 0.6B | 0.16 | huggingface.co | Official leaderboard | ||
| 244 | BAAI/bge-large-zh-v1.5 open weights, 0.3B | 0.15 | huggingface.co | Official leaderboard | ||
| 245 | shibing624/text2vec-base-multilingual open weights, 0.1B | 0.15 | huggingface.co | Official leaderboard | ||
| 246 | minishlab/M2V_multilingual_output open weights, 0.1B | 0.15 | huggingface.co | Official leaderboard | ||
| 247 | Jaume/gemma-2b-embeddings open weights, 2.5B | 0.15 | huggingface.co | Official leaderboard | ||
| 248 | BAAI/bge-small-zh-v1.5 open weights, 0B | 0.15 | huggingface.co | Official leaderboard | ||
| 249 | malenia1/ternary-weight-embedding open weights, 0.1B | 0.15 | huggingface.co | Official leaderboard | ||
| 250 | DeepPavlov/rubert-base-cased-sentence open weights, 0.1B | 0.14 | huggingface.co | Official leaderboard | ||
| 251 | DeepPavlov/distilrubert-small-cased-conversational open weights, 0.1B | 0.14 | huggingface.co | Official leaderboard | ||
| 252 | cointegrated/rubert-tiny2 open weights, 0B | 0.14 | huggingface.co | Official leaderboard | ||
| 253 | sergeyzh/rubert-tiny-turbo open weights, 0B | 0.14 | huggingface.co | Official leaderboard | ||
| 254 | minishlab/M2V_base_glove open weights, 0.1B | 0.13 | huggingface.co | Official leaderboard | ||
| 255 | jinaai/jina-embeddings-v2-small-en open weights, 0B | 0.13 | huggingface.co | Official leaderboard | ||
| 256 | minishlab/M2V_base_output open weights, 0B | 0.13 | huggingface.co | Official leaderboard | ||
| 257 | cointegrated/rubert-tiny open weights, 0B | 0.13 | huggingface.co | Official leaderboard | ||
| 258 | Omartificial-Intelligence-Space/Arabert-all-nli-triplet-Matryoshka open weights, 0.1B | 0.12 | huggingface.co | Official leaderboard | ||
| 259 | minishlab/M2V_base_glove_subword open weights, 0.1B | 0.12 | huggingface.co | Official leaderboard | ||
| 260 | ai-forever/sbert_large_mt_nlu_ru open weights, 0.4B | 0.12 | huggingface.co | Official leaderboard | ||
| 261 | DeepPavlov/rubert-base-cased open weights, 1.3B | 0.12 | huggingface.co | Official leaderboard | ||
| 262 | cnmoro/static-nomic-384-pten-v2-st open weights, 0.1B | 0.11 | huggingface.co | Official leaderboard | ||
| 263 | Omartificial-Intelligence-Space/Arabic-mpnet-base-all-nli-triplet open weights, 0.1B | 0.11 | huggingface.co | Official leaderboard | ||
| 264 | jinaai/jina-embeddings-v2-base-en open weights, 0.1B | 0.10 | huggingface.co | Official leaderboard | ||
| 265 | deepvk/USER-base open weights, 0.4B | 0.10 | huggingface.co | Official leaderboard | ||
| 266 | Omartificial-Intelligence-Space/Marbert-all-nli-triplet-Matryoshka open weights, 0.2B | 0.10 | huggingface.co | Official leaderboard | ||
| 267 | mteb/baseline-random-encoder open weights | 0.10 | Official leaderboard | |||
| 268 | deepvk/deberta-v1-base open weights, 0.1B | 0.10 | huggingface.co | Official leaderboard | ||
| 269 | shibing624/text2vec-base-chinese open weights, 0.1B | 0.10 | huggingface.co | Official leaderboard | ||
| 270 | silma-ai/silma-embeddding-matryoshka-v0.1 open weights, 0.1B | 0.09 | huggingface.co | Official leaderboard |
| # | Model | Score | Setting | Date | Link | Source |
|---|---|---|---|---|---|---|
| 1 | | 0.85 | Jun 2025 | huggingface.co | Official leaderboard | |
| 2 | | 0.81 | Jun 2025 | huggingface.co | Official leaderboard | |
| 3 | | 0.79 | Jun 2025 | huggingface.co | Official leaderboard | |
| 4 | | 0.47 | Mar 2026 | ai.google.dev | Official leaderboard | |
| 5 | | 0.25 | Oct 2026 | huggingface.co | Official leaderboard |
Number one over time
Lab claims count from the day the card came out, independent runs from the model’s release.
Source: Official AILA Statute Retrieval leaderboard
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
Source: Official AILA Statute Retrieval leaderboard
No lab model card reports it yet
We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.
More in Law, finance and medicine
- MedXpertQA-MM In use Models answer expert-level medical exam questions that combine images with clinical records and test results. Scoring is accuracy.
Qwen 3.8 Max 80.4%
- HealthBench Professional In use 525 physician-authored tasks from real clinician chats (care consult, documentation, research) with physician-adjudicated rubrics. Claude Sonnet 5.5 69.2%
- HealthBench In use 5,000 realistic health conversations graded against physician-written rubrics. A length-adjusted variant penalizes verbosity. GPT-5 67.2%
- FinSearchComp In use Agents search the web to fetch live financial data, look up history, and run multi-step investigations, across 635 expert-written questions. Scored by answer accuracy.
Ling-3.1-flash 81.7%
- KorMedMCQA In use Models answer 7,469 multiple-choice questions from Korean licensing exams for doctors, nurses, pharmacists and dentists, held from 2012 to 2024. o1-preview 92.7%
- Harvey LAB-AA v1.1 In use Artificial Analysis's run of Harvey's Legal Agent Benchmark on Harvey's newer private set of 120 tasks across 24 practice areas. A deliverable with a material hallucination scores zero, and the headline is the share of judges who find every rubric criterion passed. GPT-6.2 Astra 15%
Data audit
All 9 checks pass. Every benchmark
Catalog record 2 pass
- Pass Task access All tasks are public.
- Pass Confidence Checked against a primary source.
Scores 3 pass 2 notes
- Pass Independent runs Scores from the official leaderboard (270 entries).
- Pass Models scored 5 models we track, plus 265 other entries on its leaderboard.
- Pass Newest score The newest is from October 2026, for EmbeddingGemma 2.
- Note Frontier models None of its models are on the capabilities index.
- Note Headroom Scored as a plain number, with no fixed ceiling.
Leaderboard import 3 pass
- Pass Importer We read the board on mteb-leaderboard.hf.space: 5 rows for models we track and 265 other entries at the last read.
- Pass Last read November 20th, 2026.
- Pass Read worked The last read worked.
Consistency 1 pass 1 note
- Note Lab claims No model has both a lab number and an independent run.
- Pass Known issues No published audit found problems.