MTEB Arena
Users compare retrieval, clustering and similarity results from two anonymous embedding models and vote for the better one.
The space says the arena is unavailable because of resource limits. It has about 116 likes.
- Made by
- MTEB community
- Released
- July 2024
- Kind
- Other
- Level
- Everyday
- Scored
- Ranked by votes
- Answers
- Open-ended
- Tasks
- All public
No scores here yet
We have no scores for MTEB Arena yet.
No lab model card reports it yet
We read the headline results of 522 launch posts from 52 labs, and none of them list this benchmark.
More in Other
- Personal Superintelligence Index (Meta) In use Meta's composite of seven personal and knowledge-work evals: Agents' Last Exam, AutomationBench-AA, FocusBench, JobBench, GDP.pdf, VBT and DRACO.
- Artificial Analysis Intelligence Index v5 In use Version 5 of Artificial Analysis's index: nine evaluations in four equal categories, most with private test sets, run three times each in its own agent harness.
Gemini 4 Carbon 59.0 - SAGE v1.1 (Vals) In use Models grade handwritten undergraduate math and computer science work against rubrics. Scored by class-balanced accuracy of each rubric check against expert grading. Claude Opus 5.5 91.3%
- MTEB Fading Massive Text Embedding Benchmark: retrieval, clustering, classification across languages and modalities.
sonar 42% - Anthropic ECI (AECI) Only in system cards Index that combines a basket of capability benchmarks into one capability score to track trends across Anthropic models. Claude Opus 5.5 169.4
- SPEED-Bench Only in system cards Measures speculative decoding across varied prompts and domains. Reports the average acceptance length of draft tokens, so higher means faster generation at the same output.
Nemotron 3 Ultra 5.15