ScanBench
Baichuan-M3-235B 73.8% Models act as doctors in 303 simulated clinical cases from 12 departments. They take a history, order lab tests and give a final diagnosis, scored per stage.
The paper calls it OSCE-like and says the data will be open-sourced. Scores are given for Clinical Inquiry, Laboratory Testing and Diagnosis, with a human doctor baseline. Grader type not checked.
- Made by
- Baichuan AI
- Released
- January 2026
- Kind
- Medicine
- Level
- Expert
- Scored
- Graded by a model
- Answers
- Agent task
- Tasks
- Kept private
- Last in a launch post
- January 2026, dropped before it saturated
- Last model added
- February 2026
Baichuan-M3-235B leads with 73.8%
Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.
Source: Labs’ model cards
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | Baichuan-M3-235B | 73.8% | Jan 2026 | Lab model card |
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
Source: Labs’ model cards
Labs headline it less often now, last in January 2026
Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.
| Date | Launch post | Score | As the post writes it |
|---|---|---|---|
| Jan 13, 2026 | Baichuan-M3-235B | 73.8 | Mean of SCAN-bench Clinical Inquiry 74.9 / Lab Test 72.1 / Diagnosis 74.4 |
One system card reports it
Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.
| Date | Document | Score | As the document writes it | Section |
|---|---|---|---|---|
| Feb 6, 2026 | Baichuan-M3-235B technical report | ScanBench stations Clinical Inquiry 74.9, Laboratory Testing 72.1, Diagnosis 74.4, no overall (4.1.3 text). SCAN inquiry dimensions: Safety Stratification 75.8, Association and Inquiry 72.6, Clarity Matters 84.5, Normative Protocol 59.9 | Health |
More in Law, finance and medicine
- MedXpertQA-MM In use Models answer expert-level medical exam questions that combine images with clinical records and test results. Scoring is accuracy.
Qwen 3.8 Max 80.4% - HealthBench Professional In use 525 physician-authored tasks from real clinician chats (care consult, documentation, research) with physician-adjudicated rubrics. Claude Sonnet 5.5 69.2%
- HealthBench In use 5,000 realistic health conversations graded against physician-written rubrics. A length-adjusted variant penalizes verbosity. GPT-5 67.2%
- FinSearchComp In use Agents search the web to fetch live financial data, look up history, and run multi-step investigations, across 635 expert-written questions. Scored by answer accuracy.
Ling-3.1-flash 81.7% - KBL In use Models answer Korean legal knowledge and reasoning tasks and Korean bar exam questions. It has 7 knowledge tasks, 4 reasoning tasks and 2,510 bar exam items.
Solar Pro 4 77.5% - KorMedMCQA In use Models answer 7,469 multiple-choice questions from Korean licensing exams for doctors, nurses, pharmacists and dentists, held from 2012 to 2024. Solar Pro 4 93.2%