scBench-Long
Agents run long single-cell RNA-seq analyses that need sustained empirical work and biological reasoning.
Part of LatchBio's BioBench suite on benchmarks.bio. The V1 set has 22 evaluations. Release month is the GitHub repo creation month.
- Made by
- LatchBio
- Released
- June 2026
- Kind
- Genomics and life sciences
- Level
- Expert
- Scored
- Checked automatically
- Answers
- Agent task
- Tasks
- Public, plus a private test set
- Strongest model tested
- GPT-6 Astra #3 on the capability index
- Last model added
- October 2026
- Scores refreshed
- November 12th, 2026
Claude Opus 5.5 leads with 36.9%
Best score per model from the benchmark's own leaderboard, read on November 12th, 2026. Where a model ran with several settings or harnesses, we keep its best.
- 36.9 Claude Opus 5.5
- 31.8 Claude Sonnet 5.5
- 29.6 GPT-5.6 Sol
- 28.4 GPT-6 Sol
- 28.4
Gemini 4 Argon
- 27.3 Claude Opus 5
- 27.3 GPT-6 Astra
- 26.7 GPT-6.1 Sol
- 25.6 Claude Fable 5.1
- 21.6 GPT-5.5
- 21.0 Claude Opus 4.8
- 19.9
Gemini 3.8 Flash
- 18.8
Gemini 3.7 Flash
- 18.8 GPT-6.1 Terra
- 16.5 Grok 4.6
- 15.9 Claude Sonnet 5
- 14.8
DeepSeek V4.1 Flash
- 14.2 Kimi K3
- 13.1 GPT-5.6 Luna
- 11.9 GPT-6 Luna
- 11.4 Claude Opus 4.7
- 11.4 Grok 4.7
- 10.2 Claude Sonnet 4.6
- 10.2 GLM-5.3
- 10.2
Mistral Large 4
- 3.03
Nemotron 3 Ultra
- 0.0
Nemotron 3.5 Lightning 30B-A3B
- 1 Claude Opus 5.5 LSVP 36.9%
- 2 Claude Sonnet 5.5 31.8%
- 3 GPT-5.6 Sol 29.6%
- 4 GPT-6 Sol 28.4%
- 5
Gemini 4 Argon 28.4%
- 6 Claude Opus 5 27.3%
- 7 GPT-6 Astra 27.3%
- 8 GPT-6.1 Sol 26.7%
- 9 Claude Fable 5.1 LSVP 25.6%
- 10 GPT-5.5 21.6%
- 11 Claude Opus 4.8 21%
- 12
Gemini 3.8 Flash 19.9%
- 13
Gemini 3.7 Flash 18.8%
- 14 GPT-6.1 Terra 18.8%
- 15 Grok 4.6 16.5%
- 16 Claude Sonnet 5 15.9%
- 17
DeepSeek V4.1 Flash 14.8%
- 18 Kimi K3 14.2%
- 19 GPT-5.6 Luna 13.1%
- 20 GPT-6 Luna 11.9%
- 21 Claude Opus 4.7 11.4%
- 22 Grok 4.7 11.4%
- 23 Claude Sonnet 4.6 10.2%
- 24 GLM-5.3 10.2%
- 25
Mistral Large 4 10.2%
- 26
Nemotron 3 Ultra 3.03%
- 27
Nemotron 3.5 Lightning 30B-A3B 0%
Source: Official scBench-Long leaderboard
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | Claude Opus 5.5 | 36.9% | LSVP, Pi | Sep 2026 | Official leaderboard |
| 2 | Claude Sonnet 5.5 | 31.8% | Claude Code | Sep 2026 | Official leaderboard |
| 3 | GPT-5.6 Sol | 29.6% | Codex | Jul 2026 | Official leaderboard |
| 4 | GPT-6 Sol | 28.4% | Pi | Sep 2026 | Official leaderboard |
| 5 | | 28.4% | Pi | Sep 2026 | Official leaderboard |
| 6 | Claude Opus 5 | 27.3% | Pi | Jul 2026 | Official leaderboard |
| 7 | GPT-6 Astra | 27.3% | Pi | Sep 2026 | Official leaderboard |
| 8 | GPT-6.1 Sol | 26.7% | Pi | Sep 2026 | Official leaderboard |
| 9 | Claude Fable 5.1 | 25.6% | LSVP, Pi | Sep 2026 | Official leaderboard |
| 10 | GPT-5.5 | 21.6% | Pi | Apr 2026 | Official leaderboard |
| 11 | Claude Opus 4.8 | 21% | Claude Code | May 2026 | Official leaderboard |
| 12 | | 19.9% | Pi | Sep 2026 | Official leaderboard |
| 13 | | 18.8% | Pi | Aug 2026 | Official leaderboard |
| 14 | GPT-6.1 Terra | 18.8% | Codex | Oct 2026 | Official leaderboard |
| 15 | Grok 4.6 | 16.5% | Pi | Aug 2026 | Official leaderboard |
| 16 | Claude Sonnet 5 | 15.9% | Pi | Jun 2026 | Official leaderboard |
| 17 | | 14.8% | Pi | Sep 2026 | Official leaderboard |
| 18 | Kimi K3 | 14.2% | Pi | Jul 2026 | Official leaderboard |
| 19 | GPT-5.6 Luna | 13.1% | Pi | Jul 2026 | Official leaderboard |
| 20 | GPT-6 Luna | 11.9% | Codex | Sep 2026 | Official leaderboard |
| 21 | Claude Opus 4.7 | 11.4% | Claude Code | Apr 2026 | Official leaderboard |
| 22 | Grok 4.7 | 11.4% | Pi | Sep 2026 | Official leaderboard |
| 23 | Claude Sonnet 4.6 | 10.2% | Claude Code | Feb 2026 | Official leaderboard |
| 24 | GLM-5.3 | 10.2% | Pi | Aug 2026 | Official leaderboard |
| 25 | | 10.2% | Pi | Oct 2026 | Official leaderboard |
| 26 | | 3.03% | Pi | Jun 2026 | Official leaderboard |
| 27 | | 0% | Pi | Aug 2026 | Official leaderboard |
3 models have held number one on the official leaderboard since its release in June 2026
Lab claims count from the day the card came out, independent runs from the model’s release.
Source: Official scBench-Long leaderboard
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
Source: Official scBench-Long leaderboard
No lab model card reports it yet
We read the headline results of 522 launch posts from 52 labs, and none of them list this benchmark.
More in Biology and chemistry
- GeneBench Pro In use Agents analyze messy simulated genomics and biology datasets to estimate a decision-relevant quantity across 129 problems. Scored automatically against known answers. GPT-5.6 Sol 31.5%
- SUPERChem In use Models solve 500 expert-written chemistry reasoning problems, offered in multimodal and text-only forms. Expert solution paths also allow a reasoning path score.
Tencent Hy4 preview 66.4%
- LifeSciBench In use Models complete 750 expert-written life science research tasks, often with attached figures, tables, or sequence files. Graded against expert rubrics as score and pass rate. GPT-Rosalind-6 61.3%
- MedChemBench (OpenAI) In use Models answer chemistry questions from an OpenAI internal set, grouped with OpenAI's life science research evaluations. OpenAI has not published the task format. GPT-Rosalind-6 49.6%
- ProtocolQA Open-Ended In use Models correct errors in published lab protocols using open-ended questions adapted from LAB-Bench ProtocolQA. Scored as pass@1. GPT-6 Cyber 47.2%
- MolecularIQ In use Models answer questions about molecular graphs, such as counting, indexing and constrained generation, and a symbolic checker verifies each answer. gpt-oss-120b 47.5%