Benchmark Almanac

Biomni-Eval1

Not in model cards

Agents use biomedical data and tools to answer 433 questions across ten task types. Each task checks a structured answer against a reference.

The February 2026 paper compares eight distinct models in nine agent configurations. S1-NexusAgent with Claude 4.5 Sonnet scored 76.07% on the original Biomni Eval1 tasks.

Made by
Stanford Biomni
Released
October 2025
Kind
Genomics and life sciences
Level
Expert
Scored
Checked automatically
Answers
Agent task
Tasks
All public
Measures
Capability
Language
English
In and out
Text, Tables → Actions, Text
Interaction
Agentic
Environment
APIs and tools
Refresh
One fixed set
Run by
Anyone

No scores here yet

No lab, leaderboard or Epoch AI run has reported a score for Biomni-Eval1 yet.

No lab model card reports it yet

We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.

More in Biology and chemistry

All 137 in Biology and chemistry
  • GeneBench Pro In use Agents analyze messy simulated genomics and biology datasets to estimate a decision-relevant quantity across 129 problems. Scored automatically against known answers. GPT-5.6 Sol 31.5%
  • MedChemBench (OpenAI) In use Models work through 99 medicinal chemistry problems drawn from recent papers and patents. Each task mixes prose with structures, assay tables and plots, then asks for the program’s next decision. GPT-6 Astra 83.8%
  • SUPERChem In use Models solve 500 expert-written chemistry reasoning problems, offered in multimodal and text-only forms. Expert solution paths also allow a reasoning path score. Tencent Hy4 preview 66.4%
  • LifeSciBench In use Models complete 750 expert-written life science research tasks, often with attached figures, tables, or sequence files. Graded against expert rubrics as score and pass rate. GPT-Rosalind-6 61.3%
  • ProtocolQA Open-Ended In use Models correct errors in published lab protocols using open-ended questions adapted from LAB-Bench ProtocolQA. Scored as pass@1. GPT-6 Cyber 47.2%
  • MolecularIQ In use Models answer questions about molecular graphs, such as counting, indexing and constrained generation, and a symbolic checker verifies each answer. gpt-oss-120b 47.5%

Data audit

3 of 4 checks pass, 1 warning. Look first at the Independent runs check. No scores from any source yet. Every benchmark

Catalog record 2 pass
  • Pass Task access All tasks are public.
  • Pass Confidence Checked against a primary source.
Scores 1 warning 4 notes
  • Warning Independent runs No scores from any source yet.
  • Note Models scored No models scored yet.
  • Note Newest score No scores yet.
  • Note Frontier models No models scored yet.
  • Note Headroom No scores yet.
Leaderboard import 1 note
  • Note Importer No public leaderboard to read.
Consistency 1 pass 1 note
  • Note Lab claims No model has both a lab number and an independent run.
  • Pass Known issues No published audit found problems.

How we check