LatchBio
We track 15 benchmarks that LatchBio made or helped make.
0 in use 14 with public code 15 with a leaderboard here
Benchmarks
| Name | Kind | Released | Best score | Status |
|---|---|---|---|---|
| scBench (LatchBio SingleCellBench) 195 verifiable single-cell RNA-seq analysis problems. Each pairs a data snapshot with a task and a deterministic grader. | Lab and data work | Feb 2026 | 63.9% | System cards only |
| SpatialBench (LatchBio) Agentic spatial-transcriptomics data analysis problems with deterministic graders. Anthropic reports a 115-problem Verified variant. | Lab and data work | Dec 2025 | 57.6% | System cards only |
| BioSecBench-Function Agents recover biological function from experimental data. Scored by verifiable checks. One of three LatchBio BioSecBench evaluations. | Genomics and life sciences | Sep 2026 | 73.6% | System cards only |
| BioSecBench-Surveillance Agents turn raw pathogen sequencing data into surveillance results. The endpoint pass rate excludes refused runs. | Genomics and life sciences | Jul 2026 | 60.8% | System cards only |
| LatchBio Capabilities v1.0 LatchBio cross-benchmark suite of agentic biological data analysis (transcriptomics, epigenomics, variants, pharmacology) with deterministic graders. | Lab and data work | 2026 | 58% | System cards only |
| BioSecBench-Refusal Agents run 61 routine and 46 concealed-hazard biology analysis tasks. The score pairs red-team refusal with routine completion. | Hazardous knowledge | Jul 2026 | 62.4% | System cards only |
| OncologyBench Separate agents run analyses of cancer research data, and a final agent makes a decision on detection, diagnosis or treatment. Strict scoring needs full marks on both parts. | Genomics and life sciences | Oct 2026 | 50.7% | Not in cards |
| TxBench-Antibody-Discovery Agents make antibody discovery and development decisions from real experimental data. A grader checks each decision. | Genomics and life sciences | Aug 2026 | 67.7% | Not in cards |
| TxBench-Oligo-Discovery Agents make oligonucleotide discovery decisions, such as ASO and siRNA design, from real data. A grader checks each decision. | Genomics and life sciences | Sep 2026 | 62.2% | Not in cards |
| TxBench-Preclinical-Pharmacology Agents analyze preclinical pharmacology data and make development decisions. A grader checks each decision. | Genomics and life sciences | Jun 2026 |  66% | Not in cards |
| EpiBench Agents analyze real epigenomics datasets in a sandbox with standard tools. A deterministic grader checks the biological result. | Genomics and life sciences | Jun 2026 | 39.6% | Not in cards |
| scBench-Long Agents run long single-cell RNA-seq analyses that need sustained empirical work and biological reasoning. | Genomics and life sciences | Jun 2026 | 36.9% | Not in cards |
| SpatialBench-Long Agents run long, multi-step analyses of real spatial biology datasets that need sustained biological reasoning. | Genomics and life sciences | May 2026 | 40.5% | Not in cards |
| VariantBench Agents discover and interpret genetic variants from real sequencing analyses. A deterministic grader checks the result. | Genomics and life sciences | Jul 2026 | 52.8% | Not in cards |
| MetagenomicsBench Agents analyze microbial communities from shotgun, amplicon, long-read and spatial metagenomics data. A grader checks the biological result. | Genomics and life sciences | Sep 2026 | 62.7% | Not in cards |