Benchmark Almanac

d42me

We track 2 benchmarks that d42me made or helped make.

0 in use 0 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
Bio-Literature Search Level 2 Agents use search tools to compare abstracts from PubMedQA, including their sections, subject headings, and conclusions. Five task types require retrieving or combining evidence. Questions that need search Feb 2026 Not in cards
Reverse Wikipedia Paragraphs Models reverse a Wikipedia paragraph character by character. The evaluator compares the response with the exact reversal using the longest common subsequence. Following precise instructions Oct 2025 Not in cards