Benchmark Almanac

NASA

We track 4 benchmarks that NASA made or helped make.

0 in use 1 with public code 1 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
Climate-Change-NER Models identify and label climate terms in scientific abstracts. The authors provide 13 categories and reserve 75 abstracts for testing. Lab and data work Apr 2024 0.44 Not in cards
NASA SDE IR Benchmark v5 Models retrieve NASA science documents from questions and search phrases. The authors generated 176,901 queries from Science Discovery Engine content. Questions that need search Nov 2025 Not in cards
NASA-IR Models retrieve the scientific passage that answers a question. The test measures how often the correct passage appears among the first ten results. Questions that need search Apr 2024 Not in cards
NASA-QA Models read passages from Earth science papers and extract the words that answer a question. Some questions have no answer in the passage. Reading comprehension Apr 2024 Not in cards