Benchmark Almanac

NIST TREC Product Search Track

We track 2 benchmarks that NIST TREC Product Search Track made or helped make.

0 in use 0 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
TREC Product Search 2023 Models rank products for shopping queries using catalog text and optional product metadata. NIST assessors judged results for new queries drawn from outside the training set. Questions that need search Dec 2022 Not in cards
TREC Product Search 2024 Models retrieve relevant catalog items for a new set of shopping queries. The official file contains judgments for 80 query IDs. Questions that need search Jan 2024 Not in cards