Benchmark Almanac

The Hong Kong University of Science and Technology

We track 13 benchmarks that The Hong Kong University of Science and Technology made or helped make.

0 in use 12 with public code 1 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
TeachArena Agents make teaching decisions, tutor students through dialogue, and carry out learning management system tasks. The evaluator checks conversation turns, artifacts, and final system states. Other professions May 2026 0.80 Not in cards
ComplaintsClustering Models group consumer complaints by financial product. The score measures whether each group contains one product and whether complaints about that product stay together. Finance Jul 2024 Not in cards
DISCFinLLMReranking Models rank Chinese news articles for questions about financial events. Each question has two or three relevant articles and ten distractors. Finance Jul 2024 Not in cards
FinEvaReranking Models rank Chinese financial news passages for an investor question. Each question has one matching passage and nine or ten distractors. Finance Jul 2024 Not in cards
FinFactReranking Models rank fact checking articles for a claim. Each test row includes one designated article and nine or ten distractors. Finance Jul 2024 Not in cards
FinMTEB Models represent English and Chinese financial texts as vectors. The suite tests seven abilities, including retrieving definitions, grouping complaints, and comparing financial statements. Finance Sep 2024 Not in cards
FinMTEB FINAL Models compare passages from financial reports. The score measures how well their similarity rankings distinguish revised passages from mismatched passages. Finance Jul 2024 Not in cards
FinSTS Models compare statements from different annual reports by the same company and score whether their financial meaning changed. People labeled 370 test pairs. Finance Mar 2024 Not in cards
FiQA2018Reranking Models rank eleven candidate answers to personal finance questions. Each test row has one designated answer. Finance Jul 2024 Not in cards
HC3Reranking Models rank answers to personal finance questions. Each test question has one relevant human answer and one relevant ChatGPT answer. Finance Jul 2024 Not in cards
PiiClustering Models group synthetic English financial documents by document type. The labels include bank statements, payment confirmations, and insurance claim forms. Finance Jul 2024 Not in cards
TheGoldman Retrieval Models retrieve the Goldman Sachs dictionary definition for a financial term. The score rewards placing the correct definition near the top of the first ten results. Finance Jul 2024 Not in cards
WikiCompany2IndustryClustering Models group company descriptions by industry. The score measures how well the groups recover the industry labels. Finance Jul 2024 Not in cards