The Hong Kong University of Science and Technology
We track 13 benchmarks that The Hong Kong University of Science and Technology made or helped make.
0 in use 12 with public code 1 with a leaderboard here
Benchmarks
| Name | Kind | Released | Best score | Status |
|---|---|---|---|---|
| TeachArena Agents make teaching decisions, tutor students through dialogue, and carry out learning management system tasks. The evaluator checks conversation turns, artifacts, and final system states. | Other professions | May 2026 | 0.80 | Not in cards |
| ComplaintsClustering Models group consumer complaints by financial product. The score measures whether each group contains one product and whether complaints about that product stay together. | Finance | Jul 2024 | Not in cards | |
| DISCFinLLMReranking Models rank Chinese news articles for questions about financial events. Each question has two or three relevant articles and ten distractors. | Finance | Jul 2024 | Not in cards | |
| FinEvaReranking Models rank Chinese financial news passages for an investor question. Each question has one matching passage and nine or ten distractors. | Finance | Jul 2024 | Not in cards | |
| FinFactReranking Models rank fact checking articles for a claim. Each test row includes one designated article and nine or ten distractors. | Finance | Jul 2024 | Not in cards | |
| FinMTEB Models represent English and Chinese financial texts as vectors. The suite tests seven abilities, including retrieving definitions, grouping complaints, and comparing financial statements. | Finance | Sep 2024 | Not in cards | |
| FinMTEB FINAL Models compare passages from financial reports. The score measures how well their similarity rankings distinguish revised passages from mismatched passages. | Finance | Jul 2024 | Not in cards | |
| FinSTS Models compare statements from different annual reports by the same company and score whether their financial meaning changed. People labeled 370 test pairs. | Finance | Mar 2024 | Not in cards | |
| FiQA2018Reranking Models rank eleven candidate answers to personal finance questions. Each test row has one designated answer. | Finance | Jul 2024 | Not in cards | |
| HC3Reranking Models rank answers to personal finance questions. Each test question has one relevant human answer and one relevant ChatGPT answer. | Finance | Jul 2024 | Not in cards | |
| PiiClustering Models group synthetic English financial documents by document type. The labels include bank statements, payment confirmations, and insurance claim forms. | Finance | Jul 2024 | Not in cards | |
| TheGoldman Retrieval Models retrieve the Goldman Sachs dictionary definition for a financial term. The score rewards placing the correct definition near the top of the first ten results. | Finance | Jul 2024 | Not in cards | |
| WikiCompany2IndustryClustering Models group company descriptions by industry. The score measures how well the groups recover the industry labels. | Finance | Jul 2024 | Not in cards |