Benchmark Almanac

Shanghai University of Finance and Economics

We track 3 benchmarks that Shanghai University of Finance and Economics made or helped make.

0 in use 3 with public code 2 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
FinEval Models answer 8,351 Chinese finance questions in four areas: academic knowledge in 34 subjects, industry practice, financial security and financial agent tasks. Most questions are multiple choice, and the agent part tests tool use and multi-step reasoning. The makers run zero-shot and five-shot chain-of-thought settings. Finance Aug 2023 69.4% Not in cards
FinEval 6.0 Models solve financial evaluation tasks. The score is the official 6.0 total score. Finance Aug 2023 84.5% Not in cards
Fin-Eva Models answer 13,106 Chinese multiple-choice questions about financial knowledge, calculations, analysis, and compliance. The evaluator checks the chosen option against the answer key. Finance Sep 2023 Not in cards