Benchmark Almanac

Islamic University of Technology

We track 4 benchmarks that Islamic University of Technology made or helped make.

0 in use 4 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
xCodeEval Models understand, generate, translate, and retrieve contest code across seven tasks and up to 17 programming languages. Generated programs run against test cases through ExecEval. Competitive programming Mar 2023 3.81% Not in cards
BdSLW401 Models identify one of 401 Bangla Sign Language words in a video. The collection records signs from the front and side. Video understanding Dec 2024 Not in cards
BdSLW60 Models identify an isolated Bangla Sign Language word in a video clip. Accuracy measures how often the predicted word matches its label. Video understanding Dec 2023 Not in cards
PoemSum Models summarize the meaning of an English poem. The authors compare each summary with a reference interpretation using ROUGE and BERTScore. Reading comprehension Dec 2023 Not in cards