Benchmark Almanac

the National Information Society Agency

We track 2 benchmarks that the National Information Society Agency made or helped make.

0 in use 0 with public code 2 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
Open Ko-LLM Leaderboard 2 Models complete nine Korean evaluations covering reasoning, instructions, social values, safety, and other abilities. The organizers score submitted models on private test data. Reasoning in many languages Aug 2024 49.6% Not in cards
Open Ko-LLM Leaderboard Models answer Korean questions about knowledge, truthfulness, and commonsense reasoning. The leaderboard uses translated tasks alongside a Korean commonsense benchmark. Knowledge in many languages Sep 2023 53% Not in cards