NIA Sovereign AI Benchmark Evaluation, Phase 2
Version 2
Models answer questions across seven areas, including Korean language and instruction following. The agency combines eight weighted component scores for a maximum of 15 points.
Korea's National Information Society Agency evaluated four teams. The ministry lists society-related safety separately within safety and withholds some questions and answers.
- Released
- August 2026
- Kind
- Composite indices
- Level
- University
- Scored
- Checked automatically
- Answers
- Open-ended
- Tasks
- Public, plus a private test set
- Measures
- Capability
- Subject
- Languages and literature
- Language
- Korean
- Interaction
- Single turn
- Items from
- Another benchmark
- Refresh
- New versions replace it
- Run by
- A host
No scores here yet
No lab, leaderboard or Epoch AI run has reported a score for NIA Sovereign AI Benchmark Evaluation, Phase 2 yet.
No lab model card reports it yet
We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.
Versions
More in Other
- Artificial Analysis Intelligence Index v5 In use Version 5 of Artificial Analysis's index: nine evaluations in four equal categories, most with private test sets, run three times each in its own agent harness. Claude Fable 5.2 64.6
- Personal Superintelligence Index (Meta) In use Meta's composite of seven personal and knowledge-work evals: Agents' Last Exam, AutomationBench-AA, FocusBench, JobBench, GDP.pdf, VBT and DRACO.
- Vals Science Index In use Agents are scored on the equal average of BioMysteryBench, MysteryMechanism and Terminal-Bench-Science. GPT-6.2 Astra 68.4%
- Decision Index Public v0.3 In use Decision models return probabilities over labeled options in public tasks covering knowledge, language, retrieval, tools, and arts. A chance-corrected weighted aggregate combines the task scores. Granite Switch 4.1 30B 51.3
- SAGE v1.1 (Vals) In use Models grade handwritten undergraduate math and computer science work against rubrics. Scored by class-balanced accuracy of each rubric check against expert grading. Claude Opus 5.5 91.3%
- MTEB Fading Massive Text Embedding Benchmark: retrieval, clustering, classification across languages and modalities.
Qwen3-Embedding-8B 72.2%
Data audit
3 of 4 checks pass, 1 warning. Look first at the Independent runs check. No scores from any source yet. Every benchmark
Catalog record 2 pass
- Pass Task access Public tasks, plus a private test set.
- Pass Confidence Checked against a primary source.
Scores 1 warning 4 notes
- Warning Independent runs No scores from any source yet.
- Note Models scored No models scored yet.
- Note Newest score No scores yet.
- Note Frontier models No models scored yet.
- Note Headroom Scored as a plain number, with no fixed ceiling.
Leaderboard import 1 note
- Note Importer No public leaderboard to read.
Consistency 1 pass 1 note
- Note Lab claims No model has both a lab number and an independent run.
- Pass Known issues No published audit found problems.