KBank-MMLU (Upstage)
Solar Open 2 80.8% leads since July 2026 Models answer Korean finance questions in a multiple-choice format. Upstage built the set in house.
The technical report lists it as the finance part of the professional domain group, with no further detail.
- Made by
- Upstage
- Released
- July 2026
- Kind
- Finance
- Level
- Expert
- Scored
- Checked automatically
- Answers
- Multiple choice
- Tasks
- Kept private
- Last in a launch post
- July 2026, dropped before it saturated
- Last model added
- July 2026
Solar Open 2 leads with 80.8% among models released by July 2026
Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.
The newest model with a score here came out in July 2026, and nobody has reported a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:
- Claude Fable 5.2
-
Gemini 4 Carbon - GPT-6 Astra
- Claude Opus 5.5
- and 16 more
- 1 Solar Open 2 80.8%
- 2 Solar Pro 2 71%
- 3 Solar Open 100B 65.5%
Source: Labs’ model cards
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | Solar Open 2 | 80.8% | Jul 2026 | Lab model card | |
| 2 | Solar Pro 2 | 71% | Jul 2025 | Lab model card | |
| 3 | Solar Open 100B | 65.5% | Dec 2025 | Lab model card |
2 models have held number one in labs’ own numbers since its release in July 2026
Lab claims count from the day the card came out, independent runs from the model’s release.
Source: Labs’ model cards
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
Source: Labs’ model cards
Labs headline it less often now, last in July 2026
Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.
| Date | Launch post | Score | As the post writes it |
|---|---|---|---|
| Jul 22, 2026 | Solar Open 2 | 80.8 | KBank-MMLU (in-house) |
| Dec 31, 2025 | Solar Open 100B | 65.5 | KBankMMLU (in-house) |
| Jul 10, 2025 | Solar Pro 2 | 71 | KBankMMLU (finance, private benchmark built with Korean financial institutions) |
2 system cards report it, from 1 lab
Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.
| Date | Document | Score | As the document writes it | Section |
|---|---|---|---|---|
| Jul 22, 2026 | Solar Open 2 technical report | 80.8 | KBank-MMLU, in-house (Table 4) | Capabilities |
| Jan 11, 2026 | Solar Open 100B technical report | 65.5 | KBankMMLU (in-house), finance (Table 5) | Capabilities |
More in Law, finance and medicine
- MedXpertQA-MM In use Models answer expert-level medical exam questions that combine images with clinical records and test results. Scoring is accuracy.
Qwen 3.8 Max 80.4% - HealthBench Professional In use 525 physician-authored tasks from real clinician chats (care consult, documentation, research) with physician-adjudicated rubrics. Claude Sonnet 5.5 69.2%
- HealthBench In use 5,000 realistic health conversations graded against physician-written rubrics. A length-adjusted variant penalizes verbosity. GPT-5 67.2%
- FinSearchComp In use Agents search the web to fetch live financial data, look up history, and run multi-step investigations, across 635 expert-written questions. Scored by answer accuracy.
Ling-3.1-flash 81.7% - KBL In use Models answer Korean legal knowledge and reasoning tasks and Korean bar exam questions. It has 7 knowledge tasks, 4 reasoning tasks and 2,510 bar exam items. Solar Pro 4 77.5%
- KorMedMCQA In use Models answer 7,469 multiple-choice questions from Korean licensing exams for doctors, nurses, pharmacists and dentists, held from 2012 to 2024. Solar Pro 4 93.2%