Answer Factuality (Perplexity)
Models answer questions from search results. Graders check that answers use facts grounded in the results and resolve conflicting or missing information.
Perplexity reported it once, for Sonar, with no public method or data. The scoring method is not described, so model-judged is assumed.
- Made by
- Perplexity
- Released
- February 2025
- Kind
- Faithful to sources
- Level
- Everyday
- Scored
- Graded by a model
- Answers
- Open-ended
- Tasks
- Kept private
- Strongest model tested
-
Gemini 2.0 Flash Feb 2025 #146 on the capability index - Last in a launch post
- February 2025, dropped after it saturated
- Last model added
- February 2025
- Scores refreshed
- November 12th, 2026
sonar leads with 85.1%
Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.
sonar leads with 85.1% across all independent runs
Best score per model across the official leaderboard, Epoch AI’s own runs and any board Epoch AI copied. Each bar and row names its source.
- 1
sonar 85.1%
Source: Labs’ model cards
- 1 sonar 85.1%
- 2 Gemini 2.0 Flash Feb 2025 78.5%
- 3 Claude 3.5 Haiku 71.7%
- 4
Llama 3.3 70B Instruct 65.7%
Source: Official Answer Factuality (Perplexity) leaderboard
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | sonar | 85.1% | Feb 2025 | Lab model card |
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | sonar | 85.1% | Jan 2025 | Official leaderboard | |
| 2 | Gemini 2.0 Flash Feb 2025 | 78.5% | Feb 2025 | Official leaderboard | |
| 3 | Claude 3.5 Haiku | 71.7% | Oct 2024 | Official leaderboard | |
| 4 | Llama 3.3 70B Instruct | 65.7% | Dec 2024 | Official leaderboard |
The benchmark's own leaderboard has 7 entries, 4 of them models we track. Switch the scores above to rank them together.
Number one over time Number one over time
Lab claims count from the day the card came out, independent runs from the model’s release.
Source: Official Answer Factuality (Perplexity) leaderboard
Sonar on the official leaderboard passed 85% in January 2025
All the scores we have, one dot each, so a model tested at several settings appears more than once.
Sources: Official Answer Factuality (Perplexity) leaderboard and labs’ model cards
Labs dropped it from launch posts once the best score passed 85%
Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.
| Date | Launch post | Score | As the post writes it |
|---|---|---|---|
| Feb 11, 2025 | sonar | 85.1 | Factuality |
One lab claim next to the leaderboard
Each score a lab reported for its own model, beside the same model's best score on the leaderboard. Gaps mostly come from different harnesses, effort levels and task subsets. 1 of them match, which usually means one side copied the other. Every benchmark.
More in Factuality
- SimpleVQA In use Models answer 2,025 short factual questions about images across 9 tasks and 9 topics. An LLM judge grades answers against fixed references.
Qwen3.7-Plus 81.7% - HallusionBench In use Models answer 1,129 yes or no questions about 346 images, built in pairs to expose language hallucination and visual illusion. Scored by accuracy.
Keye-VL-2.0-30B-A3B 73.5% - SimpleQA Verified In use 1,000 human-verified, de-duplicated short-answer factual questions measuring parametric knowledge. Gemini 3.1 Pro 77.5%
- Kimi Hallu Bench In use Models answer hard prompts drawn from practical work tasks. Fact-checking agents score the share of claims that are hallucinated. GPT-6 Astra 4.20%
- Internal adversarially-designed factuality evaluations In use Models answer adversarial questions in nine categories such as history, math and code. Scored on agreement with human ideal responses. GPT-6 Luna 7.60%
- AA-Omniscience v1.1 In use Models answer 3,000 knowledge questions in six domains without tools and may abstain. The index adds correct answers and subtracts wrong ones.
Inkling 2 Small 16.1