Grok 4.20 model documentation Mar 9, 2026
- Chat Refusals, violation rate 0.00, Grok 4.2 SA, Table 1 0
- Chat Refusals + User Jailbreak, violation rate 0.01, Grok 4.2 SA, Table 1 1
- Chat Refusals + System Jailbreak, violation rate 0.00, Grok 4.2 SA, Table 1 0
- AgentHarm, violation rate 0.30, no jailbreak, Grok 4.2 SA, Table 1 30
- AgentDojo, attack success rate 0.33, Grok 4.2 SA, Table 1 33
- MASK, dishonesty rate 0.27, Grok 4.2 SA, Table 2 73
- Anthropic sycophancy evaluation, answer change rate 0.04, Grok 4.2 SA, Table 2 4
- Contrastive internal sycophancy evaluation, sycophancy rate 0.35, Grok 4.2 SA, Table 2 35
- Humanity’s Last Exam, RMS calibration error 0.19, Grok 4.2 SA, Table 2 19
- WMDP Bio, accuracy 0.91, Grok 4.2 SA, Table 4 91
- Virology Capabilities Test, accuracy 0.54, Grok 4.2 SA, Table 4 54
- ProtocolQA, accuracy 0.79, Grok 4.2 SA, Table 4 79
- FigQA, accuracy 0.66, Grok 4.2 SA, Table 4 66
- CloningScenarios, accuracy 0.67, Grok 4.2 SA, Table 4 67
- WMDP Chem, accuracy 0.90, Grok 4.2 SA, Table 4 90
- WMDP Cyber, accuracy 0.91, Grok 4.2 SA, Table 4 91
- CyBench, success rate 0.53, unguided, Grok 4.2 SA, Table 4 53
- MakeMeSay, win rate 0.08, Grok 4.2 SA, Table 4 8