Benchmark Almanac

2024 NIST GenAI Text-to-Text Discriminators

124 1.00 tops its leaderboard
Not in model cards

Detectors estimate the probability that a machine wrote a summary, without seeing the source articles. NIST reports the area under the receiver operating characteristic curve.

NIST evaluated three rounds and also reported Brier scores. Participating teams signed data use agreements before receiving evaluation material.

Released
April 2024
Kind
Other
Level
Everyday
Scored
Checked automatically
Answers
Prediction
Tasks
Kept private
Measures
Capability
Language
English
In and out
Text → Text
Interaction
Single turn
Refresh
One fixed set
Run by
A host
328
Entries on its own leaderboard, 0 models we track

124 tops the leaderboard with 1.00

Best score per entry from the benchmark's own leaderboard, read on November 20th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders.

328 entries. Scroll sideways for the rest.

  1. 1.00 124
  2. 1.00 138
  3. 1.00 143
  4. 1.00 213
  5. 1.00 214
  6. 1.00 229
  7. 1.00 234
  8. 1.00 235
  9. 1.00 236
  10. 1.00 237
  11. 1.00 238
  12. 1.00 239
  13. 1.00 240
  14. 1.00 254
  15. 1.00 258
  16. 1.00 263
  17. 1.00 295
  18. 1.00 319
  19. 1.00 323
  20. 1.00 330
  21. 1.00 336
  22. 1.00 345
  23. 1.00 352
  24. 1.00 359
  25. 1.00 393
  26. 1.00 413
  27. 1.00 429
  28. 1.00 431
  29. 1.00 439
  30. 1.00 459
  31. 1.00 463
  32. 1.00 466
  33. 1.00 467
  34. 1.00 468
  35. 1.00 476
  36. 1.00 477
  37. 1.00 486
  38. 1.00 501
  39. 1.00 318
  40. 1.00 458
  41. 1.00 475
  42. 1.00 482
  43. 1.00 483
  44. 1.00 329
  45. 1.00 248
  46. 1.00 257
  47. 1.00 260
  48. 1.00 473
  49. 1.00 478
  50. 1.00 485
  51. 1.00 358
  52. 1.00 462
  53. 1.00 464
  54. 1.00 474
  55. 1.00 490
  56. 1.00 494
  57. 1.00 498
  58. 1.00 500
  59. 1.00 502
  60. 1.00 503
  61. 1.00 505
  62. 1.00 507
  63. 1.00 508
  64. 1.00 510
  65. 1.00 511
  66. 1.00 512
  67. 1.00 513
  68. 1.00 515
  69. 1.00 516
  70. 1.00 517
  71. 1.00 360
  72. 1.00 489
  73. 1.00 375
  74. 1.00 481
  75. 1.00 487
  76. 1.00 491
  77. 1.00 394
  78. 1.00 423
  79. 1.00 446
  80. 1.00 460
  81. 1.00 265
  82. 1.00 287
  83. 1.00 321
  84. 1.00 421
  85. 1.00 447
  86. 1.00 233
  87. 1.00 369
  88. 1.00 420
  89. 1.00 455
  90. 1.00 372
  91. 1.00 169
  92. 1.00 272
  93. 1.00 320
  94. 1.00 166
  95. 1.00 176
  96. 1.00 348
  97. 1.00 227
  98. 1.00 362
  99. 1.00 364
  100. 1.00 365
  101. 1.00 178
  102. 1.00 231
  103. 1.00 353
  104. 1.00 225
  105. 1.00 232
  106. 1.00 293
  107. 1.00 488
  108. 1.00 381
  109. 1.00 141
  110. 1.00 228
  111. 1.00 325
  112. 1.00 376
  113. 1.00 357
  114. 1.00 377
  115. 1.00 378
  116. 0.99 259
  117. 0.99 261
  118. 0.99 224
  119. 0.99 495
  120. 0.99 223
  121. 0.99 269
  122. 0.99 222
  123. 0.99 428
  124. 0.99 430
  125. 0.99 456
  126. 0.99 363
  127. 0.99 374
  128. 0.99 142
  129. 0.99 311
  130. 0.99 416
  131. 0.99 451
  132. 0.99 183
  133. 0.99 292
  134. 0.99 221
  135. 0.99 469
  136. 0.99 368
  137. 0.99 448
  138. 0.99 218
  139. 0.99 219
  140. 0.99 382
  141. 0.99 450
  142. 0.99 264
  143. 0.99 327
  144. 0.99 347
  145. 0.99 284
  146. 0.99 343
  147. 0.99 454
  148. 0.99 461
  149. 0.99 282
  150. 0.99 344
  151. 0.99 351
  152. 0.99 497
  153. 0.99 294
  154. 0.99 384
  155. 0.99 484
  156. 0.98 383
  157. 0.98 386
  158. 0.98 415
  159. 0.98 387
  160. 0.98 216
  161. 0.98 283
  162. 0.98 471
  163. 0.98 399
  164. 0.98 314
  165. 0.98 338
  166. 0.98 395
  167. 0.98 496
  168. 0.98 136
  169. 0.98 137
  170. 0.98 140
  171. 0.98 211
  172. 0.98 212
  173. 0.98 241
  174. 0.98 242
  175. 0.98 243
  176. 0.98 245
  177. 0.98 373
  178. 0.98 125
  179. 0.98 465
  180. 0.98 379
  181. 0.98 389
  182. 0.98 427
  183. 0.98 126
  184. 0.98 313
  185. 0.98 315
  186. 0.98 417
  187. 0.98 215
  188. 0.98 385
  189. 0.98 499
  190. 0.98 340
  191. 0.98 392
  192. 0.98 506
  193. 0.98 328
  194. 0.98 388
  195. 0.98 391
  196. 0.98 402
  197. 0.98 403
  198. 0.98 405
  199. 0.98 407
  200. 0.98 422
  201. 0.98 440
  202. 0.98 442
  203. 0.98 443
  204. 0.98 341
  205. 0.98 509
  206. 0.98 342
  207. 0.98 424
  208. 0.98 316
  209. 0.98 445
  210. 0.98 286
  211. 0.98 181
  212. 0.98 182
  213. 0.98 514
  214. 0.98 217
  215. 0.98 400
  216. 0.97 172
  217. 0.97 220
  218. 0.97 470
  219. 0.97 290
  220. 0.97 291
  221. 0.97 252
  222. 0.97 184
  223. 0.97 289
  224. 0.97 185
  225. 0.97 279
  226. 0.97 271
  227. 0.97 390
  228. 0.97 278
  229. 0.97 173
  230. 0.97 174
  231. 0.97 274
  232. 0.97 280
  233. 0.96 275
  234. 0.96 170
  235. 0.96 380
  236. 0.96 304
  237. 0.96 355
  238. 0.96 305
  239. 0.96 310
  240. 0.96 414
  241. 0.96 144
  242. 0.96 209
  243. 0.96 302
  244. 0.96 457
  245. 0.95 349
  246. 0.95 335
  247. 0.95 410
  248. 0.95 398
  249. 0.95 452
  250. 0.95 135
  251. 0.95 180
  252. 0.95 288
  253. 0.95 307
  254. 0.95 453
  255. 0.95 309
  256. 0.95 281
  257. 0.94 230
  258. 0.94 322
  259. 0.94 396
  260. 0.94 401
  261. 0.94 285
  262. 0.94 324
  263. 0.94 370
  264. 0.93 210
  265. 0.93 244
  266. 0.93 139
  267. 0.93 266
  268. 0.93 270
  269. 0.93 361
  270. 0.93 168
  271. 0.93 249
  272. 0.93 226
  273. 0.92 273
  274. 0.92 350
  275. 0.92 267
  276. 0.92 339
  277. 0.92 297
  278. 0.92 317
  279. 0.92 177
  280. 0.91 163
  281. 0.91 276
  282. 0.91 444
  283. 0.91 479
  284. 0.90 268
  285. 0.90 480
  286. 0.90 354
  287. 0.90 175
  288. 0.89 493
  289. 0.89 171
  290. 0.87 179
  291. 0.87 208
  292. 0.86 367
  293. 0.85 296
  294. 0.85 425
  295. 0.84 418
  296. 0.83 411
  297. 0.83 207
  298. 0.81 128
  299. 0.80 129
  300. 0.80 121
  301. 0.79 119
  302. 0.79 409
  303. 0.79 262
  304. 0.77 165
  305. 0.77 356
  306. 0.75 167
  307. 0.72 449
  308. 0.71 205
  309. 0.70 397
  310. 0.68 127
  311. 0.67 303
  312. 0.67 504
  313. 0.66 371
  314. 0.66 438
  315. 0.65 308
  316. 0.63 366
  317. 0.63 346
  318. 0.57 419
  319. 0.56 247
  320. 0.52 437
  321. 0.52 436
  322. 0.51 426
  323. 0.44 435
  324. 0.44 412
  325. 0.38 164
  326. 0.36 441
  327. 0.26 492
  328. 0.25 337
  1. 1 124 Round 2 1.00
  2. 2 138 Round 2 1.00
  3. 3 143 Round 2 1.00
  4. 4 213 Round 2 1.00
  5. 5 214 Round 2 1.00
  6. 6 229 Round 2 1.00
  7. 7 234 Round 2 1.00
  8. 8 235 Round 2 1.00
  9. 9 236 Round 2 1.00
  10. 10 237 Round 2 1.00
  11. 11 238 Round 2 1.00
  12. 12 239 Round 2 1.00
  13. 13 240 Round 2 1.00
  14. 14 254 Round 2 1.00
  15. 15 258 Round 2 1.00
  16. 16 263 Round 2 1.00
  17. 17 295 Round 2 1.00
  18. 18 319 Round 2 1.00
  19. 19 323 Round 2 1.00
  20. 20 330 Round 3 1.00
  21. 21 336 Round 3 1.00
  22. 22 345 Round 3 1.00
  23. 23 352 Round 3 1.00
  24. 24 359 Round 3 1.00
  25. 25 393 Round 3 1.00
  26. 26 413 Round 3 1.00
  27. 27 429 Round 3 1.00
  28. 28 431 Round 3 1.00
  29. 29 439 Round 3 1.00
  30. 30 459 Round 3 1.00
  31. 31 463 Round 3 1.00
  32. 32 466 Round 3 1.00
  33. 33 467 Round 3 1.00
  34. 34 468 Round 3 1.00
  35. 35 476 Round 3 1.00
  36. 36 477 Round 3 1.00
  37. 37 486 Round 3 1.00
  38. 38 501 Round 3 1.00
  39. 39 318 Round 2 1.00
  40. 40 458 Round 3 1.00
  41. 41 475 Round 3 1.00
  42. 42 482 Round 3 1.00
  43. 43 483 Round 3 1.00
  44. 44 329 Round 3 1.00
  45. 45 248 Round 2 1.00
  46. 46 257 Round 2 1.00
  47. 47 260 Round 2 1.00
  48. 48 473 Round 3 1.00
  49. 49 478 Round 3 1.00
  50. 50 485 Round 3 1.00
  51. 51 358 Round 3 1.00
  52. 52 462 Round 3 1.00
  53. 53 464 Round 3 1.00
  54. 54 474 Round 3 1.00
  55. 55 490 Round 3 1.00
  56. 56 494 Round 3 1.00
  57. 57 498 Round 3 1.00
  58. 58 500 Round 3 1.00
  59. 59 502 Round 3 1.00
  60. 60 503 Round 3 1.00
  61. 61 505 Round 3 1.00
  62. 62 507 Round 3 1.00
  63. 63 508 Round 3 1.00
  64. 64 510 Round 3 1.00
  65. 65 511 Round 3 1.00
  66. 66 512 Round 3 1.00
  67. 67 513 Round 3 1.00
  68. 68 515 Round 3 1.00
  69. 69 516 Round 3 1.00
  70. 70 517 Round 3 1.00
  71. 71 360 Round 3 1.00
  72. 72 489 Round 3 1.00
  73. 73 375 Round 3 1.00
  74. 74 481 Round 3 1.00
  75. 75 487 Round 3 1.00
  76. 76 491 Round 3 1.00
  77. 77 394 Round 3 1.00
  78. 78 423 Round 3 1.00
  79. 79 446 Round 3 1.00
  80. 80 460 Round 3 1.00
  81. 81 265 Round 2 1.00
  82. 82 287 Round 2 1.00
  83. 83 321 Round 2 1.00
  84. 84 421 Round 3 1.00
  85. 85 447 Round 3 1.00
  86. 86 233 Round 2 1.00
  87. 87 369 Round 3 1.00
  88. 88 420 Round 3 1.00
  89. 89 455 Round 3 1.00
  90. 90 372 Round 3 1.00
  91. 91 169 Round 2 1.00
  92. 92 272 Round 2 1.00
  93. 93 320 Round 2 1.00
  94. 94 166 Round 2 1.00
  95. 95 176 Round 2 1.00
  96. 96 348 Round 3 1.00
  97. 97 227 Round 2 1.00
  98. 98 362 Round 3 1.00
  99. 99 364 Round 3 1.00
  100. 100 365 Round 3 1.00
  101. 101 178 Round 2 1.00
  102. 102 231 Round 2 1.00
  103. 103 353 Round 3 1.00
  104. 104 225 Round 2 1.00
  105. 105 232 Round 2 1.00
  106. 106 293 Round 2 1.00
  107. 107 488 Round 3 1.00
  108. 108 381 Round 3 1.00
  109. 109 141 Round 2 1.00
  110. 110 228 Round 2 1.00
  111. 111 325 Round 2 1.00
  112. 112 376 Round 3 1.00
  113. 113 357 Round 3 1.00
  114. 114 377 Round 3 1.00
  115. 115 378 Round 3 1.00
  116. 116 259 Round 2 0.99
  117. 117 261 Round 2 0.99
  118. 118 224 Round 2 0.99
  119. 119 495 Round 3 0.99
  120. 120 223 Round 2 0.99
  121. 121 269 Round 2 0.99
  122. 122 222 Round 2 0.99
  123. 123 428 Round 3 0.99
  124. 124 430 Round 3 0.99
  125. 125 456 Round 3 0.99
  126. 126 363 Round 3 0.99
  127. 127 374 Round 3 0.99
  128. 128 142 Round 2 0.99
  129. 129 311 Round 2 0.99
  130. 130 416 Round 3 0.99
  131. 131 451 Round 3 0.99
  132. 132 183 Round 2 0.99
  133. 133 292 Round 2 0.99
  134. 134 221 Round 2 0.99
  135. 135 469 Round 3 0.99
  136. 136 368 Round 3 0.99
  137. 137 448 Round 3 0.99
  138. 138 218 Round 2 0.99
  139. 139 219 Round 2 0.99
  140. 140 382 Round 3 0.99
  141. 141 450 Round 3 0.99
  142. 142 264 Round 2 0.99
  143. 143 327 Round 3 0.99
  144. 144 347 Round 3 0.99
  145. 145 284 Round 2 0.99
  146. 146 343 Round 3 0.99
  147. 147 454 Round 3 0.99
  148. 148 461 Round 3 0.99
  149. 149 282 Round 2 0.99
  150. 150 344 Round 3 0.99
  151. 151 351 Round 3 0.99
  152. 152 497 Round 3 0.99
  153. 153 294 Round 2 0.99
  154. 154 384 Round 3 0.99
  155. 155 484 Round 3 0.99
  156. 156 383 Round 3 0.98
  157. 157 386 Round 3 0.98
  158. 158 415 Round 3 0.98
  159. 159 387 Round 3 0.98
  160. 160 216 Round 2 0.98
  161. 161 283 Round 2 0.98
  162. 162 471 Round 3 0.98
  163. 163 399 Round 3 0.98
  164. 164 314 Round 2 0.98
  165. 165 338 Round 3 0.98
  166. 166 395 Round 3 0.98
  167. 167 496 Round 3 0.98
  168. 168 136 Round 2 0.98
  169. 169 137 Round 2 0.98
  170. 170 140 Round 2 0.98
  171. 171 211 Round 2 0.98
  172. 172 212 Round 2 0.98
  173. 173 241 Round 2 0.98
  174. 174 242 Round 2 0.98
  175. 175 243 Round 2 0.98
  176. 176 245 Round 2 0.98
  177. 177 373 Round 3 0.98
  178. 178 125 Round 2 0.98
  179. 179 465 Round 3 0.98
  180. 180 379 Round 3 0.98
  181. 181 389 Round 3 0.98
  182. 182 427 Round 3 0.98
  183. 183 126 Round 2 0.98
  184. 184 313 Round 2 0.98
  185. 185 315 Round 2 0.98
  186. 186 417 Round 3 0.98
  187. 187 215 Round 2 0.98
  188. 188 385 Round 3 0.98
  189. 189 499 Round 3 0.98
  190. 190 340 Round 3 0.98
  191. 191 392 Round 3 0.98
  192. 192 506 Round 3 0.98
  193. 193 328 Round 3 0.98
  194. 194 388 Round 3 0.98
  195. 195 391 Round 3 0.98
  196. 196 402 Round 3 0.98
  197. 197 403 Round 3 0.98
  198. 198 405 Round 3 0.98
  199. 199 407 Round 3 0.98
  200. 200 422 Round 3 0.98
  201. 201 440 Round 3 0.98
  202. 202 442 Round 3 0.98
  203. 203 443 Round 3 0.98
  204. 204 341 Round 3 0.98
  205. 205 509 Round 3 0.98
  206. 206 342 Round 3 0.98
  207. 207 424 Round 3 0.98
  208. 208 316 Round 2 0.98
  209. 209 445 Round 3 0.98
  210. 210 286 Round 2 0.98
  211. 211 181 Round 2 0.98
  212. 212 182 Round 2 0.98
  213. 213 514 Round 3 0.98
  214. 214 217 Round 2 0.98
  215. 215 400 Round 3 0.98
  216. 216 172 Round 2 0.97
  217. 217 220 Round 2 0.97
  218. 218 470 Round 3 0.97
  219. 219 290 Round 2 0.97
  220. 220 291 Round 2 0.97
  221. 221 252 Round 2 0.97
  222. 222 184 Round 2 0.97
  223. 223 289 Round 2 0.97
  224. 224 185 Round 2 0.97
  225. 225 279 Round 2 0.97
  226. 226 271 Round 2 0.97
  227. 227 390 Round 3 0.97
  228. 228 278 Round 2 0.97
  229. 229 173 Round 2 0.97
  230. 230 174 Round 2 0.97
  231. 231 274 Round 2 0.97
  232. 232 280 Round 2 0.97
  233. 233 275 Round 2 0.96
  234. 234 170 Round 2 0.96
  235. 235 380 Round 3 0.96
  236. 236 304 Round 2 0.96
  237. 237 355 Round 3 0.96
  238. 238 305 Round 2 0.96
  239. 239 310 Round 2 0.96
  240. 240 414 Round 3 0.96
  241. 241 144 Round 2 0.96
  242. 242 209 Round 2 0.96
  243. 243 302 Round 2 0.96
  244. 244 457 Round 3 0.96
  245. 245 349 Round 3 0.95
  246. 246 335 Round 3 0.95
  247. 247 410 Round 3 0.95
  248. 248 398 Round 3 0.95
  249. 249 452 Round 3 0.95
  250. 250 135 Round 2 0.95
  251. 251 180 Round 2 0.95
  252. 252 288 Round 1 0.95
  253. 253 307 Round 2 0.95
  254. 254 453 Round 3 0.95
  255. 255 309 Round 1 0.95
  256. 256 281 Round 2 0.95
  257. 257 230 Round 1 0.94
  258. 258 322 Round 1 0.94
  259. 259 396 Round 3 0.94
  260. 260 401 Round 3 0.94
  261. 261 285 Round 1 0.94
  262. 262 324 Round 2 0.94
  263. 263 370 Round 3 0.94
  264. 264 210 Round 1 0.93
  265. 265 244 Round 1 0.93
  266. 266 139 Round 2 0.93
  267. 267 266 Round 2 0.93
  268. 268 270 Round 2 0.93
  269. 269 361 Round 3 0.93
  270. 270 168 Round 2 0.93
  271. 271 249 Round 1 0.93
  272. 272 226 Round 1 0.93
  273. 273 273 Round 1 0.92
  274. 274 350 Round 3 0.92
  275. 275 267 Round 1 0.92
  276. 276 339 Round 3 0.92
  277. 277 297 Round 2 0.92
  278. 278 317 Round 2 0.92
  279. 279 177 Round 1 0.92
  280. 280 163 Round 1 0.91
  281. 281 276 Round 1 0.91
  282. 282 444 Round 3 0.91
  283. 283 479 Round 3 0.91
  284. 284 268 Round 1 0.90
  285. 285 480 Round 3 0.90
  286. 286 354 Round 3 0.90
  287. 287 175 Round 1 0.90
  288. 288 493 Round 3 0.89
  289. 289 171 Round 1 0.89
  290. 290 179 Round 1 0.87
  291. 291 208 Round 2 0.87
  292. 292 367 Round 3 0.86
  293. 293 296 Round 1 0.85
  294. 294 425 Round 3 0.85
  295. 295 418 Round 3 0.84
  296. 296 411 Round 3 0.83
  297. 297 207 Round 2 0.83
  298. 298 128 Round 1 0.81
  299. 299 129 Round 1 0.80
  300. 300 121 Round 1 0.80
  301. 301 119 Round 2 0.79
  302. 302 409 Round 3 0.79
  303. 303 262 Round 1 0.79
  304. 304 165 Round 2 0.77
  305. 305 356 Round 3 0.77
  306. 306 167 Round 2 0.75
  307. 307 449 Round 3 0.72
  308. 308 205 Round 2 0.71
  309. 309 397 Round 3 0.70
  310. 310 127 Round 1 0.68
  311. 311 303 Round 1 0.67
  312. 312 504 Round 3 0.67
  313. 313 371 Round 3 0.66
  314. 314 438 Round 3 0.66
  315. 315 308 Round 1 0.65
  316. 316 366 Round 3 0.63
  317. 317 346 Round 3 0.63
  318. 318 419 Round 3 0.57
  319. 319 247 Round 2 0.56
  320. 320 437 Round 3 0.52
  321. 321 436 Round 3 0.52
  322. 322 426 Round 3 0.51
  323. 323 435 Round 3 0.44
  324. 324 412 Round 3 0.44
  325. 325 164 Round 2 0.38
  326. 326 441 Round 3 0.36
  327. 327 492 Round 3 0.26
  328. 328 337 Round 3 0.25

Source: Official 2024 NIST GenAI Text-to-Text Discriminators leaderboard

#EntryScoreSettingSubmitted byDateSource
1 124 1.00 Round 2 6655b Official leaderboard
2 138 1.00 Round 2 61443 Official leaderboard
3 143 1.00 Round 2 61443 Official leaderboard
4 213 1.00 Round 2 61443 Official leaderboard
5 214 1.00 Round 2 61443 Official leaderboard
6 229 1.00 Round 2 61443 Official leaderboard
7 234 1.00 Round 2 61443 Official leaderboard
8 235 1.00 Round 2 61443 Official leaderboard
9 236 1.00 Round 2 61443 Official leaderboard
10 237 1.00 Round 2 61443 Official leaderboard
11 238 1.00 Round 2 61443 Official leaderboard
12 239 1.00 Round 2 61443 Official leaderboard
13 240 1.00 Round 2 61443 Official leaderboard
14 254 1.00 Round 2 18126 Official leaderboard
15 258 1.00 Round 2 1f03d Official leaderboard
16 263 1.00 Round 2 1f03d Official leaderboard
17 295 1.00 Round 2 18126 Official leaderboard
18 319 1.00 Round 2 1f03d Official leaderboard
19 323 1.00 Round 2 1f03d Official leaderboard
20 330 1.00 Round 3 61443 Official leaderboard
21 336 1.00 Round 3 6655b Official leaderboard
22 345 1.00 Round 3 18126 Official leaderboard
23 352 1.00 Round 3 61443 Official leaderboard
24 359 1.00 Round 3 61443 Official leaderboard
25 393 1.00 Round 3 18126 Official leaderboard
26 413 1.00 Round 3 18126 Official leaderboard
27 429 1.00 Round 3 18126 Official leaderboard
28 431 1.00 Round 3 6655b Official leaderboard
29 439 1.00 Round 3 6655b Official leaderboard
30 459 1.00 Round 3 1f03d Official leaderboard
31 463 1.00 Round 3 18126 Official leaderboard
32 466 1.00 Round 3 18126 Official leaderboard
33 467 1.00 Round 3 18126 Official leaderboard
34 468 1.00 Round 3 18126 Official leaderboard
35 476 1.00 Round 3 1f03d Official leaderboard
36 477 1.00 Round 3 1f03d Official leaderboard
37 486 1.00 Round 3 1f03d Official leaderboard
38 501 1.00 Round 3 18126 Official leaderboard
39 318 1.00 Round 2 1f03d Official leaderboard
40 458 1.00 Round 3 1f03d Official leaderboard
41 475 1.00 Round 3 1f03d Official leaderboard
42 482 1.00 Round 3 1f03d Official leaderboard
43 483 1.00 Round 3 1f03d Official leaderboard
44 329 1.00 Round 3 1f03d Official leaderboard
45 248 1.00 Round 2 1f03d Official leaderboard
46 257 1.00 Round 2 1f03d Official leaderboard
47 260 1.00 Round 2 1f03d Official leaderboard
48 473 1.00 Round 3 1f03d Official leaderboard
49 478 1.00 Round 3 1f03d Official leaderboard
50 485 1.00 Round 3 1f03d Official leaderboard
51 358 1.00 Round 3 61443 Official leaderboard
52 462 1.00 Round 3 18126 Official leaderboard
53 464 1.00 Round 3 18126 Official leaderboard
54 474 1.00 Round 3 18126 Official leaderboard
55 490 1.00 Round 3 1f03d Official leaderboard
56 494 1.00 Round 3 18126 Official leaderboard
57 498 1.00 Round 3 18126 Official leaderboard
58 500 1.00 Round 3 18126 Official leaderboard
59 502 1.00 Round 3 18126 Official leaderboard
60 503 1.00 Round 3 18126 Official leaderboard
61 505 1.00 Round 3 18126 Official leaderboard
62 507 1.00 Round 3 18126 Official leaderboard
63 508 1.00 Round 3 18126 Official leaderboard
64 510 1.00 Round 3 18126 Official leaderboard
65 511 1.00 Round 3 18126 Official leaderboard
66 512 1.00 Round 3 18126 Official leaderboard
67 513 1.00 Round 3 18126 Official leaderboard
68 515 1.00 Round 3 18126 Official leaderboard
69 516 1.00 Round 3 18126 Official leaderboard
70 517 1.00 Round 3 18126 Official leaderboard
71 360 1.00 Round 3 61443 Official leaderboard
72 489 1.00 Round 3 1f03d Official leaderboard
73 375 1.00 Round 3 61443 Official leaderboard
74 481 1.00 Round 3 1f03d Official leaderboard
75 487 1.00 Round 3 1f03d Official leaderboard
76 491 1.00 Round 3 1f03d Official leaderboard
77 394 1.00 Round 3 18126 Official leaderboard
78 423 1.00 Round 3 18126 Official leaderboard
79 446 1.00 Round 3 18126 Official leaderboard
80 460 1.00 Round 3 1f03d Official leaderboard
81 265 1.00 Round 2 18126 Official leaderboard
82 287 1.00 Round 2 18126 Official leaderboard
83 321 1.00 Round 2 1f03d Official leaderboard
84 421 1.00 Round 3 1f03d Official leaderboard
85 447 1.00 Round 3 1f03d Official leaderboard
86 233 1.00 Round 2 61443 Official leaderboard
87 369 1.00 Round 3 61443 Official leaderboard
88 420 1.00 Round 3 1f03d Official leaderboard
89 455 1.00 Round 3 1f03d Official leaderboard
90 372 1.00 Round 3 61443 Official leaderboard
91 169 1.00 Round 2 1f03d Official leaderboard
92 272 1.00 Round 2 18126 Official leaderboard
93 320 1.00 Round 2 1f03d Official leaderboard
94 166 1.00 Round 2 1f03d Official leaderboard
95 176 1.00 Round 2 1f03d Official leaderboard
96 348 1.00 Round 3 61443 Official leaderboard
97 227 1.00 Round 2 61443 Official leaderboard
98 362 1.00 Round 3 61443 Official leaderboard
99 364 1.00 Round 3 61443 Official leaderboard
100 365 1.00 Round 3 61443 Official leaderboard
101 178 1.00 Round 2 1f03d Official leaderboard
102 231 1.00 Round 2 61443 Official leaderboard
103 353 1.00 Round 3 61443 Official leaderboard
104 225 1.00 Round 2 61443 Official leaderboard
105 232 1.00 Round 2 61443 Official leaderboard
106 293 1.00 Round 2 18126 Official leaderboard
107 488 1.00 Round 3 1f03d Official leaderboard
108 381 1.00 Round 3 61443 Official leaderboard
109 141 1.00 Round 2 61443 Official leaderboard
110 228 1.00 Round 2 61443 Official leaderboard
111 325 1.00 Round 2 1f03d Official leaderboard
112 376 1.00 Round 3 61443 Official leaderboard
113 357 1.00 Round 3 61443 Official leaderboard
114 377 1.00 Round 3 61443 Official leaderboard
115 378 1.00 Round 3 61443 Official leaderboard
116 259 0.99 Round 2 1f03d Official leaderboard
117 261 0.99 Round 2 2dcba Official leaderboard
118 224 0.99 Round 2 61443 Official leaderboard
119 495 0.99 Round 3 18126 Official leaderboard
120 223 0.99 Round 2 61443 Official leaderboard
121 269 0.99 Round 2 18126 Official leaderboard
122 222 0.99 Round 2 61443 Official leaderboard
123 428 0.99 Round 3 18126 Official leaderboard
124 430 0.99 Round 3 18126 Official leaderboard
125 456 0.99 Round 3 1f03d Official leaderboard
126 363 0.99 Round 3 61443 Official leaderboard
127 374 0.99 Round 3 61443 Official leaderboard
128 142 0.99 Round 2 61443 Official leaderboard
129 311 0.99 Round 2 18126 Official leaderboard
130 416 0.99 Round 3 18126 Official leaderboard
131 451 0.99 Round 3 18126 Official leaderboard
132 183 0.99 Round 2 1f03d Official leaderboard
133 292 0.99 Round 2 18126 Official leaderboard
134 221 0.99 Round 2 61443 Official leaderboard
135 469 0.99 Round 3 18126 Official leaderboard
136 368 0.99 Round 3 61443 Official leaderboard
137 448 0.99 Round 3 18126 Official leaderboard
138 218 0.99 Round 2 61443 Official leaderboard
139 219 0.99 Round 2 61443 Official leaderboard
140 382 0.99 Round 3 18126 Official leaderboard
141 450 0.99 Round 3 18126 Official leaderboard
142 264 0.99 Round 2 18126 Official leaderboard
143 327 0.99 Round 3 7b355 Official leaderboard
144 347 0.99 Round 3 61443 Official leaderboard
145 284 0.99 Round 2 18126 Official leaderboard
146 343 0.99 Round 3 18126 Official leaderboard
147 454 0.99 Round 3 18126 Official leaderboard
148 461 0.99 Round 3 18126 Official leaderboard
149 282 0.99 Round 2 18126 Official leaderboard
150 344 0.99 Round 3 18126 Official leaderboard
151 351 0.99 Round 3 61443 Official leaderboard
152 497 0.99 Round 3 18126 Official leaderboard
153 294 0.99 Round 2 18126 Official leaderboard
154 384 0.99 Round 3 18126 Official leaderboard
155 484 0.99 Round 3 1f03d Official leaderboard
156 383 0.98 Round 3 18126 Official leaderboard
157 386 0.98 Round 3 18126 Official leaderboard
158 415 0.98 Round 3 18126 Official leaderboard
159 387 0.98 Round 3 18126 Official leaderboard
160 216 0.98 Round 2 61443 Official leaderboard
161 283 0.98 Round 2 18126 Official leaderboard
162 471 0.98 Round 3 18126 Official leaderboard
163 399 0.98 Round 3 18126 Official leaderboard
164 314 0.98 Round 2 18126 Official leaderboard
165 338 0.98 Round 3 18126 Official leaderboard
166 395 0.98 Round 3 18126 Official leaderboard
167 496 0.98 Round 3 18126 Official leaderboard
168 136 0.98 Round 2 61443 Official leaderboard
169 137 0.98 Round 2 61443 Official leaderboard
170 140 0.98 Round 2 61443 Official leaderboard
171 211 0.98 Round 2 61443 Official leaderboard
172 212 0.98 Round 2 61443 Official leaderboard
173 241 0.98 Round 2 61443 Official leaderboard
174 242 0.98 Round 2 61443 Official leaderboard
175 243 0.98 Round 2 61443 Official leaderboard
176 245 0.98 Round 2 61443 Official leaderboard
177 373 0.98 Round 3 61443 Official leaderboard
178 125 0.98 Round 2 9de37 Official leaderboard
179 465 0.98 Round 3 18126 Official leaderboard
180 379 0.98 Round 3 61443 Official leaderboard
181 389 0.98 Round 3 18126 Official leaderboard
182 427 0.98 Round 3 18126 Official leaderboard
183 126 0.98 Round 2 9de37 Official leaderboard
184 313 0.98 Round 2 18126 Official leaderboard
185 315 0.98 Round 2 18126 Official leaderboard
186 417 0.98 Round 3 1f03d Official leaderboard
187 215 0.98 Round 2 61443 Official leaderboard
188 385 0.98 Round 3 18126 Official leaderboard
189 499 0.98 Round 3 18126 Official leaderboard
190 340 0.98 Round 3 18126 Official leaderboard
191 392 0.98 Round 3 18126 Official leaderboard
192 506 0.98 Round 3 18126 Official leaderboard
193 328 0.98 Round 3 18126 Official leaderboard
194 388 0.98 Round 3 18126 Official leaderboard
195 391 0.98 Round 3 18126 Official leaderboard
196 402 0.98 Round 3 18126 Official leaderboard
197 403 0.98 Round 3 18126 Official leaderboard
198 405 0.98 Round 3 18126 Official leaderboard
199 407 0.98 Round 3 18126 Official leaderboard
200 422 0.98 Round 3 18126 Official leaderboard
201 440 0.98 Round 3 18126 Official leaderboard
202 442 0.98 Round 3 18126 Official leaderboard
203 443 0.98 Round 3 18126 Official leaderboard
204 341 0.98 Round 3 18126 Official leaderboard
205 509 0.98 Round 3 18126 Official leaderboard
206 342 0.98 Round 3 18126 Official leaderboard
207 424 0.98 Round 3 18126 Official leaderboard
208 316 0.98 Round 2 18126 Official leaderboard
209 445 0.98 Round 3 18126 Official leaderboard
210 286 0.98 Round 2 18126 Official leaderboard
211 181 0.98 Round 2 1f03d Official leaderboard
212 182 0.98 Round 2 1f03d Official leaderboard
213 514 0.98 Round 3 18126 Official leaderboard
214 217 0.98 Round 2 61443 Official leaderboard
215 400 0.98 Round 3 18126 Official leaderboard
216 172 0.97 Round 2 1f03d Official leaderboard
217 220 0.97 Round 2 61443 Official leaderboard
218 470 0.97 Round 3 18126 Official leaderboard
219 290 0.97 Round 2 18126 Official leaderboard
220 291 0.97 Round 2 18126 Official leaderboard
221 252 0.97 Round 2 18126 Official leaderboard
222 184 0.97 Round 2 1f03d Official leaderboard
223 289 0.97 Round 2 18126 Official leaderboard
224 185 0.97 Round 2 1f03d Official leaderboard
225 279 0.97 Round 2 18126 Official leaderboard
226 271 0.97 Round 2 18126 Official leaderboard
227 390 0.97 Round 3 18126 Official leaderboard
228 278 0.97 Round 2 18126 Official leaderboard
229 173 0.97 Round 2 1f03d Official leaderboard
230 174 0.97 Round 2 1f03d Official leaderboard
231 274 0.97 Round 2 18126 Official leaderboard
232 280 0.97 Round 2 18126 Official leaderboard
233 275 0.96 Round 2 18126 Official leaderboard
234 170 0.96 Round 2 1f03d Official leaderboard
235 380 0.96 Round 3 61443 Official leaderboard
236 304 0.96 Round 2 d5867 Official leaderboard
237 355 0.96 Round 3 61443 Official leaderboard
238 305 0.96 Round 2 d5867 Official leaderboard
239 310 0.96 Round 2 d5867 Official leaderboard
240 414 0.96 Round 3 18126 Official leaderboard
241 144 0.96 Round 2 61443 Official leaderboard
242 209 0.96 Round 2 61443 Official leaderboard
243 302 0.96 Round 2 d5867 Official leaderboard
244 457 0.96 Round 3 1f03d Official leaderboard
245 349 0.95 Round 3 61443 Official leaderboard
246 335 0.95 Round 3 d5867 Official leaderboard
247 410 0.95 Round 3 18126 Official leaderboard
248 398 0.95 Round 3 18126 Official leaderboard
249 452 0.95 Round 3 18126 Official leaderboard
250 135 0.95 Round 2 18126 Official leaderboard
251 180 0.95 Round 2 1f03d Official leaderboard
252 288 0.95 Round 1 18126 Official leaderboard
253 307 0.95 Round 2 18126 Official leaderboard
254 453 0.95 Round 3 1f03d Official leaderboard
255 309 0.95 Round 1 18126 Official leaderboard
256 281 0.95 Round 2 18126 Official leaderboard
257 230 0.94 Round 1 61443 Official leaderboard
258 322 0.94 Round 1 1f03d Official leaderboard
259 396 0.94 Round 3 18126 Official leaderboard
260 401 0.94 Round 3 18126 Official leaderboard
261 285 0.94 Round 1 18126 Official leaderboard
262 324 0.94 Round 2 1f03d Official leaderboard
263 370 0.94 Round 3 61443 Official leaderboard
264 210 0.93 Round 1 61443 Official leaderboard
265 244 0.93 Round 1 61443 Official leaderboard
266 139 0.93 Round 2 61443 Official leaderboard
267 266 0.93 Round 2 18126 Official leaderboard
268 270 0.93 Round 2 18126 Official leaderboard
269 361 0.93 Round 3 61443 Official leaderboard
270 168 0.93 Round 2 1f03d Official leaderboard
271 249 0.93 Round 1 1f03d Official leaderboard
272 226 0.93 Round 1 61443 Official leaderboard
273 273 0.92 Round 1 18126 Official leaderboard
274 350 0.92 Round 3 61443 Official leaderboard
275 267 0.92 Round 1 18126 Official leaderboard
276 339 0.92 Round 3 18126 Official leaderboard
277 297 0.92 Round 2 61443 Official leaderboard
278 317 0.92 Round 2 1f03d Official leaderboard
279 177 0.92 Round 1 1f03d Official leaderboard
280 163 0.91 Round 1 1f03d Official leaderboard
281 276 0.91 Round 1 18126 Official leaderboard
282 444 0.91 Round 3 18126 Official leaderboard
283 479 0.91 Round 3 1f03d Official leaderboard
284 268 0.90 Round 1 18126 Official leaderboard
285 480 0.90 Round 3 1f03d Official leaderboard
286 354 0.90 Round 3 61443 Official leaderboard
287 175 0.90 Round 1 1f03d Official leaderboard
288 493 0.89 Round 3 18126 Official leaderboard
289 171 0.89 Round 1 1f03d Official leaderboard
290 179 0.87 Round 1 1f03d Official leaderboard
291 208 0.87 Round 2 18126 Official leaderboard
292 367 0.86 Round 3 61443 Official leaderboard
293 296 0.85 Round 1 61443 Official leaderboard
294 425 0.85 Round 3 18126 Official leaderboard
295 418 0.84 Round 3 1f03d Official leaderboard
296 411 0.83 Round 3 18126 Official leaderboard
297 207 0.83 Round 2 18126 Official leaderboard
298 128 0.81 Round 1 18126 Official leaderboard
299 129 0.80 Round 1 18126 Official leaderboard
300 121 0.80 Round 1 9de37 Official leaderboard
301 119 0.79 Round 2 18126 Official leaderboard
302 409 0.79 Round 3 2dcba Official leaderboard
303 262 0.79 Round 1 18126 Official leaderboard
304 165 0.77 Round 2 1f03d Official leaderboard
305 356 0.77 Round 3 61443 Official leaderboard
306 167 0.75 Round 2 1f03d Official leaderboard
307 449 0.72 Round 3 1f03d Official leaderboard
308 205 0.71 Round 2 30978 Official leaderboard
309 397 0.70 Round 3 18126 Official leaderboard
310 127 0.68 Round 1 18126 Official leaderboard
311 303 0.67 Round 1 d5867 Official leaderboard
312 504 0.67 Round 3 18126 Official leaderboard
313 371 0.66 Round 3 61443 Official leaderboard
314 438 0.66 Round 3 6655b Official leaderboard
315 308 0.65 Round 1 d5867 Official leaderboard
316 366 0.63 Round 3 61443 Official leaderboard
317 346 0.63 Round 3 61443 Official leaderboard
318 419 0.57 Round 3 1f03d Official leaderboard
319 247 0.56 Round 2 30978 Official leaderboard
320 437 0.52 Round 3 6655b Official leaderboard
321 436 0.52 Round 3 6655b Official leaderboard
322 426 0.51 Round 3 18126 Official leaderboard
323 435 0.44 Round 3 6655b Official leaderboard
324 412 0.44 Round 3 18126 Official leaderboard
325 164 0.38 Round 2 1f03d Official leaderboard
326 441 0.36 Round 3 6655b Official leaderboard
327 492 0.26 Round 3 18126 Official leaderboard
328 337 0.25 Round 3 d5867 Official leaderboard

No lab model card reports it yet

We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.

More in Other

All 69 in Other
  • Artificial Analysis Intelligence Index v5 In use Version 5 of Artificial Analysis's index: nine evaluations in four equal categories, most with private test sets, run three times each in its own agent harness. Claude Fable 5.2 64.6
  • Personal Superintelligence Index (Meta) In use Meta's composite of seven personal and knowledge-work evals: Agents' Last Exam, AutomationBench-AA, FocusBench, JobBench, GDP.pdf, VBT and DRACO.
  • Vals Science Index In use Agents are scored on the equal average of BioMysteryBench, MysteryMechanism and Terminal-Bench-Science. GPT-6.2 Astra 68.4%
  • Decision Index Public v0.3 In use Decision models return probabilities over labeled options in public tasks covering knowledge, language, retrieval, tools, and arts. A chance-corrected weighted aggregate combines the task scores. Granite Switch 4.1 30B 51.3
  • SAGE v1.1 (Vals) In use Models grade handwritten undergraduate math and computer science work against rubrics. Scored by class-balanced accuracy of each rubric check against expert grading. Claude Opus 5.5 91.3%
  • MTEB Fading Massive Text Embedding Benchmark: retrieval, clustering, classification across languages and modalities. Qwen3-Embedding-8B 72.2%

Data audit

All 8 checks pass. Every benchmark

Catalog record 2 pass
  • Pass Task access The tasks are private.
  • Pass Confidence Checked against a primary source.
Scores 2 pass 3 notes
  • Pass Independent runs Scores from the official leaderboard (328 entries).
  • Pass Models scored 328 entries on its leaderboard, none a model we track.
  • Note Newest score No scores yet.
  • Note Frontier models No models scored yet.
  • Note Headroom Scored as a plain number, with no fixed ceiling.
Leaderboard import 3 pass
  • Pass Importer We read the board on miganalytics.nist.gov: 328 entries at the last read, none a model we track.
  • Pass Last read November 20th, 2026.
  • Pass Read worked The last read worked.
Consistency 1 pass 1 note
  • Note Lab claims No model has both a lab number and an independent run.
  • Pass Known issues No published audit found problems.

How we check