Benchmark Almanac

Automated Student Assessment Prize: Automated Essay Scoring

SirGuessalot & PlanetThanet & Stefan 0.81 tops its leaderboard Monkey 0.00 leads the models we track
Not in model cards
Version 1

Models score student essays written for eight prompts. The competition compares predicted scores with human grades using quadratic weighted kappa.

Harada and colleagues ran GPT-5 mini, Gemini 3 Flash, and Qwen3-Next on held-out essays from the first prompt.

Released
January 2012
Kind
Other professions
Level
University
Scored
Checked automatically
Answers
Short answer
Tasks
Public, plus a private test set
Measures
Capability
Language
English
In and out
Text → Text
Interaction
Single turn
Items from
Real work and use
Run by
A host
Last model added
November 2023
Scores refreshed
November 20th, 2026
154
Entries on its own leaderboard, 1 model we track

SirGuessalot & PlanetThanet & Stefan tops the leaderboard with 0.81 Monkey leads with 0.00

Best score per entry from the benchmark's own leaderboard, read on November 20th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. The best model we track is Monkey, at 0.00. This view shows only models we track, each at its best.

154 entries. Scroll sideways for the rest.

  1. 0.81 SirGuessalot & PlanetThanet & Stefan
  2. 0.81 @ORGANIZATION
  3. 0.81 VikP & jman
  4. 0.80 Sollers & Gxav
  5. 0.80 cs224u
  6. 0.80 Martin
  7. 0.79 Rage against the machine learning
  8. 0.79 rf
  9. 0.79 dub
  10. 0.78 joshnk
  11. 0.77 Victor
  12. 0.77 alfnie
  13. 0.77 Ali Hassaïne & LTT1
  14. 0.76 RSmith
  15. 0.76 Efimov+Berengueres
  16. 0.76 jacmac
  17. 0.75 luoq
  18. 0.75 SteveCHNC
  19. 0.75 Carpe Datum
  20. 0.75 Aces
  21. 0.75 ABKT
  22. 0.74 Tim
  23. 0.74 SH & NS
  24. 0.72 PNC
  25. 0.71 Ed Ramsden
  26. 0.70 MaBu
  27. 0.69 pico4743
  28. 0.66 ACmilan
  29. 0.66 Steven Mark Ford
  30. 0.64 teamowls
  31. 0.62 andrewma
  32. 0.57 CGMT
  33. 0.57 Dark Horse
  34. 0.55 JimmyJam
  35. 0.00 BotM
  36. 0.00 happyfeet
  37. 0.00 Length Benchmark
  38. 0.00 tjungblut
  39. 0.00 Data-Driven
  40. 0.00 BLetson
  41. 0.00 clay
  42. 0.00 Ben Haley
  43. 0.00 Daedalus
  44. 0.00 pplatypus
  45. 0.00 pumbo
  46. 0.00 ArunK
  47. 0.00 PKornev
  48. 0.00 bearcatminer
  49. 0.00 kenny
  50. 0.00 D3PO
  51. 0.00 From_Oort_With_Love
  52. 0.00 jielabs
  53. 0.00 Shinigami
  54. 0.00 JKARP
  55. 0.00 Ian
  56. 0.00 aed83
  57. 0.00 a_minion
  58. 0.00 Blue Wren
  59. 0.00 Unicorns
  60. 0.00 zharry
  61. 0.00 drewfrank
  62. 0.00 LogisticFunc
  63. 0.00 Jiaming
  64. 0.00 just a guy in a garage
  65. 0.00 ne2soft
  66. 0.00 joxaal
  67. 0.00 Jacob_M
  68. 0.00 tinkerers
  69. 0.00 akew_zn
  70. 0.00 Aron
  71. 0.00 nahnahnah
  72. 0.00 Wisdom
  73. 0.00 arctic
  74. 0.00 Double Negative
  75. 0.00 __mtb__
  76. 0.00 nisish
  77. 0.00 peterr
  78. 0.00 abcd
  79. 0.00 Titan-Oceanus
  80. 0.00 Yampa Quant
  81. 0.00 Aksarben
  82. 0.00 txtology
  83. 0.00 [Deleted]
  84. 0.00 A2
  85. 0.00 Kanuma
  86. 0.00 cclark
  87. 0.00 johnmoe
  88. 0.00 Daragh Sibley
  89. 0.00 Eigen
  90. 0.00 kingdom
  91. 0.00 Steffen
  92. 0.00 roma_marks
  93. 0.00 zero degrees
  94. 0.00 Jason Capehart
  95. 0.00 SaDa
  96. 0.00 Zstats
  97. 0.00 ActiveGalaXy
  98. 0.00 Dum S
  99. 0.00 Sunil
  100. 0.00 tsendee
  101. 0.00 andrewpoh
  102. 0.00 drago
  103. 0.00 Dynamic
  104. 0.00 rjjfdn
  105. 0.00 arobertson
  106. 0.00 BobbyCheap
  107. 0.00 Dum S2
  108. 0.00 NM
  109. 0.00 dd
  110. 0.00 Hollander
  111. 0.00 eggershead
  112. 0.00 kn
  113. 0.00 northern_lights
  114. 0.00 SA GR8RS
  115. 0.00 SquaredLoss
  116. 0.00 aadi
  117. 0.00 artificial
  118. 0.00 byte yogi
  119. 0.00 deadc0de
  120. 0.00 elrude
  121. 0.00 ilijavanil
  122. 0.00 MichCog
  123. 0.00 precision
  124. 0.00 theGAking
  125. 0.00 UnlimitedEvaluator
  126. 0.00 WUMPUSMaker
  127. 0.00 AppliedML
  128. 0.00 Maxim
  129. 0.00 The A Team
  130. 0.00 Turing M1
  131. 0.00 daniel-cussen
  132. 0.00 dormevu
  133. 0.00 EvaG
  134. 0.00 feliksss
  135. 0.00 jackpot (Jason)
  136. 0.00 John Carter
  137. 0.00 LudieLi
  138. 0.00 Nicolas
  139. 0.00 Olaf
  140. 0.00 SeelaryTeam
  141. 0.00 arav
  142. 0.00 Elev8
  143. 0.00 LyLaMa
  144. 0.00 aesir
  145. 0.00 Monkey Miner
  146. 0.00 Wow
  147. 0.00 Anaconda
  148. 0.00 Alexander Larko
  149. 0.00 Chetan Nichkawde
  150. 0.00 DanB
  151. 0.00 AJ Fisher
  152. 0.00 BarrenWuffet
  153. 0.00 Team Shasta
  154. 0.00 Monkey
  1. 1 SirGuessalot & PlanetThanet & Stefan 0.81
  2. 2 @ORGANIZATION 0.81
  3. 3 VikP & jman 0.81
  4. 4 Sollers & Gxav 0.80
  5. 5 cs224u 0.80
  6. 6 Martin 0.80
  7. 7 Rage against the machine learning 0.79
  8. 8 rf 0.79
  9. 9 dub 0.79
  10. 10 joshnk 0.78
  11. 11 Victor 0.77
  12. 12 alfnie 0.77
  13. 13 Ali Hassaïne & LTT1 0.77
  14. 14 RSmith 0.76
  15. 15 Efimov+Berengueres 0.76
  16. 16 jacmac 0.76
  17. 17 luoq 0.75
  18. 18 SteveCHNC 0.75
  19. 19 Carpe Datum 0.75
  20. 20 Aces 0.75
  21. 21 ABKT 0.75
  22. 22 Tim 0.74
  23. 23 SH & NS 0.74
  24. 24 PNC 0.72
  25. 25 Ed Ramsden 0.71
  26. 26 MaBu 0.70
  27. 27 pico4743 0.69
  28. 28 ACmilan 0.66
  29. 29 Steven Mark Ford 0.66
  30. 30 teamowls 0.64
  31. 31 andrewma 0.62
  32. 32 CGMT 0.57
  33. 33 Dark Horse 0.57
  34. 34 JimmyJam 0.55
  35. 35 BotM 0.00
  36. 36 happyfeet 0.00
  37. 37 Length Benchmark 0.00
  38. 38 tjungblut 0.00
  39. 39 Data-Driven 0.00
  40. 40 BLetson 0.00
  41. 41 clay 0.00
  42. 42 Ben Haley 0.00
  43. 43 Daedalus 0.00
  44. 44 pplatypus 0.00
  45. 45 pumbo 0.00
  46. 46 ArunK 0.00
  47. 47 PKornev 0.00
  48. 48 bearcatminer 0.00
  49. 49 kenny 0.00
  50. 50 D3PO 0.00
  51. 51 From_Oort_With_Love 0.00
  52. 52 jielabs 0.00
  53. 53 Shinigami 0.00
  54. 54 JKARP 0.00
  55. 55 Ian 0.00
  56. 56 aed83 0.00
  57. 57 a_minion 0.00
  58. 58 Blue Wren 0.00
  59. 59 Unicorns 0.00
  60. 60 zharry 0.00
  61. 61 drewfrank 0.00
  62. 62 LogisticFunc 0.00
  63. 63 Jiaming 0.00
  64. 64 just a guy in a garage 0.00
  65. 65 ne2soft 0.00
  66. 66 joxaal 0.00
  67. 67 Jacob_M 0.00
  68. 68 tinkerers 0.00
  69. 69 akew_zn 0.00
  70. 70 Aron 0.00
  71. 71 nahnahnah 0.00
  72. 72 Wisdom 0.00
  73. 73 arctic 0.00
  74. 74 Double Negative 0.00
  75. 75 __mtb__ 0.00
  76. 76 nisish 0.00
  77. 77 peterr 0.00
  78. 78 abcd 0.00
  79. 79 Titan-Oceanus 0.00
  80. 80 Yampa Quant 0.00
  81. 81 Aksarben 0.00
  82. 82 txtology 0.00
  83. 83 [Deleted] 0.00
  84. 84 A2 0.00
  85. 85 Kanuma 0.00
  86. 86 cclark 0.00
  87. 87 johnmoe 0.00
  88. 88 Daragh Sibley 0.00
  89. 89 Eigen 0.00
  90. 90 kingdom 0.00
  91. 91 Steffen 0.00
  92. 92 roma_marks 0.00
  93. 93 zero degrees 0.00
  94. 94 Jason Capehart 0.00
  95. 95 SaDa 0.00
  96. 96 Zstats 0.00
  97. 97 ActiveGalaXy 0.00
  98. 98 Dum S 0.00
  99. 99 Sunil 0.00
  100. 100 tsendee 0.00
  101. 101 andrewpoh 0.00
  102. 102 drago 0.00
  103. 103 Dynamic 0.00
  104. 104 rjjfdn 0.00
  105. 105 arobertson 0.00
  106. 106 BobbyCheap 0.00
  107. 107 Dum S2 0.00
  108. 108 NM 0.00
  109. 109 dd 0.00
  110. 110 Hollander 0.00
  111. 111 eggershead 0.00
  112. 112 kn 0.00
  113. 113 northern_lights 0.00
  114. 114 SA GR8RS 0.00
  115. 115 SquaredLoss 0.00
  116. 116 aadi 0.00
  117. 117 artificial 0.00
  118. 118 byte yogi 0.00
  119. 119 deadc0de 0.00
  120. 120 elrude 0.00
  121. 121 ilijavanil 0.00
  122. 122 MichCog 0.00
  123. 123 precision 0.00
  124. 124 theGAking 0.00
  125. 125 UnlimitedEvaluator 0.00
  126. 126 WUMPUSMaker 0.00
  127. 127 AppliedML 0.00
  128. 128 Maxim 0.00
  129. 129 The A Team 0.00
  130. 130 Turing M1 0.00
  131. 131 daniel-cussen 0.00
  132. 132 dormevu 0.00
  133. 133 EvaG 0.00
  134. 134 feliksss 0.00
  135. 135 jackpot (Jason) 0.00
  136. 136 John Carter 0.00
  137. 137 LudieLi 0.00
  138. 138 Nicolas 0.00
  139. 139 Olaf 0.00
  140. 140 SeelaryTeam 0.00
  141. 141 arav 0.00
  142. 142 Elev8 0.00
  143. 143 LyLaMa 0.00
  144. 144 aesir 0.00
  145. 145 Monkey Miner 0.00
  146. 146 Wow 0.00
  147. 147 Anaconda 0.00
  148. 148 Alexander Larko 0.00
  149. 149 Chetan Nichkawde 0.00
  150. 150 DanB 0.00
  151. 151 AJ Fisher 0.00
  152. 152 BarrenWuffet 0.00
  153. 153 Team Shasta 0.00
  154. 154 Monkey 0.00

Source: Official Automated Student Assessment Prize: Automated Essay Scoring leaderboard

Source: Official Automated Student Assessment Prize: Automated Essay Scoring leaderboard

#EntryScoreSettingSubmitted byReleasedRun onSource
1 SirGuessalot & PlanetThanet & Stefan 0.81 SirGuessalot & PlanetThanet & Stefan Apr 2012 Official leaderboard
2 @ORGANIZATION 0.81 @ORGANIZATION Apr 2012 Official leaderboard
3 VikP & jman 0.81 VikP & jman Apr 2012 Official leaderboard
4 Sollers & Gxav 0.80 Sollers & Gxav Apr 2012 Official leaderboard
5 cs224u 0.80 cs224u Apr 2012 Official leaderboard
6 Martin 0.80 Martin Apr 2012 Official leaderboard
7 Rage against the machine learning 0.79 Rage against the machine learning Apr 2012 Official leaderboard
8 rf 0.79 rf Apr 2012 Official leaderboard
9 dub 0.79 dub Apr 2012 Official leaderboard
10 joshnk 0.78 joshnk Apr 2012 Official leaderboard
11 Victor 0.77 Victor Apr 2012 Official leaderboard
12 alfnie 0.77 alfnie Apr 2012 Official leaderboard
13 Ali Hassaïne & LTT1 0.77 Ali Hassaïne & LTT1 Apr 2012 Official leaderboard
14 RSmith 0.76 RSmith Apr 2012 Official leaderboard
15 Efimov+Berengueres 0.76 Efimov+Berengueres Apr 2012 Official leaderboard
16 jacmac 0.76 jacmac Apr 2012 Official leaderboard
17 luoq 0.75 luoq Apr 2012 Official leaderboard
18 SteveCHNC 0.75 SteveCHNC Apr 2012 Official leaderboard
19 Carpe Datum 0.75 Carpe Datum Apr 2012 Official leaderboard
20 Aces 0.75 Aces Apr 2012 Official leaderboard
21 ABKT 0.75 ABKT Apr 2012 Official leaderboard
22 Tim 0.74 Tim Apr 2012 Official leaderboard
23 SH & NS 0.74 SH & NS Apr 2012 Official leaderboard
24 PNC 0.72 PNC Apr 2012 Official leaderboard
25 Ed Ramsden 0.71 Ed Ramsden Apr 2012 Official leaderboard
26 MaBu 0.70 MaBu Apr 2012 Official leaderboard
27 pico4743 0.69 pico4743 Apr 2012 Official leaderboard
28 ACmilan 0.66 ACmilan Apr 2012 Official leaderboard
29 Steven Mark Ford 0.66 Steven Mark Ford Apr 2012 Official leaderboard
30 teamowls 0.64 teamowls Apr 2012 Official leaderboard
31 andrewma 0.62 andrewma Apr 2012 Official leaderboard
32 CGMT 0.57 CGMT Apr 2012 Official leaderboard
33 Dark Horse 0.57 Dark Horse Apr 2012 Official leaderboard
34 JimmyJam 0.55 JimmyJam Apr 2012 Official leaderboard
35 BotM 0.00 BotM Feb 2012 Official leaderboard
36 happyfeet 0.00 happyfeet Feb 2012 Official leaderboard
37 Length Benchmark 0.00 Length Benchmark Feb 2012 Official leaderboard
38 tjungblut 0.00 tjungblut Feb 2012 Official leaderboard
39 Data-Driven 0.00 Data-Driven Feb 2012 Official leaderboard
40 BLetson 0.00 BLetson Feb 2012 Official leaderboard
41 clay 0.00 clay Feb 2012 Official leaderboard
42 Ben Haley 0.00 Ben Haley Feb 2012 Official leaderboard
43 Daedalus 0.00 Daedalus Feb 2012 Official leaderboard
44 pplatypus 0.00 pplatypus Feb 2012 Official leaderboard
45 pumbo 0.00 pumbo Feb 2012 Official leaderboard
46 ArunK 0.00 ArunK Feb 2012 Official leaderboard
47 PKornev 0.00 PKornev Feb 2012 Official leaderboard
48 bearcatminer 0.00 bearcatminer Mar 2012 Official leaderboard
49 kenny 0.00 kenny Mar 2012 Official leaderboard
50 D3PO 0.00 D3PO Mar 2012 Official leaderboard
51 From_Oort_With_Love 0.00 From_Oort_With_Love Mar 2012 Official leaderboard
52 jielabs 0.00 jielabs Mar 2012 Official leaderboard
53 Shinigami 0.00 Shinigami Mar 2012 Official leaderboard
54 JKARP 0.00 JKARP Mar 2012 Official leaderboard
55 Ian 0.00 Ian Mar 2012 Official leaderboard
56 aed83 0.00 aed83 Mar 2012 Official leaderboard
57 a_minion 0.00 a_minion Mar 2012 Official leaderboard
58 Blue Wren 0.00 Blue Wren Mar 2012 Official leaderboard
59 Unicorns 0.00 Unicorns Mar 2012 Official leaderboard
60 zharry 0.00 zharry Mar 2012 Official leaderboard
61 drewfrank 0.00 drewfrank Mar 2012 Official leaderboard
62 LogisticFunc 0.00 LogisticFunc Mar 2012 Official leaderboard
63 Jiaming 0.00 Jiaming Mar 2012 Official leaderboard
64 just a guy in a garage 0.00 just a guy in a garage Mar 2012 Official leaderboard
65 ne2soft 0.00 ne2soft Mar 2012 Official leaderboard
66 joxaal 0.00 joxaal Mar 2012 Official leaderboard
67 Jacob_M 0.00 Jacob_M Mar 2012 Official leaderboard
68 tinkerers 0.00 tinkerers Mar 2012 Official leaderboard
69 akew_zn 0.00 akew_zn Mar 2012 Official leaderboard
70 Aron 0.00 Aron Mar 2012 Official leaderboard
71 nahnahnah 0.00 nahnahnah Mar 2012 Official leaderboard
72 Wisdom 0.00 Wisdom Mar 2012 Official leaderboard
73 arctic 0.00 arctic Mar 2012 Official leaderboard
74 Double Negative 0.00 Double Negative Mar 2012 Official leaderboard
75 __mtb__ 0.00 __mtb__ Mar 2012 Official leaderboard
76 nisish 0.00 nisish Mar 2012 Official leaderboard
77 peterr 0.00 peterr Mar 2012 Official leaderboard
78 abcd 0.00 abcd Mar 2012 Official leaderboard
79 Titan-Oceanus 0.00 Titan-Oceanus Mar 2012 Official leaderboard
80 Yampa Quant 0.00 Yampa Quant Mar 2012 Official leaderboard
81 Aksarben 0.00 Aksarben Apr 2012 Official leaderboard
82 txtology 0.00 txtology Apr 2012 Official leaderboard
83 [Deleted] 0.00 [Deleted] Apr 2012 Official leaderboard
84 A2 0.00 A2 Apr 2012 Official leaderboard
85 Kanuma 0.00 Kanuma Apr 2012 Official leaderboard
86 cclark 0.00 cclark Apr 2012 Official leaderboard
87 johnmoe 0.00 johnmoe Apr 2012 Official leaderboard
88 Daragh Sibley 0.00 Daragh Sibley Apr 2012 Official leaderboard
89 Eigen 0.00 Eigen Apr 2012 Official leaderboard
90 kingdom 0.00 kingdom Apr 2012 Official leaderboard
91 Steffen 0.00 Steffen Apr 2012 Official leaderboard
92 roma_marks 0.00 roma_marks Apr 2012 Official leaderboard
93 zero degrees 0.00 zero degrees Apr 2012 Official leaderboard
94 Jason Capehart 0.00 Jason Capehart Apr 2012 Official leaderboard
95 SaDa 0.00 SaDa Apr 2012 Official leaderboard
96 Zstats 0.00 Zstats Apr 2012 Official leaderboard
97 ActiveGalaXy 0.00 ActiveGalaXy Apr 2012 Official leaderboard
98 Dum S 0.00 Dum S Apr 2012 Official leaderboard
99 Sunil 0.00 Sunil Apr 2012 Official leaderboard
100 tsendee 0.00 tsendee Apr 2012 Official leaderboard
101 andrewpoh 0.00 andrewpoh Apr 2012 Official leaderboard
102 drago 0.00 drago Apr 2012 Official leaderboard
103 Dynamic 0.00 Dynamic Apr 2012 Official leaderboard
104 rjjfdn 0.00 rjjfdn Apr 2012 Official leaderboard
105 arobertson 0.00 arobertson Apr 2012 Official leaderboard
106 BobbyCheap 0.00 BobbyCheap Apr 2012 Official leaderboard
107 Dum S2 0.00 Dum S2 Apr 2012 Official leaderboard
108 NM 0.00 NM Apr 2012 Official leaderboard
109 dd 0.00 dd Apr 2012 Official leaderboard
110 Hollander 0.00 Hollander Apr 2012 Official leaderboard
111 eggershead 0.00 eggershead Apr 2012 Official leaderboard
112 kn 0.00 kn Apr 2012 Official leaderboard
113 northern_lights 0.00 northern_lights Apr 2012 Official leaderboard
114 SA GR8RS 0.00 SA GR8RS Apr 2012 Official leaderboard
115 SquaredLoss 0.00 SquaredLoss Apr 2012 Official leaderboard
116 aadi 0.00 aadi Apr 2012 Official leaderboard
117 artificial 0.00 artificial Apr 2012 Official leaderboard
118 byte yogi 0.00 byte yogi Apr 2012 Official leaderboard
119 deadc0de 0.00 deadc0de Apr 2012 Official leaderboard
120 elrude 0.00 elrude Apr 2012 Official leaderboard
121 ilijavanil 0.00 ilijavanil Apr 2012 Official leaderboard
122 MichCog 0.00 MichCog Apr 2012 Official leaderboard
123 precision 0.00 precision Apr 2012 Official leaderboard
124 theGAking 0.00 theGAking Apr 2012 Official leaderboard
125 UnlimitedEvaluator 0.00 UnlimitedEvaluator Apr 2012 Official leaderboard
126 WUMPUSMaker 0.00 WUMPUSMaker Apr 2012 Official leaderboard
127 AppliedML 0.00 AppliedML Apr 2012 Official leaderboard
128 Maxim 0.00 Maxim Apr 2012 Official leaderboard
129 The A Team 0.00 The A Team Apr 2012 Official leaderboard
130 Turing M1 0.00 Turing M1 Apr 2012 Official leaderboard
131 daniel-cussen 0.00 daniel-cussen Apr 2012 Official leaderboard
132 dormevu 0.00 dormevu Apr 2012 Official leaderboard
133 EvaG 0.00 EvaG Apr 2012 Official leaderboard
134 feliksss 0.00 feliksss Apr 2012 Official leaderboard
135 jackpot (Jason) 0.00 jackpot (Jason) Apr 2012 Official leaderboard
136 John Carter 0.00 John Carter Apr 2012 Official leaderboard
137 LudieLi 0.00 LudieLi Apr 2012 Official leaderboard
138 Nicolas 0.00 Nicolas Apr 2012 Official leaderboard
139 Olaf 0.00 Olaf Apr 2012 Official leaderboard
140 SeelaryTeam 0.00 SeelaryTeam Apr 2012 Official leaderboard
141 arav 0.00 arav Apr 2012 Official leaderboard
142 Elev8 0.00 Elev8 Apr 2012 Official leaderboard
143 LyLaMa 0.00 LyLaMa Apr 2012 Official leaderboard
144 aesir 0.00 aesir Apr 2012 Official leaderboard
145 Monkey Miner 0.00 Monkey Miner Apr 2012 Official leaderboard
146 Wow 0.00 Wow Apr 2012 Official leaderboard
147 Anaconda 0.00 Anaconda Apr 2012 Official leaderboard
148 Alexander Larko 0.00 Alexander Larko Apr 2012 Official leaderboard
149 Chetan Nichkawde 0.00 Chetan Nichkawde Apr 2012 Official leaderboard
150 DanB 0.00 DanB Apr 2012 Official leaderboard
151 AJ Fisher 0.00 AJ Fisher Apr 2012 Official leaderboard
152 BarrenWuffet 0.00 BarrenWuffet Apr 2012 Official leaderboard
153 Team Shasta 0.00 Team Shasta Apr 2012 Official leaderboard
154 Monkey 0.00 Monkey Nov 2023 Mar 2012 Official leaderboard
#ModelScoreSettingSubmitted byReleasedRun onSource
1 Monkey 0.00 Monkey Nov 2023 Mar 2012 Official leaderboard

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

On the benchmark’s own leaderboard
0.00 2024 0.00 2024

Source: Official Automated Student Assessment Prize: Automated Essay Scoring leaderboard

No lab model card reports it yet

We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.

Versions

More in Law, finance and medicine

All 637 in Law, finance and medicine
  • MedXpertQA-MM In use Models answer expert-level medical exam questions that combine images with clinical records and test results. Scoring is accuracy. Qwen 3.8 Max 80.4%
  • HealthBench Professional In use 525 physician-authored tasks from real clinician chats (care consult, documentation, research) with physician-adjudicated rubrics. Claude Sonnet 5.5 69.2%
  • HealthBench In use 5,000 realistic health conversations graded against physician-written rubrics. A length-adjusted variant penalizes verbosity. GPT-5 67.2%
  • FinSearchComp In use Agents search the web to fetch live financial data, look up history, and run multi-step investigations, across 635 expert-written questions. Scored by answer accuracy. Ling-3.1-flash 81.7%
  • KorMedMCQA In use Models answer 7,469 multiple-choice questions from Korean licensing exams for doctors, nurses, pharmacists and dentists, held from 2012 to 2024. o1-preview 92.7%
  • Harvey LAB-AA v1.1 In use Artificial Analysis's run of Harvey's Legal Agent Benchmark on Harvey's newer private set of 120 tasks across 24 practice areas. A deliverable with a material hallucination scores zero, and the headline is the share of judges who find every rubric criterion passed. GPT-6.2 Astra 15%

Data audit

All 8 checks pass. Every benchmark

Catalog record 2 pass
  • Pass Task access Public tasks, plus a private test set.
  • Pass Confidence Checked against a primary source.
Scores 2 pass 3 notes
  • Pass Independent runs Scores from the official leaderboard (154 entries).
  • Pass Models scored 1 model we track, plus 153 other entries on its leaderboard.
  • Note Newest score The newest came 3 years ago, in November 2023, for Monkey. That’s expected for a test replaced by Automated Student Assessment Prize 2.0.
  • Note Frontier models None of its models are on the capabilities index.
  • Note Headroom Scored as a plain number, with no fixed ceiling.
Leaderboard import 3 pass
  • Pass Importer We read the board on kaggle.com: 1 row for models we track and 153 other entries at the last read.
  • Pass Last read November 20th, 2026.
  • Pass Read worked The last read worked.
Consistency 1 pass 1 note
  • Note Lab claims No model has both a lab number and an independent run.
  • Pass Known issues No published audit found problems.

How we check