Benchmark Almanac

Glimmer Index

We track 11 benchmarks and 1 arena that Glimmer Index made or helped make.

0 in use 0 with public code 12 with a leaderboard here

Arena leaderboards

Top five in each of its 1 arena with three or more rated models, the most rated first.

Benchmarks

Name Kind Released Best score Status
Crest Arcade Elemental Armory Models equip four elemental balls with cards, then select and aim a ball each round. The score averages match win rates across three levels. Video games 67.3% Not in cards
Crest Arcade FreeCell Models move cards to the four foundations using a variable number of free cells. The score averages win rates across five tiers. Puzzles and chess 63.3% Not in cards
Crest Arcade Hustle Sim Models buy upgrades and hire helpers to reach earnings targets in an idle game. The score compares simulated completion times with reference strategies. Video games 83.7 Not in cards
Crest Arcade Micro Mouse Models steer a simulated robot through six daily mazes. The score compares each finish time with the median human time and gives unfinished mazes zero. Video games 89.3 Not in cards
Crest Arcade Mines Models reveal or flag cells on Minesweeper boards that can be solved without guessing. The score averages win rates across four board sizes. Puzzles and chess 100% Not in cards
Crest Arcade Sudoku Models fill complete Sudoku grids and report confidence. The score averages the share solved across seven equally weighted difficulty tiers. Puzzles and chess 100% Not in cards
Crest Arcade Nations Royale Models manage one nation against 47 computer opponents on a simulated map. Wins earn full credit and unfinished games earn credit for territory held. Video games 100.0 Not in cards
Crest Arcade Nonograms Models reconstruct a picture from row and column clues in one reply. The score averages the share of exact solutions across six tiers. Puzzles and chess 91.7% Not in cards
Crest Arcade Ravelin Models build towers to protect a keep through waves of attackers. The score compares wins with the reference time plus a penalty for lives lost. Video games 106.8 Not in cards
Crest Arcade Starjar Models place pieces in a jar so matching pieces touch and merge. The score compares their total points with a reference bot on identical jars. Video games 114.5 Not in cards
Crest Arcade Wildhaven Models select a team of animals and choose where each lands in a village. The score measures the share of village strength they destroy. Video games 100% Not in cards