Coding (MiniMax in-house)

MiniMax-Text-01 90.2%

Only in system cards

Models answer coding requests from real Hailuo AI users. The report does not describe the scoring.

In-house MiniMax evaluation built mostly from Hailuo AI user queries in Mandarin. The queries are not public.

Made by: MiniMax
Released: January 2025
Kind: Function-level problems
Level: University
Scored: Graded by a model
Answers: Code
Tasks: Kept private

Last in a system card: January 2025
Last model added: January 2025

Paper arxiv.org

Model scored in lab cards

System card reports it, from 1 lab

MiniMax-Text-01 leads with 90.2%

Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.

Bars Table

90.2 MiniMax-Text-01

1 MiniMax-Text-01 90.2%

Source: Labs’ model cards

#	Model	Score	Setting	Date	Source
1	MiniMax-Text-01	90.2%		Jan 2025	Lab model card

MiniMax’s own number for MiniMax-Text-01 passed 85% in January 2025

All the scores we have, one dot each, so a model tested at several settings appears more than once.

Reported by the lab in its model card

Source: Labs’ model cards

Labs report it only in system cards

We read the headline results of 522 launch posts from 52 labs, and none of them list this benchmark. Some system cards do, below.

One system card reports it

Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.

Date	Document	Score	As the document writes it	Section
Jan 14, 2025	MiniMax-Text-01 technical report	90.2	In-house Coding (Table 12)	Capabilities

MiniMax-Text-01 leads with 90.2%

MiniMax’s own number for MiniMax-Text-01 passed 85% in January 2025

Labs report it only in system cards

One system card reports it

More in Coding