LeetCode Weekly Contest

Dropped

Labs’ own numbers All independent runs

Models solve 126 LeetCode contest problems from July to November 2023. A solution counts only if it passes all of its 20+ test cases.

Made by: DeepSeek
Released: November 2023
Kind: Competitive programming
Level: University
Scored: Checked automatically
Answers: Code

Last in a launch post: November 2023, dropped before it saturated
Last model added: January 2024
Scores refreshed: November 12th, 2026

Model scored in lab cards

Launch post lists it, from 1 lab

System card reports it, from 1 lab

DeepSeek LLM 67B leads with 17.5%

Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.

DeepSeek LLM 67B leads with 17.5% across all independent runs

Best score per model across the official leaderboard, Epoch AI’s own runs and any board Epoch AI copied. Each bar and row names its source.

Bars Table

17.5 DeepSeek LLM 67B

1 DeepSeek LLM 67B 17.5%

Source: Labs’ model cards

1 DeepSeek LLM 67B 17.5%
2 ChatGLM3-6B 2.40%

Source: Official LeetCode Weekly Contest leaderboard

#	Model	Score	Setting	Date	Source
1	DeepSeek LLM 67B	17.5%		Jan 2024	Lab model card

#	Model	Score	Setting	Date	Source
1	DeepSeek LLM 67B	17.5%		Nov 2023	Official leaderboard
2	ChatGLM3-6B	2.40%		Oct 2023	Official leaderboard

The benchmark's own leaderboard has 7 entries, 2 of them models we track. Switch the scores above to rank them together.

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

On the benchmark’s own leaderboard Reported by the lab in its model card Best so far

Sources: Official LeetCode Weekly Contest leaderboard and labs’ model cards

No launch post has listed it since November 2023

Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.

DeepSeek

Date	Launch post	Score	As the post writes it
Nov 29, 2023	DeepSeek LLM 67B		LeetCode Weekly Contest (pass@1)

One system card reports it

Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.

Date	Document	Score	As the document writes it	Section
Jan 5, 2024	DeepSeek LLM 67B technical report	17.5	LeetCode Weekly Contest 351-372 and Bi-Weekly 108-117 (Jul to Nov 2023), pass@1, held-out (Table 9)	Capabilities

One lab claim next to the leaderboard

Each score a lab reported for its own model, beside the same model's best score on the leaderboard. Gaps mostly come from different harnesses, effort levels and task subsets. 1 of them match, which usually means one side copied the other. Every benchmark.

Model	Lab says	Board says	Gap
DeepSeek LLM 67B	17.5% LeetCode Weekly Contest 351-372 and Bi-Weekly 108-117 (Jul to Nov 2023), pass@1, held-out (Table 9)	17.5% Leaderboard	Same