source
LiveBench
Benchmarks · /benchmarks/livebench-coding-completion
Coding completion
LiveBench code-completion slice derived from the official `coding_completion` tasks.
Passport
Verified but agingThis is an objective signal, so it is mainly about measurable task performance rather than public taste.
metric
Score (%)
judge
Objective
direction
higher better
group id
livebench_coding_completion_2026_04
domain
Coding
What it measures vs what it misses
✓ Measures
Objective next-step completion quality on recent coding prompts.
✗ Misses
High-level debugging and refactor workflows. Human style preference.
Why this countsIt tells you whether the model can generate, repair, and reason over code under evaluator pressure rather than marketing examples.Comparable-group ruleThis percentile only compares models inside the exact benchmark/version group shown here. It is not a universal score.What it missesIt does not fully capture repo-scale iteration, IDE ergonomics, or long debugging loops.
Leaderboard · this benchmark version
#1 · Gemini 2.5 Pro
LB · Mar 25, 2025
82%
#2 · GPT-4.5 Preview
LB · Feb 27, 2025
76%
#3 · Claude Sonnet 3.7
LB · Feb 25, 2025
74%
#4 · Claude Sonnet 3.5
LB · Dec 10, 2024
69%
#5 · Gemini 2.0 Pro Experimental
LB · Feb 5, 2025
68%
#6 · o3 mini
LB · Feb 6, 2025
60.7%
#7 · o1
LB · Mar 4, 2025
58.5%
#8 · Gemini Experimental
LB · Dec 10, 2024
57.3%
#9 · GPT-4o
LB · Mar 27, 2025
55%
#10 · Claude Haiku 3.5
LB · Dec 10, 2024
54%
#11 · DeepSeek Reasoner
LB · Jan 20, 2025
54%
#12 · Claude Haiku 4.5
LB · Dec 10, 2024
54%
#13 · Gemini 2.0 Flash
LB · Feb 5, 2025
52%
#14 · Grok 3
LB · Mar 14, 2025
51%
#15 · DeepSeek Chat
LB · Dec 11, 2024
50%
#16 · Grok Beta
LB · Dec 10, 2024
48%
#17 · GPT-4 Turbo
LB · Dec 10, 2024
46.7%
#18 · Gemini 2.0 Flash-Lite
LB · Feb 27, 2025
46%
#19 · Gemini 1.5 Pro
LB · Dec 12, 2024
44%
#20 · GPT-4o mini
LB · Dec 10, 2024
44%
#21 · o1 Preview
LB · Dec 10, 2024
44%
#22 · Grok 2
LB · Dec 16, 2024
41%
#23 · Gemini 1.5 Flash
LB · Dec 10, 2024
40.7%
#24 · Claude Opus 3
LB · Dec 10, 2024
40%
#25 · GPT-4
LB · Dec 10, 2024
40%
#26 · Grok 2 mini
LB · Dec 10, 2024
34%
#27 · Grok 3 mini
LB · Mar 14, 2025
34%
#28 · o1 mini
LB · Dec 10, 2024
32%
#29 · Gemini 1.5 Flash 8B
LB · Dec 10, 2024
26%
#30 · GPT-3.5 Turbo
LB · Dec 10, 2024
25%
#31 · Claude Haiku 3
LB · Dec 10, 2024
22%
#32 · Claude Sonnet 3
LB · Dec 10, 2024
22%