← All benchmarks·Source: LiveBench ↗

LiveBench leaderboard

LiveBench leaderboard: contamination-free LLM scores across reasoning, coding, agentic, math and more — plotted against measured cost per task so you see the best value. Current leader: claude-fable-5-1-max-effort at 83.42 (Overall (0–100)).

Cost vs quality

Each dot is a model. The dashed line is the value frontier — top-left is the best trade-off (high score, low cost).

Closed model Open-weight model

Full leaderboard

#ModelScoreOverallCodingAgentic$ / taskReleased
1
Anthropicclaude-fable-5-1-max-effort
83.4286.3866.06$1.21—
2
Anthropicclaude-opus-5-5-max-effort
83.2289.2571.72$0.799—
3
AnthropicClaude Fable 5 Max Effort
82.9785.9962.17$1.48Jun 2026
4
OpenAIgpt-6-astra-max
82.1680.3657.32$0.736Sep 2026
5
Anthropicclaude-opus-5-5-xhigh-effort
82.0689.2565.35$0.243—
6
OpenAIgpt-6.1-sol-max
81.6280.3654.55$0.142Sep 2026
7
muse-spark-1.3-xhigh
81.5981.0664.09$0.219Sep 2026
8
muse-wonder-1.0-max
81.1680.6862.73$0.615—
9
DeepSeekdeepseek-v4.1-flash-maxOPEN
81.1180.0477.27$0.029Sep 2026
10
OpenAIgpt-6.1-sol-xhigh
81.1180.7456.77$0.093Sep 2026
11
OpenAIGPT-5.6 Sol Max Effort
81.0583.9456.21$0.507Jul 2026
12
OpenAIGPT-5.5 Thinking xHigh Effort
80.1982.1553.99$0.436Apr 2026
13
Anthropicclaude-opus-5-max-effort
80.0981.4565.2$0.707Jul 2026
14
smaug-agentic
79.5182.4764.65$0.329—
15
OpenAIgpt-6-sol-max
79.2581.7752.88$0.269Sep 2026
16
Moonshot AIkimi-k3OPEN
79.1981.4562.17$0.351Jul 2026
17
Googlegemini-3.7-flash-high
78.8378.8958.28$0.157Aug 2026
18
Qwenqwen3.8-max
78.4672.8764.65$0.275—
19
grok-4.6
78.0476.7857.02$0.207Aug 2026
20
OpenAIGPT-5.4 Thinking xHigh Effort
77.9777.5453.84$0.387Mar 2026
21
muse-spark-1.2-xhigh
77.9577.5457.58$0.375Aug 2026
22
OpenAIGPT-5.6 Terra Max Effort
77.9478.2554.95$0.344Jul 2026
23
Anthropicclaude-sonnet-5-5-xhigh-effort
77.7588.8739.34$0.141—
24
DeepSeekdeepseek-v4-pro-0813
77.4477.1654.95$0.044—
25
smaug-flash
77.4377.161.06$0.014—
26
grok-4.7-xhigh
77.477.1653.99$0.718Sep 2026
27
GoogleGemini 3.1 Pro Preview High
76.9576.4544.14$0.285Feb 2026
28
smaug-mini
76.9375.4360.81$0.099—
29
DeepSeekdeepseek-v4-flash-vision-exp
76.7668.265.1$0.051—
30
AnthropicClaude 4.7 Opus Thinking xHigh Effort
76.5382.0950.66$0.528—
31
Anthropicclaude-opus-4-8-max-effort
76.2281.8350.5$0.986—
32
Qwenqwen3.8-flash-next
76.1972.5561.62$0.042—
33
glm-5.3
76.1478.9560.91$0.450Aug 2026
34
AnthropicClaude Sonnet 5 xHigh Effort
76.0480.6859.39$0.513Jun 2026
35
Googlegemini-3.8-flash-high
75.8372.4954.24$0.307Sep 2026
36
Grok 4.5
75.7768.5956.46$0.131Jul 2026
37
Anthropicclaude-sonnet-5-5-max-effort
75.6791.3756.31$0.868—
38
muse-spark-1.1-xhigh
75.377.1658.54$0.195Jul 2026
39
Qwenqwen3.8-27b
75.2775.6961.36$0.094—
40
GoogleGemini 3.5 Flash High
74.6478.1848.99$0.249May 2026
41
OpenAIGPT-5.2 High
74.6376.0750.25$0.234Dec 2025
42
AnthropicClaude 4.6 Opus Thinking High Effort
74.5278.1848.99$0.404—
43
DeepSeekdeepseek-v4-flash-0731OPEN
74.1774.9846.77$0.060Jul 2026
44
OpenAIGPT-5.2 Codex
73.9783.6249.39$0.187Dec 2025
45
Googlegemini-3.6-flash-high
73.5977.8643.43$0.235Jul 2026
46
OpenAIGPT-5.6 Luna Max Effort
73.5682.9148.43$0.168Jul 2026
47
GLM-5.2OPEN
73.1679.6551.77$0.225Jun 2026
48
AlibabaQwen 3.7 Max
73.1474.2243.59$0.182—
49
AnthropicClaude 4.6 Sonnet Thinking Medium Effort
72.9979.2742.63$0.306—
50
AnthropicClaude 4.5 Opus Thinking High Effort
72.5879.6539.7$0.610—
51
Anthropicclaude-haiku-5-5-xhigh-effort
72.0776.3951.36$0.019—
52
OpenAIgpt-6-luna-max
72.0378.9551.21$0.026Sep 2026
53
inkling-xhighOPEN
71.9271.0249.39$0.311Jul 2026
54
Mistralmistral-large-4-high
71.8477.1657.17$0.139—
55
glm-5.3-flashOPEN
71.5978.9556.77$0.030Aug 2026
56
DeepSeekDeepSeek V4 ProOPEN
71.5769.9942.63$0.050Apr 2026
57
Moonshot AIKimi K2.6 ThinkingOPEN
70.5478.5746.92$0.169Apr 2026
58
OpenAIGPT-5.4 Nano xHigh
69.5870.8446.77$0.091Mar 2026
59
ox-alpha-max
69.2475.7552.63$0.000—
60
AlibabaQwen 3.6 Plus
68.978.1841.36$0.227Apr 2026
61
Moonshot AIKimi K2.7 CodeOPEN
68.4173.9645.66$0.100Jun 2026
62
Anthropicclaude-haiku-5-5-max-effort
67.8877.8657.17$0.051—
63
Grok Build 0.1
67.7865.3945.81$0.024May 2026
64
Nemotron 3 Ultra 550B A55B
67.3670.738.74$0.371—
65
MinimaxMinimax M3OPEN
67.2668.240.66$0.060Jun 2026
66
OpenAIGPT-5.4 Mini xHigh
66.3771.6241.67$0.334Mar 2026
67
DeepSeekDeepSeek V4 FlashOPEN
65.4869.2337.63$0.016Apr 2026
68
AlibabaQwen 3.6 27BOPEN
64.0371.7839.29$0.202Apr 2026
69
Googlegemini-3.5-flash-lite-high
63.9476.0745.25$0.069Jul 2026
70
Grok 4.3
62.2569.9318.54$0.061—
71
nemotron-3.5-lightning-30b-a3b
44.4945.7619.95$0.040—

Scores from LiveBench (2026-06-25), updated —. Cost is joined from our daily API pricing where a model matches; models we don't price still appear with their score. Always verify on the benchmark's own site before relying on a number.

What LiveBench measures

LiveBench is a general-capability benchmark built to resist the biggest problem with static leaderboards — training-data contamination. It draws questions from frequently-updated sources and rotates them over time, so models can’t simply have memorised the answers. Every question has an objective ground-truth answer, and scoring is fully automatic — there’s no LLM acting as judge, which removes a common source of bias.

Tasks span six areas, each scored and then combined into the 0–100 overall you see here:

  • Reasoning — logic and multi-step problem solving.
  • Coding — code generation and completion.
  • Agentic coding — longer, tool-using software tasks.
  • Mathematics — competition and applied math.
  • Data analysis — tables, extraction, transformation.
  • Language — comprehension and instruction following.

How to read this page

The leaderboard shows each model’s overall score plus its Coding and Agentic sub-scores — the two most relevant to developers. The cost-vs-quality chart uses LiveBench’s own measured cost per successful task on the horizontal axis, so you’re seeing real spend to get a task done, not just a headline token price. Reasoning-heavy models often score well but sit far to the right because they emit many tokens per task.

Limitations

LiveBench only covers models its maintainers have run, so very new or niche models may be missing. The overall score weights all categories equally — if you only care about coding, read the Coding column directly rather than the overall.

Frequently asked questions

Is LiveBench contamination-free?
It is designed to strongly limit contamination by using frequently-updated questions that rotate over time, rather than a fixed public test set. No benchmark can guarantee zero contamination, but this design makes memorisation much harder than with static benchmarks.
How is the overall score calculated?
Each of the six categories (reasoning, coding, agentic coding, mathematics, data analysis, language) is scored, and the overall is their average on a 0–100 scale. TokenCost shows the overall plus the coding and agentic sub-scores.
What is the cost axis on the chart?
LiveBench’s own measured cost per successful task, in US dollars — the real spend to complete a task, which captures how many tokens a model uses, not just its per-token price.