TokenCostEstimate bill →
← All benchmarks·Source: Epoch AI ↗

AIME (OTIS Mock) leaderboard

Current leader: GPT-5.5 at 100 (% correct).

Cost vs quality

Each dot is a model. The dashed line is the value frontier — top-left is the best trade-off (high score, low cost).

Closed model Open-weight model

Full leaderboard

#ModelScore% correctOutput $/1MReleased
1
GPT-5.5
100$30.00Apr 2026
2
GPT-5.5 Pro
100$180.00Apr 2026
3
GPT-5.6 Sol
100$30.00Jul 2026
4
Claude Fable 5
99.72$50.00Jun 2026
5
GPT-5.6 Terra
99.72$7.50Jul 2026
6
Claude Opus 5
98.89$50.00Jul 2026
7
Claude Opus 4.8
98.33$50.00May 2026
8
GPT-5.6 Luna
98.33$3.00Jul 2026
9
Claude Opus 4.7
97.8$150.00Apr 2026
10
Grok 4.5
97.78$6.00Jul 2026
11
Kimi K3OPEN
97.22$15.00Jul 2026
12
DeepSeek-V4-ProOPEN
96.66$0.87Apr 2026
13
Kimi K2.7 CodeOPEN
96.39$3.50Jun 2026
14
Kimi K2.6OPEN
96.11$2.72Apr 2026
15
GPT-5.2
96.11—Dec 2025
16
Gemini 3.1 Pro
95.6$12.00Feb 2026
17
Gemini 3.5 Flash
95.55$9.00—
18
GPT-5.4
95.3$15.00Mar 2026
19
Qwen3.7-Max
94.99$4.42May 2026
20
Claude Sonnet 5
94.72$10.00Jun 2026
21
Claude Opus 4.6
94.44$25.00Feb 2026
22
Grok 4.3 Beta
93.33—Apr 2026
23
Gemini 3 Flash
92.77—Dec 2025
24
Grok 4.20
92.21$2.50Feb 2026
25
GLM-5.1
92.21$3.04Apr 2026
26
Kimi K2.5OPEN
92.19$2.85Feb 2026
27
Gemini 3 Pro
91.38—Nov 2025
28
GPT-5
91.38—Aug 2025
29
Qwen 3.6 Max (Preview)
91.1$6.16Apr 2026
30
Qwen 3.6 Plus
90.55$1.95Apr 2026
31
Muse Spark
88.89—Apr 2026
32
gpt-oss-120bOPEN
88.88—Aug 2025
33
GPT-5.1
88.6—Nov 2025
34
DeepSeek-V3.2OPEN
87.81—Dec 2025
35
GPT-5.4 Nano
87.77$1.25Mar 2026
36
GPT-5.4 Mini
87.21$4.50Mar 2026
37
Qwen3-235B-A22B-Thinking (Jul 2025)OPEN
86.65—Jul 2025
38
GPT-5 mini
86.65—Aug 2025
39
GLM-5.2OPEN
86.38$2.35Jun 2026
40
Qwen 3.6 Flash
86.1$1.13Apr 2026
41
Claude Opus 4.5
86.1—Nov 2025
42
Claude Sonnet 4.6
85.78$15.00Feb 2026
43
Qwen 3.5 Flash (hosted 35B-A3B)
85.54$0.26Feb 2026
44
Qwen 3.5 Plus (hosted 397B-A17B)
84.98$1.80Feb 2026
45
Gemini 2.5 Pro (Jun 2025)
84.71—Jun 2025
46
Grok 4
83.98—Sep 2025
47
o3
83.87—Dec 2024
48
GLM-4.7OPEN
83.32—Dec 2025
49
Kimi K2 ThinkingOPEN
83.04—Nov 2025
50
o4-mini
81.65—Apr 2025
51
GPT-5 nano
81.09—Aug 2025
52
GLM-5OPEN
79.98$2.55Feb 2026
53
Grok-3 mini
77.76—Feb 2025
54
Claude Sonnet 4.5
77.76—Sep 2025
55
o3-mini
76.92—Jan 2025
56
Qwen3-Max
73.31$3.90Jan 2026
57
o1
73.31—Dec 2024
58
Gemini 2.5 Flash (Apr 2025)
73.03—Apr 2025
59
Claude Sonnet 4
71.08—May 2025
60
Gemini 2.5 Flash (May 2025)
70.8—May 2025
61
Claude Opus 4.1
68.86—Aug 2025
62
Claude Haiku 4.5
66.63—Oct 2025
63
DeepSeek-R1 (May 2025)OPEN
66.36—May 2025
64
Claude Opus 4
64.41—May 2025
65
Claude 3.7 Sonnet
57.74—Feb 2025
66
Gemini 2.0 Flash Thinking (Jan 2025)
57.74—Jan 2025
67
Grok 3
55.51—Feb 2025
68
DeepSeek-R1OPEN
53.29—Jan 2025
69
o1-mini
46.89—Sep 2024
70
GPT-4.1 mini
44.67—Apr 2025
71
GPT-4.1
38.27—Apr 2025
72
DeepSeek-V3 (Mar 2025)OPEN
37.72—Mar 2025
73
GPT-4.5
37.72—Feb 2025
74
Mistral Medium 3
32.15—May 2025
75
o1-preview
31.04—Dec 2024
76
Gemini 2.0 Flash (Feb 2025)
31.04—Dec 2024
77
Magistral Small 1.1OPEN
29.93—Jun 2025
78
GPT-4.1 nano
28.82—Apr 2025
79
Gemini 1.5 Pro (Sept 2024)
22.98—Sep 2024
80
Llama 4 MaverickOPEN
20.48—Apr 2025
81
Gemma 3 27BOPEN
19.64—Mar 2025
82
Gemini 1.5 Flash (Sep 2024)
16.17—May 2024
83
Qwen2.5-Max
16.03—Jan 2025
84
DeepSeek-V3OPEN
15.75—Dec 2024
85
Phi-4OPEN
13.66—Apr 2025
86
Grok-2 (Dec 2024)
11.44—Aug 2024
87
Llama 3.1-405BOPEN
9.63—Jul 2024
88
Claude 3.5 Sonnet (October 2024)
8.38—Oct 2024
89
Mistral Large 2 (Jul 2024)
8.38—Jul 2024
90
Qwen2.5-72BOPEN
7.96—Sep 2024
91
Llama 4 ScoutOPEN
7.69—Apr 2025
92
Mistral Large 2 (Nov 2024)
7.69—Jul 2024
93
GPT-4o mini
6.85—Jul 2024
94
Gemini 1.5 Pro (May 2024)
6.71—May 2024
95
GPT-4 Turbo (Apr 2024)
6.57—Apr 2024
96
Claude 3.5 Sonnet
6.43—Jun 2024
97
GPT-4o (Aug 2024)
6.3—Aug 2024
98
GPT-4o (May 2024)
6.16—May 2024
99
GPT-4o (Nov 2024)
6.16—Nov 2024
100
Mistral Small 3.1OPEN
5.74—Mar 2025
101
Llama 3.3 70BOPEN
5.04—Dec 2024
102
Claude 3 Opus
4.63—Mar 2024
103
Claude 3.5 Haiku
4.21—Oct 2024
104
Llama 3-70BOPEN
4.21—Apr 2024
105
Gemini 1.5 Flash (May 2024)
3.79—May 2024
106
Llama 3.1-70BOPEN
3.51—Jul 2024
107
Llama 3.2 90BOPEN
2.54—Sep 2024
108
Claude 3 Sonnet
2.4—Mar 2024
109
Llama 3.1-8BOPEN
2.4—Jul 2024
110
Claude 2
2.4—Jul 2023
111
Mistral Large
1.85—Feb 2024
112
Claude 2.1
1.85—Nov 2023
113
Claude 3 Haiku
1.71—Mar 2024
114
Gemma 2 27BOPEN
1.29—Jun 2024
115
GPT-4 (Jun 2023)
1.01—Jun 2023
116
Gemini 1.0 Pro
1.01—Dec 2023
117
Llama 3-8BOPEN
0.73—Apr 2024
118
Gemma 2 9BOPEN
0.46—Jun 2024
119
GPT-4 (Mar 2023)
0.46—Mar 2023
120
Llama 2-70BOPEN
0—Jul 2023

Scores from Epoch AI, updated —. Cost is joined from our daily API pricing where a model matches; models we don't price still appear with their score. Always verify on the benchmark's own site before relying on a number.