OpenAI

o3 Mini — Benchmark Scores, Pricing & Performance Analysis

Chatbot Arena ELO
1320
Output Speed
100 tok/s
Input Cost
$1.1/1M
Output Cost
$4.4/1M
Context Window
200K
Max Output
100K
Knowledge Cutoff
Oct 2023
Accepts
text, file

o3 Mini by OpenAI demonstrates strong general intelligence, solid coding performance, outstanding mathematical reasoning. View detailed benchmark data including scores across coding, math, reasoning, speed, and cost metrics.

Specifications last checked against the provider on . Benchmark scores carry their own source, linked beside each number.

General Benchmarks

MMLU-Pro
78.0%29th of 66

Massive Multitask Language Understanding professional benchmark

HuggingFace Leaderboard
Chatbot Arena ELO
132039th of 74

Human preference ELO from blind head-to-head votes

LMSYS / HuggingFace
SimpleQA
13.0%12th of 14

Factual accuracy on short, verifiable questions

OpenAI

Coding Benchmarks

LiveCodeBench
55.0%23rd of 66

Live competitive programming benchmark

livecodebench.github.io
HumanEval+
87.0%28th of 66

Code generation correctness with extended tests

Papers
SWE-bench Verified
50.0%27th of 67

Real-world software engineering task resolution

swebench.com

Math Benchmarks

GSM8K
97.0%11th of 66

Grade school math word problems

Papers
MATH
93.0%10th of 66

Competition mathematics problem solving

Papers

Reasoning Benchmarks

ARC-AGI
45.0%16th of 66

Abstraction and Reasoning Corpus for general intelligence

arcprize.org
GPQA Diamond
77.0%74th of 140

Graduate-level science Q&A by domain experts

Papers
BBH
88.5%6th of 13

Big-Bench Hard — 23 challenging multi-step reasoning tasks

Google Research
Winogrande
89.0%9th of 14

Commonsense reasoning via pronoun resolution

Papers

Speed Benchmarks

Time to First Token
400 ms40th of 92

Latency before first token arrives

Aggregated
Output Speed
100 tok/s31st of 94

Tokens generated per second

Aggregated

Cost Benchmarks

Output Cost
$4.4301st of 413

Cost per 1M output tokens

OpenRouter API
Input Cost
$1.1302nd of 413

Cost per 1M input tokens

OpenRouter API
Cached Input Cost
$0.55130th of 136

Cost per 1M cached input tokens — the price that actually applies to a long agent conversation

OpenRouter API

Context Benchmarks

Context Length
200K189th of 451

Maximum context window size

OpenRouter API

Available from 17 providers

The same model costs different amounts depending on who serves it. You can bring your own key for 4 of these — connect it here.

ProviderInput / 1MOutput / 1MCached inContextYour key
Poe$0.99$4—200K—
Abacus$1.1$4.4$0.55200K—
Azure$1.1$4.4$0.55200KSupported
Azure Cognitive Services$1.1$4.4$0.55200K—
Cloudflare AI Gateway$1.1$4.4$0.55200K—
DevPass (LLM Gateway)$1.1$4.4$0.55200K—
Eden AI$1.1$4.4$0.55200K—
Impossibl$1.1$4.4$0.55200K—
Jiekou.AI$1.1$4.4—131K—
Kilo Gateway$1.1$4.4$0.55200K—
LLM Gateway$1.1$4.4$0.55200K—
Merge Gateway$1.1$4.4$0.55200K—
NEAR AI Cloud$1.1$4.4$0.55200K—
OpenAI$1.1$4.4$0.55200KSupported
OpenRouter$1.1$4.4$0.55200KSupported
Vercel AI Gateway$1.1$4.4$0.55200KSupported
AnyAPI———200K—

o3 Mini — Benchmark Scores Overview

Scores normalized to percentage scale for visual comparison. ELO scores mapped to 0-100 range (1100-1500).

o3 Mini — Frequently Asked Questions

How intelligent is o3 Mini?

o3 Mini scores 1320 on the Chatbot Arena ELO rating, making it a mid-tier AI model. This score is based on blind head-to-head human preference voting.

How much does o3 Mini cost?

o3 Mini costs $1.1 per 1M input tokens and $4.4 per 1M output tokens. This is mid-range pricing for its capability level.

How fast is o3 Mini?

o3 Mini generates output at 100 tokens per second, which is moderate compared to other models. The time to first token is 400 ms.

How good is o3 Mini at coding?

o3 Mini achieves 50.0% on SWE-bench Verified, demonstrating strong real-world software engineering capability. This benchmark tests the model's ability to resolve actual GitHub issues.

How good is o3 Mini at math and reasoning?

o3 Mini scores 93.0% on the MATH benchmark (competition-level mathematics). It also achieves 77.0% on GPQA Diamond, a graduate-level science reasoning benchmark.

What is the context window of o3 Mini?

o3 Mini has a context window of 200K tokens. This determines how much text, conversation history, and code the model can process in a single request.

Who created o3 Mini?

o3 Mini was created by OpenAI. It is classified as a mid model in our catalogue.

Is o3 Mini open source?

No, o3 Mini is a proprietary model. It is available through OpenAI's API and compatible providers.