OpenAI

GPT-4o Mini — Benchmark Scores, Pricing & Performance Analysis

BUDGETOpenAI
Chatbot Arena ELO
1220
Output Speed
200 tok/s
Input Cost
$0.15/1M
Output Cost
$0.60/1M
Context Window
128K
Max Output
16K
Knowledge Cutoff
Oct 2023
Accepts
text, image, file

GPT-4o Mini by OpenAI demonstrates fast output speed, competitive pricing. View detailed benchmark data including scores across coding, math, reasoning, speed, and cost metrics.

Specifications last checked against the provider on . Benchmark scores carry their own source, linked beside each number.

General Benchmarks

MMLU-Pro
64.0%56th of 66

Massive Multitask Language Understanding professional benchmark

HuggingFace Leaderboard
Chatbot Arena ELO
122064th of 74

Human preference ELO from blind head-to-head votes

LMSYS / HuggingFace
IFEval
80.0%25th of 25

Strict instruction following accuracy on verifiable constraints

Google Research
SimpleQA
10.5%14th of 14

Factual accuracy on short, verifiable questions

OpenAI

Coding Benchmarks

LiveCodeBench
28.0%57th of 66

Live competitive programming benchmark

livecodebench.github.io
HumanEval+
78.0%48th of 66

Code generation correctness with extended tests

Papers
SWE-bench Verified
20.0%61st of 67

Real-world software engineering task resolution

swebench.com
AA Coding Index
11.489th of 96

Artificial Analysis composite coding score

Artificial Analysis (via OpenRouter)

Math Benchmarks

GSM8K
88.0%47th of 66

Grade school math word problems

Papers
MATH
68.0%52nd of 66

Competition mathematics problem solving

Papers

Reasoning Benchmarks

τ²-Bench Airline
27.0%89th of 93

Multi-turn service agent making tool calls under strict policy constraints

OpenRouter (measured)
ARC-AGI
3.0%65th of 66

Abstraction and Reasoning Corpus for general intelligence

arcprize.org
GPQA Diamond
43.4%124th of 140

Graduate-level science Q&A by domain experts

Papers

Speed Benchmarks

Time to First Token
120 ms7th of 92

Latency before first token arrives

Aggregated
Output Speed
200 tok/s8th of 94

Tokens generated per second

Aggregated

Cost Benchmarks

Input Cost
$0.15149th of 413

Cost per 1M input tokens

OpenRouter API
Cached Input Cost
$0.0754th of 136

Cost per 1M cached input tokens — the price that actually applies to a long agent conversation

OpenRouter API
Output Cost
$0.60167th of 413

Cost per 1M output tokens

OpenRouter API

Context Benchmarks

Context Length
128K267th of 451

Maximum context window size

OpenRouter API

Available from 22 providers

The same model costs different amounts depending on who serves it. You can bring your own key for 4 of these — connect it here.

ProviderInput / 1MOutput / 1MCached inContextYour key
Cloudflare AI Gateway$0.075$0.3$0.0375128K—
Poe$0.14$0.54$0.068124K—
Abacus$0.15$0.6—128K—
Azure$0.15$0.6$0.075128KSupported
Azure Cognitive Services$0.15$0.6$0.075128K—
CrossModel$0.15$0.6$0.075128K—
DevPass (LLM Gateway)$0.15$0.6$0.075128K—
Eden AI$0.15$0.6$0.075128K—
Impossibl$0.15$0.6$0.075128K—
Kilo Gateway$0.15$0.6$0.075128K—
LLM Gateway$0.15$0.6$0.075128K—
Merge Gateway$0.15$0.6$0.075128K—
NanoGPT$0.15$0.6$0.075128K—
Ofox$0.15$0.6$0.075128K—
OpenAI$0.15$0.6$0.075128KSupported
OpenRouter$0.15$0.6$0.075128KSupported
OrcaRouter$0.15$0.6$0.075128K—
Pioneer$0.15$0.6$0.075128K—
Vercel AI Gateway$0.15$0.6$0.075128KSupported
Cortecs$0.159$0.638$0.081128K—
Requesty$0.165$0.66$0.0825128K—
Venice AI$0.1875$0.75$0.09375128K—

GPT-4o Mini — Benchmark Scores Overview

Scores normalized to percentage scale for visual comparison. ELO scores mapped to 0-100 range (1100-1500).

GPT-4o Mini — Frequently Asked Questions

How intelligent is GPT-4o Mini?

GPT-4o Mini scores 1220 on the Chatbot Arena ELO rating, making it an entry-level AI model. This score is based on blind head-to-head human preference voting.

How much does GPT-4o Mini cost?

GPT-4o Mini costs $0.15 per 1M input tokens and $0.60 per 1M output tokens. This makes it one of the more affordable models.

How fast is GPT-4o Mini?

GPT-4o Mini generates output at 200 tokens per second, which is very fast compared to other models. The time to first token is 120 ms.

How good is GPT-4o Mini at coding?

GPT-4o Mini achieves 20.0% on SWE-bench Verified, demonstrating basic real-world software engineering capability. This benchmark tests the model's ability to resolve actual GitHub issues.

How good is GPT-4o Mini at math and reasoning?

GPT-4o Mini scores 68.0% on the MATH benchmark (competition-level mathematics). It also achieves 43.4% on GPQA Diamond, a graduate-level science reasoning benchmark.

What is the context window of GPT-4o Mini?

GPT-4o Mini has a context window of 128K tokens. This determines how much text, conversation history, and code the model can process in a single request.

Who created GPT-4o Mini?

GPT-4o Mini was created by OpenAI. It is classified as a budget model in our catalogue.

Is GPT-4o Mini open source?

No, GPT-4o Mini is a proprietary model. It is available through OpenAI's API and compatible providers.