OpenAI

GPT-4.1 Mini — Benchmark Scores, Pricing & Performance Analysis

BUDGETOpenAI
Chatbot Arena ELO
1250
Output Speed
160 tok/s
Input Cost
$0.40/1M
Output Cost
$1.6/1M
Context Window
1.0M
Max Output
33K
Knowledge Cutoff
Jun 2024
Accepts
image, text, file

GPT-4.1 Mini by OpenAI demonstrates fast output speed, competitive pricing. View detailed benchmark data including scores across coding, math, reasoning, speed, and cost metrics.

Specifications last checked against the provider on . Benchmark scores carry their own source, linked beside each number.

General Benchmarks

Chatbot Arena ELO
125054th of 74

Human preference ELO from blind head-to-head votes

LMSYS / HuggingFace
MMLU-Pro
68.0%46th of 66

Massive Multitask Language Understanding professional benchmark

HuggingFace Leaderboard

Coding Benchmarks

Website Arena ELO
100997th of 108

Human preference ELO for building a working web page from a brief

Design Arena (via OpenRouter)
LiveCodeBench
40.0%42nd of 66

Live competitive programming benchmark

livecodebench.github.io
HumanEval+
80.0%43rd of 66

Code generation correctness with extended tests

Papers
SWE-bench Verified
35.0%43rd of 67

Real-world software engineering task resolution

swebench.com
AA Coding Index
20.277th of 96

Artificial Analysis composite coding score

Artificial Analysis (via OpenRouter)
Design Arena ELO
1000106th of 120

Human preference ELO for building things — websites, UI, games, charts, SVG

Design Arena (via OpenRouter)

Math Benchmarks

GSM8K
90.0%42nd of 66

Grade school math word problems

Papers
MATH
72.0%45th of 66

Competition mathematics problem solving

Papers

Reasoning Benchmarks

τ²-Bench Airline
44.0%80th of 93

Multi-turn service agent making tool calls under strict policy constraints

OpenRouter (measured)
ARC-AGI
22.0%38th of 66

Abstraction and Reasoning Corpus for general intelligence

arcprize.org
GPQA Diamond
64.1%96th of 140

Graduate-level science Q&A by domain experts

Papers

Speed Benchmarks

Time to First Token
130 ms10th of 92

Latency before first token arrives

Aggregated
Output Speed
160 tok/s16th of 94

Tokens generated per second

Aggregated

Cost Benchmarks

Input Cost
$0.40227th of 413

Cost per 1M input tokens

OpenRouter API
Cached Input Cost
$0.1062nd of 136

Cost per 1M cached input tokens — the price that actually applies to a long agent conversation

OpenRouter API
Output Cost
$1.6230th of 413

Cost per 1M output tokens

OpenRouter API

Context Benchmarks

Context Length
1.0M48th of 451

Maximum context window size

OpenRouter API

Available from 26 providers

The same model costs different amounts depending on who serves it. You can bring your own key for 4 of these — connect it here.

ProviderInput / 1MOutput / 1MCached inContextYour key
Poe$0.36$1.4$0.091.0M—
302.AI$0.4$1.6—1.0M—
Abacus$0.4$1.6$0.11.0M—
Aixy$0.4$1.6$0.11.0M—
Azure$0.4$1.6$0.11.0MSupported
Azure Cognitive Services$0.4$1.6$0.11.0M—
Cloudflare AI Gateway$0.4$1.6$0.11.0M—
DevPass (LLM Gateway)$0.4$1.6$0.11.0M—
Eden AI$0.4$1.6$0.11.0M—
Impossibl$0.4$1.6$0.11.0M—
Kilo Gateway$0.4$1.6$0.11.0M—
LLM Gateway$0.4$1.6$0.11.0M—
Merge Gateway$0.4$1.6$0.11.0M—
NanoGPT$0.4$1.6$0.11.0M—
NEAR AI Cloud$0.4$1.6$0.11.0M—
Ofox$0.4$1.6$0.11.0M—
OpenAI$0.4$1.6$0.11.0MSupported
OpenRouter$0.4$1.6$0.11.0MSupported
OrcaRouter$0.4$1.6$0.11.0M—
Pioneer$0.4$1.6$0.21.0M—
SAP AI Core$0.4$1.6$0.11.0M—
Vercel AI Gateway$0.4$1.6$0.11.0MSupported
Cortecs$0.434$1.704$0.1341.0M—
Requesty$0.44$1.76$0.111.0M—
AnyAPI———1.0M—
Model Oracle AI———1.0M—

GPT-4.1 Mini — Benchmark Scores Overview

Scores normalized to percentage scale for visual comparison. ELO scores mapped to 0-100 range (1100-1500).

GPT-4.1 Mini — Frequently Asked Questions

How intelligent is GPT-4.1 Mini?

GPT-4.1 Mini scores 1250 on the Chatbot Arena ELO rating, making it a mid-tier AI model. This score is based on blind head-to-head human preference voting.

How much does GPT-4.1 Mini cost?

GPT-4.1 Mini costs $0.40 per 1M input tokens and $1.6 per 1M output tokens. This makes it one of the more affordable models.

How fast is GPT-4.1 Mini?

GPT-4.1 Mini generates output at 160 tokens per second, which is very fast compared to other models. The time to first token is 130 ms.

How good is GPT-4.1 Mini at coding?

GPT-4.1 Mini achieves 35.0% on SWE-bench Verified, demonstrating moderate real-world software engineering capability. This benchmark tests the model's ability to resolve actual GitHub issues.

How good is GPT-4.1 Mini at math and reasoning?

GPT-4.1 Mini scores 72.0% on the MATH benchmark (competition-level mathematics). It also achieves 64.1% on GPQA Diamond, a graduate-level science reasoning benchmark.

What is the context window of GPT-4.1 Mini?

GPT-4.1 Mini has a context window of 1.0M tokens. This determines how much text, conversation history, and code the model can process in a single request.

Who created GPT-4.1 Mini?

GPT-4.1 Mini was created by OpenAI. It is classified as a budget model in our catalogue.

Is GPT-4.1 Mini open source?

No, GPT-4.1 Mini is a proprietary model. It is available through OpenAI's API and compatible providers.