OpenAI

GPT-5.1 Codex — Benchmark Scores, Pricing & Performance Analysis

FLAGSHIPOpenAI
Chatbot Arena ELO
1395
Output Speed
85 tok/s
Input Cost
$1.3/1M
Output Cost
$10.0/1M
Context Window
400K
Max Output
128K
Knowledge Cutoff
Sept 2024
Accepts
text, image

GPT-5.1 Codex by OpenAI demonstrates strong general intelligence, excellent coding ability. View detailed benchmark data including scores across coding, math, reasoning, speed, and cost metrics.

Specifications last checked against the provider on . Benchmark scores carry their own source, linked beside each number.

General Benchmarks

MMLU-Pro
82.0%18th of 66

Massive Multitask Language Understanding professional benchmark

HuggingFace Leaderboard
Chatbot Arena ELO
139518th of 74

Human preference ELO from blind head-to-head votes

LMSYS / HuggingFace

Coding Benchmarks

Website Arena ELO
117464th of 108

Human preference ELO for building a working web page from a brief

Design Arena (via OpenRouter)
LiveCodeBench
85.0%1st of 66

Live competitive programming benchmark

livecodebench.github.io
HumanEval+
96.0%1st of 66

Code generation correctness with extended tests

Papers
SWE-bench Verified
78.0%7th of 67

Real-world software engineering task resolution

swebench.com
Design Arena ELO
119746th of 120

Human preference ELO for building things — websites, UI, games, charts, SVG

Design Arena (via OpenRouter)
Aider Polyglot
76.0%2nd of 8

Multi-language code editing accuracy with real git repos

aider.chat

Math Benchmarks

GSM8K
95.0%21st of 66

Grade school math word problems

Papers
MATH
85.0%24th of 66

Competition mathematics problem solving

Papers

Reasoning Benchmarks

ARC-AGI
52.0%9th of 66

Abstraction and Reasoning Corpus for general intelligence

arcprize.org
GPQA Diamond
65.0%93rd of 140

Graduate-level science Q&A by domain experts

Papers

Speed Benchmarks

Time to First Token
400 ms40th of 92

Latency before first token arrives

Aggregated
Output Speed
85 tok/s42nd of 94

Tokens generated per second

Aggregated

Cost Benchmarks

Input Cost
$1.3306th of 413

Cost per 1M input tokens

OpenRouter API
Cached Input Cost
$0.1374th of 136

Cost per 1M cached input tokens — the price that actually applies to a long agent conversation

OpenRouter API
Output Cost
$10.0335th of 413

Cost per 1M output tokens

OpenRouter API

Context Benchmarks

Context Length
400K90th of 451

Maximum context window size

OpenRouter API

Available from 18 providers

The same model costs different amounts depending on who serves it. You can bring your own key for 3 of these — connect it here.

ProviderInput / 1MOutput / 1MCached inContextYour key
OpenCode Zen$1.07$8.5$0.107400K—
Poe$1.1$9$0.11400K—
Jiekou.AI$1.125$9—400K—
Abacus$1.25$10$0.125400K—
AIHubMix$1.25$10$0.125400K—
Azure$1.25$10$0.125400KSupported
Azure Cognitive Services$1.25$10$0.125400K—
DevPass (LLM Gateway)$1.25$10$0.125400K—
Eden AI$1.25$10$0.125272K—
Impossibl$1.25$10$0.125400K—
Kilo Gateway$1.25$10$0.13400K—
LLM Gateway$1.25$10—400K—
NanoGPT$1.25$10$0.125400K—
OpenRouter$1.25$10$0.13400KSupported
OrcaRouter$1.25$10$0.125400K—
Vercel AI Gateway$1.25$10$0.13400KSupported
Vivgrid$1.25$10$0.125400K—
ZenMux$1.25$10$0.12400K—

GPT-5.1 Codex — Benchmark Scores Overview

Scores normalized to percentage scale for visual comparison. ELO scores mapped to 0-100 range (1100-1500).

GPT-5.1 Codex — Frequently Asked Questions

How intelligent is GPT-5.1 Codex?

GPT-5.1 Codex scores 1395 on the Chatbot Arena ELO rating, making it a high-performing AI model. This score is based on blind head-to-head human preference voting.

How much does GPT-5.1 Codex cost?

GPT-5.1 Codex costs $1.3 per 1M input tokens and $10.0 per 1M output tokens. This is mid-range pricing for its capability level.

How fast is GPT-5.1 Codex?

GPT-5.1 Codex generates output at 85 tokens per second, which is moderate compared to other models. The time to first token is 400 ms.

How good is GPT-5.1 Codex at coding?

GPT-5.1 Codex achieves 78.0% on SWE-bench Verified, demonstrating excellent real-world software engineering capability. This benchmark tests the model's ability to resolve actual GitHub issues.

How good is GPT-5.1 Codex at math and reasoning?

GPT-5.1 Codex scores 85.0% on the MATH benchmark (competition-level mathematics). It also achieves 65.0% on GPQA Diamond, a graduate-level science reasoning benchmark.

What is the context window of GPT-5.1 Codex?

GPT-5.1 Codex has a context window of 400K tokens. This determines how much text, conversation history, and code the model can process in a single request.

Who created GPT-5.1 Codex?

GPT-5.1 Codex was created by OpenAI. It is classified as a flagship model in our catalogue.

Is GPT-5.1 Codex open source?

No, GPT-5.1 Codex is a proprietary model. It is available through OpenAI's API and compatible providers.