Anthropic

Claude Sonnet 4 — Benchmark Scores, Pricing & Performance Analysis

Chatbot Arena ELO
1365
Output Speed
75 tok/s
Input Cost
$3.0/1M
Output Cost
$15.0/1M
Context Window
1.0M
Max Output
64K
Knowledge Cutoff
Jan 2025
Accepts
image, text, file

Claude Sonnet 4 by Anthropic demonstrates strong general intelligence, excellent coding ability. View detailed benchmark data including scores across coding, math, reasoning, speed, and cost metrics.

Specifications last checked against the provider on . Benchmark scores carry their own source, linked beside each number.

General Benchmarks

MMLU-Pro
81.0%22nd of 66

Massive Multitask Language Understanding professional benchmark

HuggingFace Leaderboard
Chatbot Arena ELO
136528th of 74

Human preference ELO from blind head-to-head votes

LMSYS / HuggingFace
IFEval
87.0%18th of 25

Strict instruction following accuracy on verifiable constraints

Google Research

Coding Benchmarks

Website Arena ELO
115170th of 108

Human preference ELO for building a working web page from a brief

Design Arena (via OpenRouter)
AA Coding Index
37.662nd of 96

Artificial Analysis composite coding score

Artificial Analysis (via OpenRouter)
LiveCodeBench
58.0%18th of 66

Live competitive programming benchmark

livecodebench.github.io
HumanEval+
88.0%20th of 66

Code generation correctness with extended tests

Papers
SWE-bench Verified
72.7%14th of 67

Real-world software engineering task resolution

swebench.com
Design Arena ELO
114570th of 120

Human preference ELO for building things — websites, UI, games, charts, SVG

Design Arena (via OpenRouter)
BFCL
70.3%2nd of 7

Berkeley Function Calling Leaderboard — tool use accuracy

Berkeley

Math Benchmarks

GSM8K
94.5%26th of 66

Grade school math word problems

Papers
MATH
85.0%24th of 66

Competition mathematics problem solving

Papers

Reasoning Benchmarks

τ²-Bench Airline
68.0%54th of 93

Multi-turn service agent making tool calls under strict policy constraints

OpenRouter (measured)
ARC-AGI
42.0%20th of 66

Abstraction and Reasoning Corpus for general intelligence

arcprize.org
GPQA Diamond
76.7%75th of 140

Graduate-level science Q&A by domain experts

Papers

Speed Benchmarks

Time to First Token
400 ms40th of 92

Latency before first token arrives

Aggregated
Output Speed
75 tok/s50th of 94

Tokens generated per second

Aggregated

Cost Benchmarks

Output Cost
$15.0370th of 413

Cost per 1M output tokens

OpenRouter API
Cached Input Cost
$0.30113th of 136

Cost per 1M cached input tokens — the price that actually applies to a long agent conversation

OpenRouter API
Input Cost
$3.0372nd of 413

Cost per 1M input tokens

OpenRouter API

Context Benchmarks

Context Length
1.0M52nd of 451

Maximum context window size

OpenRouter API

Available from 13 providers

The same model costs different amounts depending on who serves it. You can bring your own key for 3 of these — connect it here.

ProviderInput / 1MOutput / 1MCached inContextYour key
Poe$2.6$13$0.26983K—
Cortecs$2.898$14.493$0.29200K—
Abacus$3$15—200K—
DigitalOcean$3$15$0.31.0M—
FastRouter$3$15$0.3200K—
Merge Gateway$3$15$0.3200K—
OpenCode Zen$3$15$0.31.0M—
OpenRouter$3$15$0.31.0MSupported
Requesty$3$15$0.31.0M—
Vercel AI Gateway$3$15$0.31.0MSupported
Vertex$3$15$0.3200KSupported
Vertex (Anthropic)$3$15$0.3200K—
ZenMux$3$15$0.31.0M—

Claude Sonnet 4 — Benchmark Scores Overview

Scores normalized to percentage scale for visual comparison. ELO scores mapped to 0-100 range (1100-1500).

Claude Sonnet 4 — Frequently Asked Questions

How intelligent is Claude Sonnet 4?

Claude Sonnet 4 scores 1365 on the Chatbot Arena ELO rating, making it a high-performing AI model. This score is based on blind head-to-head human preference voting.

How much does Claude Sonnet 4 cost?

Claude Sonnet 4 costs $3.0 per 1M input tokens and $15.0 per 1M output tokens. This is mid-range pricing for its capability level.

How fast is Claude Sonnet 4?

Claude Sonnet 4 generates output at 75 tokens per second, which is slower, prioritizing quality over speed compared to other models. The time to first token is 400 ms.

How good is Claude Sonnet 4 at coding?

Claude Sonnet 4 achieves 72.7% on SWE-bench Verified, demonstrating excellent real-world software engineering capability. This benchmark tests the model's ability to resolve actual GitHub issues.

How good is Claude Sonnet 4 at math and reasoning?

Claude Sonnet 4 scores 85.0% on the MATH benchmark (competition-level mathematics). It also achieves 76.7% on GPQA Diamond, a graduate-level science reasoning benchmark.

What is the context window of Claude Sonnet 4?

Claude Sonnet 4 has a context window of 1.0M tokens. This determines how much text, conversation history, and code the model can process in a single request.

Who created Claude Sonnet 4?

Claude Sonnet 4 was created by Anthropic. It is classified as a mid model in our catalogue.

Is Claude Sonnet 4 open source?

No, Claude Sonnet 4 is a proprietary model. It is available through Anthropic's API and compatible providers.