Anthropic

Claude 3.7 Sonnet — Benchmark Scores, Pricing & Performance Analysis

Chatbot Arena ELO
1340
Output Speed
70 tok/s
Input Cost
$3.0/1M
Output Cost
$15.0/1M
Context Window
200K

Claude 3.7 Sonnet by Anthropic demonstrates strong general intelligence, solid coding performance, outstanding mathematical reasoning. View detailed benchmark data including scores across coding, math, reasoning, speed, and cost metrics.

General Benchmarks

Chatbot Arena ELO
134033rd of 74

Human preference ELO from blind head-to-head votes

LMSYS / HuggingFace
MMLU-Pro
79.0%27th of 66

Massive Multitask Language Understanding professional benchmark

HuggingFace Leaderboard
IFEval
86.0%20th of 25

Strict instruction following accuracy on verifiable constraints

Google Research
TruthfulQA
85.5%2nd of 13

Resistance to generating false but plausible answers

Papers
MT-Bench
9.25th of 13

Multi-turn conversation quality on 80 curated dialogues

LMSYS

Coding Benchmarks

LiveCodeBench
52.0%30th of 66

Live competitive programming benchmark

livecodebench.github.io
HumanEval+
86.0%30th of 66

Code generation correctness with extended tests

Papers
SWE-bench Verified
62.3%23rd of 67

Real-world software engineering task resolution

swebench.com
Design Arena ELO
120340th of 120

Human preference ELO for building things — websites, UI, games, charts, SVG

Design Arena (via OpenRouter)
Website Arena ELO
123640th of 108

Human preference ELO for building a working web page from a brief

Design Arena (via OpenRouter)

Math Benchmarks

GSM8K
95.0%21st of 66

Grade school math word problems

Papers
MATH
96.2%4th of 66

Competition mathematics problem solving

Papers
AIME 2025
52.7%15th of 17

American Invitational Mathematics Examination — competition math

Papers

Reasoning Benchmarks

ARC-AGI
38.0%24th of 66

Abstraction and Reasoning Corpus for general intelligence

arcprize.org
GPQA Diamond
84.8%37th of 140

Graduate-level science Q&A by domain experts

Papers
Winogrande
92.3%4th of 14

Commonsense reasoning via pronoun resolution

Papers

Speed Benchmarks

Time to First Token
420 ms49th of 92

Latency before first token arrives

Aggregated
Output Speed
70 tok/s51st of 94

Tokens generated per second

Aggregated

Cost Benchmarks

Output Cost
$15.0370th of 413

Cost per 1M output tokens

OpenRouter API
Input Cost
$3.0372nd of 413

Cost per 1M input tokens

OpenRouter API

Context Benchmarks

Context Length
200K189th of 451

Maximum context window size

OpenRouter API
RULER
92.0%3rd of 13

Long-context understanding and retrieval accuracy at depth

Papers

Multimodal Benchmarks

MathVista
72.0%7th of 14

Visual mathematical reasoning across diagrams and charts

Papers

Available from 4 providers

The same model costs different amounts depending on who serves it.

ProviderInput / 1MOutput / 1MCached inContextYour key
DigitalOcean$3$15$0.3200K—
Merge Gateway$3$15$0.3200K—
ZenMux$3$15$0.3200K—
Qiniu———200K—

Claude 3.7 Sonnet — Benchmark Scores Overview

Scores normalized to percentage scale for visual comparison. ELO scores mapped to 0-100 range (1100-1500).

Claude 3.7 Sonnet — Frequently Asked Questions

How intelligent is Claude 3.7 Sonnet?

Claude 3.7 Sonnet scores 1340 on the Chatbot Arena ELO rating, making it a mid-tier AI model. This score is based on blind head-to-head human preference voting.

How much does Claude 3.7 Sonnet cost?

Claude 3.7 Sonnet costs $3.0 per 1M input tokens and $15.0 per 1M output tokens. This is mid-range pricing for its capability level.

How fast is Claude 3.7 Sonnet?

Claude 3.7 Sonnet generates output at 70 tokens per second, which is slower, prioritizing quality over speed compared to other models. The time to first token is 420 ms.

How good is Claude 3.7 Sonnet at coding?

Claude 3.7 Sonnet achieves 62.3% on SWE-bench Verified, demonstrating strong real-world software engineering capability. This benchmark tests the model's ability to resolve actual GitHub issues.

How good is Claude 3.7 Sonnet at math and reasoning?

Claude 3.7 Sonnet scores 96.2% on the MATH benchmark (competition-level mathematics). It also achieves 84.8% on GPQA Diamond, a graduate-level science reasoning benchmark.

What is the context window of Claude 3.7 Sonnet?

Claude 3.7 Sonnet has a context window of 200K tokens. This determines how much text, conversation history, and code the model can process in a single request.

Who created Claude 3.7 Sonnet?

Claude 3.7 Sonnet was created by Anthropic. It is classified as a mid model in our catalogue.

Is Claude 3.7 Sonnet open source?

No, Claude 3.7 Sonnet is a proprietary model. It is available through Anthropic's API and compatible providers.