DeepSeek

DeepSeek R1 — Benchmark Scores, Pricing & Performance Analysis

OPEN SOURCEDeepSeek
Chatbot Arena ELO
1355
Output Speed
35 tok/s
Input Cost
$0.70/1M
Output Cost
$2.5/1M
Context Window
64K
Max Output
16K
Knowledge Cutoff
Jul 2024
Accepts
text

DeepSeek R1 by DeepSeek demonstrates strong general intelligence, outstanding mathematical reasoning. View detailed benchmark data including scores across coding, math, reasoning, speed, and cost metrics.

Specifications last checked against the provider on . Benchmark scores carry their own source, linked beside each number.

General Benchmarks

Chatbot Arena ELO
135530th of 74

Human preference ELO from blind head-to-head votes

LMSYS / HuggingFace
AA Intelligence Index
11.454th of 66

Artificial Analysis composite intelligence score across 10 sub-benchmarks

Artificial Analysis (via OpenRouter)
MMLU-Pro
84.0%10th of 66

Massive Multitask Language Understanding professional benchmark

HuggingFace Leaderboard
IFEval
87.8%17th of 25

Strict instruction following accuracy on verifiable constraints

Google Research
SimpleQA
30.1%6th of 14

Factual accuracy on short, verifiable questions

OpenAI
TruthfulQA
78.0%10th of 13

Resistance to generating false but plausible answers

Papers
MT-Bench
8.711th of 13

Multi-turn conversation quality on 80 curated dialogues

LMSYS
AlpacaEval 2.0
87.6%1st of 10

Instruction following quality scored by GPT-4 as judge

tatsu-lab

Coding Benchmarks

SWE-bench Verified
49.2%29th of 67

Real-world software engineering task resolution

swebench.com
AA Coding Index
24.671st of 96

Artificial Analysis composite coding score

Artificial Analysis (via OpenRouter)
LiveCodeBench
50.0%33rd of 66

Live competitive programming benchmark

livecodebench.github.io
HumanEval+
86.0%30th of 66

Code generation correctness with extended tests

Papers

Math Benchmarks

GSM8K
97.0%11th of 66

Grade school math word problems

Papers
MATH
97.3%1st of 66

Competition mathematics problem solving

Papers
AIME 2025
79.8%12th of 17

American Invitational Mathematics Examination — competition math

Papers

Reasoning Benchmarks

AA Agentic Index
1.161st of 70

Artificial Analysis composite score for multi-step tool-using tasks

Artificial Analysis (via OpenRouter)
ARC-AGI
14.0%53rd of 66

Abstraction and Reasoning Corpus for general intelligence

arcprize.org
GPQA Diamond
71.5%85th of 140

Graduate-level science Q&A by domain experts

Papers
Winogrande
88.0%11th of 14

Commonsense reasoning via pronoun resolution

Papers
BBH
89.0%5th of 13

Big-Bench Hard — 23 challenging multi-step reasoning tasks

Google Research

Speed Benchmarks

Time to First Token
950 ms74th of 92

Latency before first token arrives

Aggregated
Output Speed
35 tok/s87th of 94

Tokens generated per second

Aggregated

Cost Benchmarks

Input Cost
$0.70269th of 413

Cost per 1M input tokens

OpenRouter API
Output Cost
$2.5265th of 413

Cost per 1M output tokens

OpenRouter API

Context Benchmarks

Context Length
64K360th of 451

Maximum context window size

OpenRouter API
RULER
82.0%10th of 13

Long-context understanding and retrieval accuracy at depth

Papers

Multimodal Benchmarks

MathVista
73.6%5th of 14

Visual mathematical reasoning across diagrams and charts

Papers

Available from 19 providers

The same model costs different amounts depending on who serves it. You can bring your own key for 6 of these — connect it here.

ProviderInput / 1MOutput / 1MCached inContextYour key
iFlow$0$0—128K—
NanoGPT$0.4$1.7$0.2128K—
D.Run (China)$0.55$2.2—131K—
Alibaba (China)$0.574$2.294—131K—
Eden AI$0.7$2.4—164K—
Hugging Face$0.7$2.5—64KSupported
Kilo Gateway$0.7$2.5—64K—
NovitaAI$0.7$2.5—64K—
OpenRouter$0.7$2.5—64KSupported
Amazon Bedrock$1.35$5.4—128KSupported
Azure$1.35$5.4—164KSupported
Azure Cognitive Services$1.35$5.4—164K—
Merge Gateway$1.35$5.4—164K—
Vercel AI Gateway$1.35$5.4—128KSupported
IO.NET$2$8.75$1128K—
Abacus$3$7—128K—
Together AI$3$7—164KSupported
Qiniu———128K—
Snowflake Cortex———128K—

DeepSeek R1 — Benchmark Scores Overview

Scores normalized to percentage scale for visual comparison. ELO scores mapped to 0-100 range (1100-1500).

DeepSeek R1 — Frequently Asked Questions

How intelligent is DeepSeek R1?

DeepSeek R1 scores 1355 on the Chatbot Arena ELO rating, making it a high-performing AI model. This score is based on blind head-to-head human preference voting.

How much does DeepSeek R1 cost?

DeepSeek R1 costs $0.70 per 1M input tokens and $2.5 per 1M output tokens. This is mid-range pricing for its capability level.

How fast is DeepSeek R1?

DeepSeek R1 generates output at 35 tokens per second, which is slower, prioritizing quality over speed compared to other models. The time to first token is 950 ms.

How good is DeepSeek R1 at coding?

DeepSeek R1 achieves 49.2% on SWE-bench Verified, demonstrating moderate real-world software engineering capability. This benchmark tests the model's ability to resolve actual GitHub issues.

How good is DeepSeek R1 at math and reasoning?

DeepSeek R1 scores 97.3% on the MATH benchmark (competition-level mathematics). It also achieves 71.5% on GPQA Diamond, a graduate-level science reasoning benchmark.

What is the context window of DeepSeek R1?

DeepSeek R1 has a context window of 64K tokens. This determines how much text, conversation history, and code the model can process in a single request.

Who created DeepSeek R1?

DeepSeek R1 was created by DeepSeek. It is classified as a open source model in our catalogue.

Is DeepSeek R1 open source?

Yes, DeepSeek R1 is an open-source model. The model weights are publicly available for download and self-hosting.