xAI

Grok 3 — Benchmark Scores, Pricing & Performance Analysis

MIDxAI
Chatbot Arena ELO
1402
Output Speed
65 tok/s
Input Cost
$3.0/1M
Output Cost
$15.0/1M
Context Window
1.0M

Grok 3 by xAI demonstrates top-tier general intelligence. View detailed benchmark data including scores across coding, math, reasoning, speed, and cost metrics.

General Benchmarks

Chatbot Arena ELO
140216th of 74

Human preference ELO from blind head-to-head votes

LMSYS / HuggingFace
MMLU-Pro
74.0%36th of 66

Massive Multitask Language Understanding professional benchmark

HuggingFace Leaderboard

Coding Benchmarks

Design Arena ELO
108989th of 120

Human preference ELO for building things — websites, UI, games, charts, SVG

Design Arena (via OpenRouter)
Website Arena ELO
110181st of 108

Human preference ELO for building a working web page from a brief

Design Arena (via OpenRouter)
LiveCodeBench
79.4%4th of 66

Live competitive programming benchmark

livecodebench.github.io
HumanEval+
82.0%39th of 66

Code generation correctness with extended tests

Papers
SWE-bench Verified
42.0%37th of 67

Real-world software engineering task resolution

swebench.com

Math Benchmarks

GSM8K
93.0%32nd of 66

Grade school math word problems

Papers
MATH
82.0%32nd of 66

Competition mathematics problem solving

Papers
AIME 2025
93.3%9th of 17

American Invitational Mathematics Examination — competition math

Papers

Reasoning Benchmarks

ARC-AGI
28.0%32nd of 66

Abstraction and Reasoning Corpus for general intelligence

arcprize.org
GPQA Diamond
84.6%38th of 140

Graduate-level science Q&A by domain experts

Papers

Speed Benchmarks

Time to First Token
400 ms40th of 92

Latency before first token arrives

Aggregated
Output Speed
65 tok/s61st of 94

Tokens generated per second

Aggregated

Cost Benchmarks

Output Cost
$15.0370th of 413

Cost per 1M output tokens

OpenRouter API
Input Cost
$3.0372nd of 413

Cost per 1M input tokens

OpenRouter API

Context Benchmarks

Context Length
1.0M18th of 451

Maximum context window size

OpenRouter API

Available from 1 provider

The same model costs different amounts depending on who serves it.

ProviderInput / 1MOutput / 1MCached inContextYour key
Poe$3$15$0.75131K—

Grok 3 — Benchmark Scores Overview

Scores normalized to percentage scale for visual comparison. ELO scores mapped to 0-100 range (1100-1500).

Grok 3 — Frequently Asked Questions

How intelligent is Grok 3?

Grok 3 scores 1402 on the Chatbot Arena ELO rating, making it a high-performing AI model. This score is based on blind head-to-head human preference voting.

How much does Grok 3 cost?

Grok 3 costs $3.0 per 1M input tokens and $15.0 per 1M output tokens. This is mid-range pricing for its capability level.

How fast is Grok 3?

Grok 3 generates output at 65 tokens per second, which is slower, prioritizing quality over speed compared to other models. The time to first token is 400 ms.

How good is Grok 3 at coding?

Grok 3 achieves 42.0% on SWE-bench Verified, demonstrating moderate real-world software engineering capability. This benchmark tests the model's ability to resolve actual GitHub issues.

How good is Grok 3 at math and reasoning?

Grok 3 scores 82.0% on the MATH benchmark (competition-level mathematics). It also achieves 84.6% on GPQA Diamond, a graduate-level science reasoning benchmark.

What is the context window of Grok 3?

Grok 3 has a context window of 1.0M tokens. This determines how much text, conversation history, and code the model can process in a single request.

Who created Grok 3?

Grok 3 was created by xAI. It is classified as a mid model in our catalogue.

Is Grok 3 open source?

No, Grok 3 is a proprietary model. It is available through xAI's API and compatible providers.