xAI

Grok 4 — Benchmark Scores, Pricing & Performance Analysis

FLAGSHIPxAI
Chatbot Arena ELO
1430
Output Speed
55 tok/s
Input Cost
$3.0/1M
Output Cost
$15.0/1M
Context Window
256K

Grok 4 by xAI demonstrates top-tier general intelligence, excellent coding ability, outstanding mathematical reasoning. View detailed benchmark data including scores across coding, math, reasoning, speed, and cost metrics.

General Benchmarks

Chatbot Arena ELO
143013th of 74

Human preference ELO from blind head-to-head votes

LMSYS / HuggingFace
MMLU-Pro
87.0%5th of 66

Massive Multitask Language Understanding professional benchmark

HuggingFace Leaderboard

Coding Benchmarks

Design Arena ELO
107393rd of 120

Human preference ELO for building things — websites, UI, games, charts, SVG

Design Arena (via OpenRouter)
Website Arena ELO
105691st of 108

Human preference ELO for building a working web page from a brief

Design Arena (via OpenRouter)
LiveCodeBench
65.0%12th of 66

Live competitive programming benchmark

livecodebench.github.io
HumanEval+
90.0%11th of 66

Code generation correctness with extended tests

Papers
SWE-bench Verified
72.0%16th of 67

Real-world software engineering task resolution

swebench.com
Aider Polyglot
79.6%1st of 8

Multi-language code editing accuracy with real git repos

aider.chat

Math Benchmarks

GSM8K
97.0%11th of 66

Grade school math word problems

Papers
MATH
91.0%15th of 66

Competition mathematics problem solving

Papers
AIME 2025
93.0%10th of 17

American Invitational Mathematics Examination — competition math

Papers

Reasoning Benchmarks

ARC-AGI
50.0%10th of 66

Abstraction and Reasoning Corpus for general intelligence

arcprize.org
GPQA Diamond
87.0%24th of 140

Graduate-level science Q&A by domain experts

Papers

Speed Benchmarks

Time to First Token
500 ms59th of 92

Latency before first token arrives

Aggregated
Output Speed
55 tok/s75th of 94

Tokens generated per second

Aggregated

Cost Benchmarks

Input Cost
$3.0372nd of 413

Cost per 1M input tokens

OpenRouter API
Output Cost
$15.0370th of 413

Cost per 1M output tokens

OpenRouter API

Context Benchmarks

Context Length
256K156th of 451

Maximum context window size

OpenRouter API

Available from 6 providers

The same model costs different amounts depending on who serves it.

ProviderInput / 1MOutput / 1MCached inContextYour key
Abacus$3$15—256K—
DevPass (LLM Gateway)$3$15$0.75256K—
FastRouter$3$15$0.75256K—
LLM Gateway$3$15$0.75256K—
Poe$3$15$0.75256K—
ZenMux$3$15$0.75256K—

Grok 4 — Benchmark Scores Overview

Scores normalized to percentage scale for visual comparison. ELO scores mapped to 0-100 range (1100-1500).

Grok 4 — Frequently Asked Questions

How intelligent is Grok 4?

Grok 4 scores 1430 on the Chatbot Arena ELO rating, making it a high-performing AI model. This score is based on blind head-to-head human preference voting.

How much does Grok 4 cost?

Grok 4 costs $3.0 per 1M input tokens and $15.0 per 1M output tokens. This is mid-range pricing for its capability level.

How fast is Grok 4?

Grok 4 generates output at 55 tokens per second, which is slower, prioritizing quality over speed compared to other models. The time to first token is 500 ms.

How good is Grok 4 at coding?

Grok 4 achieves 72.0% on SWE-bench Verified, demonstrating excellent real-world software engineering capability. This benchmark tests the model's ability to resolve actual GitHub issues.

How good is Grok 4 at math and reasoning?

Grok 4 scores 91.0% on the MATH benchmark (competition-level mathematics). It also achieves 87.0% on GPQA Diamond, a graduate-level science reasoning benchmark.

What is the context window of Grok 4?

Grok 4 has a context window of 256K tokens. This determines how much text, conversation history, and code the model can process in a single request.

Who created Grok 4?

Grok 4 was created by xAI. It is classified as a flagship model in our catalogue.

Is Grok 4 open source?

No, Grok 4 is a proprietary model. It is available through xAI's API and compatible providers.