Meta

Llama 4 Scout — Benchmark Scores, Pricing & Performance Analysis

OPEN SOURCEMeta
Chatbot Arena ELO
1240
Output Speed
140 tok/s
Input Cost
$0.10/1M
Output Cost
$0.30/1M
Context Window
1.3M
Max Output
16K
Knowledge Cutoff
Aug 2024
Accepts
text, image

Llama 4 Scout by Meta demonstrates competitive pricing. View detailed benchmark data including scores across coding, math, reasoning, speed, and cost metrics.

Specifications last checked against the provider on . Benchmark scores carry their own source, linked beside each number.

General Benchmarks

Chatbot Arena ELO
124059th of 74

Human preference ELO from blind head-to-head votes

LMSYS / HuggingFace
AA Intelligence Index
6.562nd of 66

Artificial Analysis composite intelligence score across 10 sub-benchmarks

Artificial Analysis (via OpenRouter)
MMLU-Pro
74.3%35th of 66

Massive Multitask Language Understanding professional benchmark

HuggingFace Leaderboard

Coding Benchmarks

Website Arena ELO
762108th of 108

Human preference ELO for building a working web page from a brief

Design Arena (via OpenRouter)
LiveCodeBench
32.0%52nd of 66

Live competitive programming benchmark

livecodebench.github.io
HumanEval+
75.0%56th of 66

Code generation correctness with extended tests

Papers
SWE-bench Verified
28.0%51st of 67

Real-world software engineering task resolution

swebench.com
AA Coding Index
8.293rd of 96

Artificial Analysis composite coding score

Artificial Analysis (via OpenRouter)
Design Arena ELO
811119th of 120

Human preference ELO for building things — websites, UI, games, charts, SVG

Design Arena (via OpenRouter)

Math Benchmarks

GSM8K
86.0%54th of 66

Grade school math word problems

Papers
MATH
68.0%52nd of 66

Competition mathematics problem solving

Papers

Reasoning Benchmarks

ARC-AGI
16.0%47th of 66

Abstraction and Reasoning Corpus for general intelligence

arcprize.org
GPQA Diamond
38.0%127th of 140

Graduate-level science Q&A by domain experts

Papers
AA Agentic Index
0.568th of 70

Artificial Analysis composite score for multi-step tool-using tasks

Artificial Analysis (via OpenRouter)

Speed Benchmarks

Time to First Token
330 ms30th of 92

Latency before first token arrives

Aggregated
Output Speed
140 tok/s22nd of 94

Tokens generated per second

Aggregated

Cost Benchmarks

Input Cost
$0.10114th of 413

Cost per 1M input tokens

OpenRouter API
Output Cost
$0.30127th of 413

Cost per 1M output tokens

OpenRouter API

Context Benchmarks

Context Length
1.3M4th of 451

Maximum context window size

OpenRouter API
RULER
80.2%11th of 13

Long-context understanding and retrieval accuracy at depth

Papers

Available from 2 providers

The same model costs different amounts depending on who serves it. You can bring your own key for 1 of these — connect it here.

ProviderInput / 1MOutput / 1MCached inContextYour key
NanoGPT$0.085$0.46$0.0425328K—
OpenRouter$0.1$0.3—1.3MSupported

Llama 4 Scout — Benchmark Scores Overview

Scores normalized to percentage scale for visual comparison. ELO scores mapped to 0-100 range (1100-1500).

Llama 4 Scout — Frequently Asked Questions

How intelligent is Llama 4 Scout?

Llama 4 Scout scores 1240 on the Chatbot Arena ELO rating, making it an entry-level AI model. This score is based on blind head-to-head human preference voting.

How much does Llama 4 Scout cost?

Llama 4 Scout costs $0.10 per 1M input tokens and $0.30 per 1M output tokens. This makes it one of the more affordable models.

How fast is Llama 4 Scout?

Llama 4 Scout generates output at 140 tokens per second, which is moderate compared to other models. The time to first token is 330 ms.

How good is Llama 4 Scout at coding?

Llama 4 Scout achieves 28.0% on SWE-bench Verified, demonstrating basic real-world software engineering capability. This benchmark tests the model's ability to resolve actual GitHub issues.

How good is Llama 4 Scout at math and reasoning?

Llama 4 Scout scores 68.0% on the MATH benchmark (competition-level mathematics). It also achieves 38.0% on GPQA Diamond, a graduate-level science reasoning benchmark.

What is the context window of Llama 4 Scout?

Llama 4 Scout has a context window of 1.3M tokens. This determines how much text, conversation history, and code the model can process in a single request.

Who created Llama 4 Scout?

Llama 4 Scout was created by Meta. It is classified as a open source model in our catalogue.

Is Llama 4 Scout open source?

Yes, Llama 4 Scout is an open-source model. The model weights are publicly available for download and self-hosting.