Meta

Llama 3.3 70B — Benchmark Scores, Pricing & Performance Analysis

OPEN SOURCEMeta
Chatbot Arena ELO
1210
Output Speed
90 tok/s
Input Cost
$0.10/1M
Output Cost
$0.32/1M
Context Window
131K
Max Output
16K
Knowledge Cutoff
Dec 2023
Accepts
text

Llama 3.3 70B by Meta demonstrates competitive pricing. View detailed benchmark data including scores across coding, math, reasoning, speed, and cost metrics.

Specifications last checked against the provider on . Benchmark scores carry their own source, linked beside each number.

General Benchmarks

Chatbot Arena ELO
121066th of 74

Human preference ELO from blind head-to-head votes

LMSYS / HuggingFace
MMLU-Pro
60.0%60th of 66

Massive Multitask Language Understanding professional benchmark

HuggingFace Leaderboard
SimpleQA
21.0%11th of 14

Factual accuracy on short, verifiable questions

OpenAI
TruthfulQA
73.5%13th of 13

Resistance to generating false but plausible answers

Papers
MT-Bench
8.612th of 13

Multi-turn conversation quality on 80 curated dialogues

LMSYS
AlpacaEval 2.0
39.3%9th of 10

Instruction following quality scored by GPT-4 as judge

tatsu-lab

Coding Benchmarks

SWE-bench Verified
22.0%57th of 67

Real-world software engineering task resolution

swebench.com
AA Coding Index
11.987th of 96

Artificial Analysis composite coding score

Artificial Analysis (via OpenRouter)
LiveCodeBench
26.0%60th of 66

Live competitive programming benchmark

livecodebench.github.io
HumanEval+
72.0%58th of 66

Code generation correctness with extended tests

Papers

Math Benchmarks

GSM8K
82.0%60th of 66

Grade school math word problems

Papers
MATH
60.0%60th of 66

Competition mathematics problem solving

Papers

Reasoning Benchmarks

ARC-AGI
10.0%57th of 66

Abstraction and Reasoning Corpus for general intelligence

arcprize.org
GPQA Diamond
34.0%131st of 140

Graduate-level science Q&A by domain experts

Papers
Winogrande
85.5%14th of 14

Commonsense reasoning via pronoun resolution

Papers
BBH
81.5%13th of 13

Big-Bench Hard — 23 challenging multi-step reasoning tasks

Google Research

Speed Benchmarks

Time to First Token
300 ms24th of 92

Latency before first token arrives

Aggregated
Output Speed
90 tok/s37th of 94

Tokens generated per second

Aggregated

Cost Benchmarks

Output Cost
$0.32137th of 413

Cost per 1M output tokens

OpenRouter API
Input Cost
$0.10114th of 413

Cost per 1M input tokens

OpenRouter API

Context Benchmarks

Context Length
131K212th of 451

Maximum context window size

OpenRouter API

Multimodal Benchmarks

MathVista
58.2%14th of 14

Visual mathematical reasoning across diagrams and charts

Papers

Available from 6 providers

The same model costs different amounts depending on who serves it. You can bring your own key for 2 of these — connect it here.

ProviderInput / 1MOutput / 1MCached inContextYour key
STACKIT$0.53$0.76—128K—
Groq$0.59$0.79—131KSupported
Venice AI$0.7$2.8—128K—
Weights & Biases$0.71$0.71$0.71128K—
Together AI$1.04$1.04—131KSupported
NanoGPT$1.75$2.75$1.75128K—

Llama 3.3 70B — Benchmark Scores Overview

Scores normalized to percentage scale for visual comparison. ELO scores mapped to 0-100 range (1100-1500).

Llama 3.3 70B — Frequently Asked Questions

How intelligent is Llama 3.3 70B?

Llama 3.3 70B scores 1210 on the Chatbot Arena ELO rating, making it an entry-level AI model. This score is based on blind head-to-head human preference voting.

How much does Llama 3.3 70B cost?

Llama 3.3 70B costs $0.10 per 1M input tokens and $0.32 per 1M output tokens. This makes it one of the more affordable models.

How fast is Llama 3.3 70B?

Llama 3.3 70B generates output at 90 tokens per second, which is moderate compared to other models. The time to first token is 300 ms.

How good is Llama 3.3 70B at coding?

Llama 3.3 70B achieves 22.0% on SWE-bench Verified, demonstrating basic real-world software engineering capability. This benchmark tests the model's ability to resolve actual GitHub issues.

How good is Llama 3.3 70B at math and reasoning?

Llama 3.3 70B scores 60.0% on the MATH benchmark (competition-level mathematics). It also achieves 34.0% on GPQA Diamond, a graduate-level science reasoning benchmark.

What is the context window of Llama 3.3 70B?

Llama 3.3 70B has a context window of 131K tokens. This determines how much text, conversation history, and code the model can process in a single request.

Who created Llama 3.3 70B?

Llama 3.3 70B was created by Meta. It is classified as a open source model in our catalogue.

Is Llama 3.3 70B open source?

Yes, Llama 3.3 70B is an open-source model. The model weights are publicly available for download and self-hosting.