Google

Gemini 2.0 Flash — Benchmark Scores, Pricing & Performance Analysis

BUDGETGoogle
Chatbot Arena ELO
1240
Output Speed
220 tok/s
Input Cost
$0.10/1M
Output Cost
$0.40/1M
Context Window
1.0M

Gemini 2.0 Flash by Google demonstrates fast output speed, competitive pricing. View detailed benchmark data including scores across coding, math, reasoning, speed, and cost metrics.

General Benchmarks

MMLU-Pro
66.0%53rd of 66

Massive Multitask Language Understanding professional benchmark

HuggingFace Leaderboard
Chatbot Arena ELO
124059th of 74

Human preference ELO from blind head-to-head votes

LMSYS / HuggingFace
IFEval
86.6%19th of 25

Strict instruction following accuracy on verifiable constraints

Google Research
AlpacaEval 2.0
51.5%7th of 10

Instruction following quality scored by GPT-4 as judge

tatsu-lab
SimpleQA
27.5%9th of 14

Factual accuracy on short, verifiable questions

OpenAI
TruthfulQA
80.5%8th of 13

Resistance to generating false but plausible answers

Papers
MT-Bench
8.97th of 13

Multi-turn conversation quality on 80 curated dialogues

LMSYS

Coding Benchmarks

LiveCodeBench
32.0%52nd of 66

Live competitive programming benchmark

livecodebench.github.io
HumanEval+
76.0%55th of 66

Code generation correctness with extended tests

Papers
SWE-bench Verified
28.0%51st of 67

Real-world software engineering task resolution

swebench.com

Math Benchmarks

MATH
68.0%52nd of 66

Competition mathematics problem solving

Papers
GSM8K
86.0%54th of 66

Grade school math word problems

Papers

Reasoning Benchmarks

GPQA Diamond
38.0%127th of 140

Graduate-level science Q&A by domain experts

Papers
ARC-AGI
18.0%44th of 66

Abstraction and Reasoning Corpus for general intelligence

arcprize.org
Winogrande
89.5%8th of 14

Commonsense reasoning via pronoun resolution

Papers
BBH
84.2%10th of 13

Big-Bench Hard — 23 challenging multi-step reasoning tasks

Google Research

Speed Benchmarks

Time to First Token
85 ms3rd of 92

Latency before first token arrives

Aggregated
Output Speed
220 tok/s7th of 94

Tokens generated per second

Aggregated

Cost Benchmarks

Output Cost
$0.40143rd of 413

Cost per 1M output tokens

OpenRouter API
Input Cost
$0.10126th of 413

Cost per 1M input tokens

OpenRouter API

Context Benchmarks

Context Length
1.0M18th of 451

Maximum context window size

OpenRouter API
RULER
85.5%8th of 13

Long-context understanding and retrieval accuracy at depth

Papers

Multimodal Benchmarks

MathVista
73.1%6th of 14

Visual mathematical reasoning across diagrams and charts

Papers

Available from 2 providers

The same model costs different amounts depending on who serves it.

ProviderInput / 1MOutput / 1MCached inContextYour key
Poe$0.1$0.42—990K—
Qiniu———1.0M—

Gemini 2.0 Flash — Benchmark Scores Overview

Scores normalized to percentage scale for visual comparison. ELO scores mapped to 0-100 range (1100-1500).

Gemini 2.0 Flash — Frequently Asked Questions

How intelligent is Gemini 2.0 Flash?

Gemini 2.0 Flash scores 1240 on the Chatbot Arena ELO rating, making it an entry-level AI model. This score is based on blind head-to-head human preference voting.

How much does Gemini 2.0 Flash cost?

Gemini 2.0 Flash costs $0.10 per 1M input tokens and $0.40 per 1M output tokens. This makes it one of the more affordable models.

How fast is Gemini 2.0 Flash?

Gemini 2.0 Flash generates output at 220 tokens per second, which is very fast compared to other models. The time to first token is 85 ms.

How good is Gemini 2.0 Flash at coding?

Gemini 2.0 Flash achieves 28.0% on SWE-bench Verified, demonstrating basic real-world software engineering capability. This benchmark tests the model's ability to resolve actual GitHub issues.

How good is Gemini 2.0 Flash at math and reasoning?

Gemini 2.0 Flash scores 68.0% on the MATH benchmark (competition-level mathematics). It also achieves 38.0% on GPQA Diamond, a graduate-level science reasoning benchmark.

What is the context window of Gemini 2.0 Flash?

Gemini 2.0 Flash has a context window of 1.0M tokens. This determines how much text, conversation history, and code the model can process in a single request.

Who created Gemini 2.0 Flash?

Gemini 2.0 Flash was created by Google. It is classified as a budget model in our catalogue.

Is Gemini 2.0 Flash open source?

No, Gemini 2.0 Flash is a proprietary model. It is available through Google's API and compatible providers.