Claude 3.5 Haiku by Anthropic demonstrates fast output speed. View detailed benchmark data including scores across coding, math, reasoning, speed, and cost metrics.
General Benchmarks
Human preference ELO from blind head-to-head votes
LMSYS / HuggingFaceMassive Multitask Language Understanding professional benchmark
HuggingFace LeaderboardCoding Benchmarks
Math Benchmarks
Reasoning Benchmarks
Speed Benchmarks
Cost Benchmarks
Context Benchmarks
Available from 3 providers
The same model costs different amounts depending on who serves it.
| Provider | Input / 1M | Output / 1M | Cached in | Context | Your key |
|---|---|---|---|---|---|
| DigitalOcean | $0.8 | $4 | $0.08 | 200K | — |
| ZenMux | $0.8 | $4 | $0.08 | 200K | — |
| Qiniu | — | — | — | 200K | — |
Claude 3.5 Haiku — Benchmark Scores Overview
Scores normalized to percentage scale for visual comparison. ELO scores mapped to 0-100 range (1100-1500).
Compare Claude 3.5 Haiku With
Claude 3.5 Haiku — Frequently Asked Questions
How intelligent is Claude 3.5 Haiku?
Claude 3.5 Haiku scores 1180 on the Chatbot Arena ELO rating, making it an entry-level AI model. This score is based on blind head-to-head human preference voting.
How much does Claude 3.5 Haiku cost?
Claude 3.5 Haiku costs $0.80 per 1M input tokens and $4.0 per 1M output tokens. This is mid-range pricing for its capability level.
How fast is Claude 3.5 Haiku?
Claude 3.5 Haiku generates output at 170 tokens per second, which is very fast compared to other models. The time to first token is 100 ms.
How good is Claude 3.5 Haiku at coding?
Claude 3.5 Haiku achieves 22.0% on SWE-bench Verified, demonstrating basic real-world software engineering capability. This benchmark tests the model's ability to resolve actual GitHub issues.
How good is Claude 3.5 Haiku at math and reasoning?
Claude 3.5 Haiku scores 62.0% on the MATH benchmark (competition-level mathematics). It also achieves 35.0% on GPQA Diamond, a graduate-level science reasoning benchmark.
What is the context window of Claude 3.5 Haiku?
Claude 3.5 Haiku has a context window of 200K tokens. This determines how much text, conversation history, and code the model can process in a single request.
Who created Claude 3.5 Haiku?
Claude 3.5 Haiku was created by Anthropic. It is classified as a budget model in our catalogue.
Is Claude 3.5 Haiku open source?
No, Claude 3.5 Haiku is a proprietary model. It is available through Anthropic's API and compatible providers.