o1 Mini by OpenAI demonstrates strong general intelligence, outstanding mathematical reasoning. View detailed benchmark data including scores across coding, math, reasoning, speed, and cost metrics.
General Benchmarks
Human preference ELO from blind head-to-head votes
LMSYS / HuggingFaceMassive Multitask Language Understanding professional benchmark
HuggingFace LeaderboardCoding Benchmarks
Math Benchmarks
Reasoning Benchmarks
Speed Benchmarks
Cost Benchmarks
Context Benchmarks
o1 Mini — Benchmark Scores Overview
Scores normalized to percentage scale for visual comparison. ELO scores mapped to 0-100 range (1100-1500).
Compare o1 Mini With
o1 Mini — Frequently Asked Questions
How intelligent is o1 Mini?
o1 Mini scores 1300 on the Chatbot Arena ELO rating, making it a mid-tier AI model. This score is based on blind head-to-head human preference voting.
How much does o1 Mini cost?
o1 Mini costs $3.0 per 1M input tokens and $12.0 per 1M output tokens. This is mid-range pricing for its capability level.
How fast is o1 Mini?
o1 Mini generates output at 80 tokens per second, which is moderate compared to other models. The time to first token is 500 ms.
How good is o1 Mini at coding?
o1 Mini achieves 45.0% on SWE-bench Verified, demonstrating moderate real-world software engineering capability. This benchmark tests the model's ability to resolve actual GitHub issues.
How good is o1 Mini at math and reasoning?
o1 Mini scores 90.0% on the MATH benchmark (competition-level mathematics). It also achieves 60.0% on GPQA Diamond, a graduate-level science reasoning benchmark.
What is the context window of o1 Mini?
o1 Mini has a context window of 128K tokens. This determines how much text, conversation history, and code the model can process in a single request.
Who created o1 Mini?
o1 Mini was created by OpenAI. It is classified as a mid model in our catalogue.
Is o1 Mini open source?
No, o1 Mini is a proprietary model. It is available through OpenAI's API and compatible providers.