Cohere

Command R+ — Benchmark Scores, Pricing & Performance Analysis

FLAGSHIPCohere
Chatbot Arena ELO
1200
Output Speed
60 tok/s
Input Cost
$2.5/1M
Output Cost
$10.0/1M
Context Window
128K
Max Output
4K
Knowledge Cutoff
Mar 2024
Accepts
text

Command R+ is an AI model by Cohere. View detailed benchmark scores, pricing data, and performance metrics on Serenities AI Models.

Specifications last checked against the provider on . Benchmark scores carry their own source, linked beside each number.

General Benchmarks

Chatbot Arena ELO
120067th of 74

Human preference ELO from blind head-to-head votes

LMSYS / HuggingFace
MMLU-Pro
62.0%58th of 66

Massive Multitask Language Understanding professional benchmark

HuggingFace Leaderboard
AlpacaEval 2.0
33.0%10th of 10

Instruction following quality scored by GPT-4 as judge

tatsu-lab

Coding Benchmarks

LiveCodeBench
25.0%61st of 66

Live competitive programming benchmark

livecodebench.github.io
HumanEval+
72.0%58th of 66

Code generation correctness with extended tests

Papers
SWE-bench Verified
20.0%61st of 67

Real-world software engineering task resolution

swebench.com

Math Benchmarks

GSM8K
82.0%60th of 66

Grade school math word problems

Papers
MATH
60.0%60th of 66

Competition mathematics problem solving

Papers

Reasoning Benchmarks

ARC-AGI
8.0%60th of 66

Abstraction and Reasoning Corpus for general intelligence

arcprize.org
GPQA Diamond
35.0%129th of 140

Graduate-level science Q&A by domain experts

Papers

Speed Benchmarks

Time to First Token
450 ms52nd of 92

Latency before first token arrives

Aggregated
Output Speed
60 tok/s65th of 94

Tokens generated per second

Aggregated

Cost Benchmarks

Output Cost
$10.0335th of 413

Cost per 1M output tokens

OpenRouter API
Input Cost
$2.5361st of 413

Cost per 1M input tokens

OpenRouter API

Context Benchmarks

Context Length
128K267th of 451

Maximum context window size

OpenRouter API

Available from 5 providers

The same model costs different amounts depending on who serves it. You can bring your own key for 2 of these — connect it here.

ProviderInput / 1MOutput / 1MCached inContextYour key
Cohere$0.15$0.6—128KSupported
Eden AI$0.15$0.6—128K—
Kilo Gateway$0.15$0.6—128K—
OpenRouter$0.15$0.6—128KSupported
AnyAPI———128K—

Command R+ — Benchmark Scores Overview

Scores normalized to percentage scale for visual comparison. ELO scores mapped to 0-100 range (1100-1500).

Command R+ — Frequently Asked Questions

How intelligent is Command R+?

Command R+ scores 1200 on the Chatbot Arena ELO rating, making it an entry-level AI model. This score is based on blind head-to-head human preference voting.

How much does Command R+ cost?

Command R+ costs $2.5 per 1M input tokens and $10.0 per 1M output tokens. This is mid-range pricing for its capability level.

How fast is Command R+?

Command R+ generates output at 60 tokens per second, which is slower, prioritizing quality over speed compared to other models. The time to first token is 450 ms.

How good is Command R+ at coding?

Command R+ achieves 20.0% on SWE-bench Verified, demonstrating basic real-world software engineering capability. This benchmark tests the model's ability to resolve actual GitHub issues.

How good is Command R+ at math and reasoning?

Command R+ scores 60.0% on the MATH benchmark (competition-level mathematics). It also achieves 35.0% on GPQA Diamond, a graduate-level science reasoning benchmark.

What is the context window of Command R+?

Command R+ has a context window of 128K tokens. This determines how much text, conversation history, and code the model can process in a single request.

Who created Command R+?

Command R+ was created by Cohere. It is classified as a flagship model in our catalogue.

Is Command R+ open source?

No, Command R+ is a proprietary model. It is available through Cohere's API and compatible providers.