Cohere Model Pricing & Calculator Open-Weight / Self-Hostable

Cohere: Command R+ (08-2024) API Cost Calculator

command-r-plus-08-2024 is an update of the [Command R+](/models/cohere/command-r-plus) with roughly 50% higher throughput and 25% lower latencies as compared to the previous Command R+ version, while keeping the hardware footprint...

Interactive Monthly Spend Estimator

Adjust sliders to calculate your daily and monthly bill for Cohere: Command R+ (08-2024).

Estimated Daily API Cost $0.00
Estimated Monthly API Cost (30 days) $0.00
24/7 Dedicated 2x NVIDIA H100 (160GB VRAM) Self-Host Cost $3,873.60/mo

Official Token Pricing & Specs

Model ID cohere/command-r-plus-08-2024
Provider Cohere
Weight Availability Open-Weight (Downloadable GGUF / Safetensors)
Input Price (per 1M tokens) $2.50
Output Price (per 1M tokens) $10.00
Max Context Window 128,000 tokens
VRAM Needed (4-Bit Q4 / FP16) 67.6 GB / 228.8 GB โ†’
API vs. GPU Daily Break-Even ~27.2M tokens/day
Deploy on RunPod (From $0.20/hr) Rent GPUs on Vast.ai (Save up to 70%)
Best for Serverless & Dedicated AI GPUs

Stop Overpaying for High-Volume AI Inference

Running Cohere: Command R+ (08-2024) at scale? Deploy pre-configured vLLM or Ollama pods on dedicated H100, A100, or RTX 4090 GPUs by the second.

Deploy on RunPod (From $0.20/hr) โ†’

๐Ÿš€ Deploy & Run Commands (Ollama, vLLM & Cloud GPU Docker)

Recommended TP: 1x GPU

Copy and paste to run Cohere: Command R+ (08-2024) locally or launch an OpenAI-compatible API server on a Cloud GPU pod:

1. Ollama (Local 4-Bit GGUF)
ollama run command-r-plus:104b
2. vLLM (OpenAI-Compatible Production API)
vllm serve CohereForAI/c4ai-command-r-plus --max-model-len 32768 --tensor-parallel-size 1 --gpu-memory-utilization 0.92
3. Docker / Cloud GPU Pod (RunPod & Vast.ai)
docker run --gpus all -p 8000:8000 --ipc=host vllm/vllm-openai:latest --model CohereForAI/c4ai-command-r-plus --tensor-parallel-size 1
4. Local GPU Compatibility CLI Check (Detects nvidia-smi / Apple Silicon)
curl -sL https://stigla610.github.io/ai-cost-engine/tokenbench.py | python3 -
Launch vLLM / Ollama Template on RunPod โ†’ Rent Cheap GPUs on Vast.ai โ†’

Compare Cohere: Command R+ (08-2024) With Other Popular Models