Cohere Model Pricing & Calculator Open-Weight / Self-Hostable

Cohere: Command R (08-2024) API Cost Calculator

command-r-08-2024 is an update of the [Command R](/models/cohere/command-r) with improved performance for multilingual retrieval-augmented generation (RAG) and tool use. More broadly, it is better at math, code and reasoning and...

Interactive Monthly Spend Estimator

Adjust sliders to calculate your daily and monthly bill for Cohere: Command R (08-2024).

Estimated Daily API Cost $0.00
Estimated Monthly API Cost (30 days) $0.00
24/7 Dedicated NVIDIA A100 (80GB VRAM) Self-Host Cost $1,000.80/mo

Official Token Pricing & Specs

Model ID cohere/command-r-08-2024
Provider Cohere
Weight Availability Open-Weight (Downloadable GGUF / Safetensors)
Input Price (per 1M tokens) $0.15
Output Price (per 1M tokens) $0.60
Max Context Window 128,000 tokens
VRAM Needed (4-Bit Q4 / FP16) 22.8 GB / 77.0 GB โ†’
API vs. GPU Daily Break-Even ~117.1M tokens/day
Deploy on RunPod (From $0.20/hr) Rent GPUs on Vast.ai (Save up to 70%)
Best for Serverless & Dedicated AI GPUs

Stop Overpaying for High-Volume AI Inference

Running Cohere: Command R (08-2024) at scale? Deploy pre-configured vLLM or Ollama pods on dedicated H100, A100, or RTX 4090 GPUs by the second.

Deploy on RunPod (From $0.20/hr) โ†’

๐Ÿš€ Deploy & Run Commands (Ollama, vLLM & Cloud GPU Docker)

Recommended TP: 1x GPU

Copy and paste to run Cohere: Command R (08-2024) locally or launch an OpenAI-compatible API server on a Cloud GPU pod:

1. Ollama (Local 4-Bit GGUF)
ollama run command-r:35b
2. vLLM (OpenAI-Compatible Production API)
vllm serve CohereForAI/c4ai-command-r-v01 --max-model-len 32768 --tensor-parallel-size 1 --gpu-memory-utilization 0.92
3. Docker / Cloud GPU Pod (RunPod & Vast.ai)
docker run --gpus all -p 8000:8000 --ipc=host vllm/vllm-openai:latest --model CohereForAI/c4ai-command-r-v01 --tensor-parallel-size 1
4. Local GPU Compatibility CLI Check (Detects nvidia-smi / Apple Silicon)
curl -sL https://stigla610.github.io/ai-cost-engine/tokenbench.py | python3 -
Launch vLLM / Ollama Template on RunPod โ†’ Rent Cheap GPUs on Vast.ai โ†’

Compare Cohere: Command R (08-2024) With Other Popular Models