Real-time GPU & LLM price comparison
Compute Comparison aggregates live GPU cloud pricing and LLM inference costs so AI engineers, researchers, and teams can find the cheapest compute for their workload — without manually checking dozens of provider dashboards.
Why we built this
GPU compute pricing is fragmented across dozens of providers, each with different instance naming conventions, billing models, and regional availability. Finding the cheapest H100 for a training run used to mean opening 15 browser tabs.
We built Compute Comparison to solve that — a single place where you can compare on-demand and spot rates across every major GPU cloud, updated every 15 minutes.
The same problem exists for LLM inference APIs: token prices change frequently, new providers launch constantly, and the cheapest option for GPT-4-class capability shifts month to month. Our LLM price tracker covers 274+ models across 33+ providers so you can make cost-informed decisions.
Who uses Compute Comparison
How the data works
Methodology
How we define "live", what we include, and where the data comes from.
Provider pricing endpoints are polled on a 15-minute cycle. Each price record carries a fetched_at timestamp visible in the API response and shown in the "Updated" label on live tables.
"Live" refers to the most recent successful fetch from that provider's API or pricing page — not a real-time websocket stream. If a provider's endpoint is temporarily unreachable, the last known price is shown with a staleness indicator after 60 minutes.
LLM token prices are refreshed on the same 15-minute cycle. Model availability (whether a model is currently accepting requests) is not tracked — only the advertised price per million tokens.
GPU prices are sourced from provider REST APIs where available (Lambda Labs, CoreWeave, RunPod, Vast.ai, and others), and from structured pricing pages for providers without public APIs.
LLM inference prices are sourced from provider pricing pages and, where available, from OpenAI-compatible /models endpoints that return pricing metadata.
All prices are denominated in USD. Providers that publish in other currencies are converted at the daily exchange rate from a public FX feed.
Providers use inconsistent naming: AWS calls an H100 instance p5.48xlarge; Lambda calls it gpu_1x_h100_sxm5. We maintain a hand-curated mapping table that resolves these to a canonical GPU model name (e.g. NVIDIA H100 SXM5 80GB).
The mapping is updated manually when providers launch new instance types. If you spot a misclassification, let us know.
Multi-GPU instances (e.g. 8× H100) are normalised to a per-GPU hourly rate so they're directly comparable to single-GPU listings.
- Egress & storage costs — Data transfer and object storage fees vary widely and are not included in any price shown.
- Reserved / committed-use discounts — Prices shown are on-demand or spot rates. 1-year and 3-year reserved discounts are not tracked.
- Negotiated enterprise rates — Large-volume contracts are private. Actual enterprise pricing may be 20–50% below list.
- Networking & interconnect fees — InfiniBand, VPC peering, and cross-region transfer costs are excluded.
- Software licensing — Some providers bundle CUDA, drivers, or OS licensing into the hourly rate; others do not. We do not normalise for this.
| Data type | Refresh interval | Staleness threshold | Source type |
|---|---|---|---|
| GPU on-demand prices | 15 minutes | 60 minutes | Provider API / pricing page |
| GPU spot prices | 15 minutes | 60 minutes | Provider API |
| LLM token prices (input) | 15 minutes | 60 minutes | Provider pricing page / API |
| LLM token prices (output) | 15 minutes | 60 minutes | Provider pricing page / API |
| GPU price history | Daily snapshot at 00:00 UTC | 48 hours | Aggregated from intraday polls |
| LLM price history | Daily snapshot at 00:00 UTC | 48 hours | Aggregated from intraday polls |
| GPU specs (VRAM, TFLOPS, etc.) | Manual — updated on new GPU launch | N/A | Vendor datasheets |
Prices shown are estimates based on publicly available provider data and may not reflect negotiated enterprise rates, reserved instance discounts, or egress/storage costs. Always verify pricing directly with the provider before committing to a workload. Compute Comparison is not affiliated with any GPU cloud or LLM provider listed on this site.