Overview
Strengths & Best For
AWS EC2 P5 instances are powered by NVIDIA H100 Tensor Core GPUs (up to 8× H100, 640 GB HBM3, 3,200 Gbps EFA networking). P5e and P5en instances use NVIDIA H200 GPUs (up to 8× H200, 1,128 GB HBM3e). P5en adds Gen5 PCIe and third-generation EFA for 35% lower latency. All three families deploy in EC2 UltraClusters scaling to 20,000 GPUs with petabit-scale nonblocking networking delivering 20 exaflops aggregate. SageMaker HyperPod manages resilient training clusters at any scale. Amazon Bedrock provides serverless access to DeepSeek v3.2, MiniMax, Kimi 3, Z.AI GLM 5, and Writer Palmyra. 30+ global regions with enterprise SLAs.
- P5/P5e/P5en: H100 and H200 in UltraClusters up to 20,000 GPUs
- 20 exaflops aggregate compute in EC2 UltraClusters
- 3,200 Gbps EFA networking with GPUDirect RDMA
- SageMaker HyperPod for resilient distributed training
- Amazon Bedrock: serverless access to DeepSeek, MiniMax, Kimi, GLM, Palmyra
- 30+ global regions with enterprise SLAs and compliance certifications
- Highest on-demand GPU rates among all providers
- Complex pricing — on-demand vs reserved vs spot vs savings plans
- GPU quota increases require support tickets and can take days
No reviews yet — add yours ↗
RunPod is an AI developer cloud trusted by 1M+ developers, offering Pods (on-demand GPU instances), Serverless (autoscaling endpoints that scale to zero), and Clusters (multi-node distributed training) — all in one account. GPU catalog: B300, B200, H200, RTX PRO 6000, H100 NVL, H100 PCIe, H100 SXM, A100, L40S, RTX 4090, RTX 5090. Serverless and Clusters also available. Public Endpoints for instant model access. 31 global regions. SOC 2 Type II, HIPAA, GDPR compliant.
- B300, H200 — competitive Blackwell and Hopper pricing
- RTX 5090 and RTX 4090 for budget inference
- Serverless with sub-200ms cold starts (FlashBoot) and zero idle cost
- Pods + Serverless + Clusters + Public Endpoints in one account
- SOC 2 Type II, HIPAA, GDPR compliant
- 31 global regions with per-second billing
- Community cloud tier hardware quality varies by host
- Secure Cloud (network-isolated) costs more than community tier
- Support response times slower on lower tiers
Affiliate link — we may earn a commission.
No reviews yet — add yours ↗
Live GPU Pricing
Region Coverage
Popular Comparisons
Provider pages
More AWS comparisons
Key differences
AWS
P5 (H100), P5e/P5en (H200), UltraClusters up to 20,000 GPUs — hyperscale AI infrastructure
RunPod
B300, H200, B200 — Pods, Serverless, and Clusters in one platform