AMD Instinct MI300XvsNVIDIA H200 141GB
AMD Instinct MI300X vs NVIDIA H200 141GB: Specs, Benchmarks & Cloud Pricing
Full technical comparison of AMD Instinct MI300X and NVIDIA H200 141GB — VRAM, memory bandwidth, FP16 TFLOPS, TDP, and live cloud pricing across all providers. Updated July 2026.
Technical Specifications
Spec
AMD Instinct MI300X
NVIDIA H200 141GB
Architecture
CDNA 3
Hopper
VRAM
192 GB HBM3
141 GB HBM3e
Memory bandwidth
5,300 GB/s
4,800 GB/s
FP16 performance
1,307 TFLOPS
989 TFLOPS
TDP
750 W
700 W
NVLink support
No
Yes
Release year
2023
2024
Green = better value for that metric.
AMD Instinct MI300X
The AMD MI300X leads all GPUs on memory capacity (192GB HBM3) and bandwidth (5.3 TB/s), making it exceptional for serving very large language models that don't fit on H100.
Best For
- Memory-bound LLM inference
- Large model serving
- HPC
NVIDIA H200 141GB
The H200 upgrades the H100 with 141GB HBM3e memory and 4.8 TB/s bandwidth — a massive boost for memory-bound workloads like large LLM inference.
Best For
- Very large LLMs
- Memory-bound inference
- Multi-modal models