MI300X 192GB
See rental prices ↓Current median: $3.56/hr across 5 providers (observed), 0.00 (0.0%) vs yesterday. Typical range: $2.15–$20.32/hr (P10–P90). 30-day trend unlocks after 30 days of captures
TDP 750W · 1307 TFLOPS · 192GB VRAM · 5300 GB/s bandwidth
The MI300X 192GB has a 750W TDP, 1307 TFLOPS of FP16 compute, 192GB of HBM3 VRAM, 5300 GB/s memory bandwidth.
AMD's flagship AI GPU. 192GB HBM3 — most VRAM of any single GPU at launch. Strong ROCm software stack. Widely available across major cloud providers.
MI300X 192GB currently rents for a median of $3.56/hr across 5 providers (observed on-demand prices). MI300X 192GB has 192GB of memory. Compare its specs and listed cloud rental prices below. The workload must fit in VRAM with room for runtime memory; a listed price does not confirm stock.
MI300X 192GB Overview
AMD’s MI300X is a CDNA 3 accelerator built around 192GB of HBM3, giving it one of the largest single-accelerator memory pools available. It delivers 1,307 TFLOPS of FP16/BF16 performance and targets large language-model training and inference through the ROCm ecosystem.
Its 5,300 GB/s memory bandwidth is a defining advantage for memory-bound LLM serving, and 192GB can hold very large quantized models or extensive KV cache without immediately requiring tensor parallelism. The platform uses Infinity Fabric and PCIe rather than NVIDIA NVLink, so distributed scaling and software tuning follow a different stack.
MI300X is especially compelling for large-context, open-source model serving and memory-heavy training where its capacity can reduce GPU count. The trade-off is ROCm compatibility: teams must verify kernels, inference engines, and operational tooling rather than assuming CUDA-oriented software will transfer unchanged.
Memory
Compute Performance
Hardware Specifications
Chip
Clocks
Memory
Power
Relative Performance
Relative to highest-spec GPU in database
Limitations
Live Cloud PricingOn-demand hourly rates
| Provider | On-Demand | Spot | Region | Availability |
|---|---|---|---|---|
BESTFluidStack | $31.50/hr | — | EU/US | unknown |
| $3.56/hr | — | US-West | unknown | |
| $1.99/hr | — | US | unknown | |
| $3.56/hr | — | Various | unknown | |
| $2.39/hr | — | US | unknown | |
| $1.85/hr | — | US/EU/APAC | unknown | |
| $3.45/hr | — | us-east1 | unknown |
Job Cost Estimator
At median $3.56/hr across 5 providers (observed on-demand). Spot pricing typically 40–70% lower.
Estimates only. Actual cost depends on provider, region, availability, and utilization. Use the GPU cost calculator for custom inputs.
Compare MI300X 192GB vs…
Use Case Guidance
LLM Model Size Guidance
Estimates only. Actual capacity depends on context length, KV cache, and framework overhead.
Related Guides
LLM APIs Running on This GPU Class
Providers that serve frontier LLM inference on CDNA 3-class hardware.
MI300X 192GB vs Alternatives — Spec Comparison
| Spec | MI300X 192GB this | MI300X 192GB | MI355X | MI355X 288GB |
|---|---|---|---|---|
| VRAM | 192GB HBM3 | 192GB HBM3 | 288GB HBM3e▲ | 288GB HBM3e▲ |
| Memory Bandwidth | 5300 GB/s | 5300 GB/s | 8000 GB/s▲ | 8000 GB/s▲ |
| FP16 TFLOPS | 1307▲ | 1307▲ | 1300 | 1300 |
| BF16 TFLOPS | 1307▲ | 1307▲ | 1300 | 1300 |
| FP8 TFLOPS | 2614▲ | 2614▲ | 2600 | 2600 |
| INT8 TOPS | 2614▲ | 2614▲ | 2600 | 2600 |
| TDP | 750W▲ | 750W▲ | 750W▲ | 750W▲ |
| Process Node | TSMC 5nm / 6nm▲ | TSMC 5nm / 6nm▲ | TSMC 3nm | TSMC 3nm |
| Architecture | Aqua Vanjaram | Aqua Vanjaram | Antares | Antares |
| Release Year | 2023 | 2023 | 2025▲ | 2025▲ |
| Max model (FP16) | ~96B params | ~96B params | ~144B params▲ | ~144B params▲ |
| Max model (INT4) | ~384B params | ~384B params | ~576B params▲ | ~576B params▲ |
Related GPUs
MI300X 192GB Frequently Asked Questions
What is the MI300X 192GB TDP?
The MI300X 192GB has a TDP (Thermal Design Power) of 750W.
How many TFLOPS does the MI300X 192GB have?
The MI300X 192GB delivers 1307 TFLOPS of FP16 compute and 1307 TFLOPS BF16, and 2614 TFLOPS FP8.
How much VRAM does the MI300X 192GB have?
The MI300X 192GB has 192GB of HBM3 VRAM.
What is the MI300X 192GB's memory bandwidth?
The MI300X 192GB has a memory bandwidth of 5300 GB/s.
MI300X 192GB User Reviews
MI300X 192GB User Reviews
Ready to rent?
Compare MI300X 192GB prices across 130+ providers
Live on-demand & spot rates · monthly cost estimates · availability status