Rent MI300X 192GB
Compare live on-demand and spot rental prices across 97+ cloud providers. AMD's flagship AI GPU. 192GB HBM3 — most VRAM of any single GPU at launch. Strong ROCm software stack. Widely available across major cloud providers.
Choosing the right billing model for MI300X 192GB
Provision and terminate at any time. Ideal for development, short experiments, and workloads with unpredictable duration.
Instances can be reclaimed when demand spikes. Best for fault-tolerant batch jobs, training with checkpointing, and preprocessing.
Lock in a rate for 1–3 months. Right for sustained production inference or long training runs where cost predictability matters.
Best use cases
- Memory-bound LLM inference
- Large context windows
- Open-source model serving
MI300X 192GB — Specs & Benchmarks
Performance bars, compute tiers (FP32/FP16/BF16/FP8/INT8), memory specs, LLM model size guidance, and related GPU comparisons.
MI300X 192GB Rental Guide
Rent MI300X when model size or context cache makes 80GB-class NVIDIA cards inefficient and your stack is ready for ROCm. Its 192GB HBM3 can improve both deployment simplicity and throughput for memory-bound workloads, provided the model and serving framework are validated on AMD hardware.
Spot capacity is well suited to batch inference, data preparation, and restartable training with robust checkpoints. Use on-demand or reserved MI300X systems for steady production services after confirming ROCm versions and provider images, since availability and software support vary more than for CUDA instances.
Compare it with H200 for CUDA ecosystem maturity and with B200 for next-generation NVIDIA throughput. MI300X can win on memory-per-GPU and bandwidth for suitable workloads, but a lower hourly rate does not offset engineering work if critical kernels, libraries, or observability integrations are CUDA-only.
Frequently Asked Questions
How much does it cost to rent a MI300X 192GB?
MI300X 192GB on-demand rental prices vary by provider and region. On-demand rates typically range based on availability and provider margins — use the comparison table above to see current live rates across all providers. Spot instances are generally 40–70% cheaper than on-demand but can be interrupted. Monthly cost estimates (hourly rate × 730 hours) are shown in the table for sustained workloads.
Which cloud provider has the cheapest MI300X 192GB?
The cheapest MI300X 192GB provider changes as providers update their pricing. The comparison table above shows live rates sorted by price, so the cheapest option is always at the top. Factors beyond headline price include region (latency to your users), availability (high/medium/low), and billing granularity (per-second vs per-hour minimums).
What can I run on a MI300X 192GB?
With 192GB of HBM3, the MI300X 192GB can run LLM models up to approximately 96B parameters at FP16, 192B at INT8, or 384B at INT4/GGUF quantization. Common workloads include: Memory-bound LLM inference, Large context windows, Open-source model serving. AMD's flagship AI GPU. 192GB HBM3 — most VRAM of any single GPU at launch. Strong ROCm software stack. Widely available across major cloud providers.
Should I use on-demand or spot pricing for MI300X 192GB?
Spot instances save 40–70% vs on-demand but can be interrupted when the provider needs capacity back. Use spot for: batch inference jobs, training runs with checkpointing, preprocessing pipelines, and any workload that can tolerate interruption and restart. Use on-demand for: production inference serving, interactive workloads, and jobs that cannot be interrupted. Most providers bill per second, so short on-demand jobs are not penalized by hourly minimums.
How does the MI300X 192GB compare to the H100 for cloud rental?
The H100 80GB delivers 1,979 TFLOPS FP16 with 3,350 GB/s HBM3 bandwidth, compared to the MI300X 192GB's 1307 TFLOPS FP16 and 5300 GB/s bandwidth. The H100 is significantly more expensive — typically $2.50–$5.00/hr vs lower rates for the MI300X 192GB. For workloads that fit within 192GB and don't require FP8 precision, the MI300X 192GB often delivers better cost-per-token than the H100.
What is the memory bandwidth of the MI300X 192GB and why does it matter?
The MI300X 192GB has 5300 GB/s of memory bandwidth. For LLM inference, memory bandwidth is often more important than raw TFLOPS — each autoregressive token generation reads the full model weight matrix from VRAM, so bandwidth directly determines tokens-per-second throughput. Higher bandwidth means faster inference for the same model at the same batch size. For batch inference (processing many requests simultaneously), compute throughput becomes more important.
Can I use the MI300X 192GB for Stable Diffusion or image generation?
Yes — the MI300X 192GB is well-suited for Stable Diffusion and image generation workloads. Image generation is primarily FP32 and FP16 compute-bound, and the MI300X 192GB's 163.4 TFLOPS FP32 throughput determines images-per-second. The 192GB VRAM fits SDXL (requires ~6GB) and most ControlNet pipelines. For high-throughput image generation at scale, compare cost-per-image across providers using the GPU cost calculator.