GH200 Grace Hopper 96GB
TDP 900W · 1979 TFLOPS · 96GB VRAM · 4000 GB/s bandwidth
The GH200 Grace Hopper 96GB has a 900W TDP, 1979 TFLOPS of FP16 compute, 96GB of HBM3 VRAM, 4000 GB/s memory bandwidth.
Grace Hopper superchip — ARM Grace CPU + H100 GPU connected via NVLink-C2C at 900 GB/s. 96GB HBM3 + 480GB LPDDR5X system memory accessible as unified pool.
GH200 Grace Hopper 96GB has 96GB of memory. Compare its specs and listed cloud rental prices below. The workload must fit in VRAM with room for runtime memory; a listed price does not confirm stock.
GH200 Grace Hopper 96GB Overview
The NVIDIA GH200 combines a Hopper GH100 GPU with an Arm Grace CPU in one superchip, linking them through 900 GB/s NVLink-C2C. The GPU contributes 96GB of HBM3, 1,979 TFLOPS of FP16/BF16 performance, and FP8 Transformer Engine support, while the Grace side adds large LPDDR5X system memory to the addressable platform.
The HBM3 subsystem reaches 4,000 GB/s, making GH200 especially capable for memory-bound transformer inference. Unified CPU-GPU memory access can simplify workloads whose data or context exceeds GPU memory, but CPU-attached memory is not a substitute for HBM bandwidth; performance still depends on where active tensors reside.
GH200 is tailored to large-context LLM inference, data-intensive HPC, and applications that benefit from tightly coupled CPU and GPU memory. Its specialized form factor and high platform power make it unsuitable for ordinary PCIe GPU servers or workloads that only need standard H100 compute.
Memory
Compute Performance
Hardware Specifications
Chip
Memory
Power
Relative Performance
Relative to highest-spec GPU in database
Limitations
Live Cloud PricingOn-demand hourly rates
Compare GH200 Grace Hopper 96GB vs…
Use Case Guidance
LLM Model Size Guidance
Estimates only. Actual capacity depends on context length, KV cache, and framework overhead.
Related Guides
LLM APIs Running on This GPU Class
Providers that serve frontier LLM inference on Hopper-class hardware.
GH200 Grace Hopper 96GB vs Alternatives — Spec Comparison
| Spec | GH200 Grace Hopper 96GB this | H200 141GB | H100 80GB | H100 SXM5 80GB |
|---|---|---|---|---|
| VRAM | 96GB HBM3 | 141GB HBM3e▲ | 80GB HBM3 | 80GB HBM3 |
| Memory Bandwidth | 4000 GB/s | 4800 GB/s▲ | 3350 GB/s | 3350 GB/s |
| FP16 TFLOPS | 1979▲ | 1979▲ | 1979▲ | 1979▲ |
| BF16 TFLOPS | 1979▲ | 1979▲ | 1979▲ | 1979▲ |
| FP8 TFLOPS | 3958▲ | 3958▲ | 3958▲ | 3958▲ |
| INT8 TOPS | 3958▲ | 3958▲ | 3958▲ | 3958▲ |
| TDP | 900W▲ | 700W | 700W | 700W |
| Process Node | TSMC 4N▲ | TSMC 4N▲ | TSMC 4N▲ | TSMC 4N▲ |
| Architecture | GH100 Grace Hopper▲ | GH100▲ | GH100▲ | GH100▲ |
| Release Year | 2023 | 2024▲ | 2022 | 2022 |
| Max model (FP16) | ~48B params | ~70B params▲ | ~40B params | ~40B params |
| Max model (INT4) | ~192B params | ~282B params▲ | ~160B params | ~160B params |
Related GPUs
GH200 Grace Hopper 96GB Frequently Asked Questions
What is the GH200 Grace Hopper 96GB TDP?
The GH200 Grace Hopper 96GB has a TDP (Thermal Design Power) of 900W.
How many TFLOPS does the GH200 Grace Hopper 96GB have?
The GH200 Grace Hopper 96GB delivers 1979 TFLOPS of FP16 compute and 1979 TFLOPS BF16, and 3958 TFLOPS FP8.
How much VRAM does the GH200 Grace Hopper 96GB have?
The GH200 Grace Hopper 96GB has 96GB of HBM3 VRAM.
What is the GH200 Grace Hopper 96GB's memory bandwidth?
The GH200 Grace Hopper 96GB has a memory bandwidth of 4000 GB/s.
GH200 Grace Hopper 96GB User Reviews
GH200 Grace Hopper 96GB User Reviews
Ready to rent?
Compare GH200 Grace Hopper 96GB prices across 130+ providers
Live on-demand & spot rates · monthly cost estimates · availability status