RTX A6000
See rental prices ↓Current median: $0.72/hr across 15 providers (observed), 0.00 (0.0%) vs yesterday. Typical range: $0.46–$1.67/hr (P10–P90). 30-day trend unlocks after 30 days of captures
TDP 300W · 77.4 TFLOPS · 48GB VRAM · 768 GB/s bandwidth
The RTX A6000 has a 300W TDP, 77.4 TFLOPS of FP16 compute, 48GB of GDDR6 VRAM, 768 GB/s memory bandwidth.
Ampere flagship professional GPU. 48GB GDDR6 with NVLink 3.0. Predecessor to RTX 6000 Ada. Widely available at lower cost.
RTX A6000 currently rents for a median of $0.72/hr across 15 providers (observed on-demand prices). RTX A6000 has 48GB of memory. Compare its specs and listed cloud rental prices below. The workload must fit in VRAM with room for runtime memory; a listed price does not confirm stock.
RTX A6000 Overview
The RTX A6000 is an Ampere professional GPU with 48GB of ECC GDDR6, 77.4 TFLOPS of FP16/BF16 performance, and a 300W power envelope. As the predecessor to RTX 6000 Ada, it trades newer architecture performance for mature professional drivers, large memory, and broad availability.
Its 768 GB/s memory bandwidth is adequate for many workstation and inference workloads, while 48GB gives much more room than 24GB consumer cards for model weights, assets, and batch state. NVLink 3.0 allows paired professional cards to work together, but GDDR6 bandwidth remains a constraint compared with A100-class HBM platforms.
The RTX A6000 works well for professional rendering plus AI, larger-model inference, and cost-conscious multi-GPU workstation setups. It lacks FP8 support and does not match modern Ada or Hopper cards for pure inference throughput, so it is best chosen for capacity and professional features rather than speed alone.
Memory
Compute Performance
Hardware Specifications
Chip
Processors
Clocks
Memory
Power
Relative Performance
Relative to highest-spec GPU in database
Limitations
Live Cloud PricingOn-demand hourly rates
| Provider | On-Demand | Spot | Region | Availability |
|---|---|---|---|---|
BESTFluidStack | $2.30/hr | — | EU/US | unknown |
| $0.63/hr | — | EU-West | unknown | |
| $0.79/hr | — | EU | unknown | |
| $0.72/hr | — | US | unknown | |
| $0.80/hr | — | IS | unknown | |
| $0.88/hr | — | EU | unknown | |
| $0.85/hr | — | EU | unknown | |
| $0.82/hr | — | SE | unknown | |
| $0.57/hr | — | Montreal, Canada, New York, NY, United States, Wichita, KS, United States, Kansas City, KS, United States, Des Moines, IA, United States, Las Vegas, NV, United States | unknown | |
| $2.20/hr | — | Various | unknown | |
| $0.59/hr | — | US | unknown | |
| $0.45/hr | — | US | unknown | |
| $0.70/hr | — | APAC | unknown | |
| $0.48/hr | — | US/Midwest | unknown | |
| $0.79/hr | — | EU-North | unknown | |
| $0.35/hr | — | US | unknown | |
| $0.69/hr | — | EU-North | unknown |
Job Cost Estimator
At median $0.72/hr across 15 providers (observed on-demand). Spot pricing typically 40–70% lower.
Estimates only. Actual cost depends on provider, region, availability, and utilization. Use the GPU cost calculator for custom inputs.
Compare RTX A6000 vs…
Use Case Guidance
LLM Model Size Guidance
Estimates only. Actual capacity depends on context length, KV cache, and framework overhead.
Related Guides
LLM APIs Running on This GPU Class
Providers that serve frontier LLM inference on Ampere-class hardware.
RTX A6000 vs Alternatives — Spec Comparison
| Spec | RTX A6000 this | A40 | RTX 4070 Ti | RTX 3090 |
|---|---|---|---|---|
| VRAM | 48GB GDDR6▲ | 48GB GDDR6▲ | 12GB GDDR6X | 24GB GDDR6X |
| Memory Bandwidth | 768 GB/s | 696 GB/s | 504 GB/s | 936 GB/s▲ |
| FP16 TFLOPS | 77.4 | 74.8 | 80.2▲ | 71 |
| BF16 TFLOPS | 77.4 | 74.8 | 80.2▲ | 71 |
| FP8 TFLOPS | — | — | — | — |
| INT8 TOPS | 309▲ | 149.7 | 160 | 142 |
| TDP | 300W | 300W | 285W | 350W▲ |
| Process Node | Samsung 8nm▲ | Samsung 8nm▲ | TSMC 4N | Samsung 8nm▲ |
| Architecture | GA102 | GA102 | AD104▲ | GA102 |
| Release Year | 2020 | 2020 | 2023▲ | 2020 |
| Max model (FP16) | ~24B params▲ | ~24B params▲ | ~6B params | ~12B params |
| Max model (INT4) | ~96B params▲ | ~96B params▲ | ~24B params | ~48B params |
Compare RTX A6000
Related GPUs
RTX A6000 Frequently Asked Questions
What is the RTX A6000 TDP?
The RTX A6000 has a TDP (Thermal Design Power) of 300W.
How many TFLOPS does the RTX A6000 have?
The RTX A6000 delivers 77.4 TFLOPS of FP16 compute and 77.4 TFLOPS BF16.
How much VRAM does the RTX A6000 have?
The RTX A6000 has 48GB of GDDR6 VRAM.
What is the RTX A6000's memory bandwidth?
The RTX A6000 has a memory bandwidth of 768 GB/s.
RTX A6000 User Reviews
RTX A6000 User Reviews
Ready to rent?
Compare RTX A6000 prices across 130+ providers
Live on-demand & spot rates · monthly cost estimates · availability status