Compute Comparison
NVIDIAAmpere2020

RTX 3090

See rental prices ↓

Current median: $0.30/hr across 18 providers (observed), 0.00 (0.0%) vs yesterday. Typical range: $0.18–$0.42/hr (P10–P90). 30-day trend unlocks after 30 days of captures

TDP 350W · 71 TFLOPS · 24GB VRAM · 936 GB/s bandwidth

The RTX 3090 has a 350W TDP, 71 TFLOPS of FP16 compute, 24GB of GDDR6X VRAM, 936 GB/s memory bandwidth.

Previous-gen consumer GPU. Cheapest option for 24GB VRAM workloads. Limited BF16 support.

VRAM
24GB
GDDR6X
FP16
71.0
TFLOPS
Bandwidth
936.0
GB/s
TDP
350W
power
Best for:Budget inferenceSmall model fine-tuningExperimentation

RTX 3090 currently rents for a median of $0.30/hr across 18 providers (observed on-demand prices). RTX 3090 has 24GB of memory. Compare its specs and listed cloud rental prices below. The workload must fit in VRAM with room for runtime memory; a listed price does not confirm stock.

RTX 3090 Overview

The RTX 3090 is an Ampere consumer GPU that remains relevant because it offers 24GB of GDDR6X at a comparatively low price. It provides 71 TFLOPS of FP16 performance and 936 GB/s of bandwidth, giving it considerably more memory headroom than many newer midrange consumer cards.

The 24GB pool can support smaller full-precision models and larger models after quantization, while 936 GB/s is respectable for its generation. Its shortcomings are equally important: it lacks ECC, does not provide NVLink memory pooling, and does not have native BF16 acceleration or Hopper-era FP8 support.

The card is a useful budget option for experimentation, small-model fine-tuning, and inference where 24GB matters more than newest-generation features. It is not intended for reliability-sensitive data-center deployments or for fast modern transformer training that relies on BF16 or FP8 paths.

Memory

VRAM24 GB
Memory TypeGDDR6X
Bandwidth936 GB/s

Compute Performance

FP3235.6 TFLOPS
FP1671 TFLOPS
BF1671 TFLOPS
INT8142 TOPS

Hardware Specifications

Chip

ArchitectureGA102
GenerationAmpere
Process NodeSamsung 8nm
Transistors28.3B
Die Size628 mm²
Release DateSeptember 24, 2020
Launch MSRP$1,499

Processors

CUDA / Shader Cores10,496
Tensor Cores328
RT Cores82

Clocks

Base Clock1,395 MHz
Boost Clock1,695 MHz

Memory

VRAM24 GB
Memory TypeGDDR6X
Memory Bus384-bit
Bandwidth936 GB/s
L2 Cache6 MB

Power

TDP350 W
InterconnectPCIe 4.0

Relative Performance

FP16 Compute1%
VRAM Capacity8%
Mem Bandwidth6%

Relative to highest-spec GPU in database

Limitations

No BF16 hardware acceleration — software emulation only
No NVLink — single-card VRAM ceiling
Older Ampere architecture — no FP8 support

Live Cloud PricingOn-demand hourly rates

Live27 providers · 25% price spread
ProviderOn-DemandSpotRegionAvailability
$0.28/hr—CHunknown
$0.45/hr—US/EU/Asiaunknown
$0.26/hr—US/EUunknown
$0.23/hr—Asia-Pacificunknown
$0.21/hr—South Koreaunknown
$0.29/hr—EUunknown
$0.20/hr—marketplaceunknown
$0.38/hr—EU/USunknown
$0.31/hr—UA/PL/SEunknown
$0.22/hr—Globalunknown
$0.29/hr—USunknown
$0.49/hr—USunknown
$0.30/hr—USunknown
BESTNovita
$0.28/hr—US/EU/APACunknown
$0.22/hr—us-east-1unknown
$0.32/hr—USunknown
$0.32/hr—Variousunknown
$0.09/hr—US/EUunknown
$0.46/hr—USunknown
$0.23/hr—Minsk Cityunknown
$0.31/hr—US/EU/APACunknown
$0.25/hr—USunknown
$0.30/hr—EU/USunknown
$0.40/hr—APACunknown
$0.10/hr—Australia, AUunknown
$0.28/hr—EUunknown
$0.35/hr—EU-Northunknown

Salad: Lowest priority tier — preemptible

Cheapest / month
$204
$0.28/hr × 730h
Median / month
$204
at median price
Spot savings
N/A
vs on-demand (best)

Job Cost Estimator

At median $0.30/hr across 18 providers (observed on-demand). Spot pricing typically 40–70% lower.

7B LLM fine-tune
8× GPU, 24 h · Full fine-tune, single node
$58
spot ~$26
70B LLM fine-tune
64× GPU, 72 h · Multi-node, 3-day run
$1.4k
spot ~$622
Inference server
1× GPU, 730 h · 1 month continuous
$219
spot ~$99
Image gen batch
4× GPU, 8 h · Batch generation job
$10
spot ~$4

Estimates only. Actual cost depends on provider, region, availability, and utilization. Use the GPU cost calculator for custom inputs.

Compare RTX 3090 vs…

Use Case Guidance

Budget inference
Small model fine-tuning
Experimentation

LLM Model Size Guidance

Max model (FP16)~12Bparameters at FP16 precision
Max model (INT8)~24Bparameters at INT8 precision
Max model (INT4)~48Bparameters at INT4/GGUF

Estimates only. Actual capacity depends on context length, KV cache, and framework overhead.

Related Guides

LLM APIs Running on This GPU Class

Providers that serve frontier LLM inference on Ampere-class hardware.

Browse all 42 LLM models

RTX 3090 vs Alternatives — Spec Comparison

SpecRTX 3090 thisRTX 5060 TiRTX 3080 TiRTX A5500 24GB
VRAM24GB GDDR6X▲16GB GDDR712GB GDDR6X24GB GDDR6▲
Memory Bandwidth936 GB/s▲672 GB/s912 GB/s768 GB/s
FP16 TFLOPS71▲70.468.268.2
BF16 TFLOPS71▲70.468.268.2
FP8 TFLOPS————
INT8 TOPS142140.8136272.8▲
TDP350W▲180W350W▲230W
Process NodeSamsung 8nm▲TSMC 4NPSamsung 8nm▲Samsung 8nm▲
ArchitectureGA102GB206▲GA102GA102
Release Year20202025▲20212021
Max model (FP16)~12B params▲~8B params~6B params~12B params▲
Max model (INT4)~48B params▲~32B params~24B params~48B params▲
▲ indicates best value in row · FP16/BF16 TFLOPS at full precision · Max model estimates at 2 bytes/param (FP16) and 0.5 bytes/param (INT4)Full side-by-side comparison

Compare RTX 3090

Related GPUs

RTX 3090 Frequently Asked Questions

What is the RTX 3090 TDP?

The RTX 3090 has a TDP (Thermal Design Power) of 350W.

How many TFLOPS does the RTX 3090 have?

The RTX 3090 delivers 71 TFLOPS of FP16 compute and 71 TFLOPS BF16.

How much VRAM does the RTX 3090 have?

The RTX 3090 has 24GB of GDDR6X VRAM.

What is the RTX 3090's memory bandwidth?

The RTX 3090 has a memory bandwidth of 936 GB/s.

RTX 3090 User Reviews

RTX 3090 User Reviews

Loading reviews...

Ready to rent?

Compare RTX 3090 prices across 130+ providers

Live on-demand & spot rates · monthly cost estimates · availability status

Compare rental prices