GPU pricing
GPU prices per hour: AWS vs other clouds
Updated 2026-10-19
Cheapest on AWS: NVIDIA T4 at $0.526/GPU-hr. Cheapest anywhere (in stock, on demand): NVIDIA GeForce RTX 4090 at $0.34 (Gpu Ai).
Each GPU shows its lowest in-stock on-demand price and the median across providers we track, so one odd listing can't set the headline. Spot, reserved, community and out-of-stock listings are left out.
AWS prices are us-east-1 Linux on demand from the AWS Price List; other providers from GetDeploying and the Azure Retail Prices API, checked 2026-10-19.
Every GPU, cheapest first
| GPU | Memory | Lowest in stock | Median | On AWS | AWS GPU-hours per $25k |
|---|---|---|---|---|---|
| NVIDIA GeForce RTX 4090 | 24 GB | $0.34 · Gpu Ai | $0.45 | Not offered | — |
| NVIDIA GeForce RTX 5090 | 32 GB | $0.35 · Hyper Ai | $0.7175 | Not offered | — |
| NVIDIA L4 | 24 GB | $0.44 · Jarvislabs | $0.7996 | $0.8048 | 31,064 |
| NVIDIA T4 | 16 GB | $0.526 · AWS | $0.526 | $0.526 | 47,529 |
| NVIDIA L40S | 48 GB | $0.55 · Novita Ai | $1.48 | $1.86 | 13,434 |
| NVIDIA A100 80GB | 80 GB | $0.65 · Lium | $1.76 | $3.43 | 7,287 |
| NVIDIA RTX PRO 6000 | 96 GB | $0.8 · Hyper Ai | $2.28 | Not offered | — |
| NVIDIA A100 40GB | 40 GB | $0.89 · Jarvislabs | $2.37 | $2.74 | 9,108 |
| NVIDIA A10G | 24 GB | $1.01 · AWS | $1.00 | $1.01 | 24,851 |
| NVIDIA A10 | 24 GB | $1.29 · Lambda | $1.35 | Not offered | — |
| NVIDIA H100 | 80 GB | $1.77 · Lium | $3.38 | $6.88 | 3,634 |
| NVIDIA V100 | 16 GB | $2.57 · Sesterce | $2.53 | Not offered | — |
| AMD Instinct MI300X | 192 GB | $2.99 · Hotaisle | $2.99 | Not offered | — |
| NVIDIA H200 | 141 GB | $3.75 · Lium | $4.51 | $7.91 | 3,160 |
| NVIDIA B200 | 180 GB | $3.75 · Packet Ai | $6.25 | $14.24 | 1,755 |
| NVIDIA B300 | 288 GB | $7.10 · Daytona | $8.25 | Not offered | — |
Cheapest by memory
Related cost calculators
- EC2 Pricing Calculator · Compare Instance Types & Costs
- EKS Pricing Calculator · Compare Auto Mode vs EC2 Node Costs
- Amazon SageMaker AI Pricing Calculator · On-Demand Studio, Training & Inference
Prices and credit amounts are estimates and may change. Check AWS for current terms.