GPU pricing
Cheapest GPU with 24 GB+ memory
Updated 2026-10-19
Cheapest on AWS: NVIDIA L4 at $0.8048/GPU-hr. Cheapest anywhere (in stock, on demand): NVIDIA GeForce RTX 4090 at $0.34 (Gpu Ai).
A model with ~12B parameters at 16-bit needs roughly 24 GB of GPU memory. These are the GPUs that fit, cheapest first.
Only AWS rows can be paid with AWS credits.
| GPU | Memory | Lowest in stock | Median | On AWS |
|---|---|---|---|---|
| NVIDIA GeForce RTX 4090 | 24 GB | $0.34 (Gpu Ai) | $0.45 | Not offered |
| NVIDIA GeForce RTX 5090 | 32 GB | $0.35 (Hyper Ai) | $0.7175 | Not offered |
| NVIDIA L4 | 24 GB | $0.44 (Jarvislabs) | $0.7996 | $0.8048 |
| NVIDIA L40S | 48 GB | $0.55 (Novita Ai) | $1.48 | $1.86 |
| NVIDIA A100 80GB | 80 GB | $0.65 (Lium) | $1.76 | $3.43 |
| NVIDIA RTX PRO 6000 | 96 GB | $0.8 (Hyper Ai) | $2.28 | Not offered |
| NVIDIA A100 40GB | 40 GB | $0.89 (Jarvislabs) | $2.37 | $2.74 |
| NVIDIA A10G | 24 GB | $1.01 (AWS) | $1.00 | $1.01 |
| NVIDIA A10 | 24 GB | $1.29 (Lambda) | $1.35 | Not offered |
| NVIDIA H100 | 80 GB | $1.77 (Lium) | $3.38 | $6.88 |
| AMD Instinct MI300X | 192 GB | $2.99 (Hotaisle) | $2.99 | Not offered |
| NVIDIA H200 | 141 GB | $3.75 (Lium) | $4.51 | $7.91 |
| NVIDIA B200 | 180 GB | $3.75 (Packet Ai) | $6.25 | $14.24 |
| NVIDIA B300 | 288 GB | $7.10 (Daytona) | $8.25 | Not offered |
Related cost calculators
- EC2 Pricing Calculator · Compare Instance Types & Costs
- EKS Pricing Calculator · Compare Auto Mode vs EC2 Node Costs
- Amazon SageMaker AI Pricing Calculator · On-Demand Studio, Training & Inference
Prices and credit amounts are estimates and may change. Check AWS for current terms.