GPU pricing
Cheapest GPU with 48 GB+ memory
Updated 2026-10-19
Cheapest on AWS: NVIDIA L40S at $1.86/GPU-hr. Cheapest anywhere (in stock, on demand): NVIDIA L40S at $0.55 (Novita Ai).
A model with ~24B parameters at 16-bit needs roughly 48 GB of GPU memory. These are the GPUs that fit, cheapest first.
Only AWS rows can be paid with AWS credits.
| GPU | Memory | Lowest in stock | Median | On AWS |
|---|---|---|---|---|
| NVIDIA L40S | 48 GB | $0.55 (Novita Ai) | $1.48 | $1.86 |
| NVIDIA A100 80GB | 80 GB | $0.65 (Lium) | $1.76 | $3.43 |
| NVIDIA RTX PRO 6000 | 96 GB | $0.8 (Hyper Ai) | $2.28 | Not offered |
| NVIDIA H100 | 80 GB | $1.77 (Lium) | $3.38 | $6.88 |
| AMD Instinct MI300X | 192 GB | $2.99 (Hotaisle) | $2.99 | Not offered |
| NVIDIA H200 | 141 GB | $3.75 (Lium) | $4.51 | $7.91 |
| NVIDIA B200 | 180 GB | $3.75 (Packet Ai) | $6.25 | $14.24 |
| NVIDIA B300 | 288 GB | $7.10 (Daytona) | $8.25 | Not offered |
Related cost calculators
- EC2 Pricing Calculator · Compare Instance Types & Costs
- EKS Pricing Calculator · Compare Auto Mode vs EC2 Node Costs
- Amazon SageMaker AI Pricing Calculator · On-Demand Studio, Training & Inference
Prices and credit amounts are estimates and may change. Check AWS for current terms.