GPU pricing
Cheapest GPU with 141 GB+ memory
Updated 2026-10-19
Cheapest on AWS: NVIDIA H200 at $7.91/GPU-hr. Cheapest anywhere (in stock, on demand): AMD Instinct MI300X at $2.99 (Hotaisle).
A model with ~71B parameters at 16-bit needs roughly 141 GB of GPU memory. These are the GPUs that fit, cheapest first.
Only AWS rows can be paid with AWS credits.
| GPU | Memory | Lowest in stock | Median | On AWS |
|---|---|---|---|---|
| AMD Instinct MI300X | 192 GB | $2.99 (Hotaisle) | $2.99 | Not offered |
| NVIDIA H200 | 141 GB | $3.75 (Lium) | $4.51 | $7.91 |
| NVIDIA B200 | 180 GB | $3.75 (Packet Ai) | $6.25 | $14.24 |
| NVIDIA B300 | 288 GB | $7.10 (Daytona) | $8.25 | Not offered |
Related cost calculators
- EC2 Pricing Calculator · Compare Instance Types & Costs
- EKS Pricing Calculator · Compare Auto Mode vs EC2 Node Costs
- Amazon SageMaker AI Pricing Calculator · On-Demand Studio, Training & Inference
Prices and credit amounts are estimates and may change. Check AWS for current terms.