GPU pricing · Ampere
NVIDIA A100 40GB price per GPU-hour
Updated 2026-10-19
Lowest in stock: $0.89/GPU-hr (Jarvislabs), median $2.37 across 12 providers. On AWS: $2.74, and $25,000 in credits buys about 9,108 GPU-hours.
NVIDIA A100 40GB has 40 GB of memory on the Ampere architecture.
AWS costs more per hour than the cheapest clouds, but it's the one your AWS credits pay for: the cheapest AWS option is p4d.24xlarge.
- Lowest in stock
- $0.89/h
- Median
- $2.37/h · 12 providers
- On AWS
- $2.74/h
| Provider | Configuration | $/GPU-hr | Availability | Source |
|---|---|---|---|---|
| Jarvislabs | 1x A100 | $0.89 | In stock | GetDeploying |
| Civo | 1x A100 | $1.09 | Not reported | GetDeploying |
| Denvr | 4x A100 PCIe | $1.15 | Not reported | GetDeploying |
| Runcrate | 1x A100 SXM | $1.82 | In stock | GetDeploying |
| Lambda | 1x A100 SXM gpu_1x_a100_sxm4 | $1.99 | In stock | GetDeploying |
| Cerebrium | 1x A100 AMPERE_A100_40GB | $2.00 | Not reported | GetDeploying |
| AWS | p4d.24xlarge | $2.74 | In stock | AWS Price List |
| Oracle Cloud | 8x A100 SXM BM.GPU4.8 | $3.05 | Not reported | GetDeploying |
| Paperspace | 1x A100 A100 | $3.09 | Not reported | GetDeploying |
| Azure | Standard_ND96asr_v4 (8x GPU, eastus) | $3.40 | Not reported | Azure Retail Prices API |
| Google Cloud | 16x A100 a2-megagpu-16g | $3.72 | Not reported | GetDeploying |
| Cloudferro | 1x A100 gpu.a100 | $8.26 | Not reported | GetDeploying |
AWS instances with NVIDIA A100 40GB
| Instance | GPUs | On demand / h | Per GPU-hour | Spot avg / h |
|---|---|---|---|---|
| p4d.24xlarge | 8 | $21.96 | $2.74 | $18.42 |
What your AWS credits buy
| Credits | GPU-hours | Running 24/7 for |
|---|---|---|
| $1,000 | 364 | 15 days |
| $5,000 | 1,822 | 2.5 months |
| $25,000 | 9,108 | 12.5 months |
| $100,000 | 36,434 | 49.9 months |
Compare
Third-party prices are on-demand listings from GetDeploying (and the Azure Retail Prices API for Azure), checked 2026-10-14. We drop out-of-stock, community and spot listings, and any price under 35% of the median.
Related cost calculators
- EC2 Pricing Calculator · Compare Instance Types & Costs
- EKS Pricing Calculator · Compare Auto Mode vs EC2 Node Costs
- Amazon SageMaker AI Pricing Calculator · On-Demand Studio, Training & Inference
Questions
How much does an A100 40GB cost per hour?
From $0.89 per GPU-hour in stock on demand, with a median of $2.37 across 12 providers we track. On AWS it's $2.74 (p4d.24xlarge, us-east-1).
Can AWS credits pay for A100 40GB instances?
Yes, Activate credits cover on-demand AWS GPU instances. Capacity for top GPUs can be limited; Capacity Blocks and Savings Plans are not payable with credits.
Prices and credit amounts are estimates and may change. Check AWS for current terms.