Skip to content

A100 40 GB

The A100 40 GB is an NVIDIA Ampere data centre GPU with 40 GB of memory. It rents from $2.7447 per GPU-hour on-demand at AWS, or $0.4784 if it may be interrupted. 16 offers from 5 providers.

Every offer

Per GPU-hour, cheapest provider first
  • Hyperscaler
  • GPU cloud
  • Spot or community
  • Marketplace
  • Median on-demand $3.6734
$0$1$2$3$4
Vast.ai
AWS
RunPod
Google Cloud
Oracle

Point at an offer for its details. Cloud machines open their own page.

Price over time

Cloud list price, per GPU-hour
  • Cheapest
  • Median
A100 40 GB cloud list price per GPU-hour over time$2.50$2.75$3.00$3.25$3.50$3.751 Mar26 Jun22 Oct
  • Cheapest
  • Median

The 6 machine types listed on 1 Mar are at $2.74 at best today, against $2.74 then. 1 more types have been listed since 22 Oct. 7 cloud machine types with this GPU, each in its cheapest region that day.

Price per GPU by box size

On-demand, per GPU-hour
$3.67
$3.67
1 GPU1 offer
$3.67
$3.67
2 GPUs1 offer
$3.67
$3.67
4 GPUs1 offer
$2.74
$3.05
8 GPUs3 offers
$3.48
$3.48
16 GPUs1 offer
Cheapest Median

Per GPU, the cheapest 16-GPU box costs about the same as the cheapest single GPU.

Where it runs

55 cloud regions, on-demand per GPU-hour
AWS, Oregon
$2.7447 per GPU-hour
p4d.24xlarge
Cheapest third Middle Dearest thirdSelect a region to price it. 1 not on the map.

AWS, Oregon

$2.7447per GPU-hour

Spot $1.4489 per GPU-hour. p4d.24xlarge

What you would pay

List prices, a month
GPUs
Days a month
Price

8 A100 40 GB GPUs, 24 h a day, 30 days. Cheapest at AWS

$15,810a month$5,349 less than the dearest

  • AWS
    1 × 8-GPU
    $15,810
  • Oracle
    1 × 8-GPU
    $17,568
  • Google Cloud
    8 × 1-GPU
    $21,159

Each provider's cheapest way to cover 8 GPUs with the box sizes it sells; idle GPUs are paid for. List prices, before discounts and commitments.

All offers

16 offers, cheapest per GPU-hour first
Show the table of every offer
ProviderOfferRegionPriceGPUsvCPUMemoryPer GPU-hourBox per hourChecked
Vast.aiA100-40GB:minglobalMarketplace, cheapest, 17 listings1——$0.4004$0.4004 5 min ago
AWSp4d.24xlargeus-east-2Spot8961,152 GiB$0.4784$3.8275 1 h ago
Vast.aiA100-40GB:medianglobalMarketplace, median, 17 listings1——$0.6015$0.6015 5 min ago
RunPodNVIDIA A100-SXM4-40GBglobalCommunity1——$1.0000$1.0000 2 min ago
Google Clouda2-megagpu-16gnorthamerica-northeast2Spot16961,360 GiB$1.8148$29.036 1 h ago
Google Clouda2-highgpu-1gnorthamerica-northeast2Spot11285 GiB$1.8336$1.8336 1 h ago
Google Clouda2-highgpu-2gnorthamerica-northeast2Spot224170 GiB$1.8336$3.6671 1 h ago
Google Clouda2-highgpu-4gnorthamerica-northeast2Spot448340 GiB$1.8336$7.3342 1 h ago
Google Clouda2-highgpu-8gnorthamerica-northeast2Spot896680 GiB$1.8336$14.668 1 h ago
AWSp4d.24xlargeus-east-2On-demand8961,152 GiB$2.7447$21.958 1 h ago
OracleBM.GPU4.8globalOn-demand81282,048 GiB$3.0500$24.400 1 h ago
Google Clouda2-megagpu-16gus-east1On-demand16961,360 GiB$3.4837$55.740 1 h ago
Google Clouda2-highgpu-1gus-east1On-demand11285 GiB$3.6734$3.6734 1 h ago
Google Clouda2-highgpu-2gus-west1On-demand224170 GiB$3.6734$7.3468 1 h ago
Google Clouda2-highgpu-4gus-west1On-demand448340 GiB$3.6734$14.694 1 h ago
Google Clouda2-highgpu-8gus-east5On-demand896680 GiB$3.6734$29.387 1 h ago

Get A100 40 GB prices from the API

curl "https://prices.cloudadapt.io/api/v1/gpus?model=A100-40GB"

Per GPU-hour is the box price divided by its GPUs. Cloud machines appear once, in their cheapest region, except on the map. Spot, community and marketplace prices can change or disappear at any time. US dollars, before discounts and taxes.