GPU prices
An H100 rents from $2,110 per GPU-month at RunPod. The cheapest hyperscaler asks $5,022, 2.4 times as much.
What does each GPU cost?
- RTX 2000 Ada16 GB, NVIDIA$175.202 offers
- A4048 GB, NVIDIA$182.50median $763.09
- RTX A450020 GB, NVIDIA$182.502 offers
- RTX A500024 GB, NVIDIA$197.10median $868.33
- RTX 4000 Ada20 GB, NVIDIA$204.40median $514.65
- Radeon Pro V5208 GB, AMD$276.33median $632.91
- T416 GB, NVIDIA$306.60median $713.94
- RTX 3090 Ti24 GB, NVIDIA$335.802 offers
- RTX PRO 600096 GB, NVIDIA$365.00median $1,891
- RTX 309024 GB, NVIDIA$365.004 offers
- RTX A20006 GB, NVIDIA$365.002 offers
- RTX 4070 Ti12 GB, NVIDIA$365.002 offers
- RTX 408016 GB, NVIDIA$365.002 offers
- RTX 4080 SUPER16 GB, NVIDIA$365.002 offers
- RTX PRO 400024 GB, NVIDIA$416.102 offers
- L424 GB, NVIDIA$430.70median $728.96
Cheapest GPU memory
- RTX PRO 6000$3.8096 GB
- A40$3.8048 GB
- Instinct MI355X$6.56288 GB
- RTX A5000$8.2124 GB
- RTX A6000$8.9748 GB
- Instinct MI300X$9.09192 GB
- Instinct MI325X$10.84256 GB
- L40$12.4748 GB
- Instinct MI350X$13.92288 GB
- RTX 3090 Ti$13.9924 GB
Cheapest on-demand price per GPU-month divided by its memory, for GPUs with 24 GB or more. What matters when a model has to fit in memory.
Where is the same GPU cheapest to rent?
- Hyperscaler
- GPU cloud
- Spot
- Marketplace
B200
Hyperscaler 2.1× a GPU cloud- Hyperscaler$10,220Oracle, 8-GPU boxB200, cheapest hyperscaler offer: $10,220.00/mo per GPU at Oracle.
- GPU cloud$4,884Lambda, 8-GPU boxB200, cheapest gpu cloud offer: $4,883.70/mo per GPU at Lambda.
- Spot$1,466AWS, 8-GPU boxB200, cheapest spot offer: $1,465.93/mo per GPU at AWS.
- Marketplace$7,393Median of 8 on Vast.aiB200, median listing on Vast.ai: $7,392.58/mo per GPU.
H200
Hyperscaler 2.1× a GPU cloud- Hyperscaler$5,776AWS, 8-GPU boxH200, cheapest hyperscaler offer: $5,775.76/mo per GPU at AWS.
- GPU cloud$2,767RunPodH200, cheapest gpu cloud offer: $2,766.70/mo per GPU at RunPod.
- Spot$365.00RunPod, communityH200, cheapest spot offer: $365.00/mo per GPU at RunPod.
- Marketplace$3,097Median of 29 on Vast.aiH200, median listing on Vast.ai: $3,097.36/mo per GPU.
H100
Hyperscaler 2.4× a GPU cloud- Hyperscaler$5,022AWS, 8-GPU boxH100, cheapest hyperscaler offer: $5,022.40/mo per GPU at AWS.
- GPU cloud$2,110RunPodH100, cheapest gpu cloud offer: $2,109.70/mo per GPU at RunPod.
- Spot$793.44Google Cloud, 8-GPU boxH100, cheapest spot offer: $793.44/mo per GPU at Google Cloud.
- Marketplace$2,028Median of 18 on Vast.aiH100, median listing on Vast.ai: $2,027.91/mo per GPU.
A100 80 GB
Hyperscaler 1.9× a GPU cloud- Hyperscaler$2,482Azure, 8-GPU boxA100 80 GB, cheapest hyperscaler offer: $2,481.73/mo per GPU at Azure.
- GPU cloud$1,307RunPodA100 80 GB, cheapest gpu cloud offer: $1,306.70/mo per GPU at RunPod.
- Spot$383.92Google Cloud, 8-GPU boxA100 80 GB, cheapest spot offer: $383.92/mo per GPU at Google Cloud.
- Marketplace$780.61Median of 23 on Vast.aiA100 80 GB, median listing on Vast.ai: $780.61/mo per GPU.
Instinct MI300X
Hyperscaler 2.5× a GPU cloud- Hyperscaler$4,380Oracle, 8-GPU boxInstinct MI300X, cheapest hyperscaler offer: $4,380.00/mo per GPU at Oracle.
- GPU cloud$1,745RunPodInstinct MI300X, cheapest gpu cloud offer: $1,744.70/mo per GPU at RunPod.
- Spot$365.00RunPod, communityInstinct MI300X, cheapest spot offer: $365.00/mo per GPU at RunPod.
L40S
Hyperscaler 1.7× a GPU cloud- Hyperscaler$1,359AWSL40S, cheapest hyperscaler offer: $1,358.53/mo per GPU at AWS.
- GPU cloud$795.70RunPodL40S, cheapest gpu cloud offer: $795.70/mo per GPU at RunPod.
- Spot$364.98AWS, 4-GPU boxL40S, cheapest spot offer: $364.98/mo per GPU at AWS.
- Marketplace$584.54Median of 12 on Vast.aiL40S, median listing on Vast.ai: $584.54/mo per GPU.
RTX PRO 6000
Hyperscaler 6.7× a GPU cloud- Hyperscaler$2,455AWSRTX PRO 6000, cheapest hyperscaler offer: $2,455.08/mo per GPU at AWS.
- GPU cloud$365.00RunPodRTX PRO 6000, cheapest gpu cloud offer: $365.00/mo per GPU at RunPod.
- Spot$513.48AWSRTX PRO 6000, cheapest spot offer: $513.48/mo per GPU at AWS.
- Marketplace$1,217Median of 57 on Vast.aiRTX PRO 6000, median listing on Vast.ai: $1,217.21/mo per GPU.
L4
Hyperscaler 1.2× a GPU cloud- Hyperscaler$514.30Google CloudL4, cheapest hyperscaler offer: $514.30/mo per GPU at Google Cloud.
- GPU cloud$430.70RunPodL4, cheapest gpu cloud offer: $430.70/mo per GPU at RunPod.
- Spot$51.14Google CloudL4, cheapest spot offer: $51.14/mo per GPU at Google Cloud.
- Marketplace$264.10Median of 8 on Vast.aiL4, median listing on Vast.ai: $264.10/mo per GPU.
- GPU cloud$649.70RunPodRTX 4090, cheapest gpu cloud offer: $649.70/mo per GPU at RunPod.
- Spot$248.20RunPod, communityRTX 4090, cheapest spot offer: $248.20/mo per GPU at RunPod.
- Marketplace$570.55Median of 64 on Vast.aiRTX 4090, median listing on Vast.ai: $570.55/mo per GPU.
Every GPU, every offer
Cheapest and median per GPU-month. Select a row to see its offers.BlackwellNVIDIA, 2024 onwards10 GPUs
HopperNVIDIA, 20222 GPUs
Ada LovelaceNVIDIA, 202211 GPUs
AmpereNVIDIA, 202015 GPUs
AMDInstinct and Radeon5 GPUs
Older NVIDIATuring, Volta, Pascal, Maxwell, Kepler7 GPUs
Get GPU prices from the API
curl "https://prices.cloudadapt.io/api/v1/gpus"
Price per GPU-month is the box price divided by its GPUs, for 730 hours. Virtual machines are priced in their cheapest region; GPU clouds and marketplaces at their listed price. Marketplaces publish the cheapest and median listing, not individual offers. US dollars, before discounts and taxes.
Quality data: LMArena (CC BY 4.0), Epoch AI (CC BY 4.0). Prices: OpenRouter, LiteLLM (MIT), provider pages. List prices in US dollars before discounts and taxes; other currencies converted at the European Central Bank reference rate. The figures on these pages are free to reuse under CC BY 4.0 with a link to this page.