Every host for Llama 3.3 70B Instruct
| Host | Blended | Input | Output | Cached | Precision | Uptime |
|---|---|---|---|---|---|---|
| DeepInfra | $0.155 | $0.10 | $0.32 | — | fp8 | 97.3% |
| Hyperbolic | $0.165 | $0.12 | $0.30 | — | — | — |
| Nebius | $0.198 | $0.13 | $0.40 | — | — | — |
| Crusoe | $0.20 | $0.20 | $0.20 | — | — | — |
| Nscale | $0.20 | $0.20 | $0.20 | — | — | — |
| Novita | $0.201 | $0.135 | $0.40 | — | bf16 | 100.0% |
| Inferenceapis | $0.275 | $0.20 | $0.50 | — | — | — |
| AkashML | $0.28 | $0.20 | $0.52 | $0.10 | fp8 | 100.0% |
| Parasail | $0.29 | $0.22 | $0.50 | $0.11 | fp8 | 99.8% |
| SambaNova | $0.563 | $0.45 | $0.90 | — | — | 94.9% |
| Groq | $0.64 | $0.59 | $0.79 | $0.295 | — | 100.0% |
| Azure | $0.71 | $0.71 | $0.71 | — | — | — |
| CoreWeave | $0.71 | $0.71 | $0.71 | $0.71 | fp16 | 100.0% |
| Weights & Biases | $0.71 | $0.71 | $0.71 | — | — | — |
$0.72 | $0.72 | $0.72 | — | — | — | |
| Watsonx | $0.753 | $0.753 | $0.753 | — | — | — |
| Cloudflare | $0.783 | $0.293 | $2.25 | — | fp8 | 100.0% |
| Scaleway | $0.90 | $0.90 | $0.90 | — | — | — |
| Cerebras | $0.938 | $0.85 | $1.20 | — | — | — |
| Together | $1.04 | $1.04 | $1.04 | — | — | 96.3% |
Cheapest price over time
- Input
- Output
What your workload costs
- DeepInfra$62.00
- Hyperbolic$66.00
- Nebius$79.00
- Crusoe$80.00
- Nscale$80.00
- Novita$80.50
- Inferenceapis$110.00
- AkashML$112.00
- Parasail$116.00
- SambaNova$225.00
- Groq$256.00
- Azure$284.00
8 more hosts cost more.
Rent GPUs or pay per token?
- Renting the GPUs
- $16,878/mo
- Break-even volume
- 109B tokens/mo
- Needed around the clock
- 41.4K tok/s
8 × H100 cost $16,878 a month. The cheapest API (DeepInfra) charges $0.155 per 1M blended tokens, so the GPUs only pay off above 109B tokens a month: the box must serve 41.4K tokens a second, every second.
GPU price: cheapest on-demand offer per GPU-hour × 730 hours. No throughput is assumed: it depends on the model size, precision, batch size and serving software, so measure yours. Power, storage, egress and engineering time are not included.
LMArena rating over time
Rated about the same, by price
Quality data: LMArena (CC BY 4.0), Epoch AI (CC BY 4.0). Prices: OpenRouter, LiteLLM (MIT), provider pages. List prices in US dollars before discounts and taxes; other currencies converted at the European Central Bank reference rate. The figures on these pages are free to reuse under CC BY 4.0 with a link to this page.