Skip to content

Every host for Palmyra X5

Per 1M tokens
HostBlendedInputOutputCachedPrecisionUptime
Amazon Bedrock
$1.95
$0.60$6.00——100.0%
Blended price: three input tokens for every output token, per 1M tokens.

Cheapest price over time

Per 1M tokens
Cheapest input and output price for Palmyra X5 over timeFree$2.00$4.00$6.0023 Oct23 Oct24 Oct$6.00$0.60
  • Input
  • Output
The cheapest list price at any host on each day it changed.

What your workload costs

A month, at every host
Cheapest a month
$780.00
Amazon Bedrock
  • Amazon Bedrock
    $780.00

Rent GPUs or pay per token?

Break-even
Renting the GPUs
$16,878/mo
Break-even volume
8.7B tokens/mo
Needed around the clock
3.3K tok/s

8 × H100 cost $16,878 a month. The cheapest API (Amazon Bedrock) charges $1.95 per 1M blended tokens, so the GPUs only pay off above 8.7B tokens a month: the box must serve 3.3K tokens a second, every second.

GPU price: cheapest on-demand offer per GPU-hour × 730 hours. No throughput is assumed: it depends on the model size, precision, batch size and serving software, so measure yours. Power, storage, egress and engineering time are not included.

Quality data: LMArena (CC BY 4.0), Epoch AI (CC BY 4.0). Prices: OpenRouter, LiteLLM (MIT), provider pages. List prices in US dollars before discounts and taxes; other currencies converted at the European Central Bank reference rate. The figures on these pages are free to reuse under CC BY 4.0 with a link to this page.