Skip to content

Every host for Hy3

×1.5 between cheapest and dearest input
HostBlendedInputOutputCachedPrecisionUptime
Tencent Cloud
$0.231
$0.132$0.528$0.033fp8100.0%
DeepInfra
$0.25
$0.14$0.58$0.035——
GMI Cloud
$0.25
$0.14$0.58$0.035bf1699.8%
Novita
$0.25
$0.14$0.58$0.035—100.0%
Phala
$0.272
$0.15$0.64$0.04—100.0%
Atlas Cloud
$0.35
$0.20$0.80$0.05fp8100.0%
Blended price: three input tokens for every output token, per 1M tokens.

Cheapest price over time

Per 1M tokens
Cheapest input and output price for Hy3 over timeFree$0.20$0.40$0.6027 Aug24 Sept23 Oct$0.528$0.132
  • Input
  • Output
The cheapest list price at any host on each day it changed.

What your workload costs

A month, at every host
Cheapest a month
$92.40
Tencent Cloud
  • Tencent Cloud
    $92.40
  • DeepInfra
    $100.00
  • GMI Cloud
    $100.00
  • Novita
    $100.00
  • Phala
    $109.00
  • Atlas Cloud
    $140.00

Rent GPUs or pay per token?

Break-even
Renting the GPUs
$16,878/mo
Break-even volume
73.1B tokens/mo
Needed around the clock
27.8K tok/s

8 × H100 cost $16,878 a month. The cheapest API (Tencent Cloud) charges $0.231 per 1M blended tokens, so the GPUs only pay off above 73.1B tokens a month: the box must serve 27.8K tokens a second, every second.

GPU price: cheapest on-demand offer per GPU-hour × 730 hours. No throughput is assumed: it depends on the model size, precision, batch size and serving software, so measure yours. Power, storage, egress and engineering time are not included.

LMArena rating over time

Text leaderboard
LMArena text rating of Hy3 over time1,4001,4201,44026 Jul7 Sept20 Oct1,401

Rated about the same, by price

Blended, per 1M tokens

Quality data: LMArena (CC BY 4.0), Epoch AI (CC BY 4.0). Prices: OpenRouter, LiteLLM (MIT), provider pages. List prices in US dollars before discounts and taxes; other currencies converted at the European Central Bank reference rate. The figures on these pages are free to reuse under CC BY 4.0 with a link to this page.