Models · Qwen · live prices
Qwen 2.5 14B: GPUs needed and cost to self-host
14.7B parameters. In BF16 that is about 35 GB with room for the KV cache.
Memory, BF16
35 GB
weights + ~20%
Cheapest per 1M output tokens
$0.09
1× A100 · on-demand · 60% utilization
Hosted API, sample list price
$0.30
per 1M output tokens
Cost per 1M output tokens, BF16
Prices observed 12m ago. Cheapest on-demand offer per GPU, whole instances, 60% average utilization.
- A10080 GB 1× on Vast.ai · on-demand · $0.34/hr · ~1,664 tok/s $0.09per 1M out
- H200141 GB 1× on Vast.ai · on-demand · $1.32/hr · ~3,918 tok/s $0.16per 1M out
- 509032 GB 2× on Vast.ai · on-demand · $0.92/hr · ~1,755 tok/s $0.24per 1M out
- 409024 GB 2× on Vast.ai · on-demand · $0.62/hr · ~987 tok/s $0.29per 1M out
- RTX PRO 600096 GB 1× on Vast.ai · on-demand · $1.00/hr · ~1,463 tok/s $0.32per 1M out
- H10080 GB 1× on RunPod · community · $1.99/hr · ~2,735 tok/s $0.34per 1M out
- B300288 GB 1× on RunPod · community · $6.94/hr · ~6,531 tok/s $0.49per 1M out
The tick marks the sample hosted-API price. Estimates: tokens/s from memory bandwidth with batched serving, not a benchmark. Idle hours still bill, so lower utilization means pricier tokens.
GPUs per replica by precision
One node, split 1, 2, 4 or 8 ways; 90% of VRAM usable.
| GPU | BF1635 GB | FP818 GB | INT49 GB |
|---|---|---|---|
| H10080 GB | 1× | 1× | 1× |
| H200141 GB | 1× | 1× | 1× |
| B300288 GB | 1× | 1× | 1× |
| A10080 GB | 1× | 1× | 1× |
| RTX PRO 600096 GB | 1× | 1× | 1× |
| 509032 GB | 2× | 1× | 1× |
| 409024 GB | 2× | 1× | 1× |