GPU comparison · live prices
B300 vs A100: price per hour and cost per token
Blackwell Ultra: twice the H200’s memory, so one node of 8 holds the largest open models with room for long contexts. Last generation, often the cheapest datacenter GPU per hour for models that fit.
Prices observed 11m ago · refreshed every 15 minutes
| NVIDIA B300 | NVIDIA A100 80GB | |
|---|---|---|
| Memory | 288 GB HBM3e | 80 GB HBM2e |
| Memory bandwidth | 8.0 TB/s | 2.0 TB/s |
| Cheapest on-demandper GPU-hour | $8.99RunPod | $0.34Vast.ai |
| Cheapest spotper GPU-hour | $9.30Nebius · availability not published | —None in stock |
| Providers in stock | 2 | 3 |
Per GPU-hour on demand, the A100 costs 0.04× the B300. Per token, that depends on the model:
Cost per 1M output tokens
Cheapest on-demand offer, GPUs per replica to fit the model, 60% average utilization.
B300 is cheaper per token for 1 of these models and A100 for 5: it depends on model size.
| Model | B300 | A100 |
|---|---|---|
| Llama 3.1 8BBF16 | $0.27 1× GPUs · ~12,000 tok/s | $0.05 1× GPUs · ~3,059 tok/s |
| Qwen 2.5 32BFP8 | $0.54 1× GPUs · ~5,908 tok/s | $0.10 1× GPUs · ~1,506 tok/s |
| Llama 3.3 70BFP8 | $1.18 1× GPUs · ~2,720 tok/s | $0.22 2× GPUs · ~1,386 tok/s |
| Mixtral 8x22BFP8 | $0.65 1× GPUs · ~4,923 tok/s | $0.12 4× GPUs · ~5,019 tok/s |
| Llama 3.1 405BFP8 | $6.78 2× GPUs · ~948 tok/s | $1.29 8× GPUs · ~967 tok/s |
| DeepSeek V3 (671B MoE)FP8 | $0.62 4× GPUs · ~20,757 tok/s | — Doesn’t fit on 8 |
Estimates: tokens/s from memory bandwidth with batched serving, not a benchmark. Check each provider before you buy.