Idle cost
Most inference fleets are sized for the peak and sit half-empty the rest of the day. Put in your numbers and see what the empty half costs.
Paid for and idle, per month
$0
$0 a year
Serving $0 Idle $0
See where it leaks Estimate: GPUs × price × 730 hours × unused share.