Token Distribution — body vs tail
Where does the bill actually accumulate?
Loading…
Histogram of input tokens per request (with P50/P95/P99)
Cost share by percentile band
Workload shape:
Body-heavy chat
Tail-heavy agent
Bimodal
Mixed
Token cap (50K = none):
none