AIXX Pedia › Tech Concept › Token Economics
Token economics is the core business model of AI inference services: revenue (API billing) and cost (GPU time + power + bandwidth + operations) are both measured in tokens — the gap between cost and revenue per million tokens is the profit. The core formula of token economics: gross margin = (API price - inference cost) / API price — inference cost is determined by GPU type, utilization, batch size, and Quantization precision.
What it means for buyers: token economics is the foundation for calculating GPU procurement ROI — "what is this card's inference cost per million tokens" carries more decision value than "how much does this card cost." B300's FP4 inference (9 PFLOPS dense) means "lower compute cost per token" — but only if utilization is high enough.
| Item | Value / Basis |
|---|---|
| Revenue side | API price ($/M tokens) |
| Cost side | GPU time × utilization + power + bandwidth + operations |
| Gross margin formula | (Price - cost) / price |
| Utilization is king | Low utilization = fixed costs can't be spread thin = losses |
The advantage of B300's FP4 inference in token economics: FP4 Quantization doubles token throughput per card — lowering "compute cost per token" — but only if utilization is high enough. When utilization is low, even the best price-performance is just a paper figure — utilization management at an AI factory (load balancing / elastic scaling / multi-model co-serving) is the real profit lever.