What Inference Engineering Is

Part of the Inference Engineering track on AI-ML Companion.

Prefill vs decode, the bandwidth ceiling, the KV cache, and the three numbers