Prefill is limited by compute, decode by memory bandwidth, and every doubling of context halves how many users a GPU can serve at once. How a model serves people decides how much memory and bandwidth the building has to hold.