AI 机房说到底就是三根管子
一个 token 从机房里出来,背后有三根管子一直在跑。电进来,热出去,数据在几万张 GPU 之间来回传。机房能干多少活,看三根里最细的那根,现在最细的是电。
一个 token 从机房里出来,背后有三根管子一直在跑。电进来,热出去,数据在几万张 GPU 之间来回传。机房能干多少活,看三根里最细的那根,现在最细的是电。
Every token that leaves a data center rides on three pipes: power coming in, heat going out, and data moving between tens of thousands of GPUs. The building can only do as much work as its narrowest pipe allows, and today that pipe is power.
© Xingfan Xia 2024 - 2026 · CC BY-NC 4.0