几万张 GPU 是怎么连成一台机器的
NVLink 管机柜里面，InfiniBand 和以太网管机柜之间，再往外是园区之间的光纤。训练跑多快，看最慢的那张卡和最挤的那根线，所以网络拓扑得跟楼板图一起画。
- 硬件 (24)
- 数据中心 (9)
- AI (304)
- theme:watts-to-tokens (16)
- type:research (32)
- GPU 云 (1)
- Stargate (2)
- Abilene (2)
- 液冷 (1)
- 散热 (1)
- 用水 (1)
- 网络 (1)
- NVLink (2)
- InfiniBand (2)
- UPS (2)
- 冗余 (1)
- 可靠性 (1)
- 供电 (2)
- 800V DC (2)
- VRM (2)
- 电网 (1)
- 燃气轮机 (1)
- Colossus (2)
- 推理 (1)
- KV cache (2)
- HBM (8)
- GB300 (2)
- PUE (2)
- Hardware (26)
- Data Center (9)
- GPU Cloud (1)
- Liquid Cooling (1)
- Cooling (1)
- Water (1)
- Networking (1)
- Redundancy (1)
- Reliability (1)
- Power (2)
- Grid (1)
- Gas Turbines (1)
- Inference (1)
- Crypto (1)
- 稳定币 (1)
- theme:deep-dive (18)
- type:essay (71)
- Codex (2)
- GPT-6 (2)
- Evals (4)
- Agents (138)
- type:builder-log (40)
- Claude Code (58)
- Opus (2)
- Security (1)
- Energy (1)
- 安全 (1)
- 能源 (1)
- Optical Communication (5)
- Optical Module (5)
- theme:light-vs-copper (10)
- Optical Chips (1)
- ODSP (4)
- Supply Chain (1)
- CPO (2)
- Advanced Packaging (1)
- Fiber Optics (1)
- SerDes (4)
- History of Communication (1)
- Copper Cable (1)
- Network Wall (1)
- 800G (2)
- PON (1)
- 光通信 (5)
- 光模块 (5)
- 光芯片 (1)
- 产业链 (1)
- 先进封装 (1)
- 光纤 (1)
- 通信史 (1)
- 铜缆 (1)
- 网络墙 (1)
- 光猫 (1)
- Product (24)
- Mio (65)
- phase:rethink (7)
- product:mio (1)
- theme:vision (22)
- PanPanMao (5)
- product:panpanmao (21)
- DevOps (12)
- Mobile (2)
- Rust (2)
- Swift (2)
- macOS (7)
- Prompt Engineering (8)
- Education (1)
- Motivation (1)
- Alignment (2)
- Cognitive Science (1)
- 教育 (1)
- 学习动机 (1)
- 认知科学 (1)
- theme:teach-ai-zh (7)
- Entrepreneurship (1)
- Business (3)
- Growth (1)
- Pricing (1)
- Cognition (1)
- theme:investor (28)
- 创业 (1)
- 商业方法论 (1)
- 增长 (1)
- 定价 (1)
- 认知 (1)
- Wealth Distribution (1)
- Tech Revolutions (1)
- Railroads (1)
- Electricity (1)
- Internet (1)
- AI Infrastructure (4)
- 财富分配 (1)
- 技术革命 (1)
- 铁路 (1)
- 电力 (1)
- 互联网 (1)
- Software Development (28)
- Career (5)
- Promotion (1)
- Future of Work (12)
- Management (1)
- Embodied AI (1)
- Robotics (1)
- UBI (2)
- Investing (12)
- Reflexivity (1)
- Investment Research (1)
- 职场 (2)
- 升职 (1)
- AI 提效 (1)
- 认知升级 (1)
- 具身智能 (1)
- 机器人 (1)
- 未来社会 (1)
- 赛博朋克 (1)
- 投资 (11)
- AI 基础设施 (1)
- 反身性 (1)
- 投资研究 (1)
- 软件开发 (4)
- Workflows (2)
- Lithography (1)
- Semiconductors (7)
- Quantum Dots (1)
- AR (2)
- theme:taming-electrons (10)
- Memory (11)
- VRAM (1)
- GPU (5)
- Storage (2)
- Hard Drive (1)
- SSD (2)
- RAID (2)
- CPU (2)
- Registers (1)
- Cache (1)
- Transistor (1)
- Vacuum Tube (1)
- 光刻机 (1)
- 半导体 (5)
- 量子点 (1)
- 内存 (7)
- 显存 (1)
- 存储 (1)
- 硬盘 (1)
- 寄存器 (1)
- 缓存 (1)
- 晶体管 (1)
- 电子管 (1)
- 语音转写 (2)
- 说话人分离 (1)
- 火山引擎 (1)
- 自动化 (2)
- Speech to Text (1)
- Speaker Diarization (1)
- Volcano Engine (1)
- Automation (3)
- AI 编程 (1)
- Agentic Coding (1)
- 编程语言 (1)
- CXL (1)
- China (3)
- 计算架构 (1)
- product:compute-labs (6)
- theme:memory-stack (6)
- Organization (10)
- theme:philosophy (8)
- Game Development (2)
- Godot (2)
- Unity (2)
- Unreal (2)
- Skills (7)
- Game Design (7)
- type:skill-workshop (2)
- 战锤40K (5)
- Warhammer 40K (10)
- 科幻 (5)
- 世界观 (9)
- 设定考据 (9)
- NAND (2)
- Warhammer (9)
- Science Fiction (5)
- Worldbuilding (9)
- Lore (9)
- DRAM (2)
- Compute (5)
- 计算机体系结构 (1)
- Warhammer Fantasy (8)
- Fantasy (4)
- 战锤奇幻 (4)
- 奇幻 (4)
- 游戏剧本 (1)
- 创作 (1)
- 占卜 (1)
- 开发 (1)
- AI Skills (2)
- Tools (4)
- Open Source (6)
- Workflow (6)
- type:skill-config (2)
- type:tool (5)
- Engineering (20)
- product:shichuan (6)
- Design (12)
- UI (4)
- MCP (4)
- System Design (4)
- product:radar (4)
- Research (1)
- Public Opinion (1)
- Workplace (1)
- 研究 (1)
- 公众舆论 (1)
- product:game-producer (6)
- AI Workflow (2)
- Architecture (1)
- Electron (2)
- Clawd (10)
- product:clawd (10)
- Product Design (2)
- Memory Systems (1)
- Personality System (1)
- Desktop Pet (1)
- AI Agents (27)
- 多 Agent (6)
- Agora (3)
- 狼人杀 (2)
- product:agora (7)
- LLM (12)
- 架构设计 (1)
- 开源 (6)
- 架构决策 (1)
- AgentScope (1)
- 产品设计 (4)
- 游戏 (1)
- 架构 (1)
- 记忆系统 (1)
- 人格系统 (1)
- 桌面宠物 (1)
- 思维模型 (11)
- Agent Fleet (6)
- Mental Models (10)
- 开发工具 (2)
- Knowledge Management (2)
- Obsidian (2)
- theme:runtime (9)
- AI Safety (2)
- Interpretability (2)
- Anthropic (2)
- SaaS (2)
- AI Companion (2)
- 工具 (2)
- 会议录音 (2)
- whisper (1)
- Foundry (2)
- product:foundry (2)
- Easter Eggs (2)
- Fun (2)
- Agent Runtimes (3)
- Frontend (3)
- Philosophy (2)
- WeChat (1)
- Chips (2)
- TPU (2)
- Writing (8)
- NLP (6)
- Lumi (8)
- theme:soul-framework (10)
- Chinese (2)
- product:elan (10)
- Voice (8)
- product:openclaw (8)
- theme:runbook (8)
- 产品测评 (1)
- Linux (8)
- VPN (4)
- Self-hosting (2)
- 翻墙 (2)
- 科学上网 (2)
- Economics (4)
- Labor (2)
- Psychology (2)
- phase:rebuild (12)
- Claude (4)
- GPT (2)
- phase:manifesto (2)
- phase:evolve (16)
- OpenClaw (8)
- TTS (2)
- product:work-agents (2)
- GCP (4)
- phase:foundation (18)
- Ops (2)
- Cost Optimization (2)
- Agent Teams (4)
- type:manifesto (2)
- Apple Watch (1)
- 微信 (1)
- AppleScript (1)
- Python (1)
- Best Practices (1)