https://lilinji.github.io/tags/reducescatter/Recent content in ReduceScatter on Ringi's LogHugo -- 0.152.2zh-cnWed, 02 Sep 2026 00:00:00 +0800https://lilinji.github.io/2026/09/%E7%AC%AC09%E8%AE%B2-%E7%BD%91%E7%BB%9C%E9%80%9A%E4%BF%A1%E5%9F%BA%E7%A1%80%E4%B8%8E%E9%9B%86%E5%90%88%E9%80%9A%E4%BF%A1-collective-%E5%8E%9F%E8%AF%AD%E7%9B%B4%E8%A7%89%E4%BB%8E%E7%89%A9%E7%90%86%E7%BD%91%E7%BB%9C%E6%8B%93%E6%89%91%E5%88%B0-ringtree-%E7%AE%97%E6%B3%95%E4%B8%8E%E9%80%9A%E4%BF%A1%E9%87%8F%E7%AC%AC%E4%B8%80%E6%80%A7%E5%8E%9F%E7%90%86/Wed, 02 Sep 2026 00:00:00 +0800https://lilinji.github.io/2026/09/%E7%AC%AC09%E8%AE%B2-%E7%BD%91%E7%BB%9C%E9%80%9A%E4%BF%A1%E5%9F%BA%E7%A1%80%E4%B8%8E%E9%9B%86%E5%90%88%E9%80%9A%E4%BF%A1-collective-%E5%8E%9F%E8%AF%AD%E7%9B%B4%E8%A7%89%E4%BB%8E%E7%89%A9%E7%90%86%E7%BD%91%E7%BB%9C%E6%8B%93%E6%89%91%E5%88%B0-ringtree-%E7%AE%97%E6%B3%95%E4%B8%8E%E9%80%9A%E4%BF%A1%E9%87%8F%E7%AC%AC%E4%B8%80%E6%80%A7%E5%8E%9F%E7%90%86/以大众直觉与大厂工程第一性原理拆解分布式网络：从 Gbps/GBps 物理单位换算、P2P 瓶颈、八大集合通信原语（Broadcast/Reduce/AllReduce/AllGather/ReduceScatter/AllToAll），到 Ring-AllReduce 环形流水线、Tree 算法、α-β 通信耗时模型与通信量精确手算，直通 DDP、TP、ZeRO 与 MoE 的生产底层。