知识卡片
并行收益受固定开销限制
每增加一片都要解析、传输、加密和调度,而分给该片的有用计算变少。到固定开销超过计算收益时,继续增加叶节点不再缩短响应,反而增加总资源成本。应测量拆分、计算与汇总的占比,而不是把更多机器当作线性加速保证。
这张卡片看不懂?
这张卡片的反馈已满 10 条,暂时无法继续提交。
已有反馈 · 0 / 10 条
还没有人提交反馈。
在整书笔记中的位置
原书出处 · 1 处
- Chapter 8. Scatter/Gather · 查看原书依据
Each leaf node you add to increase parallelism increases the total overhead cost. Additionally, increasing the parallelism reduces the time spent performing “useful” computation on each leaf node, until eventually the time spent on the computational overhead is significantly greater than the time spent performing “useful” computation. When
参考来源
- 位置:《Designing Distributed Systems, 2nd Edition》第08章《Chapter 8. Scatter/Gather》(来源项目 book-sources;源文件:extracted/Designing Distributed Systems, 2nd Edition/_epub-src/OEBPS/ch08.html)
- 结论依据:原文分析每叶固定开销与有效计算随分片变化的关系。
- 原始内容:Each leaf node you add to increase parallelism increases the total overhead cost. Additionally, increasing the parallelism reduces the time spent performing “useful” computation on each leaf node, until eventually the time spent on the computational overhead is significantly greater than the time spent performing “useful” computation. When