知识卡片
归约合并可组合摘要
归约把多个输入压成同类摘要,再把摘要继续合并,直到得到全局结果。词频映射逐键相加、人口数求和都可用同一合并逻辑处理原始输出与中间结果。因此无需等所有map完成就能开始局部计算;最终完整结果仍要确认所有必要输入已纳入,组合顺序也须符合运算性质。
这张卡片看不懂?
这张卡片已通过人工审查,不再接受失败反馈。
已有反馈 · 0 条
还没有人提交反馈。
在整书笔记中的位置
原书出处 · 1 处
- Chapter 13. Coordinated Batch Processing · 查看原书依据
the reduce phase can be repeated as many or as few times as necessary in order to successfully reduce the output down to a single output for the entire data set. This is a fortunate contrast to the join pattern, because unlike join, it means that reduce can
参考来源
- 位置:《Designing Distributed Systems, 2nd Edition》第13章《Chapter 13. Coordinated Batch Processing》(来源项目 book-sources;源文件:extracted/Designing Distributed Systems, 2nd Edition/_epub-src/OEBPS/ch13.html)
- 结论依据:原文反复归约的同类输出以及计数、求和例子说明可并行合并。
- 原始内容:the reduce phase can be repeated as many or as few times as necessary in order to successfully reduce the output down to a single output for the entire data set. This is a fortunate contrast to the join pattern, because unlike join, it means that reduce can