知识卡片

普通读书笔记卡 · 2313.e.5.f.11.a.2.b.5

归约合并可组合摘要

理解等级:中级

归约把多个输入压成同类摘要,再把摘要继续合并,直到得到全局结果。词频映射逐键相加、人口数求和都可用同一合并逻辑处理原始输出与中间结果。因此无需等所有map完成就能开始局部计算;最终完整结果仍要确认所有必要输入已纳入,组合顺序也须符合运算性质。

这张卡片看不懂?

已有反馈 · 0 / 10 条

    还没有人提交反馈。

    在整书笔记中的位置

    原书出处 · 1 处

    • Chapter 13. Coordinated Batch Processing · 查看原书依据

      the reduce phase can be repeated as many or as few times as necessary in order to successfully reduce the output down to a single output for the entire data set. This is a fortunate contrast to the join pattern, because unlike join, it means that reduce can

    参考来源

    - 位置:《Designing Distributed Systems, 2nd Edition》第13章《Chapter 13. Coordinated Batch Processing》(来源项目 book-sources;源文件:extracted/Designing Distributed Systems, 2nd Edition/_epub-src/OEBPS/ch13.html) - 结论依据:原文反复归约的同类输出以及计数、求和例子说明可并行合并。 - 原始内容:the reduce phase can be repeated as many or as few times as necessary in order to successfully reduce the output down to a single output for the entire data set. This is a fortunate contrast to the join pattern, because unlike join, it means that reduce can