知识卡片
水位线协调时间进度
水位线向下游传播事件时间进度,使算子能判断窗口何时可计算或结束。多输入算子通常以最慢输入的进度为界,避免一个快分区使另一分区被提前视为迟到。实际水位线依赖来源和策略,是带假设的完整性判断,仍须处理晚到记录。它通知时间推进,并不代替调度算法决定每条事件处理先后。
这张卡片看不懂?
这张卡片已通过人工审查,不再接受失败反馈。
已有反馈 · 0 条
还没有人提交反馈。
在整书笔记中的位置
原书出处 · 1 处
- Deterministic Stream Processing · 查看原书依据
Watermarking is used to track the progress of event time through a processing topology and to declare that all data of a given event time (or earlier) has been processed. This is a common technique used by many of the leading stream-processing frameworks, such as Apache Spark, Apache Flink, Apache Samza, and Apache Beam. A whitepaper from Google describes watermarks in greater detail and provides a good starting point for
参考来源
- 位置:《Building Event-Driven Microservices Leveraging Organizational Data at Scale (Adam Bellemare)》第06章《Deterministic Stream Processing》(来源项目:a19c7933-4eda-4176-aebd-30fe7e1ad292;源文件:extracted/Building Event-Driven Microservices Leveraging Organizational Data at Scale (Adam Bellemare)/_epub-src/OEBPS/ch06.xhtml;规范化段落起句:Watermarking is used to track)
- 结论依据:原文对该对象的定义、运行说明或对比支持以下归纳:水位线向下游传播事件时间进度,使算子能判断窗口何时可计算或结束。本卡同时保留其适用条件与失败边界。
- 原始内容:Watermarking is used to track the progress of event time through a processing topology and to declare that all data of a given event time (or earlier) has been processed. This is a common technique used by many of the leading stream-processing frameworks, such as Apache Spark, Apache Flink, Apache Samza, and Apache Beam. A whitepaper from Google describes watermarks in greater detail and provides a good starting point for