知识卡片
消费血缘保留回指
消费管道应记录源产品、文件或事件、本地键和每步转换,支持追踪新数据怎样形成。工具选择要兼容所需血缘粒度;若只记录最终结果而无法回指输入,就难以解释错误传播及再分发责任。
这张卡片看不懂?
这张卡片已通过人工审查,不再接受失败反馈。
已有反馈 · 0 条
还没有人提交反馈。
在整书笔记中的位置
原书出处 · 1 处
- Turning Data into Value · 查看原书依据
Finally, the entire pipeline must be set up to provide metadata for lineage, so it’s possible to trace and understand what data is mutated in what way at each specific step in the pipeline. This requires transparent back-pointers to, for example, your data products. File and event names, business keys, source system identifiers, and the like must be made available in central tools to ensure
参考来源
- 位置:《Data Management at Scale》第11章《Turning Data into Value》(来源项目 a19c7933-4eda-4176-aebd-30fe7e1ad292,源文件:extracted/Data Management at Scale/_epub-src/OEBPS/ch11.html)
- 结论依据:原文对transparent back-pointers的解释、约束及上下文支持本卡;内容为中文归纳,不把架构建议当作所有组织的必然规律。
- 原始内容:Finally, the entire pipeline must be set up to provide metadata for lineage, so it’s possible to trace and understand what data is mutated in what way at each specific step in the pipeline. This requires transparent back-pointers to, for example, your data products. File and event names, business keys, source system identifiers, and the like must be made available in central tools to ensure