知识卡片
隐藏分区隔离查询和布局
Iceberg 的分区变换写在表元数据中,查询可按原始业务列过滤,由规划器推导对应分区条件。分区方案演进时,旧数据可按旧方案继续解释,避免每次调整都立即重写全部文件。
这张卡片看不懂?
这张卡片的反馈已满 10 条,暂时无法继续提交。
已有反馈 · 0 / 10 条
还没有人提交反馈。
原书出处
参考来源
- 位置:《Practical Lakehouse Architecture》第3章《Storage: The Heart of the Lakehouse》(源文件:_epub-src/OEBPS/ch03.html)
- 结论依据:原文说明隐藏分区和分区演进;Apache Iceberg 规范将源列谓词变换为分区谓词,并允许多个分区规范并存。
- 原始内容:Iceberg offers a feature known as hidden partitions. These help you to perform transformations on partition columns and limit the scans based on partition transformations. Partition evolution As the data increases with time, the existing partitions might need to be changed for better query performance. In such cases, the only option in Hive was to