返回主题:湖仓平台与开放表格式

知识卡片

普通读书笔记卡 · 2275.as.6.g.1.b.1.a

隐藏分区隔离查询和布局

理解等级:中级

Iceberg 的分区变换写在表元数据中,查询可按原始业务列过滤,由规划器推导对应分区条件。分区方案演进时,旧数据可按旧方案继续解释,避免每次调整都立即重写全部文件。

这张卡片看不懂?

已有反馈 · 0 条

    还没有人提交反馈。

    原书出处

    参考来源

    - 位置:《Practical Lakehouse Architecture》第3章《Storage: The Heart of the Lakehouse》(源文件:_epub-src/OEBPS/ch03.html) - 结论依据:原文说明隐藏分区和分区演进;Apache Iceberg 规范将源列谓词变换为分区谓词,并允许多个分区规范并存。 - 原始内容:Iceberg offers a feature known as hidden partitions. These help you to perform transformations on partition columns and limit the scans based on partition transformations. Partition evolution As the data increases with time, the existing partitions might need to be changed for better query performance. In such cases, the only option in Hive was to