Support for Iceberg partition pruning bucket transform#79262
Support for Iceberg partition pruning bucket transform#79262
Conversation
…k/addBucketPartitionTransform
…k/addBucketPartitionTransform
…k/addBucketPartitionTransform
There was a problem hiding this comment.
Copilot reviewed 3 out of 7 changed files in this pull request and generated 1 comment.
Files not reviewed (4)
- src/Functions/icebergBucketTransform.cpp: Language not supported
- src/Storages/ObjectStorage/DataLakes/Iceberg/ManifestFilesPruning.cpp: Language not supported
- tests/queries/0_stateless/03411_iceberg_bucket.reference: Language not supported
- tests/queries/0_stateless/03411_iceberg_bucket.sql: Language not supported
|
This PR was Partially inspired by: It was really difficult to understand how the functions should be implemented without the reference implementation (not all the aspects are clear from specification) Please, pay attention to both the reference implementation as well as the iceberg specification. Feel free to ask any questions if you notice any inconsistencies of our implementation with a reference one |
|
Performance comparison check can't be restarted because of some issues, but it seems unrelated to my changes (and is not supposed to block MC,afaik) |
robot-ch-test-poll
added
the
pr-synced-to-cloud
…PartitionTransform Support for Iceberg partition pruning bucket transform
…PartitionTransform Support for Iceberg partition pruning bucket transform
25.3 Antalya - Iceberg: Backport of ClickHouse#79262 - Support for Iceberg partition pruning bucket transform
Changelog category:
Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):
Add
icebergHashandicebergBucketTransformfunctions. Support data files pruning inIcebergtables partitioned withbucket transfom.Documentation entry for user-facing changes