Skip to content

feat: implement delete file index#435

Merged
wgtmac merged 4 commits intoapache:mainfrom
wgtmac:delete_file_index
Dec 29, 2025
Merged

feat: implement delete file index#435
wgtmac merged 4 commits intoapache:mainfrom
wgtmac:delete_file_index

Conversation

@wgtmac
Copy link
Copy Markdown
Member

@wgtmac wgtmac commented Dec 24, 2025

Implemented the DeleteFileIndex and Builder to manage and efficiently filter
delete files (equality deletes, position deletes, and deletion vectors)
based on sequence numbers and partitions.

Key changes:

  • Added DeleteFileIndex and DeleteFileIndex::Builder in src/iceberg/delete_file_index.{h,cc}.
  • Added ContentFileUtil for helper functions related to content files and DVs.
  • Updated ManifestReader to support dropping stats via TryDropStats().
  • Added comprehensive unit tests in src/iceberg/test/delete_file_index_test.cc.

Comment thread src/iceberg/delete_file_index.cc Outdated
@wgtmac wgtmac force-pushed the delete_file_index branch 4 times, most recently from 9345afc to 0b8f579 Compare December 25, 2025 03:20
Comment thread src/iceberg/delete_file_index.h Outdated
Comment thread src/iceberg/delete_file_index.cc Outdated
Comment thread src/iceberg/delete_file_index.cc Outdated
Comment thread src/iceberg/delete_file_index.cc Outdated
Comment thread src/iceberg/delete_file_index.cc Outdated
Comment thread src/iceberg/delete_file_index.cc Outdated
Comment thread src/iceberg/delete_file_index.cc Outdated
Comment thread src/iceberg/delete_file_index.cc Outdated
Comment thread src/iceberg/delete_file_index.cc Outdated
Comment thread src/iceberg/manifest/manifest_reader.cc Outdated
Comment thread src/iceberg/manifest/manifest_reader.cc
Comment thread src/iceberg/delete_file_index.cc
Comment thread src/iceberg/delete_file_index.cc
Comment thread src/iceberg/delete_file_index.cc
Comment thread src/iceberg/delete_file_index.cc
Comment thread src/iceberg/delete_file_index.cc
Comment thread src/iceberg/delete_file_index.cc
Comment thread src/iceberg/delete_file_index.cc
Comment thread src/iceberg/delete_file_index.cc
@shangxinli
Copy link
Copy Markdown
Contributor

LGTM

@wgtmac wgtmac merged commit 8926246 into apache:main Dec 29, 2025
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants