Add change to s3 scan source to create partitions after each page of …#6006

Merged

oeyh merged 6 commits into

opensearch-project:mainfrom

Davidding4718:S3ScanChange

Sep 10, 2025

Commits on Aug 21, 2025

Add change to s3 scan source to create partitions after each page of objects listed

graytaylor0
authored and
Davidding4718
committed

Commits on Aug 22, 2025

Renew the unit test to handle the two scans and seperate buckets
Davidding4718
committed

Commits on Sep 2, 2025

Commits on Sep 9, 2025

Remove the each time update in ScanObjectWorker; Add the lastGlobalOwnershipRenewal related renewGlobalOwnershipIfNeeded to ensures ownership is maintained both before starting and throughout the e…
Davidding4718
committed
Make renewGlobalStateOwnershipForPartitionCreation private
Davidding4718
committed