Skip to content

Swartzn/feat/sort by archival placement hints#287

Closed
swartzn wants to merge 2 commits into
mainfrom
swartzn/feat/sort-by-archival-placement-hints
Closed

Swartzn/feat/sort by archival placement hints#287
swartzn wants to merge 2 commits into
mainfrom
swartzn/feat/sort-by-archival-placement-hints

Conversation

@swartzn

@swartzn swartzn commented Jan 9, 2026

Copy link
Copy Markdown
Contributor

Requires ThinkParQ/protobuf#65

What does this PR do / why do we need it?

Required for all PRs.

  • Allow rst clients to provide jobrequest.SortValues so builder jobs can stream requests in a deterministic order. For now, this just supports the changes needed for s3 tape archives.
  • Adds support for ordering job requests for archived s3 objects using the storage class' placement hints. This supports efficient s3 tape restore operations.

Related Issue(s)

Required when applicable.

Where should the reviewer(s) start reviewing this?

Only required for larger PRs when this may not be immediately obvious.

Are there any specific topics we should discuss before merging?

Not required.

What are the next steps after this PR?

Not required.

Checklist before merging:

Required for all PRs.

When creating a PR these are items to keep in mind that cannot be checked by GitHub actions:

  • Documentation:
    • Does developer documentation (code comments, readme, etc.) need to be added or updated?
    • Does the user documentation need to be expanded or updated for this change?
  • Testing:
    • Does this functionality require changing or adding new unit tests?
    • Does this functionality require changing or adding new integration tests?
  • Git Hygiene:

For more details refer to the Go coding standards and the pull request process.

…rting

Add support for JobRequest SortValues.
- Generically allows RST clients to optionally provide an order string slice to sort job requests.
Add support for s3 storage class placement hints.
- Supports string, integer and float s3 metadata value types.
- Includes unit tests
Unify rst.GetRemotePathInfo return values into RemotePathInfo type.
Add warning message when builder's job request buffer exceeds memory utilization threshold.
@swartzn swartzn requested a review from a team as a code owner January 9, 2026 19:03
@swartzn swartzn self-assigned this Jan 12, 2026
@iamjoemccormick

Copy link
Copy Markdown
Member

For now this was replaced by #312 which adds support for integrating with non-S3 bulk restore APIs. It may be useful to add support for something like sorting by archival placement hints, but we'll defer further work until we have a reason to revisit this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants