feat(gms): add host-tier storage contracts [GMS 06/18]#11051
Closed
hutm wants to merge 1 commit into
Closed
Conversation
This comment has been minimized.
This comment has been minimized.
This was referenced Jun 29, 2026
06ad30d to
a202b9b
Compare
bac3fdb to
47f9a1a
Compare
47f9a1a to
ed08b35
Compare
c5ed3d0 to
403de8b
Compare
275d776 to
67dd9d9
Compare
403de8b to
0ffff30
Compare
67dd9d9 to
42c69ca
Compare
c3b6f4c to
7d871e8
Compare
42c69ca to
3ece523
Compare
Signed-off-by: mkhadkevich <mkhadkevich@nvidia.com>
7d871e8 to
de02314
Compare
Contributor
Author
|
Closing this PR because the deprecated umbrella #10450 has been replaced by the deliberately vLLM-only MVP tracker #11600. This PR covers work outside that MVP and is deferred to a future milestone; it is not being marked implemented, rejected, or unnecessary. The branch, comments, and reviews are intentionally retained so future work can reference the design and discussion. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Define the engine-neutral contracts for moving KV content between GPU memory, host memory, and durable storage.
Scope
Adds ring, memory, storage, and transfer interfaces only. Daemon lifecycle, engine adapters, and optional network backends remain separate.
Stack
Position 6/18 in the GMS-managed KV review train. This PR is based on
review/gms-v2-latehost-04-sglang-integration.Parent: #10450
Tracking: #10455
Review migration
This is the current review entry replacing historical merged PR #10472. GitHub does not allow a merged PR to be retargeted; #10472 and all of its comments and reviews remain intact as the historical record.
The train is rebased on
mainataeda23b483831df2f75b697b8ccf65f4ffd9f3d6. The reordered functionality is preserved while each PR boundary is independently buildable and lintable: compatibility call sites and the engine-facing placement adapter now appear at first use; missing type imports and test markers were added; repository-pinned formatting was applied; one unused constant was removed; and every commit carries a DCO sign-off. The complete range passesgit diff --checkand the full pre-commit suite.Validation
Contract and component tests are included with the host-tier implementation; cross-node behavior is completed in positions 8-9.