feat(store): add SLRU-backed persistent chunk cache#442
Open
kisielewski wants to merge 1 commit into
Open
Conversation
kisielewski
force-pushed
the
feat/cache-srlu-policy
branch
from
040e401 to
716c0a9
Compare
kisielewski
force-pushed
the
feat/cache-srlu-policy
branch
from
716c0a9 to
0f3711b
Compare
kisielewski
changed the base branch from
feat/search-api
to
feat/chunk-read-write-optimization-for-search-api
Introduces a segmented LRU (SLRU) eviction policy and a pluggable cache backend abstraction. GlobalCache now uses SlruBackedCache with an in-memory backend by default, and exposes setChunksCacheBackend() for external persistent backends (e.g. LevelDB).
kisielewski
force-pushed
the
feat/cache-srlu-policy
branch
from
0f3711b to
62a6403
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Important
Depends on: #436 — chunk read cache, batched writes, and in-memory file size
Do not merge before #436 is merged.
Depends on #436 (feat/chunk-read-write-optimization-for-search-api)
Summary
SlruPolicy— an in-memory Segmented LRU eviction trackerwith two segments (Probationary / Protected)
CacheBackendInterfaceabstraction for pluggable persistent storage,with
CacheBackendInMemoryas the default in-memory implementationSlruBackedCache— aCacheInterfacebacked by anyCacheBackendInterface, persisting both values and SLRU metadata(segment, sequence, size) so eviction order survives process restarts
GlobalCachewithsetChunksCacheBackend()for supplying anexternal backend (e.g. LevelDB); the built-in path now routes through
SlruBackedCache+CacheBackendInMemoryby default