Skip to content

Navigation Menu

Appearance settings

View all features
- BY COMPANY SIZE
  Enterprises
  Small and medium teams
  Startups
  Nonprofits
- BY USE CASE
  App Modernization
  DevSecOps
  DevOps
  CI/CD
  View all use cases
- BY INDUSTRY
  Healthcare
  Financial services
  Manufacturing
  Government
  View all industries
View all solutions
- EXPLORE BY TOPIC
  AI
  Software Development
  DevOps
  Security
  View all topics
- EXPLORE BY TYPE
  Customer stories
  Events & webinars
  Ebooks & reports
  Business insights
  GitHub Skills
- SUPPORT & SERVICES
  Documentation
  Customer support
  Community forum
  Trust center
  Partners
View all resources
- COMMUNITY
  GitHub SponsorsFund open source developers
- PROGRAMS
  Security Lab
  Maintainer Community
  Accelerator
  GitHub Stars
  Archive Program
- REPOSITORIES
  Topics
  Trending
  Collections
- ENTERPRISE SOLUTIONS
  Enterprise platformAI-powered developer platform
- AVAILABLE ADD-ONS
  GitHub Advanced SecurityEnterprise-grade security features
  Copilot for BusinessEnterprise-grade AI features
  Premium SupportEnterprise-grade 24/7 support
Pricing

Search code, repositories, users, issues, pull requests...

Search

Clear

Search syntax tips

Provide feedback

We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted

Saved searches

Use saved searches to filter your results more quickly

Name

Query

To see all available qualifiers, see our documentation.

Appearance settings

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

m3db / m3 Public

Notifications You must be signed in to change notification settings
Fork 461
Star 4.9k

Code
Issues 87
Pull requests 133
Discussions
Actions
Projects
Wiki
Security and quality
Insights

Additional navigation options

Code
Issues
Pull requests
Discussions
Actions
Projects
Wiki
Security and quality
Insights

[dbnode] Add index snapshotting#2556

Open

notbdu wants to merge 82 commits into

masterm3db/m3:masterfrom

bdu/index-snapshotsm3db/m3:bdu/index-snapshotsCopy head branch name to clipboard

Conversation Commits82 (82)Checks Files changed

Open

[dbnode] Add index snapshotting#2556
notbdu wants to merge 82 commits into
masterfrom
bdu/index-snapshots

Commits

Commits on Nov 3, 2020

Extend persist manager to support persisting index snapshots.
notbdu
committed
Add test for prepare index snapshot and fixes.
notbdu
committed
Implement index snapshotting and add test.
notbdu
committed
Fix test.
notbdu
committed
Add test for subtracing index snapshot shard time ranges from fs bootstrapper.
notbdu
committed
Bootstrap snapshots in commitlog.
notbdu
committed
save
notbdu
committed
Use index info files to determine index volume type written to disk.
notbdu
committed
Implement adding snapshotted segments to an index block.
notbdu
committed
Add segment compactable/frozen state.
notbdu
committed
Record index snapshot state.
notbdu
committed
Add TODOs and initialize index snapshot state.
notbdu
committed
Cleanup index snapshots based on cached index snapshot state.
notbdu
committed
Cleanup and update mocks
notbdu
committed
Fix tests and add unit tests for cleaning up index snapshots.
notbdu
committed
Write empty snapshot files after index flush completes.
notbdu
committed
Test writing empty snapshots after successful warm flush.
notbdu
committed
Fix unit tests
notbdu
committed
Fix comments.
notbdu
committed
Extend comment
notbdu
committed
Update mocks
notbdu
committed
Remove bootstrapping from snapshots in fs bootstrapper.
notbdu
committed
Check if reverse index exists.
notbdu
committed
Flush type.
notbdu
committed
Do no work if index block does not exist.
notbdu
committed
Only perform cleanup if enabled.
notbdu
committed
Only cleanup index snapshots when index enabled and fix tests.
notbdu
committed
Remove index bootstrapping from fs bootstrapper.
notbdu
committed
Remove unneeded test.
notbdu
committed
Fix fs bootstrapper unit tests.
notbdu
committed
Fix unit test.
notbdu
committed
Add integration test for bootstrapping from index snapshots.
notbdu
committed
Update read only index proxy.
notbdu
committed
Add snapshot ID to index snapshot info files and handle checksum validation in read path for index fileset files.
notbdu
committed
Refactor calculating fulfilled time ranges for index block.
notbdu
committed
Write both index and data snapshots to disk and bootstrap. Verify works.
notbdu
committed
Fix more integration tests.
notbdu
committed
Fix unit test and codegen.
notbdu
committed
Can have more than one snapshot per block start since cleanup is async.
notbdu
committed
Use the same snapshot ID across all snapshots.
notbdu
committed
Cleanup.
notbdu
committed
Make all segment fileset writers implement segment state and update mocks/tests.
notbdu
committed
Add/modify unit tests for bootstrapping index data in fs bootstrapper.
notbdu
committed
Re-use snapshot segments array when snapshotting.
notbdu
committed
Make read through segments implement fst.Segment and amortize allocs for snapshots.
notbdu
committed
Handle closed mutable segments.
notbdu
committed
Short circuit if no work to do.
notbdu
committed
Calling memory segments data when closed is not an error case.
notbdu
committed
Return nil.
notbdu
committed
Fix unit tests.
notbdu
committed
No data if closed.
notbdu
committed
Remove up to latest index snapshot or loaded.
notbdu
committed
Add test for flushing index snapshots and removal of old index snapshots after data flush.
notbdu
committed
Add snapshot documentation.
notbdu
committed
Remove snapshot version flushed and modify unit tests to test for deletion up to version loaded or most recent UUID.
notbdu
committed
Cleanup logic fix
notbdu
committed
Fix read thru seg and cleanup tests.
notbdu
committed
Fix rebase conflicts and tests.
notbdu
committed
Fix cleanup test.
notbdu
committed
Fix integration tests.
notbdu
committed
Update mocks.
notbdu
committed
Address PR feedback.
notbdu
committed
Remove delete warm snapshot block for now.
notbdu
committed
Use an actual index instead of the ns hash.
notbdu
committed
Address PR comments and move around docs.
notbdu
committed
Fix unit tests.
notbdu
committed
Fix integration test fn call.
notbdu
committed
Split invariant violation logic.
notbdu
committed
Can have no snapshots for certain blocks.
notbdu
committed
Wait for warm flush to succeed.
notbdu
committed
Move digest notes to docs folder.
notbdu
committed
Only emit invariant violation if error.
notbdu
committed
Don't mmap index snapshots after persisting.
notbdu
committed
Fix method calls and tests.
notbdu
committed
Fix flaky docker integration test reads.
notbdu
committed
Return errors when buffer size too small.
notbdu
committed
Remove write empty index snapshots logic, update docs, and use ns ID string as key in index results.
notbdu
committed
Address PR comments.
notbdu
committed
Fn name change.
notbdu
committed
Address PR feedback.
notbdu
committed
Update commitlog bootstrap integration test to cover the full reliance on snapshots case in addition to the split across snapshots/commitlogs case. Add comments.
notbdu
committed
Update license header.
notbdu
committed

Footer

© 2026 GitHub, Inc.

Footer navigation

Terms
Privacy
Security
Status
Community
Docs
Contact

You can’t perform that action at this time.