background processes simulator application for re-building vector indexes#32

Draft

galsalomon66 wants to merge 11 commits into

lancedb:mainfrom

galsalomon66:s3vector_background_process

Commits on Apr 9, 2026

this utility provides the basic simulation for the background processes to enable the rebuild of all indexes, while put and remove vectors runs concurrently.
galsalomon66
committed
the table/index metadata is now save using the lancedb api, the metadata is part of the table metadata.
galsalomon66
committed
Added S3 backend support via environment variables.
galsalomon66
committed
Remove CMakeCache.txt from tracking, add to .gitignore
galsalomon66
committed
src/query.rs — Two new Rust FFI functions
galsalomon66
committed
enable the user to create scalar indexes on specific table columns (after table creation), list all indexes with detailed info, and drop indexes by name — all via the existing CLI interface.
galsalomon66
committed
Add missing test_scalar_index.cpp test file
galsalomon66
committed
cargo fmt
galsalomon66
committed
fix the CI issue with nlohmann_json
galsalomon66
committed
fixing a valgrind issue(leak) in tests/test_scalar_index.cpp, the Cmake is missing ${TEST_ENV_PREFIX} that cause a failure in the test run
galsalomon66
committed

Commits on Apr 18, 2026

adding tests, for concurrent put-vectors (multiple processes uploading vectors) , verifing only a single index-re-build is running, no interuption for querie
galsalomon66
committed