Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
2587741
feat: Add Apache Iceberg lakehouse table format support (Phase 2)
tsafin Feb 1, 2026
0884b3a
feat: Implement Phase 3.1 - Real Lance data writing with Parquet backing
tsafin Feb 3, 2026
35d870c
build: Add Cargo.lock for reproducible Rust FFI builds
tsafin Feb 3, 2026
d38d0f1
build: Ignore Rust build artifacts in source tree
tsafin Feb 3, 2026
80a018e
build: Fix Rust toolchain detection to prefer /snap/bin versions
tsafin Feb 3, 2026
dc18f59
build: Fix Rust env var passing in cargo build command
tsafin Feb 3, 2026
56d7e0d
build: Disable --true-zero-copy flag and Buffer::Wrap complexity
tsafin Feb 4, 2026
c833ed4
feat: Implement Lance FFI Phase 1 - Streaming via Rust Writer
tsafin Feb 5, 2026
28b1f4d
docs: Add Phase 1 benchmarking suite and comprehensive report
tsafin Feb 5, 2026
63956ba
docs: Document Lance FFI Phase 1.5 critical blocking issue and implem…
tsafin Feb 6, 2026
1970616
fix: Implement Arrow C Data Interface import for Lance FFI
tsafin Feb 7, 2026
949173b
build: Integrate mold linker for faster C++ linking
tsafin Feb 7, 2026
000251a
test: Phase 2.0c-1 batch size sensitivity analysis
tsafin Feb 7, 2026
f629e6e
opt: Phase 2.0c-2a Lance configuration optimization (+8.8%)
tsafin Feb 7, 2026
2fe7344
opt: Apply 5K batch size optimization from Phase 2.0c-1
tsafin Feb 7, 2026
46ab3dd
benchmark: Phase 2.0c comprehensive all-tables benchmark
tsafin Feb 7, 2026
0cf495d
feat: Phase 2.0c-2 encoding hints optimization
tsafin Feb 7, 2026
41e13a3
Phase 2.0c-3: Encoding Strategy Simplification - Complete
tsafin Feb 7, 2026
d9d961e
fix: Address PR #5 critical review issues
tsafin Feb 8, 2026
ed0a0d1
fix: Resolve FFI ownership mismatch - eliminate double-free vulnerabi…
tsafin Feb 8, 2026
8ef4bf9
fix: Add proper CMake detection for uuid library instead of blind lin…
tsafin Feb 8, 2026
09837e8
feat: Add comprehensive GTest suite for Lance writer
tsafin Feb 8, 2026
5f15c8f
feat: Add comprehensive GTest suite for Lance writer with full test p…
tsafin Feb 8, 2026
c42c755
Vendor googletest and guard mold
tsafin Feb 8, 2026
4d23cef
fix: Comprehensive GTest suite with nullable array support and extend…
tsafin Feb 8, 2026
fb49735
feat: streaming moe in lance. attempt #1
tsafin Feb 9, 2026
73c454c
infra: use mold for faster rust link time
tsafin Feb 9, 2026
ccc3db6
Build: Fix dbgen test working directory for dists.dss access
tsafin Feb 9, 2026
8b95d36
Build: Integrate local Lance submodule and update FFI dependency
tsafin Feb 9, 2026
a2607a3
feat: proper streaming support in lance rust code
tsafin Feb 9, 2026
b95a211
Fix(lance): Streaming Zero-Copy Implementation
tsafin Feb 9, 2026
b2223fe
chore: remove cmake build artifacts from git tracking
tsafin Feb 10, 2026
19e94b3
perf(lance): tune write parameters for 3x throughput improvement
tsafin Feb 10, 2026
612b723
fix: resolve build errors after rebase - missing lance include and Ar…
tsafin Feb 10, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions .cargo/config.toml
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
[target.x86_64-unknown-linux-gnu]
linker = "clang"
rustflags = ["-C", "link-arg=-fuse-ld=mold"]
Comment thread
tsafin marked this conversation as resolved.
22 changes: 20 additions & 2 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -25,14 +25,20 @@ libtpch_core.a
*.lib
*.obj

# CMake build artifacts in any subdirectory
**/CMakeFiles/
**/cmake_install.cmake
**/CTestTestfile.cmake

# Build artifacts in examples/ subdirectory (CMake output)
examples/CMakeFiles/
examples/Makefile
examples/cmake_install.cmake
examples/*.o
examples/*.o.d
examples/*.d

# Build artifacts in third_party subdirectories
third_party/dbgen/Makefile

# Executables (generated from examples and main)
/tpch_benchmark
/examples/simple_arrow_parquet
Expand Down Expand Up @@ -62,3 +68,15 @@ __pycache__/
# Package manager artifacts (should not be committed)
*.deb
*.rpm

# Root-level documentation and text files (except README.md)
/*.md
!README.md
/*.txt

# Rust build artifacts
# Note: Cargo target directory should be in CMAKE_BINARY_DIR (e.g., build/rust/)
# NOT in the source tree. Ignore any in-source target/ directories.
third_party/lance-ffi/target/
# Note: Project-specific Cargo.lock files (e.g., third_party/lance-ffi/Cargo.lock) ARE committed
# Only a root-level Cargo.lock would be ignored (if it existed)
6 changes: 6 additions & 0 deletions .gitmodules
Original file line number Diff line number Diff line change
Expand Up @@ -10,3 +10,9 @@
[submodule "third_party/arrow"]
path = third_party/arrow
url = https://github.com/apache/arrow.git
[submodule "third_party/googletest"]
path = third_party/googletest
url = https://github.com/google/googletest.git
[submodule "third_party/lance"]
path = third_party/lance
url = https://github.com/lancedb/lance
170 changes: 0 additions & 170 deletions BUILD_AND_BENCHMARK_GUIDE.md

This file was deleted.

Loading