Update Rust crate lance-encoding to v6

[renovate]

This PR contains the following updates:

Package	Type	Update	Change
lance-encoding	dependencies	major	4 → 6

---

Warning

Some dependencies could not be looked up. Check the Dependency Dashboard for more information.

---

Release Notes

lance-format/lance (lance-encoding)

v6.0.0

Compare Source

What's Changed

Breaking Changes 🛠

• refactor!: vendor the tokenizer stack into lance by @​Xuanwo in #​6512
• perf!: run scheduler initialize eagerly in async read_tasks by @​westonpace in #​6710

New Features 🎉

• feat: support segmented inverted index build and search by @​Xuanwo in #​6305
• feat(dictionary-namespace): support table related operation by @​zhangyue19921010 in #​6308
• feat: clean up transaction files on failed commits by @​wjones127 in #​6319
• feat: add planned blob reads with source-level coalescing by @​Xuanwo in #​6352
• refactor: use exact base-scoped store bindings by @​Xuanwo in #​6422
• feat: wire batch_size_bytes to Python and public Rust API by @​westonpace in #​6428
• feat(vector): add partition search parallelism by @​BubbleCal in #​6475
• feat(index): support float16 and float64 in IVF_FLAT by @​BubbleCal in #​6476
• feat: batch chopping fallback for filtered read by @​westonpace in #​6482
• feat(java): add Dataset.sample() API by @​beinan in #​6500
• feat: add ANN proto codecs and extract table_identifier module by @​LuQQiu in #​6503
• feat: add configurable blob v2 pack file size by @​hamersaw in #​6508
• feat: expose has_stable_row_ids property on LanceDataset by @​pengw0048 in #​6531
• feat: expose base scoped store bindings to python by @​zhangyue19921010 in #​6547
• feat: support zonemap index segments by @​beinan in #​6593
• feat: update lance-namespace to 0.7.2 and align namespace declared table lifecycle by @​jackye1995 in #​6608
• feat: generalize dynamic object store credentials by @​jackye1995 in #​6609
• feat: add ANNIvfPartitionExecProto by @​LuQQiu in #​6612
• feat: add prefilter_type to ANNIvfSubIndexExecProto by @​LuQQiu in #​6613
• feat: replace Azure SDK and google-cloud-auth with direct reqwest for credential vending by @​jackye1995 in #​6617
• feat(io): bypass backpressure for io_buffer_size=0 and 2.0 indirect I/O by @​westonpace in #​6627

Bug Fixes 🐛

• fix: warn and clamp LANCE_INITIAL_UPLOAD_SIZE instead of panicking by @​LuciferYang in #​6389
• fix: keep delete-by-source fast path with scalar indexes by @​Xuanwo in #​6435
• fix: include column_metadatas and column_infos in CachedFileMetadata::DeepSizeOf by @​jiaoew1991 in #​6480
• fix(index): preserve fts prewarm position codec by @​BubbleCal in #​6485
• fix: handle FlatBin quantization in optimize_vector_indices_v2 by @​jackye1995 in #​6488
• fix: use logical OR instead of bitwise OR in conflict resolver by @​dentiny in #​6492
• fix: add dir_listing_to_manifest_migration_enabled flag to avoid extra object store calls by @​jackye1995 in #​6507
• fix: prevent arithmetic overflow in U64Segment encoding selection for sparse/extreme row id ranges by @​ivscheianu in #​6516
• fix: bump jieba-rs to 0.9.0 to fix build-no-lock CI by @​westonpace in #​6518
• fix: blob projection schema compatibility by @​Xuanwo in #​6521
• fix(namespace): serialize manifest mutations by @​Xuanwo in #​6525
• fix: missing bumpversion entry for lance-tokenizer by @​Xuanwo in #​6526
• fix: scale default memory pool size by partition count by @​westonpace in #​6562
• fix: apply fragment bitmap allow-list to index search results by @​westonpace in #​6563
• fix: hard cap batch size in merge_insert to prevent sort failures by @​westonpace in #​6564
• fix: index type try_from miss RTree and BLOOMFILTER by @​wojiaodoubao in #​6568
• fix(namespace): align error handling with namespace spec by @​jackye1995 in #​6575
• fix: reject Rewrite vs CreateIndex when FRI groups straddle bitmap by @​wjones127 in #​6610
• fix(json): detect float64-stored numbers in json type extraction by @​dentiny in #​6622
• fix: respect LANCE_DEFAULT_IO_BUFFER_SIZE if it has been set by @​westonpace in #​6636
• fix: make vector distance schema nullable by @​BubbleCal in #​6649

Documentation 📚

• docs: tighten python environment workflow guidance by @​Xuanwo in #​6520
• docs: fix broken intra-doc link in DatasetPreFilter by @​LuciferYang in #​6579
• docs: correct repetition level example in encoding docs by @​BubbleCal in #​6585

Performance Improvements 🚀

• perf: intern DataFile fields/column_indices to reduce manifest memory by @​beinan in #​6477
• perf: intern RowDatasetVersionMeta inline bytes to reduce manifest memory by @​beinan in #​6499
• perf: add SIMD-accelerated u8 dot product for SQ distance by @​justinrmiller in #​6506
• perf: add SIMD kernels for bf16 distance functions by @​justinrmiller in #​6510
• perf: submit I/O requests eagerly in FullZipScheduler by @​hushengquan in #​6513
• perf: add SIMD-accelerated u8 L2 and cosine distance kernels by @​justinrmiller in #​6517
• perf: speed up RaBitQ 4-bit LUT distance on ARM by 16x by @​justinrmiller in #​6537
• perf: add explicit SIMD types and distance kernels for f64 by @​justinrmiller in #​6540
• perf: don't spawn the scheduling on a separate thread for small reads by @​westonpace in #​6637
• perf: avoid materializing RoaringBitmap::full() in fragment allow-list by @​wkalt in #​6664
• perf: revert inline scheduling by @​westonpace in #​6709

Full Changelog: lance-format/lance@release-root/6.0.0-beta.N...v6.0.0

---

Configuration

📅 Schedule: (UTC)

• Branch creation
  • Between 12:00 AM and 03:59 AM, only on Monday (* 0-3 * * 1)
• Automerge
  • At any time (no schedule defined)

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

---

• If you want to rebase/retry this PR, check this box

---

This PR was generated by Mend Renovate. View the repository job log.

[codspeed-hq]

Merging this PR will degrade performance by 16.58%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

❌ 1 regressed benchmark
✅ 1220 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

	Mode	Benchmark	BASE	HEAD	Efficiency
❌	Simulation	chunked_varbinview_opt_canonical_into[(1000, 10)]	188 µs	225.4 µs	-16.58%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

---

_{Comparing renovate/lance-encoding-6.x (446bcea) with develop (c573cef)}

[renovate]

Edited/Blocked Notification

Renovate will not automatically rebase this PR, because it does not recognize the last commit author and assumes somebody else may have edited the PR.

You can manually request rebase by checking the rebase/retry box above.

⚠️ Warning: custom changes will be lost.