Skip to content

register_splits to get both offset and relative row_range#7913

Merged
onursatici merged 1 commit into
developfrom
os/row-ranges
May 14, 2026
Merged

register_splits to get both offset and relative row_range#7913
onursatici merged 1 commit into
developfrom
os/row-ranges

Conversation

@onursatici
Copy link
Copy Markdown
Contributor

Summary

register_splits had a row_range that was local, so nested chunked layouts failed to get the right global split registered. Add the global offset and send it with the local row_range so layout readers have all information to register the global correct split offset.

I could have done this without changing the API but then the outer chunk layout has to create a new local btreemap and send that then merge with the global btreemap with the chunk offset applied, and that felt expensive

@onursatici onursatici added the changelog/fix A bug fix label May 13, 2026
Comment thread vortex-io/public-api.lock Outdated
Copy link
Copy Markdown
Contributor

@joseph-isaacs joseph-isaacs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You could pass down an offset btree?

@onursatici
Copy link
Copy Markdown
Contributor Author

yea I thought about that but that would introduce unnecessary mutable state. We would keep changing the btree offset before passing down to each child

@joseph-isaacs
Copy link
Copy Markdown
Contributor

It would be a stack alloced wrapper

@onursatici
Copy link
Copy Markdown
Contributor Author

yea true, it is &mut now anyway. Still I think I prefer this because it is more explicit and if projection eval or pruning eval methods in the reader decide to use the global offset in the future, we can use this SplitRange struct to give them this information

Signed-off-by: Onur Satici <onur@spiraldb.com>
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 14, 2026

Merging this PR will improve performance by 20.24%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 6 improved benchmarks
✅ 1210 untouched benchmarks
⏩ 24 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation new_bp_prim_test_between[i16, 32768] 134.1 µs 120.3 µs +11.54%
Simulation new_bp_prim_test_between[i32, 16384] 109.1 µs 94.8 µs +15.07%
Simulation new_bp_prim_test_between[i64, 32768] 236.7 µs 178.1 µs +32.94%
Simulation new_bp_prim_test_between[i32, 32768] 169.9 µs 141.1 µs +20.42%
Simulation new_bp_prim_test_between[i64, 16384] 144.4 µs 115.2 µs +25.4%
Simulation new_alp_prim_test_between[f64, 16384] 148.8 µs 126.9 µs +17.26%

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.


Comparing os/row-ranges (e6024a0) with develop (7349cd6)

Open in CodSpeed

Footnotes

  1. 24 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@onursatici onursatici merged commit 7668bef into develop May 14, 2026
66 checks passed
@onursatici onursatici deleted the os/row-ranges branch May 14, 2026 14:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/fix A bug fix

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants