Add OnPair string compression encoding with predicate pushdown#7927

Closed

joseph-isaacs wants to merge 22 commits into

developfrom

claude/vortex-array-rust-bindings-FQfIX

Commits on May 14, 2026

Add OnPair string array encoding with predicate pushdown
claude
committed
Add 100k-row smoke test for OnPair encoding
claude
committed
Refactor OnPair to FSST-shape: dict-as-blob, u16 codes child, Rust decode
claude
committed
Wire OnPair as a btrblocks string scheme
claude
committed
Make OnPair the default string-fragmentation scheme + register globally
claude
committed
Move OnPair default-feature flag up to the vortex umbrella crate
claude
committed
Round out OnPair CI: widen-on-decode + public-api locks + lints
claude
committed
Add file-write roundtrip skeleton + track Misaligned buffer follow-up
claude
committed
OnPair layout v3: all integer arrays as buffers, file roundtrip works
claude
committed
Thorough multi-column / multi-chunk OnPair file round-trip tests
claude
committed
Wire the OnPair roundtrip suite through the full Vortex session
claude
committed
SIMD-friendly OnPair decode + divan bench
claude
committed
Fix Misaligned buffer on read by reordering OnPair buffers
claude
committed
OnPair: FSST-shape ABI — codes / codes_offsets / dict_offsets as slot children
claude
committed
OnPair decoder: combined (offset|length) table + skip canonicalize double-copy
claude
committed
OnPair decoder: drop redundant dict_offsets widen + tighter hot path
claude
committed
OnPair: filter shares dict (TPC-H Q22 SF=10 fix) + token-aware predicates + memchr contains
claude
committed
OnPair: drop Like pushdown for now, keep Compare token-aware path
claude
committed
OnPair: fast LIKE on compressed codes (PrefixAutomaton + bloom + filter ptype fix)
claude
committed
OnPair: regression tests for narrowed codes_offsets in filter
claude
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add OnPair string compression encoding with predicate pushdown#7927

Add OnPair string compression encoding with predicate pushdown#7927
joseph-isaacs wants to merge 22 commits into
developfrom
claude/vortex-array-rust-bindings-FQfIX

Commits on May 14, 2026

Add OnPair string array encoding with predicate pushdown

Add 100k-row smoke test for OnPair encoding

Refactor OnPair to FSST-shape: dict-as-blob, u16 codes child, Rust decode

Wire OnPair as a btrblocks string scheme

Make OnPair the default string-fragmentation scheme + register globally

Move OnPair default-feature flag up to the vortex umbrella crate

Round out OnPair CI: widen-on-decode + public-api locks + lints

Add file-write roundtrip skeleton + track Misaligned buffer follow-up

OnPair layout v3: all integer arrays as buffers, file roundtrip works

Thorough multi-column / multi-chunk OnPair file round-trip tests

Wire the OnPair roundtrip suite through the full Vortex session

SIMD-friendly OnPair decode + divan bench

Fix Misaligned buffer on read by reordering OnPair buffers

OnPair: FSST-shape ABI — codes / codes_offsets / dict_offsets as slot children

OnPair decoder: combined (offset|length) table + skip canonicalize double-copy

OnPair decoder: drop redundant dict_offsets widen + tighter hot path

OnPair: filter shares dict (TPC-H Q22 SF=10 fix) + token-aware predicates + memchr contains

OnPair: drop Like pushdown for now, keep Compare token-aware path

OnPair: fast LIKE on compressed codes (PrefixAutomaton + bloom + filter ptype fix)

OnPair: regression tests for narrowed codes_offsets in filter

Commits on May 15, 2026

OnPair: drop `%contains%` pushdown (fall through to canonical decode), fix lint

OnPair: FineWeb-shape bench + decode-vs-fallback measurements