Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
4a30a9c
feat(vortex-row): add row-oriented byte encoder crate
joseph-isaacs Jun 4, 2026
083c7f3
ci(vortex-row): run row_encode benchmarks on CodSpeed
joseph-isaacs Jun 4, 2026
37936e2
vortex-row: skip ListView validation in row encoder output
joseph-isaacs Jun 4, 2026
48b92d1
vortex-row: add validity fast-path helper for the hot encoders
joseph-isaacs Jun 4, 2026
578495d
vortex-row: skip zero-init of the output buffer
joseph-isaacs Jun 4, 2026
6e401b9
vortex-row: auto-vectorize pure-fixed offsets construction
joseph-isaacs Jun 4, 2026
bd781d7
vortex-row: auto-vectorize mixed-path offsets construction
joseph-isaacs Jun 4, 2026
bb39136
vortex-row: rewrite varlen 32-byte block encoder with copy_nonoverlap…
joseph-isaacs Jun 4, 2026
ee049ae
vortex-row: walk VarBinView rows directly in the encoder hot loop
joseph-isaacs Jun 4, 2026
65a24f9
vortex-row: satisfy cast-truncation lints in ported hot paths
joseph-isaacs Jun 4, 2026
2711504
vortex-row: arithmetic-write fast path for fixed-before-varlen columns
joseph-isaacs Jun 4, 2026
2fc07fa
ci(vortex-row): fold row_encode benchmarks into CodSpeed shard 8
joseph-isaacs Jun 5, 2026
b97b7e4
vortex-row: benchmark FSST row-encoding (unpack-then-convert vs phases)
joseph-isaacs Jun 4, 2026
d6f1f4e
vortex-row: rustfmt the fsst row-encode benchmark
joseph-isaacs Jun 4, 2026
43915bd
vortex-row: add fused fast-path FSST row-encode benchmark
joseph-isaacs Jun 4, 2026
2c54e62
vortex-row: add scatter-right fused FSST row-encode benchmark
joseph-isaacs Jun 5, 2026
b3411f1
fix
joseph-isaacs Jun 5, 2026
a213cdd
fix
joseph-isaacs Jun 5, 2026
2a3ae8f
reduce coverage job disk pressure
joseph-isaacs Jun 5, 2026
0892a82
fix
joseph-isaacs Jun 5, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/codspeed.yml
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ jobs:
- { shard: 5, name: "Encodings 2", packages: "vortex-decimal-byte-parts vortex-fastlanes vortex-fsst", features: "--features _test-harness" }
- { shard: 6, name: "Encodings 3", packages: "vortex-pco vortex-runend vortex-sequence" }
- { shard: 7, name: "Encodings 4", packages: "vortex-sparse vortex-zigzag vortex-zstd" }
- { shard: 8, name: "Storage formats", packages: "vortex-flatbuffers vortex-proto vortex-btrblocks" }
- { shard: 8, name: "Storage formats & row encoding", packages: "vortex-flatbuffers vortex-proto vortex-btrblocks vortex-row" }
name: "Benchmark with Codspeed (Shard #${{ matrix.shard }})"
timeout-minutes: 30
runs-on: >-
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/rust-instrumented.yml
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ jobs:
- suite: tests
runs-on: >-
${{ github.repository == 'vortex-data/vortex'
&& format('runs-on={0}/runner=amd64-large/image=ubuntu24-full-x64-pre-v2/tag=rust-coverage-suite-{1}', github.run_id, matrix.suite)
&& format('runs-on={0}/runner=amd64-large/disk=large/image=ubuntu24-full-x64-pre-v2/tag=rust-coverage-suite-{1}', github.run_id, matrix.suite)
|| 'ubuntu-latest' }}
env:
RUSTFLAGS: "-Cinstrument-coverage -A warnings"
Expand Down
20 changes: 20 additions & 0 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

3 changes: 3 additions & 0 deletions Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,7 @@ members = [
"vortex-io",
"vortex-proto",
"vortex-array",
"vortex-row",
"vortex-tensor",
"vortex-turboquant",
"vortex-compressor",
Expand Down Expand Up @@ -104,6 +105,7 @@ arrow-cast = "58"
arrow-data = "58"
arrow-ipc = "58"
arrow-ord = "58"
arrow-row = "58"
arrow-schema = "58"
arrow-select = "58"
arrow-string = "58"
Expand Down Expand Up @@ -295,6 +297,7 @@ vortex-onpair = { version = "0.1.0", path = "./encodings/experimental/onpair", d
vortex-parquet-variant = { version = "0.1.0", path = "./encodings/parquet-variant" }
vortex-pco = { version = "0.1.0", path = "./encodings/pco", default-features = false }
vortex-proto = { version = "0.1.0", path = "./vortex-proto", default-features = false }
vortex-row = { version = "0.1.0", path = "./vortex-row", default-features = false }
vortex-runend = { version = "0.1.0", path = "./encodings/runend", default-features = false }
vortex-scan = { version = "0.1.0", path = "./vortex-scan", default-features = false }
vortex-sequence = { version = "0.1.0", path = "encodings/sequence", default-features = false }
Expand Down
1 change: 1 addition & 0 deletions docs/specs/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,4 +11,5 @@ file-format
ipc-format
dtype-format
scalar-format
row-encoding
```
Loading
Loading