Skip to content

feat(vortex-file): gate the file writer behind editions#8877

Draft
joseph-isaacs wants to merge 12 commits into
developfrom
claude/writer-editions-gating-8qy1fv
Draft

feat(vortex-file): gate the file writer behind editions#8877
joseph-isaacs wants to merge 12 commits into
developfrom
claude/writer-editions-gating-8qy1fv

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Rationale for this change

Follow-up to the editions implementation (#8871): the edition declarations existed but nothing enforced them. This PR gates the file writer behind editions. The session is the source of truth: it stores the set of enabled editions alongside the declarations, and exposes the resolved set of all enabled encodings. The default session enables core2026.07.0 (EditionId::new("core", 2026, 7, 0)), so by default:

  • the compressor only chooses schemes whose output encodings belong to the enabled editions, and
  • the set that validates every encoding serialized to disk (failing the write on a violation) is that same edition's encoding set.

What changes are included in this PR?

  • vortex-edition: EditionSession now stores the enabled editions next to the declarations: enable() (must be declared; at most one edition per family), enabled(), and enabled_encodings() — the resolved, sorted union of the enabled editions' encoding sets (None when nothing is enabled). The first-party declarations stay in the vortex facade; this crate remains types + session variable + test harness.
  • vortex (facade): register_default_editions now also enables DEFAULT_WRITE_EDITIONS (core2026.07.0, plus the newest unstable draft when the unstable_encodings feature opts in) on the session. New tests: a golden pin of the frozen core2026.07.0 encoding set, per-edition harness validation, subset properties, and a check that every default compression scheme's produced encodings are covered by the default write editions.
  • vortex-compressor: new required Scheme::produced_encodings(&self) -> Vec<ArrayId> trait method declaring the array encodings a scheme may emit (empty = only canonical arrays; cascaded children are covered by their own schemes). CascadingCompressor::with_enabled_editions_gating makes scheme selection resolve the session's enabled encodings from the execution context at compression time and skip schemes whose outputs are not all allowed; sessions with no enabled editions are not gated. Unit-tested with a synthetic edition/scheme.
  • vortex-btrblocks: every scheme declares its produced encodings (including the env-gated Patched output of BitPacking/ALP). BtrBlocksCompressorBuilder gains gate_by_enabled_editions() (session gating pass-through) and retain_allowed_encodings() (static filtering for explicit allow sets).
  • vortex-layout: FlatLayoutStrategy::with_enabled_editions_gating resolves the allowed encodings from the session's enabled editions at write_stream time — an encoding outside them fails the write via the existing normalize-with-Error validation — falling back to the explicit allowed_encodings set when the session enables no editions.
  • vortex-file: the default WriteStrategyBuilder wires all of this up: flat writer gated by enabled editions with the static ALLOWED_ENCODINGS registry as fallback, and both the data and stats compressors gated at compression time. An explicit with_allow_encodings set overrides the session gate everywhere (unchanged behavior for vortex-jni / vortex-parquet-variant). The writer's deterministic pre-populated ArrayContext likewise comes from the session's enabled encodings. Experimental patches remain a runtime opt-out: Patched is only writable when the experimental environment variable is set, mirroring when compression produces it.

Checks run (after rebasing onto develop at #8871): cargo nextest run -p vortex-edition -p vortex-compressor -p vortex-btrblocks -p vortex-layout -p vortex-file -p vortex (411 passed; also with --all-features for file/btrblocks/compressor), cargo test --doc for the touched crates, cargo +nightly fmt --all, and cargo clippy --all-targets --all-features for the touched crates plus vortex-tensor, vortex-jni, and vortex-parquet-variant (clean). Workspace-wide clippy could not be run: vortex-duckdb's build script cannot download DuckDB sources in this sandbox.

What APIs are changed? Are there any user-facing changes?

  • Scheme has a new required method produced_encodings() -> Vec<ArrayId> — a breaking change for third-party schemes, which must now declare their outputs.
  • EditionSession::{enable, enabled, enabled_encodings}, CascadingCompressor::with_enabled_editions_gating, BtrBlocksCompressorBuilder::{gate_by_enabled_editions, retain_allowed_encodings}, FlatLayoutStrategy::with_enabled_editions_gating, and vortex::editions::DEFAULT_WRITE_EDITIONS are new.
  • Behavior change for sessions built via the vortex facade: encodings outside the enabled editions (fastlanes.delta, vortex.onpair, vortex.zstd_buffers without the unstable_encodings feature, vortex.patched without the env opt-in) are no longer writable — writes containing them fail at the flat-layout validation instead of producing files without the read-forever guarantee. Sessions that enable no editions keep the previous static ALLOWED_ENCODINGS behavior.

🤖 Generated with Claude Code

https://claude.ai/code/session_01CK2nCuXnyd2g3mNHQC8Lz2

@joseph-isaacs
joseph-isaacs marked this pull request as draft July 21, 2026 12:41
Base automatically changed from claude/editions-impl-fiicrg to develop July 21, 2026 13:47
@joseph-isaacs
joseph-isaacs force-pushed the claude/writer-editions-gating-8qy1fv branch from bf7ca36 to 2da25df Compare July 21, 2026 13:54
@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 63d1f29 1 Explore Profiling Data
Previous Runs (5)
Status Commit Job Attempt Link
🟢 Done 51a8f52 1 Explore Profiling Data
🟢 Done c85b1c3 1 Explore Profiling Data
🟢 Done 0726cb5 1 Explore Profiling Data
🟢 Done c84896c 1 Explore Profiling Data
🟢 Done 2da25df 1 Explore Profiling Data

Powered by Polar Signals Cloud

@joseph-isaacs joseph-isaacs added the changelog/feature A new feature label Jul 21, 2026 — with Claude
@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Vortex queries 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+6.6%, low confidence) · DuckDB No clear signal (-5.6%, low confidence)
Vortex (geomean): 0.969x ➖
Parquet (geomean): 0.968x ➖
Shifts: Parquet (control) -3.2% · Median polish -3.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.007x ➖, 0↑ 0↓)
name PR 63d1f29 (ns) base 7654891 (ns) ratio (PR/base)
vortex_q00/datafusion:vortex-file-compressed 8440562 8574618 0.98
vortex_q01/datafusion:vortex-file-compressed 5386990 5229639 1.03
datafusion / parquet (0.945x ➖, 0↑ 0↓)
name PR 63d1f29 (ns) base 7654891 (ns) ratio (PR/base)
vortex_q00/datafusion:parquet 20292479 21568209 0.94
vortex_q01/datafusion:parquet 4585035 4830857 0.95
duckdb / vortex-file-compressed (0.936x ➖, 0↑ 0↓)
name PR 63d1f29 (ns) base 7654891 (ns) ratio (PR/base)
vortex_q00/duckdb:vortex-file-compressed 10138113 10627404 0.95
vortex_q01/duckdb:vortex-file-compressed 6018940 6551542 0.92
duckdb / parquet (0.992x ➖, 0↑ 0↓)
name PR 63d1f29 (ns) base 7654891 (ns) ratio (PR/base)
vortex_q00/duckdb:parquet 23443070 23559866 1.00
vortex_q01/duckdb:parquet 9430884 9545147 0.99

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
test.vortex 1.0 vortex-file-compressed 80.59 MB 80.59 MB +216 B +0.0%

Totals:

  • vortex-file-compressed: 80.85 MB → 80.85 MB (+0.0%)

…at layout to allow composing encoding validation with different layout strategies

This will be used to adding edition encoding filtering

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
joseph-isaacs force-pushed the claude/writer-editions-gating-8qy1fv branch from c84896c to 58776e3 Compare July 22, 2026 10:16
…ions-gating-8qy1fv

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

# Conflicts:
#	vortex-file/src/strategy.rs
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Jul 22, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jul 22, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Vortex (geomean): 1.145x ❌

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.145x ❌, 0↑ 7↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 133671397 125831766 1.06
polarsignals_q01/datafusion:vortex-file-compressed 301584566 276599952 1.09
polarsignals_q02/datafusion:vortex-file-compressed 🚨 29242039 23597351 1.24
polarsignals_q03/datafusion:vortex-file-compressed 🚨 329197903 260970725 1.26
polarsignals_q04/datafusion:vortex-file-compressed 🚨 12354285 9969948 1.24
polarsignals_q05/datafusion:vortex-file-compressed 🚨 17752287 15446254 1.15
polarsignals_q06/datafusion:vortex-file-compressed 🚨 23981095 20744317 1.16
polarsignals_q07/datafusion:vortex-file-compressed 🚨 16516966 14646604 1.13
polarsignals_q08/datafusion:vortex-file-compressed 🚨 450776784 399833405 1.13
polarsignals_q09/datafusion:vortex-file-compressed 13376277 13126456 1.02

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.4%
Engines: DataFusion No clear signal (+3.2%, environment too noisy confidence) · DuckDB No clear signal (+5.7%, environment too noisy confidence)
Vortex (geomean): 1.052x ➖
Parquet (geomean): 1.014x ➖
Shifts: Parquet (control) +1.4% · Median polish +5.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.039x ➖, 0↑ 1↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 56223804 54583692 1.03
tpch_q02/datafusion:vortex-file-compressed 23019964 23098368 1.00
tpch_q03/datafusion:vortex-file-compressed 32272395 29940608 1.08
tpch_q04/datafusion:vortex-file-compressed 19829648 19861358 1.00
tpch_q05/datafusion:vortex-file-compressed 47185048 45629263 1.03
tpch_q06/datafusion:vortex-file-compressed 🚨 10650668 9663201 1.10
tpch_q07/datafusion:vortex-file-compressed 53832584 52690066 1.02
tpch_q08/datafusion:vortex-file-compressed 39850613 38288869 1.04
tpch_q09/datafusion:vortex-file-compressed 52859770 50784675 1.04
tpch_q10/datafusion:vortex-file-compressed 33311727 32297740 1.03
tpch_q11/datafusion:vortex-file-compressed 17262536 16333160 1.06
tpch_q12/datafusion:vortex-file-compressed 24434643 23368978 1.05
tpch_q13/datafusion:vortex-file-compressed 26171514 26165443 1.00
tpch_q14/datafusion:vortex-file-compressed 15548535 14741292 1.05
tpch_q15/datafusion:vortex-file-compressed 23523681 22318255 1.05
tpch_q16/datafusion:vortex-file-compressed 20042847 19239177 1.04
tpch_q17/datafusion:vortex-file-compressed 67194570 67408124 1.00
tpch_q18/datafusion:vortex-file-compressed 77191642 75610922 1.02
tpch_q19/datafusion:vortex-file-compressed 20058083 19163394 1.05
tpch_q20/datafusion:vortex-file-compressed 31352140 29947334 1.05
tpch_q21/datafusion:vortex-file-compressed 72130463 67506575 1.07
tpch_q22/datafusion:vortex-file-compressed 12232175 11554944 1.06
datafusion / vortex-compact (1.051x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 60722733 60014269 1.01
tpch_q02/datafusion:vortex-compact 26895397 25570496 1.05
tpch_q03/datafusion:vortex-compact 34713116 32701468 1.06
tpch_q04/datafusion:vortex-compact 23627120 22850684 1.03
tpch_q05/datafusion:vortex-compact 50788509 47449153 1.07
tpch_q06/datafusion:vortex-compact 12761017 12114643 1.05
tpch_q07/datafusion:vortex-compact 58940231 56022222 1.05
tpch_q08/datafusion:vortex-compact 46049681 42708489 1.08
tpch_q09/datafusion:vortex-compact 59361087 55530476 1.07
tpch_q10/datafusion:vortex-compact 39477588 37249278 1.06
tpch_q11/datafusion:vortex-compact 18034151 17224894 1.05
tpch_q12/datafusion:vortex-compact 32281558 30673667 1.05
tpch_q13/datafusion:vortex-compact 32686658 31147602 1.05
tpch_q14/datafusion:vortex-compact 18963850 18197585 1.04
tpch_q15/datafusion:vortex-compact 31127588 29463076 1.06
tpch_q16/datafusion:vortex-compact 24250564 22588077 1.07
tpch_q17/datafusion:vortex-compact 72641682 68135743 1.07
tpch_q18/datafusion:vortex-compact 79038314 77688155 1.02
tpch_q19/datafusion:vortex-compact 40039798 38621992 1.04
tpch_q20/datafusion:vortex-compact 36133181 34866093 1.04
tpch_q21/datafusion:vortex-compact 81696718 78069266 1.05
tpch_q22/datafusion:vortex-compact 13781466 12977263 1.06
datafusion / parquet (1.028x ➖, 1↑ 1↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 127795365 134999651 0.95
tpch_q02/datafusion:parquet 64401343 61970380 1.04
tpch_q03/datafusion:parquet 82748027 80484702 1.03
tpch_q04/datafusion:parquet 48280219 45667526 1.06
tpch_q05/datafusion:parquet 98902507 93652913 1.06
tpch_q06/datafusion:parquet 41897347 42344619 0.99
tpch_q07/datafusion:parquet 110171632 107579527 1.02
tpch_q08/datafusion:parquet 100909287 91873284 1.10
tpch_q09/datafusion:parquet 134329849 125656920 1.07
tpch_q10/datafusion:parquet 120904601 115635448 1.05
tpch_q11/datafusion:parquet 43746789 40618310 1.08
tpch_q12/datafusion:parquet 77753681 82831533 0.94
tpch_q13/datafusion:parquet 205687811 194313900 1.06
tpch_q14/datafusion:parquet 44522263 44747363 0.99
tpch_q15/datafusion:parquet 62412800 60349148 1.03
tpch_q16/datafusion:parquet 45475131 42899732 1.06
tpch_q17/datafusion:parquet 🚨 154981825 133524882 1.16
tpch_q18/datafusion:parquet 157482686 151967548 1.04
tpch_q19/datafusion:parquet 🚀 66097275 81278067 0.81
tpch_q20/datafusion:parquet 74981126 72769587 1.03
tpch_q21/datafusion:parquet 146559463 142454512 1.03
tpch_q22/datafusion:parquet 46456271 43310473 1.07
datafusion / arrow (1.091x ➖, 0↑ 10↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 60712640 64827656 0.94
tpch_q02/datafusion:arrow 18197067 17074645 1.07
tpch_q03/datafusion:arrow 🚨 35886040 31466873 1.14
tpch_q04/datafusion:arrow 🚨 29320803 26035889 1.13
tpch_q05/datafusion:arrow 🚨 66621390 54539575 1.22
tpch_q06/datafusion:arrow 🚨 24872186 20974653 1.19
tpch_q07/datafusion:arrow 🚨 117873142 102624724 1.15
tpch_q08/datafusion:arrow 🚨 49851811 41161617 1.21
tpch_q09/datafusion:arrow 71913693 66953967 1.07
tpch_q10/datafusion:arrow 53408516 53597611 1.00
tpch_q11/datafusion:arrow 9934119 9242103 1.07
tpch_q12/datafusion:arrow 54186432 50546137 1.07
tpch_q13/datafusion:arrow 47236351 45323081 1.04
tpch_q14/datafusion:arrow 🚨 25495733 22632096 1.13
tpch_q15/datafusion:arrow 🚨 50261373 44383864 1.13
tpch_q16/datafusion:arrow 17433513 16337240 1.07
tpch_q17/datafusion:arrow 🚨 72232317 65414336 1.10
tpch_q18/datafusion:arrow 116359047 108552313 1.07
tpch_q19/datafusion:arrow 40480102 37627251 1.08
tpch_q20/datafusion:arrow 🚨 39738385 36037846 1.10
tpch_q21/datafusion:arrow 163054814 159188290 1.02
tpch_q22/datafusion:arrow 12681726 12171017 1.04
duckdb / vortex-file-compressed (1.056x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 28527827 28190714 1.01
tpch_q02/duckdb:vortex-file-compressed 25928256 24501425 1.06
tpch_q03/duckdb:vortex-file-compressed 32951032 32253141 1.02
tpch_q04/duckdb:vortex-file-compressed 28546428 27646031 1.03
tpch_q05/duckdb:vortex-file-compressed 37637988 34333020 1.10
tpch_q06/duckdb:vortex-file-compressed 9149000 8681168 1.05
tpch_q07/duckdb:vortex-file-compressed 35339345 33395495 1.06
tpch_q08/duckdb:vortex-file-compressed 40697549 38668499 1.05
tpch_q09/duckdb:vortex-file-compressed 59140784 55947836 1.06
tpch_q10/duckdb:vortex-file-compressed 42393024 40887116 1.04
tpch_q11/duckdb:vortex-file-compressed 14758828 13626961 1.08
tpch_q12/duckdb:vortex-file-compressed 24316019 23332392 1.04
tpch_q13/duckdb:vortex-file-compressed 41967844 39332896 1.07
tpch_q14/duckdb:vortex-file-compressed 20494365 19976264 1.03
tpch_q15/duckdb:vortex-file-compressed 16649601 16049528 1.04
tpch_q16/duckdb:vortex-file-compressed 28543872 27203400 1.05
tpch_q17/duckdb:vortex-file-compressed 23801001 22488733 1.06
tpch_q18/duckdb:vortex-file-compressed 54156972 50864575 1.06
tpch_q19/duckdb:vortex-file-compressed 27089407 25227872 1.07
tpch_q20/duckdb:vortex-file-compressed 32990337 30425508 1.08
tpch_q21/duckdb:vortex-file-compressed 106141684 97228496 1.09
tpch_q22/duckdb:vortex-file-compressed 17372007 16069277 1.08
duckdb / vortex-compact (1.060x ➖, 0↑ 3↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38817404 37832454 1.03
tpch_q02/duckdb:vortex-compact 31841710 31014162 1.03
tpch_q03/duckdb:vortex-compact 37503684 34647335 1.08
tpch_q04/duckdb:vortex-compact 35480449 34388780 1.03
tpch_q05/duckdb:vortex-compact 🚨 43228172 39158393 1.10
tpch_q06/duckdb:vortex-compact 10830513 10375752 1.04
tpch_q07/duckdb:vortex-compact 44883767 42639801 1.05
tpch_q08/duckdb:vortex-compact 49304989 46073764 1.07
tpch_q09/duckdb:vortex-compact 69045032 66797116 1.03
tpch_q10/duckdb:vortex-compact 48719571 46647126 1.04
tpch_q11/duckdb:vortex-compact 16666716 15339191 1.09
tpch_q12/duckdb:vortex-compact 32814915 32326953 1.02
tpch_q13/duckdb:vortex-compact 46938853 44622208 1.05
tpch_q14/duckdb:vortex-compact 25445233 23352376 1.09
tpch_q15/duckdb:vortex-compact 20723647 19611625 1.06
tpch_q16/duckdb:vortex-compact 30746993 28793502 1.07
tpch_q17/duckdb:vortex-compact 28830502 27797212 1.04
tpch_q18/duckdb:vortex-compact 60324281 57381002 1.05
tpch_q19/duckdb:vortex-compact 🚨 31088415 28213686 1.10
tpch_q20/duckdb:vortex-compact 🚨 40635439 36829241 1.10
tpch_q21/duckdb:vortex-compact 120737806 111627856 1.08
tpch_q22/duckdb:vortex-compact 18332262 17115908 1.07
duckdb / parquet (1.001x ➖, 2↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77735201 77283328 1.01
tpch_q02/duckdb:parquet 40926275 39867594 1.03
tpch_q03/duckdb:parquet 74510526 71394562 1.04
tpch_q04/duckdb:parquet 🚀 50816481 57298941 0.89
tpch_q05/duckdb:parquet 69856618 69167067 1.01
tpch_q06/duckdb:parquet 22841719 22652592 1.01
tpch_q07/duckdb:parquet 74056675 69935993 1.06
tpch_q08/duckdb:parquet 84628070 84980259 1.00
tpch_q09/duckdb:parquet 139751421 149052508 0.94
tpch_q10/duckdb:parquet 129854412 134657905 0.96
tpch_q11/duckdb:parquet 23276996 22710006 1.02
tpch_q12/duckdb:parquet 59799271 59465712 1.01
tpch_q13/duckdb:parquet 264331931 252693292 1.05
tpch_q14/duckdb:parquet 53288555 50887573 1.05
tpch_q15/duckdb:parquet 26780511 27536853 0.97
tpch_q16/duckdb:parquet 60200124 58159065 1.04
tpch_q17/duckdb:parquet 59392369 57155853 1.04
tpch_q18/duckdb:parquet 122705005 121610923 1.01
tpch_q19/duckdb:parquet 🚀 72020021 86251560 0.83
tpch_q20/duckdb:parquet 67326009 65950020 1.02
tpch_q21/duckdb:parquet 185826962 170110887 1.09
tpch_q22/duckdb:parquet 56210771 56142001 1.00
duckdb / duckdb (1.060x ➖, 0↑ 2↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 18568605 17825967 1.04
tpch_q02/duckdb:duckdb 15663174 14495560 1.08
tpch_q03/duckdb:duckdb 25059418 22838555 1.10
tpch_q04/duckdb:duckdb 22510465 22142358 1.02
tpch_q05/duckdb:duckdb 24418675 23297416 1.05
tpch_q06/duckdb:duckdb 7413145 7053514 1.05
tpch_q07/duckdb:duckdb 27649933 25600054 1.08
tpch_q08/duckdb:duckdb 25352278 24402070 1.04
tpch_q09/duckdb:duckdb 63910079 58308859 1.10
tpch_q10/duckdb:duckdb 52258914 52082628 1.00
tpch_q11/duckdb:duckdb 🚨 7804645 7059794 1.11
tpch_q12/duckdb:duckdb 18774590 18125951 1.04
tpch_q13/duckdb:duckdb 42305902 39605724 1.07
tpch_q14/duckdb:duckdb 23341344 21532316 1.08
tpch_q15/duckdb:duckdb 14601921 13838541 1.06
tpch_q16/duckdb:duckdb 27919228 26089967 1.07
tpch_q17/duckdb:duckdb 16831105 16400926 1.03
tpch_q18/duckdb:duckdb 42917230 40655919 1.06
tpch_q19/duckdb:duckdb 🚨 34496879 30631784 1.13
tpch_q20/duckdb:duckdb 25940233 25056321 1.04
tpch_q21/duckdb:duckdb 66219275 61682382 1.07
tpch_q22/duckdb:duckdb 27089904 25833345 1.05

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+1.1%, low confidence) · DuckDB No clear signal (-0.7%, low confidence)
Vortex (geomean): 1.004x ➖
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.007x ➖, 0↑ 1↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 6306601 5667855 1.11
fineweb_q01/datafusion:vortex-file-compressed 32763048 32798706 1.00
fineweb_q02/datafusion:vortex-file-compressed 38090563 35102041 1.09
fineweb_q03/datafusion:vortex-file-compressed 55918515 54895390 1.02
fineweb_q04/datafusion:vortex-file-compressed 243765370 243478794 1.00
fineweb_q05/datafusion:vortex-file-compressed 181652860 188150661 0.97
fineweb_q06/datafusion:vortex-file-compressed 49761631 50988454 0.98
fineweb_q07/datafusion:vortex-file-compressed 53094749 56040839 0.95
fineweb_q08/datafusion:vortex-file-compressed 22511889 23185103 0.97
datafusion / vortex-compact (1.011x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5999065 6088026 0.99
fineweb_q01/datafusion:vortex-compact 97823112 95229817 1.03
fineweb_q02/datafusion:vortex-compact 105881596 103341638 1.02
fineweb_q03/datafusion:vortex-compact 851134788 860128586 0.99
fineweb_q04/datafusion:vortex-compact 913713026 911131650 1.00
fineweb_q05/datafusion:vortex-compact 821699158 805119812 1.02
fineweb_q06/datafusion:vortex-compact 456940861 457504099 1.00
fineweb_q07/datafusion:vortex-compact 488815440 479005075 1.02
fineweb_q08/datafusion:vortex-compact 20951510 20329984 1.03
datafusion / parquet (0.998x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6949654 7195780 0.97
fineweb_q01/datafusion:parquet 293164938 290497142 1.01
fineweb_q02/datafusion:parquet 295311053 293857467 1.00
fineweb_q03/datafusion:parquet 290343981 276512429 1.05
fineweb_q04/datafusion:parquet 307919386 306544885 1.00
fineweb_q05/datafusion:parquet 301224212 314789526 0.96
fineweb_q06/datafusion:parquet 286066071 294092649 0.97
fineweb_q07/datafusion:parquet 286837449 279155744 1.03
fineweb_q08/datafusion:parquet 276885909 279155378 0.99
duckdb / vortex-file-compressed (0.994x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 2958563 3047990 0.97
fineweb_q01/duckdb:vortex-file-compressed 32464145 32856459 0.99
fineweb_q02/duckdb:vortex-file-compressed 37627974 36599904 1.03
fineweb_q03/duckdb:vortex-file-compressed 100175837 100604638 1.00
fineweb_q04/duckdb:vortex-file-compressed 242890825 240923993 1.01
fineweb_q05/duckdb:vortex-file-compressed 184373841 183448336 1.01
fineweb_q06/duckdb:vortex-file-compressed 52069767 52594885 0.99
fineweb_q07/duckdb:vortex-file-compressed 53211324 53943822 0.99
fineweb_q08/duckdb:vortex-file-compressed 20625990 21074399 0.98
duckdb / vortex-compact (1.003x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3320815 3194505 1.04
fineweb_q01/duckdb:vortex-compact 109434745 111023767 0.99
fineweb_q02/duckdb:vortex-compact 114128331 113050644 1.01
fineweb_q03/duckdb:vortex-compact 856761394 856675083 1.00
fineweb_q04/duckdb:vortex-compact 899194394 895427126 1.00
fineweb_q05/duckdb:vortex-compact 804402420 801824163 1.00
fineweb_q06/duckdb:vortex-compact 463319337 460280020 1.01
fineweb_q07/duckdb:vortex-compact 479736342 484134517 0.99
fineweb_q08/duckdb:vortex-compact 20216329 20480017 0.99
duckdb / parquet (1.005x ➖, 0↑ 1↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚨 34019661 30714989 1.11
fineweb_q01/duckdb:parquet 89312680 93035759 0.96
fineweb_q02/duckdb:parquet 89275117 88985948 1.00
fineweb_q03/duckdb:parquet 319439886 318526973 1.00
fineweb_q04/duckdb:parquet 450610662 446727435 1.01
fineweb_q05/duckdb:parquet 419855400 420976653 1.00
fineweb_q06/duckdb:parquet 206410126 211446987 0.98
fineweb_q07/duckdb:parquet 218024480 218293169 1.00
fineweb_q08/duckdb:parquet 37601767 37575784 1.00

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (+0.9%, low confidence)
Vortex (geomean): 1.017x ➖
Parquet (geomean): 1.014x ➖
Shifts: Parquet (control) +1.4% · Median polish +1.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.018x ➖, 0↑ 1↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 23146286 24806561 0.93
tpcds_q02/datafusion:vortex-file-compressed 43947249 42912695 1.02
tpcds_q03/datafusion:vortex-file-compressed 16010828 14936796 1.07
tpcds_q04/datafusion:vortex-file-compressed 235576655 232250990 1.01
tpcds_q05/datafusion:vortex-file-compressed 46081470 43767197 1.05
tpcds_q06/datafusion:vortex-file-compressed 23555317 23234403 1.01
tpcds_q07/datafusion:vortex-file-compressed 41854744 44413237 0.94
tpcds_q08/datafusion:vortex-file-compressed 31096436 29353447 1.06
tpcds_q09/datafusion:vortex-file-compressed 32971802 31548529 1.05
tpcds_q10/datafusion:vortex-file-compressed 40288746 37567712 1.07
tpcds_q11/datafusion:vortex-file-compressed 135923719 132288993 1.03
tpcds_q12/datafusion:vortex-file-compressed 18770314 17398317 1.08
tpcds_q13/datafusion:vortex-file-compressed 42312161 42617424 0.99
tpcds_q14/datafusion:vortex-file-compressed 169318278 163221586 1.04
tpcds_q15/datafusion:vortex-file-compressed 27503817 26070983 1.05
tpcds_q16/datafusion:vortex-file-compressed 24351467 23756977 1.03
tpcds_q17/datafusion:vortex-file-compressed 59435158 59996889 0.99
tpcds_q18/datafusion:vortex-file-compressed 61377947 60328104 1.02
tpcds_q19/datafusion:vortex-file-compressed 22774218 21837103 1.04
tpcds_q20/datafusion:vortex-file-compressed 20728282 20202209 1.03
tpcds_q21/datafusion:vortex-file-compressed 35927533 35739352 1.01
tpcds_q22/datafusion:vortex-file-compressed 127675589 135668150 0.94
tpcds_q23/datafusion:vortex-file-compressed 158185063 156700205 1.01
tpcds_q24/datafusion:vortex-file-compressed 92905355 86560866 1.07
tpcds_q25/datafusion:vortex-file-compressed 64085623 67610310 0.95
tpcds_q26/datafusion:vortex-file-compressed 31641675 31437490 1.01
tpcds_q27/datafusion:vortex-file-compressed 96499052 92287706 1.05
tpcds_q28/datafusion:vortex-file-compressed 33226440 33377578 1.00
tpcds_q29/datafusion:vortex-file-compressed 60525477 59093383 1.02
tpcds_q30/datafusion:vortex-file-compressed 24615550 23735765 1.04
tpcds_q31/datafusion:vortex-file-compressed 74527335 71020144 1.05
tpcds_q32/datafusion:vortex-file-compressed 18719584 18666876 1.00
tpcds_q33/datafusion:vortex-file-compressed 29692069 29205029 1.02
tpcds_q34/datafusion:vortex-file-compressed 25584423 25709312 1.00
tpcds_q35/datafusion:vortex-file-compressed 44864030 45018926 1.00
tpcds_q36/datafusion:vortex-file-compressed 58768534 58632177 1.00
tpcds_q37/datafusion:vortex-file-compressed 21711871 20079235 1.08
tpcds_q38/datafusion:vortex-file-compressed 40032656 40558728 0.99
tpcds_q39/datafusion:vortex-file-compressed 110879520 109594073 1.01
tpcds_q40/datafusion:vortex-file-compressed 30501194 29711600 1.03
tpcds_q41/datafusion:vortex-file-compressed 20426844 20491206 1.00
tpcds_q42/datafusion:vortex-file-compressed 14014328 13794396 1.02
tpcds_q43/datafusion:vortex-file-compressed 18628881 18708699 1.00
tpcds_q44/datafusion:vortex-file-compressed 30975403 30830218 1.00
tpcds_q45/datafusion:vortex-file-compressed 25719324 25536351 1.01
tpcds_q46/datafusion:vortex-file-compressed 36412006 35562081 1.02
tpcds_q47/datafusion:vortex-file-compressed 143815791 146331958 0.98
tpcds_q48/datafusion:vortex-file-compressed 36833610 36661637 1.00
tpcds_q49/datafusion:vortex-file-compressed 59837346 58511243 1.02
tpcds_q50/datafusion:vortex-file-compressed 38887583 39517726 0.98
tpcds_q51/datafusion:vortex-file-compressed 89446413 89066244 1.00
tpcds_q52/datafusion:vortex-file-compressed 14481201 13657547 1.06
tpcds_q53/datafusion:vortex-file-compressed 22898066 24473356 0.94
tpcds_q54/datafusion:vortex-file-compressed 34576037 34523612 1.00
tpcds_q55/datafusion:vortex-file-compressed 14119754 13476061 1.05
tpcds_q56/datafusion:vortex-file-compressed 30882907 30132526 1.02
tpcds_q57/datafusion:vortex-file-compressed 94360690 94371773 1.00
tpcds_q58/datafusion:vortex-file-compressed 55793713 53998675 1.03
tpcds_q59/datafusion:vortex-file-compressed 62645634 60579386 1.03
tpcds_q60/datafusion:vortex-file-compressed 29776526 29555156 1.01
tpcds_q61/datafusion:vortex-file-compressed 42461915 40671054 1.04
tpcds_q62/datafusion:vortex-file-compressed 22857330 21329993 1.07
tpcds_q63/datafusion:vortex-file-compressed 23626623 22721268 1.04
tpcds_q64/datafusion:vortex-file-compressed 390334331 381057292 1.02
tpcds_q65/datafusion:vortex-file-compressed 52313982 52693037 0.99
tpcds_q66/datafusion:vortex-file-compressed 70573071 72150712 0.98
tpcds_q67/datafusion:vortex-file-compressed 155973904 161739338 0.96
tpcds_q68/datafusion:vortex-file-compressed 34318659 33827378 1.01
tpcds_q69/datafusion:vortex-file-compressed 37437453 36152717 1.04
tpcds_q70/datafusion:vortex-file-compressed 104171829 97269153 1.07
tpcds_q71/datafusion:vortex-file-compressed 22907694 22705452 1.01
tpcds_q72/datafusion:vortex-file-compressed 2134022358 2119182898 1.01
tpcds_q73/datafusion:vortex-file-compressed 24629159 24170546 1.02
tpcds_q74/datafusion:vortex-file-compressed 80636312 81553721 0.99
tpcds_q75/datafusion:vortex-file-compressed 107673470 110252012 0.98
tpcds_q76/datafusion:vortex-file-compressed 28308573 27251576 1.04
tpcds_q77/datafusion:vortex-file-compressed 37245202 36330711 1.03
tpcds_q78/datafusion:vortex-file-compressed 111897476 111156951 1.01
tpcds_q79/datafusion:vortex-file-compressed 29531030 29696273 0.99
tpcds_q80/datafusion:vortex-file-compressed 93132531 92888774 1.00
tpcds_q81/datafusion:vortex-file-compressed 🚨 28668905 24670262 1.16
tpcds_q82/datafusion:vortex-file-compressed 21244472 20088435 1.06
tpcds_q83/datafusion:vortex-file-compressed 35261959 34767440 1.01
tpcds_q84/datafusion:vortex-file-compressed 13077361 12239815 1.07
tpcds_q85/datafusion:vortex-file-compressed 88632800 88106220 1.01
tpcds_q86/datafusion:vortex-file-compressed 15903047 15271095 1.04
tpcds_q87/datafusion:vortex-file-compressed 40798913 39384113 1.04
tpcds_q88/datafusion:vortex-file-compressed 55087099 54664175 1.01
tpcds_q89/datafusion:vortex-file-compressed 26321827 26463019 0.99
tpcds_q90/datafusion:vortex-file-compressed 14087418 13896608 1.01
tpcds_q91/datafusion:vortex-file-compressed 19212272 19609276 0.98
tpcds_q92/datafusion:vortex-file-compressed 16655307 16896106 0.99
tpcds_q93/datafusion:vortex-file-compressed 34506843 32000442 1.08
tpcds_q94/datafusion:vortex-file-compressed 21650309 20830210 1.04
tpcds_q95/datafusion:vortex-file-compressed 56460075 56968071 0.99
tpcds_q96/datafusion:vortex-file-compressed 13432134 13519498 0.99
tpcds_q97/datafusion:vortex-file-compressed 29547146 29111209 1.01
tpcds_q98/datafusion:vortex-file-compressed 26618817 25455946 1.05
tpcds_q99/datafusion:vortex-file-compressed 26862192 25082552 1.07
datafusion / vortex-compact (1.015x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 25565936 24324921 1.05
tpcds_q02/datafusion:vortex-compact 52578352 52333367 1.00
tpcds_q03/datafusion:vortex-compact 19813939 20231168 0.98
tpcds_q04/datafusion:vortex-compact 270343440 264754001 1.02
tpcds_q05/datafusion:vortex-compact 49457800 49168105 1.01
tpcds_q06/datafusion:vortex-compact 30988807 29899521 1.04
tpcds_q07/datafusion:vortex-compact 63673098 59953511 1.06
tpcds_q08/datafusion:vortex-compact 42232719 40796198 1.04
tpcds_q09/datafusion:vortex-compact 56955647 56060863 1.02
tpcds_q10/datafusion:vortex-compact 56118667 55141364 1.02
tpcds_q11/datafusion:vortex-compact 155743719 156898949 0.99
tpcds_q12/datafusion:vortex-compact 21191859 21483844 0.99
tpcds_q13/datafusion:vortex-compact 131182543 128935579 1.02
tpcds_q14/datafusion:vortex-compact 186680244 189676698 0.98
tpcds_q15/datafusion:vortex-compact 30446638 29982516 1.02
tpcds_q16/datafusion:vortex-compact 30764205 29887847 1.03
tpcds_q17/datafusion:vortex-compact 100534410 100523059 1.00
tpcds_q18/datafusion:vortex-compact 75570744 71733080 1.05
tpcds_q19/datafusion:vortex-compact 35015227 34750870 1.01
tpcds_q20/datafusion:vortex-compact 24797452 24516988 1.01
tpcds_q21/datafusion:vortex-compact 42173718 39706376 1.06
tpcds_q22/datafusion:vortex-compact 134353268 131700937 1.02
tpcds_q23/datafusion:vortex-compact 182286282 186146673 0.98
tpcds_q24/datafusion:vortex-compact 108653117 108205942 1.00
tpcds_q25/datafusion:vortex-compact 83437109 81653102 1.02
tpcds_q26/datafusion:vortex-compact 44359177 45153539 0.98
tpcds_q27/datafusion:vortex-compact 140267649 138660710 1.01
tpcds_q28/datafusion:vortex-compact 89611762 89142746 1.01
tpcds_q29/datafusion:vortex-compact 82794206 78549109 1.05
tpcds_q30/datafusion:vortex-compact 30188842 28296897 1.07
tpcds_q31/datafusion:vortex-compact 105310007 105699259 1.00
tpcds_q32/datafusion:vortex-compact 23577793 22618614 1.04
tpcds_q33/datafusion:vortex-compact 40069175 39513457 1.01
tpcds_q34/datafusion:vortex-compact 42380523 42470090 1.00
tpcds_q35/datafusion:vortex-compact 59660468 58779126 1.01
tpcds_q36/datafusion:vortex-compact 80501298 77241150 1.04
tpcds_q37/datafusion:vortex-compact 28228111 28239694 1.00
tpcds_q38/datafusion:vortex-compact 51977574 52465045 0.99
tpcds_q39/datafusion:vortex-compact 116882871 112971730 1.03
tpcds_q40/datafusion:vortex-compact 33259882 32445873 1.03
tpcds_q41/datafusion:vortex-compact 23496166 22076708 1.06
tpcds_q42/datafusion:vortex-compact 19779823 18848418 1.05
tpcds_q43/datafusion:vortex-compact 27623838 27541797 1.00
tpcds_q44/datafusion:vortex-compact 48262322 49639536 0.97
tpcds_q45/datafusion:vortex-compact 31628202 30413500 1.04
tpcds_q46/datafusion:vortex-compact 56742031 54328669 1.04
tpcds_q47/datafusion:vortex-compact 165380892 160671580 1.03
tpcds_q48/datafusion:vortex-compact 99443574 99372857 1.00
tpcds_q49/datafusion:vortex-compact 79553912 77761921 1.02
tpcds_q50/datafusion:vortex-compact 52179948 51494096 1.01
tpcds_q51/datafusion:vortex-compact 94205852 95700117 0.98
tpcds_q52/datafusion:vortex-compact 19940330 18912194 1.05
tpcds_q53/datafusion:vortex-compact 30464060 30688410 0.99
tpcds_q54/datafusion:vortex-compact 45792276 44138650 1.04
tpcds_q55/datafusion:vortex-compact 19152148 18424393 1.04
tpcds_q56/datafusion:vortex-compact 39688063 40637392 0.98
tpcds_q57/datafusion:vortex-compact 98347945 101033863 0.97
tpcds_q58/datafusion:vortex-compact 61794621 59568087 1.04
tpcds_q59/datafusion:vortex-compact 80515247 76852081 1.05
tpcds_q60/datafusion:vortex-compact 40900294 40789484 1.00
tpcds_q61/datafusion:vortex-compact 58396487 57880411 1.01
tpcds_q62/datafusion:vortex-compact 23563521 23312106 1.01
tpcds_q63/datafusion:vortex-compact 29997793 31280036 0.96
tpcds_q64/datafusion:vortex-compact 470228155 451212937 1.04
tpcds_q65/datafusion:vortex-compact 69666719 69407799 1.00
tpcds_q66/datafusion:vortex-compact 75666169 75719272 1.00
tpcds_q67/datafusion:vortex-compact 159111700 167933552 0.95
tpcds_q68/datafusion:vortex-compact 55280160 54517582 1.01
tpcds_q69/datafusion:vortex-compact 52846167 52069780 1.01
tpcds_q70/datafusion:vortex-compact 116047792 112315201 1.03
tpcds_q71/datafusion:vortex-compact 33670475 33032818 1.02
tpcds_q72/datafusion:vortex-compact 2137728326 2128365567 1.00
tpcds_q73/datafusion:vortex-compact 39766352 40827782 0.97
tpcds_q74/datafusion:vortex-compact 98495238 100368712 0.98
tpcds_q75/datafusion:vortex-compact 138061465 132994619 1.04
tpcds_q76/datafusion:vortex-compact 39589807 38586827 1.03
tpcds_q77/datafusion:vortex-compact 49800665 49244556 1.01
tpcds_q78/datafusion:vortex-compact 129566007 129554842 1.00
tpcds_q79/datafusion:vortex-compact 49632260 48300189 1.03
tpcds_q80/datafusion:vortex-compact 105124205 100659879 1.04
tpcds_q81/datafusion:vortex-compact 28004265 28199467 0.99
tpcds_q82/datafusion:vortex-compact 30276938 28844709 1.05
tpcds_q83/datafusion:vortex-compact 36154158 35809865 1.01
tpcds_q84/datafusion:vortex-compact 14631940 14543818 1.01
tpcds_q85/datafusion:vortex-compact 143441688 142949171 1.00
tpcds_q86/datafusion:vortex-compact 17341689 17557350 0.99
tpcds_q87/datafusion:vortex-compact 53162961 52437395 1.01
tpcds_q88/datafusion:vortex-compact 110746752 108843840 1.02
tpcds_q89/datafusion:vortex-compact 33642289 33330078 1.01
tpcds_q90/datafusion:vortex-compact 15896919 15579725 1.02
tpcds_q91/datafusion:vortex-compact 38936581 38437494 1.01
tpcds_q92/datafusion:vortex-compact 20238224 19623915 1.03
tpcds_q93/datafusion:vortex-compact 40587744 41726486 0.97
tpcds_q94/datafusion:vortex-compact 25668862 26127066 0.98
tpcds_q95/datafusion:vortex-compact 64532290 63346892 1.02
tpcds_q96/datafusion:vortex-compact 23673850 22867461 1.04
tpcds_q97/datafusion:vortex-compact 38141809 38947888 0.98
tpcds_q98/datafusion:vortex-compact 33336259 30650141 1.09
tpcds_q99/datafusion:vortex-compact 28389809 27154269 1.05
datafusion / parquet (1.016x ➖, 1↑ 2↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 24644293 26293195 0.94
tpcds_q02/datafusion:parquet 42414949 42926916 0.99
tpcds_q03/datafusion:parquet 14346001 13992087 1.03
tpcds_q04/datafusion:parquet 315813191 312857640 1.01
tpcds_q05/datafusion:parquet 48833101 45960429 1.06
tpcds_q06/datafusion:parquet 24968885 23290165 1.07
tpcds_q07/datafusion:parquet 82601752 76518828 1.08
tpcds_q08/datafusion:parquet 30883575 30585354 1.01
tpcds_q09/datafusion:parquet 🚨 42613577 38365432 1.11
tpcds_q10/datafusion:parquet 75848748 72396244 1.05
tpcds_q11/datafusion:parquet 157356709 148062453 1.06
tpcds_q12/datafusion:parquet 19167530 17523403 1.09
tpcds_q13/datafusion:parquet 77450761 76925744 1.01
tpcds_q14/datafusion:parquet 158577908 162146532 0.98
tpcds_q15/datafusion:parquet 20866446 22614994 0.92
tpcds_q16/datafusion:parquet 28642311 31556697 0.91
tpcds_q17/datafusion:parquet 63535480 63934377 0.99
tpcds_q18/datafusion:parquet 109403008 109565770 1.00
tpcds_q19/datafusion:parquet 23643272 23481255 1.01
tpcds_q20/datafusion:parquet 19113226 17395150 1.10
tpcds_q21/datafusion:parquet 18856869 18876079 1.00
tpcds_q22/datafusion:parquet 158980053 169886718 0.94
tpcds_q23/datafusion:parquet 149413682 152354647 0.98
tpcds_q24/datafusion:parquet 91226018 87679314 1.04
tpcds_q25/datafusion:parquet 63976531 64580861 0.99
tpcds_q26/datafusion:parquet 70126342 65726553 1.07
tpcds_q27/datafusion:parquet 141682612 138490326 1.02
tpcds_q28/datafusion:parquet 45323044 43565881 1.04
tpcds_q29/datafusion:parquet 67220518 64509682 1.04
tpcds_q30/datafusion:parquet 34661189 33114225 1.05
tpcds_q31/datafusion:parquet 67819344 70516792 0.96
tpcds_q32/datafusion:parquet 16835012 16462908 1.02
tpcds_q33/datafusion:parquet 29009197 28283091 1.03
tpcds_q34/datafusion:parquet 22474477 21380554 1.05
tpcds_q35/datafusion:parquet 71668740 71748494 1.00
tpcds_q36/datafusion:parquet 60714933 56926742 1.07
tpcds_q37/datafusion:parquet 🚨 21475538 18945078 1.13
tpcds_q38/datafusion:parquet 44780333 43263052 1.04
tpcds_q39/datafusion:parquet 76264760 76513446 1.00
tpcds_q40/datafusion:parquet 23205099 24177735 0.96
tpcds_q41/datafusion:parquet 15417423 14539725 1.06
tpcds_q42/datafusion:parquet 12964846 11834090 1.10
tpcds_q43/datafusion:parquet 18462739 17567245 1.05
tpcds_q44/datafusion:parquet 33454778 32020596 1.04
tpcds_q45/datafusion:parquet 28545169 27659005 1.03
tpcds_q46/datafusion:parquet 33849164 32146471 1.05
tpcds_q47/datafusion:parquet 133864488 128667335 1.04
tpcds_q48/datafusion:parquet 70542714 68939876 1.02
tpcds_q49/datafusion:parquet 58328717 57416540 1.02
tpcds_q50/datafusion:parquet 44806570 42839643 1.05
tpcds_q51/datafusion:parquet 87961408 85961477 1.02
tpcds_q52/datafusion:parquet 🚀 12222063 13734854 0.89
tpcds_q53/datafusion:parquet 19035813 18296550 1.04
tpcds_q54/datafusion:parquet 33269687 33215631 1.00
tpcds_q55/datafusion:parquet 11927952 11860891 1.01
tpcds_q56/datafusion:parquet 29940414 28581045 1.05
tpcds_q57/datafusion:parquet 105886557 104027772 1.02
tpcds_q58/datafusion:parquet 59471969 58177018 1.02
tpcds_q59/datafusion:parquet 63840935 63165244 1.01
tpcds_q60/datafusion:parquet 27897432 28966770 0.96
tpcds_q61/datafusion:parquet 44694234 43166882 1.04
tpcds_q62/datafusion:parquet 26111269 24885583 1.05
tpcds_q63/datafusion:parquet 18872238 19501899 0.97
tpcds_q64/datafusion:parquet 314267466 313211452 1.00
tpcds_q65/datafusion:parquet 37316948 40364497 0.92
tpcds_q66/datafusion:parquet 72030398 69388004 1.04
tpcds_q67/datafusion:parquet 150511380 149658443 1.01
tpcds_q68/datafusion:parquet 32552187 31731423 1.03
tpcds_q69/datafusion:parquet 69338068 67742574 1.02
tpcds_q70/datafusion:parquet 34848127 34385894 1.01
tpcds_q71/datafusion:parquet 22996682 24011927 0.96
tpcds_q72/datafusion:parquet 604095196 593707592 1.02
tpcds_q73/datafusion:parquet 22079960 22255507 0.99
tpcds_q74/datafusion:parquet 86469418 88485387 0.98
tpcds_q75/datafusion:parquet 107908798 106354607 1.01
tpcds_q76/datafusion:parquet 32191179 31899706 1.01
tpcds_q77/datafusion:parquet 39978896 40218481 0.99
tpcds_q78/datafusion:parquet 114525506 110589960 1.04
tpcds_q79/datafusion:parquet 27363892 27190465 1.01
tpcds_q80/datafusion:parquet 78577049 75717259 1.04
tpcds_q81/datafusion:parquet 31043172 30383487 1.02
tpcds_q82/datafusion:parquet 19381055 18949016 1.02
tpcds_q83/datafusion:parquet 41965735 42574986 0.99
tpcds_q84/datafusion:parquet 41468718 40397126 1.03
tpcds_q85/datafusion:parquet 151318439 151376672 1.00
tpcds_q86/datafusion:parquet 16779155 15977068 1.05
tpcds_q87/datafusion:parquet 44261521 45967363 0.96
tpcds_q88/datafusion:parquet 60712242 58973843 1.03
tpcds_q89/datafusion:parquet 23940047 22809511 1.05
tpcds_q90/datafusion:parquet 15201898 14589566 1.04
tpcds_q91/datafusion:parquet 62124949 59518369 1.04
tpcds_q92/datafusion:parquet 19295841 18384791 1.05
tpcds_q93/datafusion:parquet 31406938 30321529 1.04
tpcds_q94/datafusion:parquet 21955198 21595795 1.02
tpcds_q95/datafusion:parquet 63864198 61216955 1.04
tpcds_q96/datafusion:parquet 12920344 13069082 0.99
tpcds_q97/datafusion:parquet 30244993 31794867 0.95
tpcds_q98/datafusion:parquet 21349006 22073872 0.97
tpcds_q99/datafusion:parquet 26760459 27097972 0.99
duckdb / vortex-file-compressed (1.019x ➖, 1↑ 4↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 24321804 22623560 1.08
tpcds_q02/duckdb:vortex-file-compressed 22747325 22174453 1.03
tpcds_q03/duckdb:vortex-file-compressed 19540181 18578642 1.05
tpcds_q04/duckdb:vortex-file-compressed 93671174 94575852 0.99
tpcds_q05/duckdb:vortex-file-compressed 35059193 35236943 0.99
tpcds_q06/duckdb:vortex-file-compressed 35309567 34429746 1.03
tpcds_q07/duckdb:vortex-file-compressed 28842271 28586536 1.01
tpcds_q08/duckdb:vortex-file-compressed 29918550 27687827 1.08
tpcds_q09/duckdb:vortex-file-compressed 16096572 16046768 1.00
tpcds_q10/duckdb:vortex-file-compressed 41834021 39883066 1.05
tpcds_q11/duckdb:vortex-file-compressed 75038582 73683720 1.02
tpcds_q12/duckdb:vortex-file-compressed 14380808 14392094 1.00
tpcds_q13/duckdb:vortex-file-compressed 34671774 35260687 0.98
tpcds_q14/duckdb:vortex-file-compressed 105374542 103744457 1.02
tpcds_q15/duckdb:vortex-file-compressed 27456255 27991000 0.98
tpcds_q16/duckdb:vortex-file-compressed 23575506 23603813 1.00
tpcds_q17/duckdb:vortex-file-compressed 48144923 47878622 1.01
tpcds_q18/duckdb:vortex-file-compressed 41217765 39756374 1.04
tpcds_q19/duckdb:vortex-file-compressed 35977977 36432362 0.99
tpcds_q20/duckdb:vortex-file-compressed 14885892 14517203 1.03
tpcds_q21/duckdb:vortex-file-compressed 16601924 16025782 1.04
tpcds_q22/duckdb:vortex-file-compressed 72199547 70700212 1.02
tpcds_q23/duckdb:vortex-file-compressed 89313844 89294249 1.00
tpcds_q24/duckdb:vortex-file-compressed 48318174 45611434 1.06
tpcds_q25/duckdb:vortex-file-compressed 38212169 38481555 0.99
tpcds_q26/duckdb:vortex-file-compressed 19071693 18676309 1.02
tpcds_q27/duckdb:vortex-file-compressed 29462334 29364515 1.00
tpcds_q28/duckdb:vortex-file-compressed 12773917 11810998 1.08
tpcds_q29/duckdb:vortex-file-compressed 49405197 45727032 1.08
tpcds_q30/duckdb:vortex-file-compressed 25772560 26857951 0.96
tpcds_q31/duckdb:vortex-file-compressed 30458215 31522711 0.97
tpcds_q32/duckdb:vortex-file-compressed 13538425 13114612 1.03
tpcds_q33/duckdb:vortex-file-compressed 26135990 25812270 1.01
tpcds_q34/duckdb:vortex-file-compressed 🚨 30349583 27308851 1.11
tpcds_q35/duckdb:vortex-file-compressed 67810040 66688609 1.02
tpcds_q36/duckdb:vortex-file-compressed 26009733 25125176 1.04
tpcds_q37/duckdb:vortex-file-compressed 20309217 19404182 1.05
tpcds_q38/duckdb:vortex-file-compressed 40401529 40818517 0.99
tpcds_q39/duckdb:vortex-file-compressed 29575218 28443516 1.04
tpcds_q40/duckdb:vortex-file-compressed 18695774 18435645 1.01
tpcds_q41/duckdb:vortex-file-compressed 12543711 12436872 1.01
tpcds_q42/duckdb:vortex-file-compressed 15782949 15335750 1.03
tpcds_q43/duckdb:vortex-file-compressed 19525202 18328335 1.07
tpcds_q44/duckdb:vortex-file-compressed 22190804 22631705 0.98
tpcds_q45/duckdb:vortex-file-compressed 31086079 30832303 1.01
tpcds_q46/duckdb:vortex-file-compressed 31449190 31120019 1.01
tpcds_q47/duckdb:vortex-file-compressed 55220612 52823105 1.05
tpcds_q48/duckdb:vortex-file-compressed 32448276 32804489 0.99
tpcds_q49/duckdb:vortex-file-compressed 37691945 36288916 1.04
tpcds_q50/duckdb:vortex-file-compressed 27668952 27747353 1.00
tpcds_q51/duckdb:vortex-file-compressed 106902167 107816539 0.99
tpcds_q52/duckdb:vortex-file-compressed 15191905 15119836 1.00
tpcds_q53/duckdb:vortex-file-compressed 24230446 24489681 0.99
tpcds_q54/duckdb:vortex-file-compressed 31413765 30168257 1.04
tpcds_q55/duckdb:vortex-file-compressed 15383609 15066737 1.02
tpcds_q56/duckdb:vortex-file-compressed 28380266 28468605 1.00
tpcds_q57/duckdb:vortex-file-compressed 36305123 36838150 0.99
tpcds_q58/duckdb:vortex-file-compressed 29464005 30954775 0.95
tpcds_q59/duckdb:vortex-file-compressed 39219832 39499496 0.99
tpcds_q60/duckdb:vortex-file-compressed 28058003 27307829 1.03
tpcds_q61/duckdb:vortex-file-compressed 33863202 31568051 1.07
tpcds_q62/duckdb:vortex-file-compressed 16237576 15105713 1.07
tpcds_q63/duckdb:vortex-file-compressed 24348393 22444337 1.08
tpcds_q64/duckdb:vortex-file-compressed 100199102 100651719 1.00
tpcds_q65/duckdb:vortex-file-compressed 24447694 23001292 1.06
tpcds_q66/duckdb:vortex-file-compressed 30717813 31353857 0.98
tpcds_q67/duckdb:vortex-file-compressed 140653886 144071788 0.98
tpcds_q68/duckdb:vortex-file-compressed 🚨 39176643 32398345 1.21
tpcds_q69/duckdb:vortex-file-compressed 43443826 42929697 1.01
tpcds_q70/duckdb:vortex-file-compressed 33784292 32856406 1.03
tpcds_q71/duckdb:vortex-file-compressed 22885225 22154510 1.03
tpcds_q72/duckdb:vortex-file-compressed 151707924 155830342 0.97
tpcds_q73/duckdb:vortex-file-compressed 28345195 28696250 0.99
tpcds_q74/duckdb:vortex-file-compressed 47036728 48155703 0.98
tpcds_q75/duckdb:vortex-file-compressed 50544887 48088544 1.05
tpcds_q76/duckdb:vortex-file-compressed 22712045 21592194 1.05
tpcds_q77/duckdb:vortex-file-compressed 🚀 24921163 27760022 0.90
tpcds_q78/duckdb:vortex-file-compressed 68136405 67022269 1.02
tpcds_q79/duckdb:vortex-file-compressed 🚨 30520598 26960729 1.13
tpcds_q80/duckdb:vortex-file-compressed 49091440 49186672 1.00
tpcds_q81/duckdb:vortex-file-compressed 30095387 29915813 1.01
tpcds_q82/duckdb:vortex-file-compressed 47071221 46327728 1.02
tpcds_q83/duckdb:vortex-file-compressed 28402490 28252927 1.01
tpcds_q84/duckdb:vortex-file-compressed 17050586 17832050 0.96
tpcds_q85/duckdb:vortex-file-compressed 44229364 43850132 1.01
tpcds_q86/duckdb:vortex-file-compressed 16543885 16937537 0.98
tpcds_q87/duckdb:vortex-file-compressed 41159408 41113127 1.00
tpcds_q88/duckdb:vortex-file-compressed 57162008 58159026 0.98
tpcds_q89/duckdb:vortex-file-compressed 22848640 22396513 1.02
tpcds_q90/duckdb:vortex-file-compressed 11486820 11075277 1.04
tpcds_q91/duckdb:vortex-file-compressed 24233359 22396314 1.08
tpcds_q92/duckdb:vortex-file-compressed 18119970 17887594 1.01
tpcds_q93/duckdb:vortex-file-compressed 28595086 29201338 0.98
tpcds_q94/duckdb:vortex-file-compressed 23517606 22490401 1.05
tpcds_q95/duckdb:vortex-file-compressed 129373883 125358604 1.03
tpcds_q96/duckdb:vortex-file-compressed 14117582 13895762 1.02
tpcds_q97/duckdb:vortex-file-compressed 39399562 39589874 1.00
tpcds_q98/duckdb:vortex-file-compressed 🚨 21649489 19087282 1.13
tpcds_q99/duckdb:vortex-file-compressed 19163733 19418707 0.99
duckdb / vortex-compact (1.015x ➖, 0↑ 2↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 25578922 24443485 1.05
tpcds_q02/duckdb:vortex-compact 26510486 25163468 1.05
tpcds_q03/duckdb:vortex-compact 46190654 46357791 1.00
tpcds_q04/duckdb:vortex-compact 119701518 119898133 1.00
tpcds_q05/duckdb:vortex-compact 🚨 56922877 50605159 1.12
tpcds_q06/duckdb:vortex-compact 50392732 49507625 1.02
tpcds_q07/duckdb:vortex-compact 62043487 60603685 1.02
tpcds_q08/duckdb:vortex-compact 107354550 107411847 1.00
tpcds_q09/duckdb:vortex-compact 25342876 25983547 0.98
tpcds_q10/duckdb:vortex-compact 82676528 76245689 1.08
tpcds_q11/duckdb:vortex-compact 90749788 88930456 1.02
tpcds_q12/duckdb:vortex-compact 20740310 19459296 1.07
tpcds_q13/duckdb:vortex-compact 89023212 86520278 1.03
tpcds_q14/duckdb:vortex-compact 141963556 142193613 1.00
tpcds_q15/duckdb:vortex-compact 33463975 34339497 0.97
tpcds_q16/duckdb:vortex-compact 31032747 30919582 1.00
tpcds_q17/duckdb:vortex-compact 88974479 89745121 0.99
tpcds_q18/duckdb:vortex-compact 54872483 57078043 0.96
tpcds_q19/duckdb:vortex-compact 67046598 67000111 1.00
tpcds_q20/duckdb:vortex-compact 19272231 19345695 1.00
tpcds_q21/duckdb:vortex-compact 18693470 18078313 1.03
tpcds_q22/duckdb:vortex-compact 74432815 75443293 0.99
tpcds_q23/duckdb:vortex-compact 130811284 127536285 1.03
tpcds_q24/duckdb:vortex-compact 76104914 73407896 1.04
tpcds_q25/duckdb:vortex-compact 65072026 68727170 0.95
tpcds_q26/duckdb:vortex-compact 40518168 37326826 1.09
tpcds_q27/duckdb:vortex-compact 68397566 67265747 1.02
tpcds_q28/duckdb:vortex-compact 23148766 23994044 0.96
tpcds_q29/duckdb:vortex-compact 89646908 87127960 1.03
tpcds_q30/duckdb:vortex-compact 30773133 31449056 0.98
tpcds_q31/duckdb:vortex-compact 51651455 52796924 0.98
tpcds_q32/duckdb:vortex-compact 20012440 19884848 1.01
tpcds_q33/duckdb:vortex-compact 48371216 46021018 1.05
tpcds_q34/duckdb:vortex-compact 55512361 55265195 1.00
tpcds_q35/duckdb:vortex-compact 105910960 101215506 1.05
tpcds_q36/duckdb:vortex-compact 47431309 48043190 0.99
tpcds_q37/duckdb:vortex-compact 24537481 22909261 1.07
tpcds_q38/duckdb:vortex-compact 56871447 56653222 1.00
tpcds_q39/duckdb:vortex-compact 31577281 29816263 1.06
tpcds_q40/duckdb:vortex-compact 22317099 22992068 0.97
tpcds_q41/duckdb:vortex-compact 14633389 13862816 1.06
tpcds_q42/duckdb:vortex-compact 25455528 25451933 1.00
tpcds_q43/duckdb:vortex-compact 38233772 39240188 0.97
tpcds_q44/duckdb:vortex-compact 35382858 35771989 0.99
tpcds_q45/duckdb:vortex-compact 41788272 40014792 1.04
tpcds_q46/duckdb:vortex-compact 75931316 72105904 1.05
tpcds_q47/duckdb:vortex-compact 75815472 73579084 1.03
tpcds_q48/duckdb:vortex-compact 74324285 74365982 1.00
tpcds_q49/duckdb:vortex-compact 62512238 64629928 0.97
tpcds_q50/duckdb:vortex-compact 62284424 60288157 1.03
tpcds_q51/duckdb:vortex-compact 117476249 118562853 0.99
tpcds_q52/duckdb:vortex-compact 25882515 24915123 1.04
tpcds_q53/duckdb:vortex-compact 45628050 45910675 0.99
tpcds_q54/duckdb:vortex-compact 48997680 49039637 1.00
tpcds_q55/duckdb:vortex-compact 25490970 24635462 1.03
tpcds_q56/duckdb:vortex-compact 46740896 46778334 1.00
tpcds_q57/duckdb:vortex-compact 45214569 41994210 1.08
tpcds_q58/duckdb:vortex-compact 41901359 42072068 1.00
tpcds_q59/duckdb:vortex-compact 58080556 57637700 1.01
tpcds_q60/duckdb:vortex-compact 49556334 49388383 1.00
tpcds_q61/duckdb:vortex-compact 91385741 90940786 1.00
tpcds_q62/duckdb:vortex-compact 19883353 18538518 1.07
tpcds_q63/duckdb:vortex-compact 44132891 44442379 0.99
tpcds_q64/duckdb:vortex-compact 172510214 169114120 1.02
tpcds_q65/duckdb:vortex-compact 40522568 40433783 1.00
tpcds_q66/duckdb:vortex-compact 39795351 37251931 1.07
tpcds_q67/duckdb:vortex-compact 165284491 161475287 1.02
tpcds_q68/duckdb:vortex-compact 76711569 75153223 1.02
tpcds_q69/duckdb:vortex-compact 79952848 82034786 0.97
tpcds_q70/duckdb:vortex-compact 74209110 72534586 1.02
tpcds_q71/duckdb:vortex-compact 43750224 42619061 1.03
tpcds_q72/duckdb:vortex-compact 178799589 184297727 0.97
tpcds_q73/duckdb:vortex-compact 53859993 53645221 1.00
tpcds_q74/duckdb:vortex-compact 62352540 63738138 0.98
tpcds_q75/duckdb:vortex-compact 67387564 66642390 1.01
tpcds_q76/duckdb:vortex-compact 37165070 37876698 0.98
tpcds_q77/duckdb:vortex-compact 49712219 46267167 1.07
tpcds_q78/duckdb:vortex-compact 84100251 83587592 1.01
tpcds_q79/duckdb:vortex-compact 92033301 91858203 1.00
tpcds_q80/duckdb:vortex-compact 78911963 78327854 1.01
tpcds_q81/duckdb:vortex-compact 33778694 36027370 0.94
tpcds_q82/duckdb:vortex-compact 50872461 50664462 1.00
tpcds_q83/duckdb:vortex-compact 36950891 35678798 1.04
tpcds_q84/duckdb:vortex-compact 21468970 20373115 1.05
tpcds_q85/duckdb:vortex-compact 66200068 67124806 0.99
tpcds_q86/duckdb:vortex-compact 19882839 19471903 1.02
tpcds_q87/duckdb:vortex-compact 58375210 58252603 1.00
tpcds_q88/duckdb:vortex-compact 236678288 237034889 1.00
tpcds_q89/duckdb:vortex-compact 44586635 44200861 1.01
tpcds_q90/duckdb:vortex-compact 17064165 17052100 1.00
tpcds_q91/duckdb:vortex-compact 57554122 55864986 1.03
tpcds_q92/duckdb:vortex-compact 34299666 34152527 1.00
tpcds_q93/duckdb:vortex-compact 36838224 37116935 0.99
tpcds_q94/duckdb:vortex-compact 32677227 30891402 1.06
tpcds_q95/duckdb:vortex-compact 140425766 134219377 1.05
tpcds_q96/duckdb:vortex-compact 37739635 38048868 0.99
tpcds_q97/duckdb:vortex-compact 49723028 51978141 0.96
tpcds_q98/duckdb:vortex-compact 32324637 32905500 0.98
tpcds_q99/duckdb:vortex-compact 🚨 28218530 22904203 1.23
duckdb / parquet (1.011x ➖, 1↑ 1↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 30153349 29596277 1.02
tpcds_q02/duckdb:parquet 25583245 25193428 1.02
tpcds_q03/duckdb:parquet 13065446 13641456 0.96
tpcds_q04/duckdb:parquet 170291622 171015258 1.00
tpcds_q05/duckdb:parquet 34157425 32881110 1.04
tpcds_q06/duckdb:parquet 34691453 34238816 1.01
tpcds_q07/duckdb:parquet 25092072 24811351 1.01
tpcds_q08/duckdb:parquet 30209013 29738849 1.02
tpcds_q09/duckdb:parquet 46254734 44801918 1.03
tpcds_q10/duckdb:parquet 39756108 38185685 1.04
tpcds_q11/duckdb:parquet 92588853 90038572 1.03
tpcds_q12/duckdb:parquet 15993803 16718270 0.96
tpcds_q13/duckdb:parquet 35813490 35625018 1.01
tpcds_q14/duckdb:parquet 107707082 103367959 1.04
tpcds_q15/duckdb:parquet 31172641 31393695 0.99
tpcds_q16/duckdb:parquet 23354180 23303084 1.00
tpcds_q17/duckdb:parquet 39468274 39577140 1.00
tpcds_q18/duckdb:parquet 49883285 49678930 1.00
tpcds_q19/duckdb:parquet 32866887 32316827 1.02
tpcds_q20/duckdb:parquet 17389234 17456010 1.00
tpcds_q21/duckdb:parquet 12561009 11782696 1.07
tpcds_q22/duckdb:parquet 76598857 71535464 1.07
tpcds_q23/duckdb:parquet 83345979 84342772 0.99
tpcds_q24/duckdb:parquet 47979305 47385224 1.01
tpcds_q25/duckdb:parquet 36746535 38073147 0.97
tpcds_q26/duckdb:parquet 41622721 39142061 1.06
tpcds_q27/duckdb:parquet 54543926 54028584 1.01
tpcds_q28/duckdb:parquet 44052364 43661800 1.01
tpcds_q29/duckdb:parquet 39533700 43242261 0.91
tpcds_q30/duckdb:parquet 38537565 37850312 1.02
tpcds_q31/duckdb:parquet 28283129 28358144 1.00
tpcds_q32/duckdb:parquet 13317841 12522948 1.06
tpcds_q33/duckdb:parquet 24605455 24775448 0.99
tpcds_q34/duckdb:parquet 22980116 24075334 0.95
tpcds_q35/duckdb:parquet 62584221 63152323 0.99
tpcds_q36/duckdb:parquet 23397310 23105873 1.01
tpcds_q37/duckdb:parquet 14500220 14535036 1.00
tpcds_q38/duckdb:parquet 40142249 37028944 1.08
tpcds_q39/duckdb:parquet 33352123 32161000 1.04
tpcds_q40/duckdb:parquet 20727244 20109727 1.03
tpcds_q41/duckdb:parquet 9118293 8768014 1.04
tpcds_q42/duckdb:parquet 12542825 13228640 0.95
tpcds_q43/duckdb:parquet 🚨 19400693 17346689 1.12
tpcds_q44/duckdb:parquet 26617203 26396344 1.01
tpcds_q45/duckdb:parquet 30365158 28783368 1.05
tpcds_q46/duckdb:parquet 48553378 49123974 0.99
tpcds_q47/duckdb:parquet 52616154 50621284 1.04
tpcds_q48/duckdb:parquet 33525938 32933743 1.02
tpcds_q49/duckdb:parquet 29165330 29007682 1.01
tpcds_q50/duckdb:parquet 27043558 26594019 1.02
tpcds_q51/duckdb:parquet 106042318 104635155 1.01
tpcds_q52/duckdb:parquet 13364469 14435224 0.93
tpcds_q53/duckdb:parquet 17540759 17391900 1.01
tpcds_q54/duckdb:parquet 29471427 30459770 0.97
tpcds_q55/duckdb:parquet 13814214 13074062 1.06
tpcds_q56/duckdb:parquet 25206431 23956143 1.05
tpcds_q57/duckdb:parquet 39530357 39122843 1.01
tpcds_q58/duckdb:parquet 27159373 27184339 1.00
tpcds_q59/duckdb:parquet 37035473 36541706 1.01
tpcds_q60/duckdb:parquet 25859908 25343951 1.02
tpcds_q61/duckdb:parquet 34847561 34783889 1.00
tpcds_q62/duckdb:parquet 13302779 13077243 1.02
tpcds_q63/duckdb:parquet 16110780 15928704 1.01
tpcds_q64/duckdb:parquet 81395231 82300256 0.99
tpcds_q65/duckdb:parquet 24120221 23394899 1.03
tpcds_q66/duckdb:parquet 30600925 31031152 0.99
tpcds_q67/duckdb:parquet 141652054 138840570 1.02
tpcds_q68/duckdb:parquet 39433790 39617834 1.00
tpcds_q69/duckdb:parquet 39544260 38541842 1.03
tpcds_q70/duckdb:parquet 24101174 22941829 1.05
tpcds_q71/duckdb:parquet 24009633 24223699 0.99
tpcds_q72/duckdb:parquet 167870336 167781845 1.00
tpcds_q73/duckdb:parquet 20838155 20815776 1.00
tpcds_q74/duckdb:parquet 129470861 128628213 1.01
tpcds_q75/duckdb:parquet 56575660 61252345 0.92
tpcds_q76/duckdb:parquet 23773003 21981827 1.08
tpcds_q77/duckdb:parquet 26413221 25770485 1.02
tpcds_q78/duckdb:parquet 79380811 78500836 1.01
tpcds_q79/duckdb:parquet 31710005 30753329 1.03
tpcds_q80/duckdb:parquet 48064847 44423493 1.08
tpcds_q81/duckdb:parquet 36302885 36050448 1.01
tpcds_q82/duckdb:parquet 17651994 17711502 1.00
tpcds_q83/duckdb:parquet 18980412 18991717 1.00
tpcds_q84/duckdb:parquet 21705274 21124336 1.03
tpcds_q85/duckdb:parquet 43913670 43238634 1.02
tpcds_q86/duckdb:parquet 14298172 13750601 1.04
tpcds_q87/duckdb:parquet 39862472 39784210 1.00
tpcds_q88/duckdb:parquet 54661561 54933776 1.00
tpcds_q89/duckdb:parquet 20472574 20459232 1.00
tpcds_q90/duckdb:parquet 8719915 8898511 0.98
tpcds_q91/duckdb:parquet 26841534 25604227 1.05
tpcds_q92/duckdb:parquet 13827106 13561423 1.02
tpcds_q93/duckdb:parquet 32812802 32436297 1.01
tpcds_q94/duckdb:parquet 18565800 18285688 1.02
tpcds_q95/duckdb:parquet 🚀 127810569 149086657 0.86
tpcds_q96/duckdb:parquet 10749934 10870388 0.99
tpcds_q97/duckdb:parquet 39551206 39032761 1.01
tpcds_q98/duckdb:parquet 22357339 21565666 1.04
tpcds_q99/duckdb:parquet 21192379 20587155 1.03
duckdb / duckdb (1.027x ➖, 0↑ 4↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 22369667 22005308 1.02
tpcds_q02/duckdb:duckdb 19212217 19996700 0.96
tpcds_q03/duckdb:duckdb 10657847 10258150 1.04
tpcds_q04/duckdb:duckdb 180696406 181447337 1.00
tpcds_q05/duckdb:duckdb 21308322 22135400 0.96
tpcds_q06/duckdb:duckdb 28727426 27381681 1.05
tpcds_q07/duckdb:duckdb 42036660 40571899 1.04
tpcds_q08/duckdb:duckdb 122345785 120656517 1.01
tpcds_q09/duckdb:duckdb 20971803 20741698 1.01
tpcds_q10/duckdb:duckdb 28372523 27856212 1.02
tpcds_q11/duckdb:duckdb 90443438 89421777 1.01
tpcds_q12/duckdb:duckdb 13300612 12823130 1.04
tpcds_q13/duckdb:duckdb 27127861 26677128 1.02
tpcds_q14/duckdb:duckdb 97197385 93774660 1.04
tpcds_q15/duckdb:duckdb 26075429 25898795 1.01
tpcds_q16/duckdb:duckdb 🚨 22165092 20071167 1.10
tpcds_q17/duckdb:duckdb 25549666 24010106 1.06
tpcds_q18/duckdb:duckdb 48480813 49095053 0.99
tpcds_q19/duckdb:duckdb 20040248 19424664 1.03
tpcds_q20/duckdb:duckdb 13899803 13397478 1.04
tpcds_q21/duckdb:duckdb 7870258 7680285 1.02
tpcds_q22/duckdb:duckdb 63243176 62870942 1.01
tpcds_q23/duckdb:duckdb 80166989 77357876 1.04
tpcds_q24/duckdb:duckdb 26578364 26002357 1.02
tpcds_q25/duckdb:duckdb 19600746 19080637 1.03
tpcds_q26/duckdb:duckdb 29110909 28195305 1.03
tpcds_q27/duckdb:duckdb 44956125 41269864 1.09
tpcds_q28/duckdb:duckdb 25796380 25038572 1.03
tpcds_q29/duckdb:duckdb 24092020 23190507 1.04
tpcds_q30/duckdb:duckdb 32145244 31332606 1.03
tpcds_q31/duckdb:duckdb 51958657 52209973 1.00
tpcds_q32/duckdb:duckdb 8579114 8232802 1.04
tpcds_q33/duckdb:duckdb 15904647 15671643 1.01
tpcds_q34/duckdb:duckdb 18776742 18201361 1.03
tpcds_q35/duckdb:duckdb 37843568 37844849 1.00
tpcds_q36/duckdb:duckdb 72864618 71920054 1.01
tpcds_q37/duckdb:duckdb 9467619 8924607 1.06
tpcds_q38/duckdb:duckdb 35035339 32733380 1.07
tpcds_q39/duckdb:duckdb 28091855 28267626 0.99
tpcds_q40/duckdb:duckdb 15457158 14727952 1.05
tpcds_q41/duckdb:duckdb 9855806 9414061 1.05
tpcds_q42/duckdb:duckdb 🚨 9412556 8400843 1.12
tpcds_q43/duckdb:duckdb 15640394 14941392 1.05
tpcds_q44/duckdb:duckdb 15516053 15507359 1.00
tpcds_q45/duckdb:duckdb 19487629 19127211 1.02
tpcds_q46/duckdb:duckdb 40106618 38556679 1.04
tpcds_q47/duckdb:duckdb 48082270 45996357 1.05
tpcds_q48/duckdb:duckdb 25361994 25618293 0.99
tpcds_q49/duckdb:duckdb 21623949 21162874 1.02
tpcds_q50/duckdb:duckdb 16565716 16170638 1.02
tpcds_q51/duckdb:duckdb 101994959 102579379 0.99
tpcds_q52/duckdb:duckdb 🚨 10064227 8721782 1.15
tpcds_q53/duckdb:duckdb 16081007 15600308 1.03
tpcds_q54/duckdb:duckdb 19853334 19745960 1.01
tpcds_q55/duckdb:duckdb 9749532 10252055 0.95
tpcds_q56/duckdb:duckdb 16893113 16330199 1.03
tpcds_q57/duckdb:duckdb 37802106 36474198 1.04
tpcds_q58/duckdb:duckdb 16954261 17198135 0.99
tpcds_q59/duckdb:duckdb 37684164 37153656 1.01
tpcds_q60/duckdb:duckdb 17988394 17856843 1.01
tpcds_q61/duckdb:duckdb 17138573 16451903 1.04
tpcds_q62/duckdb:duckdb 10405074 9971586 1.04
tpcds_q63/duckdb:duckdb 14751027 14269012 1.03
tpcds_q64/duckdb:duckdb 59007719 57458773 1.03
tpcds_q65/duckdb:duckdb 37341001 36611327 1.02
tpcds_q66/duckdb:duckdb 27859360 26671270 1.04
tpcds_q67/duckdb:duckdb 137314641 136436781 1.01
tpcds_q68/duckdb:duckdb 26817446 27101032 0.99
tpcds_q69/duckdb:duckdb 28386536 29251192 0.97
tpcds_q70/duckdb:duckdb 17613478 16528451 1.07
tpcds_q71/duckdb:duckdb 15919563 16128461 0.99
tpcds_q72/duckdb:duckdb 47650281 46447899 1.03
tpcds_q73/duckdb:duckdb 13935225 14144574 0.99
tpcds_q74/duckdb:duckdb 147356659 145357197 1.01
tpcds_q75/duckdb:duckdb 49056934 45213152 1.09
tpcds_q76/duckdb:duckdb 14783790 14908754 0.99
tpcds_q77/duckdb:duckdb 15407357 15014849 1.03
tpcds_q78/duckdb:duckdb 67090191 67209216 1.00
tpcds_q79/duckdb:duckdb 20827616 20198914 1.03
tpcds_q80/duckdb:duckdb 32478464 32832202 0.99
tpcds_q81/duckdb:duckdb 40240250 40052140 1.00
tpcds_q82/duckdb:duckdb 10808846 10138214 1.07
tpcds_q83/duckdb:duckdb 11453793 11087072 1.03
tpcds_q84/duckdb:duckdb 15339208 14832659 1.03
tpcds_q85/duckdb:duckdb 27007989 26128172 1.03
tpcds_q86/duckdb:duckdb 12407730 12251500 1.01
tpcds_q87/duckdb:duckdb 36507061 35666531 1.02
tpcds_q88/duckdb:duckdb 29776642 28916383 1.03
tpcds_q89/duckdb:duckdb 17863546 17021831 1.05
tpcds_q90/duckdb:duckdb 6696531 6418565 1.04
tpcds_q91/duckdb:duckdb 15868263 15021394 1.06
tpcds_q92/duckdb:duckdb 10430651 10107475 1.03
tpcds_q93/duckdb:duckdb 24641482 23469245 1.05
tpcds_q94/duckdb:duckdb 15220435 15276824 1.00
tpcds_q95/duckdb:duckdb 113579906 112325429 1.01
tpcds_q96/duckdb:duckdb 🚨 6541251 5813464 1.13
tpcds_q97/duckdb:duckdb 32614280 32845063 0.99
tpcds_q98/duckdb:duckdb 18001853 17100060 1.05
tpcds_q99/duckdb:duckdb 17748393 16805924 1.06

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +6.1%
Engines: DataFusion No clear signal (+5.1%, environment too noisy confidence) · DuckDB No clear signal (+7.1%, low confidence)
Vortex (geomean): 1.074x ➖
Parquet (geomean): 1.013x ➖
Shifts: Parquet (control) +1.3% · Median polish +3.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.043x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 37856223 30443100 1.24
fineweb_q01/datafusion:vortex-file-compressed 431550346 480967686 0.90
fineweb_q02/datafusion:vortex-file-compressed 475344329 521519240 0.91
fineweb_q03/datafusion:vortex-file-compressed 1124175647 1083071472 1.04
fineweb_q04/datafusion:vortex-file-compressed 1154169397 1160901215 0.99
fineweb_q05/datafusion:vortex-file-compressed 1159876384 1077826698 1.08
fineweb_q06/datafusion:vortex-file-compressed 1407240384 1256444733 1.12
fineweb_q07/datafusion:vortex-file-compressed 1248130569 1111068100 1.12
fineweb_q08/datafusion:vortex-file-compressed 459705979 448023173 1.03
datafusion / vortex-compact (1.084x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 36141903 33035550 1.09
fineweb_q01/datafusion:vortex-compact 563564986 444168274 1.27
fineweb_q02/datafusion:vortex-compact 727082352 596134069 1.22
fineweb_q03/datafusion:vortex-compact 1401360515 1349605520 1.04
fineweb_q04/datafusion:vortex-compact 1639083261 1591687224 1.03
fineweb_q05/datafusion:vortex-compact 1368262363 1359249711 1.01
fineweb_q06/datafusion:vortex-compact 1292980582 1247226028 1.04
fineweb_q07/datafusion:vortex-compact 1230746579 1151249473 1.07
fineweb_q08/datafusion:vortex-compact 406585816 396124424 1.03
datafusion / parquet (1.012x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1132438729 974184605 1.16
fineweb_q01/datafusion:parquet 1671946856 1724357608 0.97
fineweb_q02/datafusion:parquet 1732276379 1731911205 1.00
fineweb_q03/datafusion:parquet 1798579827 1630336403 1.10
fineweb_q04/datafusion:parquet 1805467300 1796198690 1.01
fineweb_q05/datafusion:parquet 1901977842 1899069437 1.00
fineweb_q06/datafusion:parquet 1659705520 1749478199 0.95
fineweb_q07/datafusion:parquet 1709703309 1762047235 0.97
fineweb_q08/datafusion:parquet 1650648647 1707291456 0.97
duckdb / vortex-file-compressed (1.089x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 91356486 77832551 1.17
fineweb_q01/duckdb:vortex-file-compressed 583325151 516421111 1.13
fineweb_q02/duckdb:vortex-file-compressed 503408402 496482853 1.01
fineweb_q03/duckdb:vortex-file-compressed 1395293186 1226427929 1.14
fineweb_q04/duckdb:vortex-file-compressed 1483666375 1387409621 1.07
fineweb_q05/duckdb:vortex-file-compressed 1266451222 1235100670 1.03
fineweb_q06/duckdb:vortex-file-compressed 1389067297 1417619335 0.98
fineweb_q07/duckdb:vortex-file-compressed 1407873551 1264652140 1.11
fineweb_q08/duckdb:vortex-file-compressed 595566808 505884966 1.18
duckdb / vortex-compact (1.080x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 80183326 67103710 1.19
fineweb_q01/duckdb:vortex-compact 559355390 520280643 1.08
fineweb_q02/duckdb:vortex-compact 599572524 562460042 1.07
fineweb_q03/duckdb:vortex-compact 1857825060 1741247264 1.07
fineweb_q04/duckdb:vortex-compact 1865150920 1829800832 1.02
fineweb_q05/duckdb:vortex-compact 1673442590 1634023063 1.02
fineweb_q06/duckdb:vortex-compact 1721833095 1463345784 1.18
fineweb_q07/duckdb:vortex-compact 1450665493 1351840852 1.07
fineweb_q08/duckdb:vortex-compact 469929667 452832725 1.04
duckdb / parquet (1.013x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1088705754 1057130264 1.03
fineweb_q01/duckdb:parquet 1359372047 1338015857 1.02
fineweb_q02/duckdb:parquet 1301291778 1286704402 1.01
fineweb_q03/duckdb:parquet 3496637457 3510085017 1.00
fineweb_q04/duckdb:parquet 1858608224 1854193042 1.00
fineweb_q05/duckdb:parquet 2105020103 2056563370 1.02
fineweb_q06/duckdb:parquet 4160638260 4059004043 1.03
fineweb_q07/duckdb:parquet 2548494158 2513893236 1.01
fineweb_q08/duckdb:parquet 1049101705 1049836599 1.00

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Engines: DuckDB No clear signal (-0.7%, low confidence)
Vortex (geomean): 1.012x ➖
Parquet (geomean): 1.020x ➖
Shifts: Parquet (control) +2.0% · Median polish +2.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

duckdb / vortex-file-compressed (1.020x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12247936 11605536 1.06
statpopgen_q01/duckdb:vortex-file-compressed 27556489 26776040 1.03
statpopgen_q02/duckdb:vortex-file-compressed 523977746 517789117 1.01
statpopgen_q03/duckdb:vortex-file-compressed 1038114301 1013584147 1.02
statpopgen_q04/duckdb:vortex-file-compressed 1048326364 1039203953 1.01
statpopgen_q05/duckdb:vortex-file-compressed 472810720 447765124 1.06
statpopgen_q06/duckdb:vortex-file-compressed 1520347814 1495830915 1.02
statpopgen_q07/duckdb:vortex-file-compressed 189616085 194888862 0.97
statpopgen_q08/duckdb:vortex-file-compressed 224159228 220254688 1.02
statpopgen_q09/duckdb:vortex-file-compressed 834377949 816910225 1.02
statpopgen_q10/duckdb:vortex-file-compressed 2564366410 2536786821 1.01
duckdb / vortex-compact (1.005x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 12200244 11907744 1.02
statpopgen_q01/duckdb:vortex-compact 214336182 214525658 1.00
statpopgen_q02/duckdb:vortex-compact 568926335 585511782 0.97
statpopgen_q03/duckdb:vortex-compact 1156717024 1164098934 0.99
statpopgen_q04/duckdb:vortex-compact 1161713665 1158444346 1.00
statpopgen_q05/duckdb:vortex-compact 560460287 599027212 0.94
statpopgen_q06/duckdb:vortex-compact 1487842121 1462734968 1.02
statpopgen_q07/duckdb:vortex-compact 883454820 848868160 1.04
statpopgen_q08/duckdb:vortex-compact 908190773 877593031 1.03
statpopgen_q09/duckdb:vortex-compact 941026211 910730992 1.03
statpopgen_q10/duckdb:vortex-compact 2602761588 2600046928 1.00
duckdb / parquet (1.020x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 347206184 340478786 1.02
statpopgen_q01/duckdb:parquet 430483352 413082236 1.04
statpopgen_q02/duckdb:parquet 808942577 800203237 1.01
statpopgen_q03/duckdb:parquet 1230054256 1220180618 1.01
statpopgen_q04/duckdb:parquet 1248532115 1238304886 1.01
statpopgen_q05/duckdb:parquet 866060233 838071558 1.03
statpopgen_q06/duckdb:parquet 1444940262 1455531941 0.99
statpopgen_q07/duckdb:parquet 913686767 885149092 1.03
statpopgen_q08/duckdb:parquet 935368487 887228725 1.05
statpopgen_q09/duckdb:parquet 1056427578 1050635194 1.01
statpopgen_q10/duckdb:parquet 2281060301 2255766245 1.01

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.8%
Engines: DataFusion No clear signal (-3.5%, environment too noisy confidence) · DuckDB No clear signal (+4.7%, low confidence)
Vortex (geomean): 1.056x ➖
Parquet (geomean): 1.025x ➖
Shifts: Parquet (control) +2.5% · Median polish +1.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.991x ➖, 1↑ 1↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-file-compressed 🚨 485682280 394159588 1.23
clickbench-sorted_q24/datafusion:vortex-file-compressed 21581927 22650433 0.95
clickbench-sorted_q26/datafusion:vortex-file-compressed 🚀 20322995 23961963 0.85
clickbench-sorted_q36/datafusion:vortex-file-compressed 70679549 70365835 1.00
clickbench-sorted_q37/datafusion:vortex-file-compressed 45511838 48795055 0.93
clickbench-sorted_q38/datafusion:vortex-file-compressed 44102927 47788899 0.92
clickbench-sorted_q39/datafusion:vortex-file-compressed 121067171 118569243 1.02
clickbench-sorted_q40/datafusion:vortex-file-compressed 22276044 20826814 1.07
clickbench-sorted_q41/datafusion:vortex-file-compressed 20676641 22261589 0.93
clickbench-sorted_q42/datafusion:vortex-file-compressed 15599199 14971407 1.04
datafusion / parquet (1.027x ➖, 0↑ 1↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet 5036920485 5344923228 0.94
clickbench-sorted_q24/datafusion:parquet 🚨 30193006 26493524 1.14
clickbench-sorted_q26/datafusion:parquet 28726380 27952036 1.03
clickbench-sorted_q36/datafusion:parquet 184217822 178280877 1.03
clickbench-sorted_q37/datafusion:parquet 115477859 119276995 0.97
clickbench-sorted_q38/datafusion:parquet 170751949 155263465 1.10
clickbench-sorted_q39/datafusion:parquet 309140376 297521468 1.04
clickbench-sorted_q40/datafusion:parquet 66361973 64318787 1.03
clickbench-sorted_q41/datafusion:parquet 64778026 63328533 1.02
clickbench-sorted_q42/datafusion:parquet 32789555 33574052 0.98
duckdb / vortex-file-compressed (1.125x ❌, 0↑ 4↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-file-compressed 🚨 162277084 144402763 1.12
clickbench-sorted_q24/duckdb:vortex-file-compressed 🚨 30473298 21677892 1.41
clickbench-sorted_q26/duckdb:vortex-file-compressed 🚨 45154497 34476645 1.31
clickbench-sorted_q36/duckdb:vortex-file-compressed 60303208 57265354 1.05
clickbench-sorted_q37/duckdb:vortex-file-compressed 48993608 44778173 1.09
clickbench-sorted_q38/duckdb:vortex-file-compressed 52816250 48902596 1.08
clickbench-sorted_q39/duckdb:vortex-file-compressed 🚨 121698626 104362734 1.17
clickbench-sorted_q40/duckdb:vortex-file-compressed 29598367 28975995 1.02
clickbench-sorted_q41/duckdb:vortex-file-compressed 28838969 28098166 1.03
clickbench-sorted_q42/duckdb:vortex-file-compressed 25156671 24439506 1.03
duckdb / parquet (1.023x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet 198577836 189079577 1.05
clickbench-sorted_q24/duckdb:parquet 30207038 29840137 1.01
clickbench-sorted_q26/duckdb:parquet 24458526 24575174 1.00
clickbench-sorted_q36/duckdb:parquet 112287522 111209833 1.01
clickbench-sorted_q37/duckdb:parquet 97067648 93354747 1.04
clickbench-sorted_q38/duckdb:parquet 100027041 95593797 1.05
clickbench-sorted_q39/duckdb:parquet 182293212 179305732 1.02
clickbench-sorted_q40/duckdb:parquet 42348432 42286326 1.00
clickbench-sorted_q41/duckdb:parquet 43166464 42098264 1.03
clickbench-sorted_q42/duckdb:parquet 31389977 30469190 1.03
duckdb / duckdb (1.020x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:duckdb 300671194 289772731 1.04
clickbench-sorted_q24/duckdb:duckdb 45556070 44416254 1.03
clickbench-sorted_q26/duckdb:duckdb 43000794 42571561 1.01
clickbench-sorted_q36/duckdb:duckdb 91149967 89397434 1.02
clickbench-sorted_q37/duckdb:duckdb 82263602 80214641 1.03
clickbench-sorted_q38/duckdb:duckdb 65074050 63908156 1.02
clickbench-sorted_q39/duckdb:duckdb 125025437 122182077 1.02
clickbench-sorted_q40/duckdb:duckdb 44982538 44343445 1.01
clickbench-sorted_q41/duckdb:duckdb 43110060 42465159 1.02
clickbench-sorted_q42/duckdb:duckdb 36145651 35827551 1.01

File Size Changes (201 files changed, +0.0% overall, 105↑ 96↓)
File Scale Format Base HEAD Change %
hits_000.vortex 1.0 vortex-compact 98.40 MB 100.24 MB +1.84 MB +1.9%
hits_061.vortex 1.0 vortex-compact 123.63 MB 125.44 MB +1.80 MB +1.5%
hits_004.vortex 1.0 vortex-compact 97.34 MB 98.52 MB +1.17 MB +1.2%
hits_034.vortex 1.0 vortex-file-compressed 181.89 MB 184.01 MB +2.12 MB +1.2%
hits_050.vortex 1.0 vortex-compact 124.29 MB 125.52 MB +1.23 MB +1.0%
hits_075.vortex 1.0 vortex-compact 137.84 MB 139.16 MB +1.32 MB +1.0%
hits_012.vortex 1.0 vortex-compact 138.76 MB 140.02 MB +1.26 MB +0.9%
hits_082.vortex 1.0 vortex-file-compressed 139.91 MB 141.15 MB +1.23 MB +0.9%
hits_024.vortex 1.0 vortex-compact 124.35 MB 125.41 MB +1.06 MB +0.8%
hits_039.vortex 1.0 vortex-compact 123.91 MB 124.88 MB +1000.00 KB +0.8%
hits_013.vortex 1.0 vortex-compact 124.39 MB 125.37 MB +1001.81 KB +0.8%
hits_066.vortex 1.0 vortex-file-compressed 163.52 MB 164.77 MB +1.25 MB +0.8%
hits_023.vortex 1.0 vortex-compact 141.71 MB 142.77 MB +1.06 MB +0.7%
hits_023.vortex 1.0 vortex-file-compressed 195.63 MB 196.88 MB +1.26 MB +0.6%
hits_071.vortex 1.0 vortex-file-compressed 140.05 MB 140.93 MB +907.25 KB +0.6%
hits_085.vortex 1.0 vortex-file-compressed 198.44 MB 199.59 MB +1.16 MB +0.6%
hits_002.vortex 1.0 vortex-compact 124.30 MB 125.01 MB +729.20 KB +0.6%
hits_054.vortex 1.0 vortex-file-compressed 147.01 MB 147.79 MB +796.70 KB +0.5%
hits_087.vortex 1.0 vortex-compact 125.56 MB 126.18 MB +638.66 KB +0.5%
hits_019.vortex 1.0 vortex-compact 106.20 MB 106.70 MB +516.94 KB +0.5%
hits_059.vortex 1.0 vortex-file-compressed 198.05 MB 198.99 MB +962.26 KB +0.5%
hits_018.vortex 1.0 vortex-compact 152.99 MB 153.70 MB +722.54 KB +0.5%
hits_068.vortex 1.0 vortex-file-compressed 160.56 MB 161.25 MB +701.59 KB +0.4%
hits_008.vortex 1.0 vortex-compact 105.74 MB 106.17 MB +439.47 KB +0.4%
hits_033.vortex 1.0 vortex-compact 152.84 MB 153.43 MB +604.05 KB +0.4%
hits_015.vortex 1.0 vortex-compact 98.08 MB 98.43 MB +357.80 KB +0.4%
hits_098.vortex 1.0 vortex-compact 104.08 MB 104.42 MB +352.80 KB +0.3%
hits_040.vortex 1.0 vortex-compact 110.08 MB 110.43 MB +366.59 KB +0.3%
hits_055.vortex 1.0 vortex-file-compressed 199.54 MB 200.17 MB +641.02 KB +0.3%
hits_016.vortex 1.0 vortex-compact 127.28 MB 127.64 MB +373.56 KB +0.3%
hits_046.vortex 1.0 vortex-file-compressed 101.15 MB 101.43 MB +288.02 KB +0.3%
hits_007.vortex 1.0 vortex-compact 153.40 MB 153.78 MB +381.13 KB +0.2%
hits_084.vortex 1.0 vortex-compact 110.45 MB 110.68 MB +241.66 KB +0.2%
hits_079.vortex 1.0 vortex-file-compressed 181.04 MB 181.42 MB +394.52 KB +0.2%
hits_099.vortex 1.0 vortex-compact 133.18 MB 133.45 MB +270.92 KB +0.2%
hits_086.vortex 1.0 vortex-file-compressed 192.17 MB 192.56 MB +389.66 KB +0.2%
hits_031.vortex 1.0 vortex-file-compressed 159.52 MB 159.83 MB +313.66 KB +0.2%
hits_073.vortex 1.0 vortex-file-compressed 172.63 MB 172.95 MB +324.91 KB +0.2%
hits_083.vortex 1.0 vortex-compact 109.90 MB 110.09 MB +191.03 KB +0.2%
hits_025.vortex 1.0 vortex-compact 133.49 MB 133.71 MB +225.23 KB +0.2%
hits_077.vortex 1.0 vortex-file-compressed 172.43 MB 172.71 MB +285.39 KB +0.2%
hits_079.vortex 1.0 vortex-compact 127.88 MB 128.06 MB +186.88 KB +0.1%
hits_030.vortex 1.0 vortex-file-compressed 131.81 MB 131.98 MB +178.27 KB +0.1%
hits_099.vortex 1.0 vortex-file-compressed 171.15 MB 171.37 MB +221.10 KB +0.1%
hits_048.vortex 1.0 vortex-compact 153.34 MB 153.52 MB +183.27 KB +0.1%
hits_029.vortex 1.0 vortex-file-compressed 199.81 MB 200.04 MB +234.51 KB +0.1%
hits_043.vortex 1.0 vortex-file-compressed 126.48 MB 126.63 MB +145.83 KB +0.1%
hits_062.vortex 1.0 vortex-file-compressed 170.62 MB 170.81 MB +194.95 KB +0.1%
hits_016.vortex 1.0 vortex-file-compressed 180.26 MB 180.46 MB +202.46 KB +0.1%
hits_030.vortex 1.0 vortex-compact 98.27 MB 98.38 MB +110.20 KB +0.1%
hits_046.vortex 1.0 vortex-compact 74.88 MB 74.96 MB +80.80 KB +0.1%
hits_019.vortex 1.0 vortex-file-compressed 140.95 MB 141.10 MB +146.22 KB +0.1%
hits_036.vortex 1.0 vortex-compact 133.42 MB 133.55 MB +137.70 KB +0.1%
hits_032.vortex 1.0 vortex-file-compressed 154.57 MB 154.72 MB +157.34 KB +0.1%
hits_060.vortex 1.0 vortex-file-compressed 193.09 MB 193.27 MB +191.49 KB +0.1%
hits_096.vortex 1.0 vortex-file-compressed 199.31 MB 199.49 MB +187.29 KB +0.1%
hits_083.vortex 1.0 vortex-file-compressed 157.09 MB 157.24 MB +147.32 KB +0.1%
hits_020.vortex 1.0 vortex-compact 111.66 MB 111.76 MB +99.80 KB +0.1%
hits_064.vortex 1.0 vortex-compact 140.06 MB 140.18 MB +124.40 KB +0.1%
hits_075.vortex 1.0 vortex-file-compressed 189.45 MB 189.61 MB +165.47 KB +0.1%
hits_078.vortex 1.0 vortex-file-compressed 130.90 MB 131.01 MB +112.98 KB +0.1%
hits_070.vortex 1.0 vortex-compact 153.50 MB 153.63 MB +131.84 KB +0.1%
hits_031.vortex 1.0 vortex-compact 111.61 MB 111.70 MB +87.91 KB +0.1%
hits_039.vortex 1.0 vortex-file-compressed 161.00 MB 161.12 MB +116.91 KB +0.1%
hits_065.vortex 1.0 vortex-file-compressed 161.29 MB 161.40 MB +114.19 KB +0.1%
hits_018.vortex 1.0 vortex-file-compressed 199.52 MB 199.66 MB +139.62 KB +0.1%
hits_069.vortex 1.0 vortex-file-compressed 142.21 MB 142.31 MB +95.94 KB +0.1%
hits_001.vortex 1.0 vortex-file-compressed 189.02 MB 189.14 MB +121.56 KB +0.1%
hits_094.vortex 1.0 vortex-file-compressed 158.39 MB 158.49 MB +100.52 KB +0.1%
hits_000.vortex 1.0 vortex-file-compressed 131.64 MB 131.71 MB +81.66 KB +0.1%
hits_029.vortex 1.0 vortex-compact 153.45 MB 153.54 MB +92.01 KB +0.1%
hits_051.vortex 1.0 vortex-compact 134.16 MB 134.23 MB +72.39 KB +0.1%
hits_007.vortex 1.0 vortex-file-compressed 200.07 MB 200.17 MB +103.43 KB +0.1%
hits_095.vortex 1.0 vortex-file-compressed 154.28 MB 154.36 MB +79.42 KB +0.1%
hits_034.vortex 1.0 vortex-compact 133.32 MB 133.38 MB +68.44 KB +0.1%
hits_089.vortex 1.0 vortex-file-compressed 131.46 MB 131.53 MB +63.32 KB +0.0%
hits_040.vortex 1.0 vortex-file-compressed 143.31 MB 143.38 MB +68.64 KB +0.0%
hits_049.vortex 1.0 vortex-file-compressed 191.36 MB 191.44 MB +83.33 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.09 MB 147.15 MB +60.55 KB +0.0%
hits_011.vortex 1.0 vortex-compact 152.75 MB 152.81 MB +61.72 KB +0.0%
hits_076.vortex 1.0 vortex-file-compressed 161.01 MB 161.07 MB +63.28 KB +0.0%
hits_038.vortex 1.0 vortex-file-compressed 190.06 MB 190.13 MB +72.48 KB +0.0%
hits_017.vortex 1.0 vortex-file-compressed 146.82 MB 146.88 MB +53.29 KB +0.0%
hits_087.vortex 1.0 vortex-file-compressed 161.04 MB 161.09 MB +53.80 KB +0.0%
hits_026.vortex 1.0 vortex-file-compressed 131.34 MB 131.37 MB +40.16 KB +0.0%
hits_014.vortex 1.0 vortex-file-compressed 172.20 MB 172.25 MB +51.09 KB +0.0%
hits_052.vortex 1.0 vortex-file-compressed 130.77 MB 130.81 MB +38.62 KB +0.0%
hits_048.vortex 1.0 vortex-file-compressed 199.37 MB 199.43 MB +57.41 KB +0.0%
hits_094.vortex 1.0 vortex-compact 110.75 MB 110.78 MB +21.56 KB +0.0%
hits_021.vortex 1.0 vortex-compact 110.64 MB 110.65 MB +17.65 KB +0.0%
hits_055.vortex 1.0 vortex-compact 153.37 MB 153.39 MB +23.77 KB +0.0%
hits_088.vortex 1.0 vortex-file-compressed 172.08 MB 172.10 MB +26.11 KB +0.0%
hits_047.vortex 1.0 vortex-compact 110.49 MB 110.51 MB +16.06 KB +0.0%
hits_050.vortex 1.0 vortex-file-compressed 161.02 MB 161.04 MB +23.15 KB +0.0%
hits_025.vortex 1.0 vortex-file-compressed 172.14 MB 172.16 MB +23.66 KB +0.0%
hits_092.vortex 1.0 vortex-compact 153.30 MB 153.32 MB +19.75 KB +0.0%
hits_063.vortex 1.0 vortex-compact 98.17 MB 98.18 MB +10.05 KB +0.0%
hits_044.vortex 1.0 vortex-file-compressed 199.83 MB 199.85 MB +20.34 KB +0.0%
hits_092.vortex 1.0 vortex-file-compressed 200.06 MB 200.08 MB +20.33 KB +0.0%
hits_027.vortex 1.0 vortex-file-compressed 189.98 MB 190.00 MB +15.98 KB +0.0%
hits_057.vortex 1.0 vortex-compact 111.74 MB 111.75 MB +8.16 KB +0.0%
hits_074.vortex 1.0 vortex-file-compressed 199.13 MB 199.15 MB +12.95 KB +0.0%
hits_036.vortex 1.0 vortex-file-compressed 171.48 MB 171.49 MB +9.75 KB +0.0%
hits_056.vortex 1.0 vortex-compact 100.86 MB 100.86 MB +4.18 KB +0.0%
hits_012.vortex 1.0 vortex-file-compressed 191.08 MB 191.08 MB +896 B +0.0%
hits_095.vortex 1.0 vortex-compact 110.65 MB 110.65 MB 416 B -0.0%
hits_009.vortex 1.0 vortex-compact 75.23 MB 75.23 MB 504 B -0.0%
hits_035.vortex 1.0 vortex-compact 75.93 MB 75.93 MB 1.48 KB -0.0%
hits_061.vortex 1.0 vortex-file-compressed 160.80 MB 160.79 MB 11.73 KB -0.0%
hits_014.vortex 1.0 vortex-compact 133.92 MB 133.91 MB 11.09 KB -0.0%
hits_028.vortex 1.0 vortex-compact 115.68 MB 115.67 MB 9.98 KB -0.0%
hits_072.vortex 1.0 vortex-file-compressed 102.29 MB 102.28 MB 9.24 KB -0.0%
hits_062.vortex 1.0 vortex-compact 132.63 MB 132.62 MB 12.01 KB -0.0%
hits_072.vortex 1.0 vortex-compact 75.66 MB 75.66 MB 7.37 KB -0.0%
hits_091.vortex 1.0 vortex-compact 112.28 MB 112.27 MB 12.15 KB -0.0%
hits_042.vortex 1.0 vortex-compact 136.35 MB 136.33 MB 15.86 KB -0.0%
hits_022.vortex 1.0 vortex-compact 153.16 MB 153.14 MB 18.32 KB -0.0%
hits_093.vortex 1.0 vortex-file-compressed 131.69 MB 131.68 MB 17.00 KB -0.0%
hits_003.vortex 1.0 vortex-file-compressed 136.64 MB 136.62 MB 18.09 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.37 MB 126.36 MB 18.40 KB -0.0%
hits_068.vortex 1.0 vortex-compact 112.50 MB 112.48 MB 16.59 KB -0.0%
hits_058.vortex 1.0 vortex-compact 111.10 MB 111.08 MB 16.79 KB -0.0%
hits_084.vortex 1.0 vortex-file-compressed 154.53 MB 154.50 MB 23.48 KB -0.0%
hits_060.vortex 1.0 vortex-compact 141.19 MB 141.17 MB 22.84 KB -0.0%
hits_097.vortex 1.0 vortex-file-compressed 192.89 MB 192.86 MB 33.05 KB -0.0%
hits_071.vortex 1.0 vortex-compact 106.18 MB 106.16 MB 22.55 KB -0.0%
hits_054.vortex 1.0 vortex-compact 112.06 MB 112.04 MB 25.42 KB -0.0%
hits_003.vortex 1.0 vortex-compact 104.54 MB 104.52 MB 25.47 KB -0.0%
hits_024.vortex 1.0 vortex-file-compressed 160.57 MB 160.53 MB 40.20 KB -0.0%
hits_032.vortex 1.0 vortex-compact 110.65 MB 110.62 MB 30.45 KB -0.0%
hits_058.vortex 1.0 vortex-file-compressed 155.17 MB 155.13 MB 43.89 KB -0.0%
hits_013.vortex 1.0 vortex-file-compressed 161.33 MB 161.29 MB 46.13 KB -0.0%
hits_074.vortex 1.0 vortex-compact 153.03 MB 152.98 MB 45.52 KB -0.0%
hits_059.vortex 1.0 vortex-compact 153.06 MB 153.01 MB 45.98 KB -0.0%
hits_009.vortex 1.0 vortex-file-compressed 101.42 MB 101.39 MB 30.63 KB -0.0%
hits_001.vortex 1.0 vortex-compact 139.08 MB 139.04 MB 44.19 KB -0.0%
hits_035.vortex 1.0 vortex-file-compressed 102.82 MB 102.79 MB 32.77 KB -0.0%
hits_078.vortex 1.0 vortex-compact 97.83 MB 97.80 MB 33.84 KB -0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.87 MB 126.83 MB 46.02 KB -0.0%
hits_026.vortex 1.0 vortex-compact 98.60 MB 98.56 MB 40.79 KB -0.0%
hits_085.vortex 1.0 vortex-compact 153.31 MB 153.25 MB 64.87 KB -0.0%
hits_045.vortex 1.0 vortex-compact 106.13 MB 106.08 MB 51.16 KB -0.0%
hits_002.vortex 1.0 vortex-file-compressed 161.06 MB 160.98 MB 80.48 KB -0.0%
hits_005.vortex 1.0 vortex-file-compressed 167.87 MB 167.78 MB 92.48 KB -0.1%
hits_021.vortex 1.0 vortex-file-compressed 154.48 MB 154.39 MB 89.11 KB -0.1%
hits_096.vortex 1.0 vortex-compact 153.19 MB 153.09 MB 104.69 KB -0.1%
hits_041.vortex 1.0 vortex-file-compressed 131.35 MB 131.25 MB 100.32 KB -0.1%
hits_037.vortex 1.0 vortex-file-compressed 177.36 MB 177.22 MB 139.34 KB -0.1%
hits_047.vortex 1.0 vortex-file-compressed 154.63 MB 154.51 MB 122.95 KB -0.1%
hits_073.vortex 1.0 vortex-compact 134.35 MB 134.24 MB 118.84 KB -0.1%
hits_038.vortex 1.0 vortex-compact 139.55 MB 139.43 MB 124.05 KB -0.1%
hits_086.vortex 1.0 vortex-compact 140.85 MB 140.73 MB 125.32 KB -0.1%
hits_015.vortex 1.0 vortex-file-compressed 131.31 MB 131.19 MB 119.80 KB -0.1%
hits_067.vortex 1.0 vortex-file-compressed 131.90 MB 131.78 MB 122.56 KB -0.1%
hits_082.vortex 1.0 vortex-compact 105.79 MB 105.69 MB 108.45 KB -0.1%
hits_069.vortex 1.0 vortex-compact 99.72 MB 99.61 MB 114.10 KB -0.1%
hits_090.vortex 1.0 vortex-file-compressed 192.76 MB 192.54 MB 223.77 KB -0.1%
hits_081.vortex 1.0 vortex-compact 153.55 MB 153.35 MB 200.44 KB -0.1%
hits_037.vortex 1.0 vortex-compact 132.28 MB 132.11 MB 175.65 KB -0.1%
hits_028.vortex 1.0 vortex-file-compressed 152.05 MB 151.85 MB 204.91 KB -0.1%
hits_011.vortex 1.0 vortex-file-compressed 199.38 MB 199.10 MB 288.31 KB -0.1%
hits_045.vortex 1.0 vortex-file-compressed 140.72 MB 140.51 MB 214.22 KB -0.1%
hits_053.vortex 1.0 vortex-file-compressed 190.30 MB 190.01 MB 291.23 KB -0.1%
hits_098.vortex 1.0 vortex-file-compressed 137.83 MB 137.61 MB 217.44 KB -0.2%
hits_004.vortex 1.0 vortex-file-compressed 131.96 MB 131.74 MB 222.70 KB -0.2%
hits_044.vortex 1.0 vortex-compact 153.75 MB 153.49 MB 269.74 KB -0.2%
hits_043.vortex 1.0 vortex-compact 94.21 MB 94.04 MB 176.18 KB -0.2%
hits_042.vortex 1.0 vortex-file-compressed 202.06 MB 201.68 MB 389.34 KB -0.2%
hits_010.vortex 1.0 vortex-file-compressed 169.17 MB 168.84 MB 340.12 KB -0.2%
hits_008.vortex 1.0 vortex-file-compressed 140.56 MB 140.28 MB 286.83 KB -0.2%
hits_077.vortex 1.0 vortex-compact 134.43 MB 134.15 MB 285.05 KB -0.2%
hits_070.vortex 1.0 vortex-file-compressed 200.26 MB 199.84 MB 434.04 KB -0.2%
hits_056.vortex 1.0 vortex-file-compressed 136.01 MB 135.73 MB 295.07 KB -0.2%
hits_063.vortex 1.0 vortex-file-compressed 132.11 MB 131.76 MB 355.30 KB -0.3%
hits_051.vortex 1.0 vortex-file-compressed 172.44 MB 171.95 MB 500.03 KB -0.3%
hits_041.vortex 1.0 vortex-compact 97.93 MB 97.62 MB 313.91 KB -0.3%
hits_057.vortex 1.0 vortex-file-compressed 160.63 MB 160.09 MB 557.27 KB -0.3%
hits_010.vortex 1.0 vortex-compact 123.45 MB 123.02 MB 436.34 KB -0.3%
hits_088.vortex 1.0 vortex-compact 134.63 MB 134.13 MB 509.45 KB -0.4%
hits_033.vortex 1.0 vortex-file-compressed 199.92 MB 199.12 MB 820.94 KB -0.4%
hits_066.vortex 1.0 vortex-compact 118.18 MB 117.69 MB 494.99 KB -0.4%
hits_005.vortex 1.0 vortex-compact 116.41 MB 115.86 MB 570.19 KB -0.5%
hits_022.vortex 1.0 vortex-file-compressed 198.93 MB 197.96 MB 987.08 KB -0.5%
hits_017.vortex 1.0 vortex-compact 112.16 MB 111.61 MB 557.39 KB -0.5%
hits_006.vortex 1.0 vortex-compact 95.90 MB 95.42 MB 485.93 KB -0.5%
hits_081.vortex 1.0 vortex-file-compressed 200.14 MB 199.12 MB 1.02 MB -0.5%
hits_067.vortex 1.0 vortex-compact 99.86 MB 99.29 MB 582.58 KB -0.6%
hits_053.vortex 1.0 vortex-compact 138.44 MB 137.51 MB 952.95 KB -0.7%
hits_020.vortex 1.0 vortex-file-compressed 160.32 MB 159.07 MB 1.25 MB -0.8%
hits_049.vortex 1.0 vortex-compact 140.53 MB 139.43 MB 1.10 MB -0.8%
hits_080.vortex 1.0 vortex-compact 96.76 MB 95.99 MB 786.75 KB -0.8%
hits_097.vortex 1.0 vortex-compact 141.28 MB 140.14 MB 1.14 MB -0.8%
hits_090.vortex 1.0 vortex-compact 141.24 MB 140.05 MB 1.19 MB -0.8%
hits_027.vortex 1.0 vortex-compact 139.35 MB 138.07 MB 1.28 MB -0.9%
hits_052.vortex 1.0 vortex-compact 98.87 MB 97.96 MB 933.45 KB -0.9%
hits_076.vortex 1.0 vortex-compact 125.29 MB 124.07 MB 1.22 MB -1.0%
hits_093.vortex 1.0 vortex-compact 99.47 MB 98.46 MB 1.01 MB -1.0%
hits_064.vortex 1.0 vortex-file-compressed 193.04 MB 190.97 MB 2.07 MB -1.1%
hits_065.vortex 1.0 vortex-compact 125.86 MB 124.37 MB 1.49 MB -1.2%
hits_089.vortex 1.0 vortex-compact 99.80 MB 98.30 MB 1.50 MB -1.5%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 11.93 GB → 11.93 GB (+0.0%)
  • vortex-file-compressed: 15.96 GB → 15.97 GB (+0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.3%
Engines: DataFusion No clear signal (-2.0%, environment too noisy confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): 0.994x ➖
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish +1.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.982x ➖, 4↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 449033480 472516442 0.95
tpch_q02/datafusion:vortex-file-compressed 106716778 103234855 1.03
tpch_q03/datafusion:vortex-file-compressed 201785821 196689230 1.03
tpch_q04/datafusion:vortex-file-compressed 100523982 98205103 1.02
tpch_q05/datafusion:vortex-file-compressed 351217390 349112752 1.01
tpch_q06/datafusion:vortex-file-compressed 39904770 38828875 1.03
tpch_q07/datafusion:vortex-file-compressed 470600766 459998885 1.02
tpch_q08/datafusion:vortex-file-compressed 🚀 350468345 416255290 0.84
tpch_q09/datafusion:vortex-file-compressed 🚀 619245421 756244562 0.82
tpch_q10/datafusion:vortex-file-compressed 🚀 232259237 286421590 0.81
tpch_q11/datafusion:vortex-file-compressed 🚀 80652956 93731278 0.86
tpch_q12/datafusion:vortex-file-compressed 118003895 115518215 1.02
tpch_q13/datafusion:vortex-file-compressed 200338819 194545985 1.03
tpch_q14/datafusion:vortex-file-compressed 53362053 50928061 1.05
tpch_q15/datafusion:vortex-file-compressed 104708578 101929070 1.03
tpch_q16/datafusion:vortex-file-compressed 76575738 74742412 1.02
tpch_q17/datafusion:vortex-file-compressed 604088553 586382327 1.03
tpch_q18/datafusion:vortex-file-compressed 862515974 834141458 1.03
tpch_q19/datafusion:vortex-file-compressed 78108721 77043316 1.01
tpch_q20/datafusion:vortex-file-compressed 161185894 160035996 1.01
tpch_q21/datafusion:vortex-file-compressed 603711884 600232614 1.01
tpch_q22/datafusion:vortex-file-compressed 55636913 55856544 1.00
datafusion / vortex-compact (0.978x ➖, 3↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 524687750 549204342 0.96
tpch_q02/datafusion:vortex-compact 🚀 114561852 135607977 0.84
tpch_q03/datafusion:vortex-compact 🚀 222176471 272765758 0.81
tpch_q04/datafusion:vortex-compact 131758363 146101045 0.90
tpch_q05/datafusion:vortex-compact 367791421 364045990 1.01
tpch_q06/datafusion:vortex-compact 62923926 63751204 0.99
tpch_q07/datafusion:vortex-compact 504103816 493719012 1.02
tpch_q08/datafusion:vortex-compact 376550079 365360276 1.03
tpch_q09/datafusion:vortex-compact 634185616 610927266 1.04
tpch_q10/datafusion:vortex-compact 280412122 274116877 1.02
tpch_q11/datafusion:vortex-compact 83666532 82811097 1.01
tpch_q12/datafusion:vortex-compact 181680061 175382958 1.04
tpch_q13/datafusion:vortex-compact 250726179 245100559 1.02
tpch_q14/datafusion:vortex-compact 71454213 70508348 1.01
tpch_q15/datafusion:vortex-compact 158384284 155194992 1.02
tpch_q16/datafusion:vortex-compact 83032268 81212831 1.02
tpch_q17/datafusion:vortex-compact 605692673 580629968 1.04
tpch_q18/datafusion:vortex-compact 904335754 879596980 1.03
tpch_q19/datafusion:vortex-compact 207055253 228765942 0.91
tpch_q20/datafusion:vortex-compact 🚀 189124913 224051206 0.84
tpch_q21/datafusion:vortex-compact 715581322 714998082 1.00
tpch_q22/datafusion:vortex-compact 64086030 64665543 0.99
datafusion / parquet (1.007x ➖, 1↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 502355066 480483275 1.05
tpch_q02/datafusion:parquet 183665655 173857884 1.06
tpch_q03/datafusion:parquet 268992268 262175588 1.03
tpch_q04/datafusion:parquet 124980515 123626543 1.01
tpch_q05/datafusion:parquet 425191219 407730096 1.04
tpch_q06/datafusion:parquet 129553118 133943468 0.97
tpch_q07/datafusion:parquet 595707311 657003033 0.91
tpch_q08/datafusion:parquet 🚀 472036098 577032306 0.82
tpch_q09/datafusion:parquet 765887286 741699094 1.03
tpch_q10/datafusion:parquet 602293015 576759197 1.04
tpch_q11/datafusion:parquet 125089091 121873655 1.03
tpch_q12/datafusion:parquet 220440153 210389270 1.05
tpch_q13/datafusion:parquet 354415559 349876433 1.01
tpch_q14/datafusion:parquet 157678959 157175158 1.00
tpch_q15/datafusion:parquet 276158250 262986289 1.05
tpch_q16/datafusion:parquet 126460947 121932113 1.04
tpch_q17/datafusion:parquet 701697029 688365523 1.02
tpch_q18/datafusion:parquet 896482226 968480585 0.93
tpch_q19/datafusion:parquet 285274534 272199168 1.05
tpch_q20/datafusion:parquet 303097726 298620694 1.01
tpch_q21/datafusion:parquet 677221492 653917008 1.04
tpch_q22/datafusion:parquet 218006488 215874019 1.01
datafusion / arrow (1.000x ➖, 2↑ 1↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 723966664 707034705 1.02
tpch_q02/datafusion:arrow 117449845 111394212 1.05
tpch_q03/datafusion:arrow 528409672 504369372 1.05
tpch_q04/datafusion:arrow 389609562 379916445 1.03
tpch_q05/datafusion:arrow 780543010 764270907 1.02
tpch_q06/datafusion:arrow 🚀 341378697 395956470 0.86
tpch_q07/datafusion:arrow 1204781385 1186137720 1.02
tpch_q08/datafusion:arrow 991879828 1098216215 0.90
tpch_q09/datafusion:arrow 1131644170 1079595959 1.05
tpch_q10/datafusion:arrow 682449057 624826973 1.09
tpch_q11/datafusion:arrow 94287627 93503978 1.01
tpch_q12/datafusion:arrow 1366612946 1431151915 0.95
tpch_q13/datafusion:arrow 477882288 467129058 1.02
tpch_q14/datafusion:arrow 380223739 361160248 1.05
tpch_q15/datafusion:arrow 🚨 799245924 725081556 1.10
tpch_q16/datafusion:arrow 84397002 83138495 1.02
tpch_q17/datafusion:arrow 1018733860 1105998464 0.92
tpch_q18/datafusion:arrow 1963262689 1990790150 0.99
tpch_q19/datafusion:arrow 🚀 575848726 671026901 0.86
tpch_q20/datafusion:arrow 527668200 531599737 0.99
tpch_q21/datafusion:arrow 3218583416 3232145794 1.00
tpch_q22/datafusion:arrow 85369230 81995943 1.04
duckdb / vortex-file-compressed (0.996x ➖, 2↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 169713819 171351154 0.99
tpch_q02/duckdb:vortex-file-compressed 54457764 54049125 1.01
tpch_q03/duckdb:vortex-file-compressed 123555710 119639768 1.03
tpch_q04/duckdb:vortex-file-compressed 158414327 153782963 1.03
tpch_q05/duckdb:vortex-file-compressed 137916324 136164188 1.01
tpch_q06/duckdb:vortex-file-compressed 35096648 34606271 1.01
tpch_q07/duckdb:vortex-file-compressed 133184728 130990964 1.02
tpch_q08/duckdb:vortex-file-compressed 🚀 175074146 204435276 0.86
tpch_q09/duckdb:vortex-file-compressed 🚀 398833794 474878967 0.84
tpch_q10/duckdb:vortex-file-compressed 197319930 209468730 0.94
tpch_q11/duckdb:vortex-file-compressed 31569631 30906516 1.02
tpch_q12/duckdb:vortex-file-compressed 108408568 105366197 1.03
tpch_q13/duckdb:vortex-file-compressed 275512888 270917323 1.02
tpch_q14/duckdb:vortex-file-compressed 54886826 53832030 1.02
tpch_q15/duckdb:vortex-file-compressed 91627459 89505669 1.02
tpch_q16/duckdb:vortex-file-compressed 80296909 78212979 1.03
tpch_q17/duckdb:vortex-file-compressed 87952504 88061098 1.00
tpch_q18/duckdb:vortex-file-compressed 291189688 290778086 1.00
tpch_q19/duckdb:vortex-file-compressed 77532856 73228978 1.06
tpch_q20/duckdb:vortex-file-compressed 141777369 137669986 1.03
tpch_q21/duckdb:vortex-file-compressed 497091686 498191031 1.00
tpch_q22/duckdb:vortex-file-compressed 66703134 68353356 0.98
duckdb / vortex-compact (1.020x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 275907401 282086389 0.98
tpch_q02/duckdb:vortex-compact 63779610 61863895 1.03
tpch_q03/duckdb:vortex-compact 160470926 158631225 1.01
tpch_q04/duckdb:vortex-compact 220087425 214601230 1.03
tpch_q05/duckdb:vortex-compact 188314770 181656669 1.04
tpch_q06/duckdb:vortex-compact 57966904 58197678 1.00
tpch_q07/duckdb:vortex-compact 219061855 214843305 1.02
tpch_q08/duckdb:vortex-compact 222920187 215706474 1.03
tpch_q09/duckdb:vortex-compact 471605172 462682441 1.02
tpch_q10/duckdb:vortex-compact 268259772 257936451 1.04
tpch_q11/duckdb:vortex-compact 40615023 38789184 1.05
tpch_q12/duckdb:vortex-compact 196056733 190836623 1.03
tpch_q13/duckdb:vortex-compact 328008462 322927009 1.02
tpch_q14/duckdb:vortex-compact 73402575 72392751 1.01
tpch_q15/duckdb:vortex-compact 120428145 117200909 1.03
tpch_q16/duckdb:vortex-compact 81412829 78774036 1.03
tpch_q17/duckdb:vortex-compact 106257682 105595249 1.01
tpch_q18/duckdb:vortex-compact 356261101 347678674 1.02
tpch_q19/duckdb:vortex-compact 93700467 91944720 1.02
tpch_q20/duckdb:vortex-compact 184894583 181028306 1.02
tpch_q21/duckdb:vortex-compact 645771358 629967552 1.03
tpch_q22/duckdb:vortex-compact 73561202 74335640 0.99
duckdb / parquet (0.998x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 266626598 266036454 1.00
tpch_q02/duckdb:parquet 104724384 106783587 0.98
tpch_q03/duckdb:parquet 218995441 215088759 1.02
tpch_q04/duckdb:parquet 139252461 142161634 0.98
tpch_q05/duckdb:parquet 227564266 226556638 1.00
tpch_q06/duckdb:parquet 76426256 76649515 1.00
tpch_q07/duckdb:parquet 190218086 201394021 0.94
tpch_q08/duckdb:parquet 273606891 293897796 0.93
tpch_q09/duckdb:parquet 522416465 518472561 1.01
tpch_q10/duckdb:parquet 634501613 628209356 1.01
tpch_q11/duckdb:parquet 66835643 67411256 0.99
tpch_q12/duckdb:parquet 136237862 132175574 1.03
tpch_q13/duckdb:parquet 455880157 461280238 0.99
tpch_q14/duckdb:parquet 181301223 189481233 0.96
tpch_q15/duckdb:parquet 107262326 105982060 1.01
tpch_q16/duckdb:parquet 170466815 168286684 1.01
tpch_q17/duckdb:parquet 184602509 182913213 1.01
tpch_q18/duckdb:parquet 370737253 365313035 1.01
tpch_q19/duckdb:parquet 291356535 287711131 1.01
tpch_q20/duckdb:parquet 238432267 237846629 1.00
tpch_q21/duckdb:parquet 590657559 568173002 1.04
tpch_q22/duckdb:parquet 306674177 304345364 1.01
duckdb / duckdb (0.961x ➖, 4↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 122017770 120704174 1.01
tpch_q02/duckdb:duckdb 50072659 51897100 0.96
tpch_q03/duckdb:duckdb 104680839 105328899 0.99
tpch_q04/duckdb:duckdb 142433822 141410792 1.01
tpch_q05/duckdb:duckdb 122069816 121500077 1.00
tpch_q06/duckdb:duckdb 45304118 47276696 0.96
tpch_q07/duckdb:duckdb 🚀 92867412 103693634 0.90
tpch_q08/duckdb:duckdb 🚀 121077039 136562646 0.89
tpch_q09/duckdb:duckdb 🚀 288069889 341738492 0.84
tpch_q10/duckdb:duckdb 🚀 219535806 250899027 0.87
tpch_q11/duckdb:duckdb 19173698 21158824 0.91
tpch_q12/duckdb:duckdb 91469240 99777101 0.92
tpch_q13/duckdb:duckdb 238263575 238762273 1.00
tpch_q14/duckdb:duckdb 79651714 80856568 0.99
tpch_q15/duckdb:duckdb 83579027 84502056 0.99
tpch_q16/duckdb:duckdb 80045486 77815140 1.03
tpch_q17/duckdb:duckdb 89140232 88838786 1.00
tpch_q18/duckdb:duckdb 235011720 234854947 1.00
tpch_q19/duckdb:duckdb 125913745 124934760 1.01
tpch_q20/duckdb:duckdb 118417416 118228490 1.00
tpch_q21/duckdb:duckdb 307567473 325006502 0.95
tpch_q22/duckdb:duckdb 68948577 72256148 0.95

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.8%
Engines: DataFusion No clear signal (-1.2%, low confidence) · DuckDB No clear signal (-1.6%, low confidence)
Vortex (geomean): 0.948x ➖
Parquet (geomean): 0.961x ➖
Shifts: Parquet (control) -3.9% · Median polish -4.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.930x ➖, 7↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1577659 1673732 0.94
clickbench_q01/datafusion:vortex-file-compressed 17936752 19284188 0.93
clickbench_q02/datafusion:vortex-file-compressed 33753749 36619833 0.92
clickbench_q03/datafusion:vortex-file-compressed 38042275 40062677 0.95
clickbench_q04/datafusion:vortex-file-compressed 233733905 254045863 0.92
clickbench_q05/datafusion:vortex-file-compressed 304914073 327483635 0.93
clickbench_q06/datafusion:vortex-file-compressed 1547355 1613476 0.96
clickbench_q07/datafusion:vortex-file-compressed 🚀 22540093 28256463 0.80
clickbench_q08/datafusion:vortex-file-compressed 328959834 360773272 0.91
clickbench_q09/datafusion:vortex-file-compressed 450704923 498512945 0.90
clickbench_q10/datafusion:vortex-file-compressed 76087303 74216023 1.03
clickbench_q11/datafusion:vortex-file-compressed 83527361 88983296 0.94
clickbench_q12/datafusion:vortex-file-compressed 259243551 276576265 0.94
clickbench_q13/datafusion:vortex-file-compressed 409494453 437327606 0.94
clickbench_q14/datafusion:vortex-file-compressed 274502389 278873357 0.98
clickbench_q15/datafusion:vortex-file-compressed 275601973 299545564 0.92
clickbench_q16/datafusion:vortex-file-compressed 668888545 699231838 0.96
clickbench_q17/datafusion:vortex-file-compressed 636387283 702073960 0.91
clickbench_q18/datafusion:vortex-file-compressed 1361898415 1432075797 0.95
clickbench_q19/datafusion:vortex-file-compressed 27292770 27980851 0.98
clickbench_q20/datafusion:vortex-file-compressed 🚀 255022745 303140139 0.84
clickbench_q21/datafusion:vortex-file-compressed 349005147 387660064 0.90
clickbench_q22/datafusion:vortex-file-compressed 443214460 465225489 0.95
clickbench_q23/datafusion:vortex-file-compressed 569010928 614381513 0.93
clickbench_q24/datafusion:vortex-file-compressed 42059323 41662392 1.01
clickbench_q25/datafusion:vortex-file-compressed 70700730 75363695 0.94
clickbench_q26/datafusion:vortex-file-compressed 42306032 46039085 0.92
clickbench_q27/datafusion:vortex-file-compressed 370466840 405594228 0.91
clickbench_q28/datafusion:vortex-file-compressed 2340416810 2430190850 0.96
clickbench_q29/datafusion:vortex-file-compressed 🚀 47690138 57021485 0.84
clickbench_q30/datafusion:vortex-file-compressed 233012133 239679332 0.97
clickbench_q31/datafusion:vortex-file-compressed 241507905 260294648 0.93
clickbench_q32/datafusion:vortex-file-compressed 🚀 1034086150 1164063570 0.89
clickbench_q33/datafusion:vortex-file-compressed 1375061096 1429914192 0.96
clickbench_q34/datafusion:vortex-file-compressed 1375214764 1510885284 0.91
clickbench_q35/datafusion:vortex-file-compressed 🚀 229853437 256060011 0.90
clickbench_q36/datafusion:vortex-file-compressed 🚀 60354285 69129204 0.87
clickbench_q37/datafusion:vortex-file-compressed 27216271 26501106 1.03
clickbench_q38/datafusion:vortex-file-compressed 16321442 17335320 0.94
clickbench_q39/datafusion:vortex-file-compressed 124052658 129535393 0.96
clickbench_q40/datafusion:vortex-file-compressed 12594117 13138208 0.96
clickbench_q41/datafusion:vortex-file-compressed 12467235 12918547 0.97
clickbench_q42/datafusion:vortex-file-compressed 🚀 11213922 12844176 0.87
datafusion / parquet (0.942x ➖, 7↑ 1↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1543969 1573195 0.98
clickbench_q01/datafusion:parquet 18684218 19824199 0.94
clickbench_q02/datafusion:parquet 43167058 44074919 0.98
clickbench_q03/datafusion:parquet 🚨 39337218 35440072 1.11
clickbench_q04/datafusion:parquet 266679775 283173845 0.94
clickbench_q05/datafusion:parquet 331503418 330073697 1.00
clickbench_q06/datafusion:parquet 🚀 1499646 1702147 0.88
clickbench_q07/datafusion:parquet 21871670 21929124 1.00
clickbench_q08/datafusion:parquet 336156477 361609668 0.93
clickbench_q09/datafusion:parquet 🚀 468795018 537426781 0.87
clickbench_q10/datafusion:parquet 92848943 98508554 0.94
clickbench_q11/datafusion:parquet 114988686 126838978 0.91
clickbench_q12/datafusion:parquet 296018539 323946650 0.91
clickbench_q13/datafusion:parquet 461910243 498409600 0.93
clickbench_q14/datafusion:parquet 316130771 330373670 0.96
clickbench_q15/datafusion:parquet 🚀 278356336 312043674 0.89
clickbench_q16/datafusion:parquet 660502032 718242836 0.92
clickbench_q17/datafusion:parquet 🚀 630515403 703376550 0.90
clickbench_q18/datafusion:parquet 🚀 1371720895 1535094695 0.89
clickbench_q19/datafusion:parquet 26244130 28136229 0.93
clickbench_q20/datafusion:parquet 566537529 594397809 0.95
clickbench_q21/datafusion:parquet 619424995 635076680 0.98
clickbench_q22/datafusion:parquet 912152725 973101518 0.94
clickbench_q23/datafusion:parquet 4033566401 4289022098 0.94
clickbench_q24/datafusion:parquet 53220635 55389760 0.96
clickbench_q25/datafusion:parquet 126209613 131065586 0.96
clickbench_q26/datafusion:parquet 53950118 54151497 1.00
clickbench_q27/datafusion:parquet 652418113 694722511 0.94
clickbench_q28/datafusion:parquet 2454395424 2489451246 0.99
clickbench_q29/datafusion:parquet 🚀 44169461 53134965 0.83
clickbench_q30/datafusion:parquet 318194882 326400113 0.97
clickbench_q31/datafusion:parquet 348922459 362450731 0.96
clickbench_q32/datafusion:parquet 1117227929 1201945341 0.93
clickbench_q33/datafusion:parquet 1500287753 1586133284 0.95
clickbench_q34/datafusion:parquet 1481461027 1618123359 0.92
clickbench_q35/datafusion:parquet 236423844 247325793 0.96
clickbench_q36/datafusion:parquet 105048587 115787463 0.91
clickbench_q37/datafusion:parquet 42326476 44296886 0.96
clickbench_q38/datafusion:parquet 60478030 61595195 0.98
clickbench_q39/datafusion:parquet 206749957 217640902 0.95
clickbench_q40/datafusion:parquet 🚀 22861706 26556012 0.86
clickbench_q41/datafusion:parquet 22498204 23927009 0.94
clickbench_q42/datafusion:parquet 22045287 22961795 0.96
duckdb / vortex-file-compressed (0.966x ➖, 1↑ 2↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 9473686 9343910 1.01
clickbench_q01/duckdb:vortex-file-compressed 15825193 16030910 0.99
clickbench_q02/duckdb:vortex-file-compressed 20058183 22045535 0.91
clickbench_q03/duckdb:vortex-file-compressed 26348137 28630055 0.92
clickbench_q04/duckdb:vortex-file-compressed 199293838 212246141 0.94
clickbench_q05/duckdb:vortex-file-compressed 185767115 198079317 0.94
clickbench_q06/duckdb:vortex-file-compressed 17901155 19388648 0.92
clickbench_q07/duckdb:vortex-file-compressed 19733172 21334229 0.92
clickbench_q08/duckdb:vortex-file-compressed 268830363 280922918 0.96
clickbench_q09/duckdb:vortex-file-compressed 347898145 373077280 0.93
clickbench_q10/duckdb:vortex-file-compressed 72235703 76085135 0.95
clickbench_q11/duckdb:vortex-file-compressed 85162314 88682278 0.96
clickbench_q12/duckdb:vortex-file-compressed 205885294 214123865 0.96
clickbench_q13/duckdb:vortex-file-compressed 419011392 425499413 0.98
clickbench_q14/duckdb:vortex-file-compressed 243253896 248351561 0.98
clickbench_q15/duckdb:vortex-file-compressed 256844745 278578242 0.92
clickbench_q16/duckdb:vortex-file-compressed 541502886 561409367 0.96
clickbench_q17/duckdb:vortex-file-compressed 435366875 458065088 0.95
clickbench_q18/duckdb:vortex-file-compressed 949625527 1005795276 0.94
clickbench_q19/duckdb:vortex-file-compressed 21438451 23730332 0.90
clickbench_q20/duckdb:vortex-file-compressed 247197689 274658711 0.90
clickbench_q21/duckdb:vortex-file-compressed 🚀 334358706 373479424 0.90
clickbench_q22/duckdb:vortex-file-compressed 517422510 574400756 0.90
clickbench_q23/duckdb:vortex-file-compressed 156103287 171208477 0.91
clickbench_q24/duckdb:vortex-file-compressed 39420460 37148003 1.06
clickbench_q25/duckdb:vortex-file-compressed 78763908 82532423 0.95
clickbench_q26/duckdb:vortex-file-compressed 50597968 46235009 1.09
clickbench_q27/duckdb:vortex-file-compressed 219496239 224546183 0.98
clickbench_q28/duckdb:vortex-file-compressed 3045675781 3070029157 0.99
clickbench_q29/duckdb:vortex-file-compressed 27700615 28602561 0.97
clickbench_q30/duckdb:vortex-file-compressed 197415575 213157258 0.93
clickbench_q31/duckdb:vortex-file-compressed 293125976 324421478 0.90
clickbench_q32/duckdb:vortex-file-compressed 1129855929 1154328892 0.98
clickbench_q33/duckdb:vortex-file-compressed 1084903520 1145788850 0.95
clickbench_q34/duckdb:vortex-file-compressed 1185831357 1277615283 0.93
clickbench_q35/duckdb:vortex-file-compressed 371326519 380192736 0.98
clickbench_q36/duckdb:vortex-file-compressed 32032123 29821920 1.07
clickbench_q37/duckdb:vortex-file-compressed 21895648 20671433 1.06
clickbench_q38/duckdb:vortex-file-compressed 🚨 26320337 22995537 1.14
clickbench_q39/duckdb:vortex-file-compressed 45740084 45599252 1.00
clickbench_q40/duckdb:vortex-file-compressed 21516911 21280260 1.01
clickbench_q41/duckdb:vortex-file-compressed 🚨 21792975 19693700 1.11
clickbench_q42/duckdb:vortex-file-compressed 21146158 22372065 0.95
duckdb / parquet (0.981x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 24604382 25583832 0.96
clickbench_q01/duckdb:parquet 30468226 31177065 0.98
clickbench_q02/duckdb:parquet 51373119 50972248 1.01
clickbench_q03/duckdb:parquet 39866657 42672254 0.93
clickbench_q04/duckdb:parquet 204453333 214845602 0.95
clickbench_q05/duckdb:parquet 261140754 269113397 0.97
clickbench_q06/duckdb:parquet 47905796 49857748 0.96
clickbench_q07/duckdb:parquet 32750635 33114756 0.99
clickbench_q08/duckdb:parquet 271125161 275558131 0.98
clickbench_q09/duckdb:parquet 400600374 409614892 0.98
clickbench_q10/duckdb:parquet 85062291 84315867 1.01
clickbench_q11/duckdb:parquet 102478788 102429324 1.00
clickbench_q12/duckdb:parquet 282694561 290070503 0.97
clickbench_q13/duckdb:parquet 480554118 493030391 0.97
clickbench_q14/duckdb:parquet 318545926 325641208 0.98
clickbench_q15/duckdb:parquet 262718180 261978090 1.00
clickbench_q16/duckdb:parquet 605289249 615275882 0.98
clickbench_q17/duckdb:parquet 502934095 516997890 0.97
clickbench_q18/duckdb:parquet 1043989181 1071392426 0.97
clickbench_q19/duckdb:parquet 28329055 29603135 0.96
clickbench_q20/duckdb:parquet 412728913 422136882 0.98
clickbench_q21/duckdb:parquet 534360782 546439381 0.98
clickbench_q22/duckdb:parquet 922831899 963257940 0.96
clickbench_q23/duckdb:parquet 266255746 280444739 0.95
clickbench_q24/duckdb:parquet 71669192 73876424 0.97
clickbench_q25/duckdb:parquet 164444246 167571229 0.98
clickbench_q26/duckdb:parquet 53926447 55181190 0.98
clickbench_q27/duckdb:parquet 467696574 474842315 0.98
clickbench_q28/duckdb:parquet 4786484748 4884161902 0.98
clickbench_q29/duckdb:parquet 43968688 44554750 0.99
clickbench_q30/duckdb:parquet 311091454 316266718 0.98
clickbench_q31/duckdb:parquet 379991561 382888213 0.99
clickbench_q32/duckdb:parquet 1112040053 1158029193 0.96
clickbench_q33/duckdb:parquet 1119323442 1181040599 0.95
clickbench_q34/duckdb:parquet 1154359541 1229308483 0.94
clickbench_q35/duckdb:parquet 369497677 378529119 0.98
clickbench_q36/duckdb:parquet 50859444 48316691 1.05
clickbench_q37/duckdb:parquet 34763567 35153151 0.99
clickbench_q38/duckdb:parquet 38502956 38201667 1.01
clickbench_q39/duckdb:parquet 95377135 91559116 1.04
clickbench_q40/duckdb:parquet 22083698 21819587 1.01
clickbench_q41/duckdb:parquet 21941278 22395674 0.98
clickbench_q42/duckdb:parquet 23424950 23179838 1.01
duckdb / duckdb (0.963x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18838959 19757505 0.95
clickbench_q01/duckdb:duckdb 35614328 37587695 0.95
clickbench_q02/duckdb:duckdb 52889674 55552168 0.95
clickbench_q03/duckdb:duckdb 57387356 59941601 0.96
clickbench_q04/duckdb:duckdb 212217607 225751641 0.94
clickbench_q05/duckdb:duckdb 285051634 292607893 0.97
clickbench_q06/duckdb:duckdb 35888130 36753806 0.98
clickbench_q07/duckdb:duckdb 36594497 37083466 0.99
clickbench_q08/duckdb:duckdb 273323791 278654008 0.98
clickbench_q09/duckdb:duckdb 391554066 398744618 0.98
clickbench_q10/duckdb:duckdb 118073751 119261999 0.99
clickbench_q11/duckdb:duckdb 129161317 129842183 0.99
clickbench_q12/duckdb:duckdb 258538549 264886478 0.98
clickbench_q13/duckdb:duckdb 441279998 461232890 0.96
clickbench_q14/duckdb:duckdb 286358012 301718825 0.95
clickbench_q15/duckdb:duckdb 241946436 256997004 0.94
clickbench_q16/duckdb:duckdb 563919104 604086244 0.93
clickbench_q17/duckdb:duckdb 475420116 514286893 0.92
clickbench_q18/duckdb:duckdb 1016889547 1042021800 0.98
clickbench_q19/duckdb:duckdb 36203158 36588916 0.99
clickbench_q20/duckdb:duckdb 460617464 481201458 0.96
clickbench_q21/duckdb:duckdb 459221196 489983527 0.94
clickbench_q22/duckdb:duckdb 534239664 571600787 0.93
clickbench_q23/duckdb:duckdb 253087981 264960136 0.96
clickbench_q24/duckdb:duckdb 63503571 63738352 1.00
clickbench_q25/duckdb:duckdb 149889618 153840663 0.97
clickbench_q26/duckdb:duckdb 63684749 68019042 0.94
clickbench_q27/duckdb:duckdb 399111167 433945460 0.92
clickbench_q28/duckdb:duckdb 4437391001 4546852802 0.98
clickbench_q29/duckdb:duckdb 52484780 52982043 0.99
clickbench_q30/duckdb:duckdb 281484618 282965115 0.99
clickbench_q31/duckdb:duckdb 366851217 375480784 0.98
clickbench_q32/duckdb:duckdb 1108039473 1161218933 0.95
clickbench_q33/duckdb:duckdb 1114576037 1202205175 0.93
clickbench_q34/duckdb:duckdb 1195740077 1255189867 0.95
clickbench_q35/duckdb:duckdb 296063313 304567683 0.97
clickbench_q36/duckdb:duckdb 56288197 58116861 0.97
clickbench_q37/duckdb:duckdb 30106396 31916432 0.94
clickbench_q38/duckdb:duckdb 34705078 37283566 0.93
clickbench_q39/duckdb:duckdb 83535911 85665708 0.98
clickbench_q40/duckdb:duckdb 29822377 30551451 0.98
clickbench_q41/duckdb:duckdb 28890676 28937517 1.00
clickbench_q42/duckdb:duckdb 30919161 30809223 1.00

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.11 GB → 7.11 GB (-0.0%)
  • vortex-file-compressed: 11.04 GB → 11.04 GB (0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +8.1%
Engines: DataFusion No clear signal (+13.1%, environment too noisy confidence) · DuckDB No clear signal (+3.3%, environment too noisy confidence)
Vortex (geomean): 1.079x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish +3.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.086x ➖, 0↑ 1↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 276567052 238778477 1.16
tpch_q02/datafusion:vortex-file-compressed 430887287 428742219 1.01
tpch_q03/datafusion:vortex-file-compressed 388161407 388910367 1.00
tpch_q04/datafusion:vortex-file-compressed 201782593 204799666 0.99
tpch_q05/datafusion:vortex-file-compressed 351358262 336719014 1.04
tpch_q06/datafusion:vortex-file-compressed 302371365 284754751 1.06
tpch_q07/datafusion:vortex-file-compressed 445089473 377009802 1.18
tpch_q08/datafusion:vortex-file-compressed 506363060 465473008 1.09
tpch_q09/datafusion:vortex-file-compressed 🚨 485916946 322568195 1.51
tpch_q10/datafusion:vortex-file-compressed 421325837 403847860 1.04
tpch_q11/datafusion:vortex-file-compressed 267542232 249380462 1.07
tpch_q12/datafusion:vortex-file-compressed 379675157 367380543 1.03
tpch_q13/datafusion:vortex-file-compressed 192462300 199564936 0.96
tpch_q14/datafusion:vortex-file-compressed 245556949 236162757 1.04
tpch_q15/datafusion:vortex-file-compressed 488472425 431647871 1.13
tpch_q16/datafusion:vortex-file-compressed 190119380 188266577 1.01
tpch_q17/datafusion:vortex-file-compressed 347733526 308068217 1.13
tpch_q18/datafusion:vortex-file-compressed 276416554 224915514 1.23
tpch_q19/datafusion:vortex-file-compressed 504821154 413113799 1.22
tpch_q20/datafusion:vortex-file-compressed 413722647 379929630 1.09
tpch_q21/datafusion:vortex-file-compressed 497780901 530423750 0.94
tpch_q22/datafusion:vortex-file-compressed 166638442 151772323 1.10
datafusion / vortex-compact (1.101x ➖, 0↑ 5↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 224325574 285857528 0.78
tpch_q02/datafusion:vortex-compact 422610067 418361868 1.01
tpch_q03/datafusion:vortex-compact 381024685 384953926 0.99
tpch_q04/datafusion:vortex-compact 🚨 278669025 198199472 1.41
tpch_q05/datafusion:vortex-compact 🚨 496461108 326048164 1.52
tpch_q06/datafusion:vortex-compact 300313518 295640682 1.02
tpch_q07/datafusion:vortex-compact 460629778 374441931 1.23
tpch_q08/datafusion:vortex-compact 441618618 458701231 0.96
tpch_q09/datafusion:vortex-compact 387620091 356172389 1.09
tpch_q10/datafusion:vortex-compact 388933473 396232707 0.98
tpch_q11/datafusion:vortex-compact 250389324 253773507 0.99
tpch_q12/datafusion:vortex-compact 339043874 348272705 0.97
tpch_q13/datafusion:vortex-compact 207087451 206373033 1.00
tpch_q14/datafusion:vortex-compact 228589743 215206434 1.06
tpch_q15/datafusion:vortex-compact 399062865 405485205 0.98
tpch_q16/datafusion:vortex-compact 180740598 187595122 0.96
tpch_q17/datafusion:vortex-compact 🚨 486745248 321144470 1.52
tpch_q18/datafusion:vortex-compact 🚨 345651945 242936778 1.42
tpch_q19/datafusion:vortex-compact 553871266 512466289 1.08
tpch_q20/datafusion:vortex-compact 450439080 433860884 1.04
tpch_q21/datafusion:vortex-compact 530315385 476241492 1.11
tpch_q22/datafusion:vortex-compact 🚨 206106375 140493082 1.47
datafusion / parquet (0.967x ➖, 1↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 215480787 215263334 1.00
tpch_q02/datafusion:parquet 404235017 393662094 1.03
tpch_q03/datafusion:parquet 325015136 306035066 1.06
tpch_q04/datafusion:parquet 149979759 139868873 1.07
tpch_q05/datafusion:parquet 434544701 425815933 1.02
tpch_q06/datafusion:parquet 152704293 140826272 1.08
tpch_q07/datafusion:parquet 428746737 431729189 0.99
tpch_q08/datafusion:parquet 531218593 518924845 1.02
tpch_q09/datafusion:parquet 450208354 479162789 0.94
tpch_q10/datafusion:parquet 459045296 479026379 0.96
tpch_q11/datafusion:parquet 370689150 417731749 0.89
tpch_q12/datafusion:parquet 218072914 203935855 1.07
tpch_q13/datafusion:parquet 420729188 440415241 0.96
tpch_q14/datafusion:parquet 161682207 164009048 0.99
tpch_q15/datafusion:parquet 284354049 285143988 1.00
tpch_q16/datafusion:parquet 182472356 166942841 1.09
tpch_q17/datafusion:parquet 374307963 385771742 0.97
tpch_q18/datafusion:parquet 441070116 434688428 1.01
tpch_q19/datafusion:parquet 295634728 339394442 0.87
tpch_q20/datafusion:parquet 316995025 307094731 1.03
tpch_q21/datafusion:parquet 🚀 481015966 749305416 0.64
tpch_q22/datafusion:parquet 157336249 215189906 0.73
duckdb / vortex-file-compressed (1.048x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 256144635 249894183 1.03
tpch_q02/duckdb:vortex-file-compressed 897015306 866841894 1.03
tpch_q03/duckdb:vortex-file-compressed 609544327 573835719 1.06
tpch_q04/duckdb:vortex-file-compressed 376753555 370581168 1.02
tpch_q05/duckdb:vortex-file-compressed 780515506 758797636 1.03
tpch_q06/duckdb:vortex-file-compressed 339213350 322704633 1.05
tpch_q07/duckdb:vortex-file-compressed 860849139 826018720 1.04
tpch_q08/duckdb:vortex-file-compressed 1098329620 988103468 1.11
tpch_q09/duckdb:vortex-file-compressed 892793232 885699251 1.01
tpch_q10/duckdb:vortex-file-compressed 636469399 666254898 0.96
tpch_q11/duckdb:vortex-file-compressed 492090585 470774857 1.05
tpch_q12/duckdb:vortex-file-compressed 646811218 588296850 1.10
tpch_q13/duckdb:vortex-file-compressed 463608126 388735464 1.19
tpch_q14/duckdb:vortex-file-compressed 436706307 352571990 1.24
tpch_q15/duckdb:vortex-file-compressed 281313805 260293769 1.08
tpch_q16/duckdb:vortex-file-compressed 324356782 322629756 1.01
tpch_q17/duckdb:vortex-file-compressed 670750536 689067545 0.97
tpch_q18/duckdb:vortex-file-compressed 526292436 548141216 0.96
tpch_q19/duckdb:vortex-file-compressed 443568811 432295998 1.03
tpch_q20/duckdb:vortex-file-compressed 726249527 685741068 1.06
tpch_q21/duckdb:vortex-file-compressed 982081074 940695462 1.04
tpch_q22/duckdb:vortex-file-compressed 269738308 262151588 1.03
duckdb / vortex-compact (1.081x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 317069006 299243279 1.06
tpch_q02/duckdb:vortex-compact 898795232 828761633 1.08
tpch_q03/duckdb:vortex-compact 623819189 595383202 1.05
tpch_q04/duckdb:vortex-compact 382003467 308273035 1.24
tpch_q05/duckdb:vortex-compact 747357698 746290584 1.00
tpch_q06/duckdb:vortex-compact 324189801 286752682 1.13
tpch_q07/duckdb:vortex-compact 903793758 845880375 1.07
tpch_q08/duckdb:vortex-compact 1048808251 1042168225 1.01
tpch_q09/duckdb:vortex-compact 950855667 886775725 1.07
tpch_q10/duckdb:vortex-compact 683264214 663230650 1.03
tpch_q11/duckdb:vortex-compact 455378181 470658629 0.97
tpch_q12/duckdb:vortex-compact 598469124 570653998 1.05
tpch_q13/duckdb:vortex-compact 357334754 321560722 1.11
tpch_q14/duckdb:vortex-compact 398563466 328160461 1.21
tpch_q15/duckdb:vortex-compact 271225436 257785681 1.05
tpch_q16/duckdb:vortex-compact 320361045 294296906 1.09
tpch_q17/duckdb:vortex-compact 633070724 551362279 1.15
tpch_q18/duckdb:vortex-compact 518674499 515374220 1.01
tpch_q19/duckdb:vortex-compact 447752483 412133915 1.09
tpch_q20/duckdb:vortex-compact 760545719 678523083 1.12
tpch_q21/duckdb:vortex-compact 1011888671 967825901 1.05
tpch_q22/duckdb:vortex-compact 279974368 233302248 1.20
duckdb / parquet (1.030x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 407692779 407420774 1.00
tpch_q02/duckdb:parquet 987703681 1014940881 0.97
tpch_q03/duckdb:parquet 907828748 866171036 1.05
tpch_q04/duckdb:parquet 583619092 573348649 1.02
tpch_q05/duckdb:parquet 1146929744 1030181922 1.11
tpch_q06/duckdb:parquet 417011858 370971704 1.12
tpch_q07/duckdb:parquet 1131885646 1092112132 1.04
tpch_q08/duckdb:parquet 1331187618 1318384359 1.01
tpch_q09/duckdb:parquet 1277522120 1279023838 1.00
tpch_q10/duckdb:parquet 1213455333 1186281146 1.02
tpch_q11/duckdb:parquet 708005304 670560660 1.06
tpch_q12/duckdb:parquet 611792205 640158080 0.96
tpch_q13/duckdb:parquet 883295463 893590574 0.99
tpch_q14/duckdb:parquet 648021714 654126002 0.99
tpch_q15/duckdb:parquet 515031326 449975591 1.14
tpch_q16/duckdb:parquet 614873268 589621961 1.04
tpch_q17/duckdb:parquet 721661290 689824867 1.05
tpch_q18/duckdb:parquet 809012454 798140114 1.01
tpch_q19/duckdb:parquet 703345733 746660258 0.94
tpch_q20/duckdb:parquet 1023628893 1025524236 1.00
tpch_q21/duckdb:parquet 1005428220 962952018 1.04
tpch_q22/duckdb:parquet 574750297 509307904 1.13

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Vortex (geomean): 1.069x ➖
Parquet (geomean): 1.057x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

unknown / unknown (1.054x ➖, 0↑ 7↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 376507 360716 1.04
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1015470 1033724 0.98
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8579363444 8442125042 1.02
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8424200431 8270612624 1.02
random-access/feature-vectors/correlated/vortex-tokio-local-disk 3122406 2983961 1.05
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 2676392 2556752 1.05
random-access/feature-vectors/uniform/lance-tokio-local-disk 1183689 1131642 1.05
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1877094 1811248 1.04
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8432031929 8297353086 1.02
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8568551027 8201289277 1.04
random-access/feature-vectors/uniform/vortex-tokio-local-disk 3576541 3447690 1.04
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 5886308 5648155 1.04
random-access/lance-tokio-local-disk 650689 624180 1.04
random-access/lance-tokio-local-disk-footer 1324049 1270833 1.04
random-access/nested-lists/correlated/lance-tokio-local-disk 224536 212435 1.06
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 557555 546534 1.02
random-access/nested-lists/correlated/parquet-tokio-local-disk 131970053 126663453 1.04
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 133920188 129027149 1.04
random-access/nested-lists/correlated/vortex-tokio-local-disk 344324 331367 1.04
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 451800 425758 1.06
random-access/nested-lists/uniform/lance-tokio-local-disk 975300 990819 0.98
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1333666 1309217 1.02
random-access/nested-lists/uniform/parquet-tokio-local-disk 134692978 126060283 1.07
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 131039060 128488248 1.02
random-access/nested-lists/uniform/vortex-tokio-local-disk 1970114 1879345 1.05
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2086866 1971557 1.06
random-access/nested-structs/correlated/lance-tokio-local-disk 352621 344585 1.02
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 531159 516983 1.03
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 22776157 20313247 1.12
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 22785706 20675564 1.10
random-access/nested-structs/correlated/vortex-tokio-local-disk 466795 425115 1.10
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚨 654670 579106 1.13
random-access/nested-structs/uniform/lance-tokio-local-disk 2488941 2410671 1.03
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2667127 2638501 1.01
random-access/nested-structs/uniform/parquet-tokio-local-disk 22435954 21424734 1.05
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 22476487 20322010 1.11
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚨 1260833 1135831 1.11
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1569510 1469412 1.07
random-access/parquet-tokio-local-disk 177537850 167769727 1.06
random-access/parquet-tokio-local-disk-footer 180387941 169970102 1.06
random-access/taxi/correlated/lance-tokio-local-disk 968798 929019 1.04
random-access/taxi/correlated/lance-tokio-local-disk-footer 1954858 1800188 1.09
random-access/taxi/correlated/parquet-tokio-local-disk 269776856 252547143 1.07
random-access/taxi/correlated/parquet-tokio-local-disk-footer 270679542 254211565 1.06
random-access/taxi/correlated/vortex-tokio-local-disk 1289044 1196126 1.08
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚨 1974225 1707224 1.16
random-access/taxi/uniform/lance-tokio-local-disk 9770613 9023845 1.08
random-access/taxi/uniform/lance-tokio-local-disk-footer 10540471 9692508 1.09
random-access/taxi/uniform/parquet-tokio-local-disk 287117340 268456762 1.07
random-access/taxi/uniform/parquet-tokio-local-disk-footer 285840336 267654320 1.07
random-access/taxi/uniform/vortex-tokio-local-disk 4637231 4725257 0.98
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚨 5770387 5218227 1.11
random-access/vortex-tokio-local-disk 725855 688246 1.05
random-access/vortex-tokio-local-disk-footer 1271779 1159485 1.10

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (+1.3%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): 0.924x ➖
Parquet (geomean): 0.922x ➖
Shifts: Parquet (control) -7.8% · Median polish -8.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.925x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 128911541 135831877 0.95
appian_q02/datafusion:vortex-file-compressed 590446315 640252714 0.92
appian_q03/datafusion:vortex-file-compressed 337182384 373989957 0.90
appian_q04/datafusion:vortex-file-compressed 44414455952 47090019667 0.94
appian_q05/datafusion:vortex-file-compressed 249339671 266327662 0.94
appian_q06/datafusion:vortex-file-compressed 332036072 356745312 0.93
appian_q07/datafusion:vortex-file-compressed 422122904 467400872 0.90
appian_q08/datafusion:vortex-file-compressed 1922691251 2105163441 0.91
datafusion / parquet (0.913x ➖, 2↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
appian_q01/datafusion:parquet 127561066 138969824 0.92
appian_q02/datafusion:parquet 597450158 651169604 0.92
appian_q03/datafusion:parquet 🚀 327110462 374975453 0.87
appian_q04/datafusion:parquet 44546505923 47036306054 0.95
appian_q05/datafusion:parquet 278417211 302227150 0.92
appian_q06/datafusion:parquet 🚀 347472367 387348890 0.90
appian_q07/datafusion:parquet 425838696 465330103 0.92
appian_q08/datafusion:parquet 1924781801 2095394855 0.92
duckdb / vortex-file-compressed (0.924x ➖, 1↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 183579239 201226900 0.91
appian_q02/duckdb:vortex-file-compressed 595011075 654328295 0.91
appian_q03/duckdb:vortex-file-compressed 🚀 257625093 291743800 0.88
appian_q04/duckdb:vortex-file-compressed 1317903252 1392421521 0.95
appian_q05/duckdb:vortex-file-compressed 284135362 308833937 0.92
appian_q06/duckdb:vortex-file-compressed 801628261 826302588 0.97
appian_q07/duckdb:vortex-file-compressed 346973102 370951169 0.94
appian_q08/duckdb:vortex-file-compressed 1270479069 1390096622 0.91
duckdb / parquet (0.932x ➖, 1↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
appian_q01/duckdb:parquet 205437588 209409228 0.98
appian_q02/duckdb:parquet 602011191 626840408 0.96
appian_q03/duckdb:parquet 288647416 303012150 0.95
appian_q04/duckdb:parquet 1312076169 1435926873 0.91
appian_q05/duckdb:parquet 🚀 314640341 358623402 0.88
appian_q06/duckdb:parquet 784282392 818428215 0.96
appian_q07/duckdb:parquet 361076384 400638348 0.90
appian_q08/duckdb:parquet 1267157600 1387714471 0.91
duckdb / duckdb (0.933x ➖, 1↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 169720285 186548610 0.91
appian_q02/duckdb:duckdb 🚀 547582302 614864587 0.89
appian_q03/duckdb:duckdb 387582772 410133775 0.95
appian_q04/duckdb:duckdb 1293777226 1394814410 0.93
appian_q05/duckdb:duckdb 287008983 299790462 0.96
appian_q06/duckdb:duckdb 776341835 801397811 0.97
appian_q07/duckdb:duckdb 324012012 341826788 0.95
appian_q08/duckdb:duckdb 1217047305 1328824756 0.92

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.91 MB → 271.65 MB (-0.1%)
  • vortex-file-compressed: 479.69 MB → 479.69 MB (0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (+2.5%, environment too noisy confidence) · DuckDB No clear signal (-3.2%, low confidence)
Vortex (geomean): 0.995x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.988x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 706881103 715413279 0.99
tpch_q02/datafusion:vortex-file-compressed 668730271 708260394 0.94
tpch_q03/datafusion:vortex-file-compressed 699966512 727932184 0.96
tpch_q04/datafusion:vortex-file-compressed 443834018 469845403 0.94
tpch_q05/datafusion:vortex-file-compressed 825481847 814427961 1.01
tpch_q06/datafusion:vortex-file-compressed 535850239 523581115 1.02
tpch_q07/datafusion:vortex-file-compressed 831195955 854220464 0.97
tpch_q08/datafusion:vortex-file-compressed 1140342158 1138517816 1.00
tpch_q09/datafusion:vortex-file-compressed 1083741578 1259805604 0.86
tpch_q10/datafusion:vortex-file-compressed 861168774 882511070 0.98
tpch_q11/datafusion:vortex-file-compressed 449794875 441484035 1.02
tpch_q12/datafusion:vortex-file-compressed 714992958 651579805 1.10
tpch_q13/datafusion:vortex-file-compressed 407378306 393412157 1.04
tpch_q14/datafusion:vortex-file-compressed 457947391 460814150 0.99
tpch_q15/datafusion:vortex-file-compressed 935025457 822985766 1.14
tpch_q16/datafusion:vortex-file-compressed 361506635 385011442 0.94
tpch_q17/datafusion:vortex-file-compressed 1125151267 1045232773 1.08
tpch_q18/datafusion:vortex-file-compressed 1124676582 1152756327 0.98
tpch_q19/datafusion:vortex-file-compressed 809624615 796454791 1.02
tpch_q20/datafusion:vortex-file-compressed 736711158 790588185 0.93
tpch_q21/datafusion:vortex-file-compressed 1317621582 1333627530 0.99
tpch_q22/datafusion:vortex-file-compressed 338050086 380101100 0.89
datafusion / vortex-compact (0.994x ➖, 0↑ 1↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 728080698 745889008 0.98
tpch_q02/datafusion:vortex-compact 666036466 773190406 0.86
tpch_q03/datafusion:vortex-compact 673703873 685412505 0.98
tpch_q04/datafusion:vortex-compact 420940562 409029925 1.03
tpch_q05/datafusion:vortex-compact 769286499 964436990 0.80
tpch_q06/datafusion:vortex-compact 528852974 504815685 1.05
tpch_q07/datafusion:vortex-compact 992205516 872861367 1.14
tpch_q08/datafusion:vortex-compact 1239358307 1095222035 1.13
tpch_q09/datafusion:vortex-compact 1106737166 1093720408 1.01
tpch_q10/datafusion:vortex-compact 854522569 825273117 1.04
tpch_q11/datafusion:vortex-compact 422664890 401014673 1.05
tpch_q12/datafusion:vortex-compact 676013595 637996859 1.06
tpch_q13/datafusion:vortex-compact 394262886 414853454 0.95
tpch_q14/datafusion:vortex-compact 456840165 481147990 0.95
tpch_q15/datafusion:vortex-compact 806977440 846600395 0.95
tpch_q16/datafusion:vortex-compact 383597535 404817954 0.95
tpch_q17/datafusion:vortex-compact 1062971401 1136136625 0.94
tpch_q18/datafusion:vortex-compact 1099172898 1142240566 0.96
tpch_q19/datafusion:vortex-compact 898793708 870778256 1.03
tpch_q20/datafusion:vortex-compact 753377388 761765870 0.99
tpch_q21/datafusion:vortex-compact 1281562093 1552033925 0.83
tpch_q22/datafusion:vortex-compact 🚨 455570281 342721314 1.33
datafusion / parquet (0.967x ➖, 1↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 848740236 834156759 1.02
tpch_q02/datafusion:parquet 722470083 698517866 1.03
tpch_q03/datafusion:parquet 964316944 1035317644 0.93
tpch_q04/datafusion:parquet 438895205 542626715 0.81
tpch_q05/datafusion:parquet 1154945100 1065998527 1.08
tpch_q06/datafusion:parquet 504910084 511713078 0.99
tpch_q07/datafusion:parquet 1173405521 1215683530 0.97
tpch_q08/datafusion:parquet 1446031009 1463111764 0.99
tpch_q09/datafusion:parquet 1651244577 1620378718 1.02
tpch_q10/datafusion:parquet 1946915740 1987163491 0.98
tpch_q11/datafusion:parquet 489988469 516370733 0.95
tpch_q12/datafusion:parquet 635639326 650815632 0.98
tpch_q13/datafusion:parquet 691126768 667278197 1.04
tpch_q14/datafusion:parquet 746594146 755141981 0.99
tpch_q15/datafusion:parquet 1210860212 1199025687 1.01
tpch_q16/datafusion:parquet 361941694 330565121 1.09
tpch_q17/datafusion:parquet 1303199156 1325490495 0.98
tpch_q18/datafusion:parquet 1492201010 1473940598 1.01
tpch_q19/datafusion:parquet 945043099 907681750 1.04
tpch_q20/datafusion:parquet 1155068256 1040177417 1.11
tpch_q21/datafusion:parquet 1859903896 2326855456 0.80
tpch_q22/datafusion:parquet 🚀 667283201 1084593635 0.62
duckdb / vortex-file-compressed (0.988x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 596946440 589034321 1.01
tpch_q02/duckdb:vortex-file-compressed 1193091729 1083126495 1.10
tpch_q03/duckdb:vortex-file-compressed 813718741 766841417 1.06
tpch_q04/duckdb:vortex-file-compressed 591449759 599363921 0.99
tpch_q05/duckdb:vortex-file-compressed 1049982437 1025348142 1.02
tpch_q06/duckdb:vortex-file-compressed 516136905 544061535 0.95
tpch_q07/duckdb:vortex-file-compressed 1091299751 1069841526 1.02
tpch_q08/duckdb:vortex-file-compressed 1441061224 1387450519 1.04
tpch_q09/duckdb:vortex-file-compressed 1610927767 1593759479 1.01
tpch_q10/duckdb:vortex-file-compressed 1290241886 1257684112 1.03
tpch_q11/duckdb:vortex-file-compressed 614701704 598292337 1.03
tpch_q12/duckdb:vortex-file-compressed 1164063407 1167904037 1.00
tpch_q13/duckdb:vortex-file-compressed 760416880 818323918 0.93
tpch_q14/duckdb:vortex-file-compressed 606863767 672156097 0.90
tpch_q15/duckdb:vortex-file-compressed 527411186 523238680 1.01
tpch_q16/duckdb:vortex-file-compressed 495554655 526153734 0.94
tpch_q17/duckdb:vortex-file-compressed 927673664 1055210609 0.88
tpch_q18/duckdb:vortex-file-compressed 866736992 910149393 0.95
tpch_q19/duckdb:vortex-file-compressed 747549904 771598446 0.97
tpch_q20/duckdb:vortex-file-compressed 1192122775 1271341804 0.94
tpch_q21/duckdb:vortex-file-compressed 1802656533 1903437138 0.95
tpch_q22/duckdb:vortex-file-compressed 391738696 370982530 1.06
duckdb / vortex-compact (1.011x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 630560780 666652237 0.95
tpch_q02/duckdb:vortex-compact 1098088761 1041837185 1.05
tpch_q03/duckdb:vortex-compact 793691414 823357970 0.96
tpch_q04/duckdb:vortex-compact 585998960 613204295 0.96
tpch_q05/duckdb:vortex-compact 1110942014 1077409540 1.03
tpch_q06/duckdb:vortex-compact 553619016 530105668 1.04
tpch_q07/duckdb:vortex-compact 1152973234 1092656845 1.06
tpch_q08/duckdb:vortex-compact 1417892784 1400581846 1.01
tpch_q09/duckdb:vortex-compact 1591564394 1499929976 1.06
tpch_q10/duckdb:vortex-compact 1361955815 1274025448 1.07
tpch_q11/duckdb:vortex-compact 689889223 612757846 1.13
tpch_q12/duckdb:vortex-compact 1026389609 1058332380 0.97
tpch_q13/duckdb:vortex-compact 731440966 765655172 0.96
tpch_q14/duckdb:vortex-compact 636639144 636490072 1.00
tpch_q15/duckdb:vortex-compact 529348209 563334527 0.94
tpch_q16/duckdb:vortex-compact 397364485 389634196 1.02
tpch_q17/duckdb:vortex-compact 866173935 876459188 0.99
tpch_q18/duckdb:vortex-compact 854559072 842411573 1.01
tpch_q19/duckdb:vortex-compact 731537451 734787518 1.00
tpch_q20/duckdb:vortex-compact 1113185655 1178246229 0.94
tpch_q21/duckdb:vortex-compact 1811555300 1675206099 1.08
tpch_q22/duckdb:vortex-compact 413146254 400358978 1.03
duckdb / parquet (1.032x ➖, 0↑ 0↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 750392481 728469640 1.03
tpch_q02/duckdb:parquet 1250041351 1248363974 1.00
tpch_q03/duckdb:parquet 1541677261 1501731860 1.03
tpch_q04/duckdb:parquet 881937798 831675308 1.06
tpch_q05/duckdb:parquet 1738053738 1706114757 1.02
tpch_q06/duckdb:parquet 721823806 679312359 1.06
tpch_q07/duckdb:parquet 1709638798 1516918018 1.13
tpch_q08/duckdb:parquet 2110722818 2122384160 0.99
tpch_q09/duckdb:parquet 2483558508 2341741430 1.06
tpch_q10/duckdb:parquet 2880320102 2835404560 1.02
tpch_q11/duckdb:parquet 939080735 832488711 1.13
tpch_q12/duckdb:parquet 977908983 1067114279 0.92
tpch_q13/duckdb:parquet 1160138405 1136977543 1.02
tpch_q14/duckdb:parquet 1163782996 1123180033 1.04
tpch_q15/duckdb:parquet 899884121 862219928 1.04
tpch_q16/duckdb:parquet 861998853 866950433 0.99
tpch_q17/duckdb:parquet 1251202846 1224940047 1.02
tpch_q18/duckdb:parquet 1338077487 1246993963 1.07
tpch_q19/duckdb:parquet 1408331570 1338377340 1.05
tpch_q20/duckdb:parquet 1649726239 1688900775 0.98
tpch_q21/duckdb:parquet 1688517533 1650766455 1.02
tpch_q22/duckdb:parquet 1019846294 978252390 1.04

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Vortex (geomean): 1.009x ➖
Parquet (geomean): 1.010x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

unknown / unknown (1.013x ➖, 0↑ 8↓)
name PR c85b1c3 (ns) base bc443ac (ns) ratio (PR/base)
compress time/Arade 1105812582 1102885548 1.00
compress time/Bimbo 5854772421 5748260018 1.02
compress time/CMSprovider 2643542548 2684657411 0.98
compress time/Euro2016 428459287 432572913 0.99
compress time/Food 368555963 369781497 1.00
compress time/HashTags 846501907 837332324 1.01
compress time/TPC-H l_comment canonical 1227036777 1228968937 1.00
compress time/TPC-H l_comment chunked 1215579592 1212302265 1.00
compress time/taxi 586687229 577189745 1.02
compress time/wide table cols=100 chunks=1 rows=1000 12176240 11886165 1.02
compress time/wide table cols=100 chunks=50 rows=1000 12219885 12127740 1.01
compress time/wide table cols=1000 chunks=1 rows=1000 🚨 151191214 136932792 1.10
compress time/wide table cols=1000 chunks=50 rows=1000 137219322 136222244 1.01
compress time/wide table cols=10000 chunks=1 rows=1000 1571234958 1522163743 1.03
compress time/wide table cols=10000 chunks=50 rows=1000 1558387891 1532250056 1.02
decompress time/Arade 28760139 29232328 0.98
decompress time/Bimbo 96435548 91633449 1.05
decompress time/CMSprovider 82372841 76860198 1.07
decompress time/Euro2016 20260143 20603273 0.98
decompress time/Food 8874476 8652439 1.03
decompress time/HashTags 94099751 94163193 1.00
decompress time/TPC-H l_comment canonical 42276905 42502652 0.99
decompress time/TPC-H l_comment chunked 43953631 42950266 1.02
decompress time/taxi 17147389 17506011 0.98
decompress time/wide table cols=100 chunks=1 rows=1000 🚨 2781066 2479064 1.12
decompress time/wide table cols=100 chunks=50 rows=1000 2516806 2464345 1.02
decompress time/wide table cols=1000 chunks=1 rows=1000 🚨 25917185 23435245 1.11
decompress time/wide table cols=1000 chunks=50 rows=1000 24538721 23645465 1.04
decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 282970418 239453342 1.18
decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 298971545 260250148 1.15
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2654309598 2646052716 1.00
parquet_rs-zstd compress time/Bimbo 12679652144 12567887157 1.01
parquet_rs-zstd compress time/CMSprovider 6997832453 6906854202 1.01
parquet_rs-zstd compress time/Euro2016 1342086703 1296893982 1.03
parquet_rs-zstd compress time/Food 786798031 801286763 0.98
parquet_rs-zstd compress time/HashTags 2205092246 2169908385 1.02
parquet_rs-zstd compress time/TPC-H l_comment canonical 3176412607 3228984012 0.98
parquet_rs-zstd compress time/TPC-H l_comment chunked 3229244767 3206504093 1.01
parquet_rs-zstd compress time/taxi 1195320525 1193011394 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6504840 6041877 1.08
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6135804 6024276 1.02
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 79070166 73812631 1.07
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 76626440 76211983 1.01
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 781503630 768182212 1.02
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 779743412 763767172 1.02
parquet_rs-zstd decompress time/Arade 611074530 624797613 0.98
parquet_rs-zstd decompress time/Bimbo 1704211483 1708251201 1.00
parquet_rs-zstd decompress time/CMSprovider 1691632872 1728224470 0.98
parquet_rs-zstd decompress time/Euro2016 377752948 376469403 1.00
parquet_rs-zstd decompress time/Food 196995196 202946309 0.97
parquet_rs-zstd decompress time/HashTags 644816900 645335266 1.00
parquet_rs-zstd decompress time/TPC-H l_comment canonical 592226115 594623753 1.00
parquet_rs-zstd decompress time/TPC-H l_comment chunked 601711924 596283553 1.01
parquet_rs-zstd decompress time/taxi 244748466 246705168 0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2898139 2822382 1.03
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2792334 2778189 1.01
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 🚨 36074082 32164328 1.12
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 34015786 33959652 1.00
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 351006637 347101971 1.01
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 354690620 347599772 1.02
vortex-file-compressed size/Arade 145358060 145358060 1.00
vortex-file-compressed size/Bimbo 467257556 467257556 1.00
vortex-file-compressed size/CMSprovider 417789364 417789356 1.00
vortex-file-compressed size/Euro2016 162144164 162144164 1.00
vortex-file-compressed size/Food 41977096 41977096 1.00
vortex-file-compressed size/HashTags 184887972 184887972 1.00
vortex-file-compressed size/TPC-H l_comment canonical 172639744 172639744 1.00
vortex-file-compressed size/TPC-H l_comment chunked 172639744 172639744 1.00
vortex-file-compressed size/taxi 52296276 52296276 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 932512 932512 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 932512 932512 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9309712 9309712 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9309712 9309712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93117712 93117712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93117712 93117712 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.00
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.01
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.97
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.96
vortex:parquet-zstd ratio compress time/Food 0 0 1.02
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.99
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.00
vortex:parquet-zstd ratio compress time/taxi 0 0 1.01
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 0.95
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 2 0.99
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 2 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 2 1.00
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.01
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.05
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.09
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.98
vortex:parquet-zstd ratio decompress time/Food 0 0 1.06
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.00
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.00
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.01
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.09
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 1.02
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 0 0 1.17
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 0 0 1.13
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1 1 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1 1 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
joseph-isaacs force-pushed the claude/writer-editions-gating-8qy1fv branch from c85b1c3 to a388e2e Compare July 23, 2026 10:21
…ions-gating-8qy1fv

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

# Conflicts:
#	vortex-file/src/writer.rs
@codspeed-hq

codspeed-hq Bot commented Jul 23, 2026

Copy link
Copy Markdown

Merging this PR will degrade performance by 0.17%

⚡ 1 improved benchmark
❌ 1 regressed benchmark
✅ 1845 untouched benchmarks
⏩ 46 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation decode_varbin[(1000, 8)] 27.1 µs 34.4 µs -21.31%
Simulation decode_varbin[(1000, 4)] 34.3 µs 27.1 µs +26.64%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing claude/writer-editions-gating-8qy1fv (a5e0c3d) with develop (f806450)

Open in CodSpeed

Footnotes

  1. 46 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

claude added 2 commits July 23, 2026 11:44
…nks, Python goldens

The develop merge brought in the file-level metadata tests (#8740), which
write with bare sessions that enable no editions and now fail validation.
Enable the crate's test edition in those sessions, matching the other
vortex-file unit tests.

Also re-qualify the vortex::editions module-doc links (module docs resolve
at the lib.rs `pub mod` site) and update the Python doctest golden file
sizes for the edition-derived footer context.

Signed-off-by: Claude <noreply@anthropic.com>

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01CK2nCuXnyd2g3mNHQC8Lz2
The writer now rejects encodings outside the session's enabled editions
regardless of the configured strategy, so vortex-jni's strategy-level
allow-set override for `vortex.parquet.variant` no longer worked. JNI
sessions instead enable the latest unstable edition (the family that
encoding belongs to), which restores variant writability through the
session policy. The schema-conditional strategy override is removed:
parquet-variant arrays only arise for variant-typed columns, so the
session-wide policy is equivalent.

Sibling unstable encodings are not registered in the JNI build, so the
footer's pre-populated context may advertise enabled-but-unregistered
ids; a new integration test pins that such files stay readable.

Signed-off-by: Claude <noreply@anthropic.com>

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01CK2nCuXnyd2g3mNHQC8Lz2
@joseph-isaacs
joseph-isaacs force-pushed the claude/writer-editions-gating-8qy1fv branch from c5aff5c to a5e0c3d Compare July 23, 2026 11:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants