Skip to content

Remove chunked special case from stat execution#7928

Merged
gatesn merged 1 commit into
developfrom
ngates/stats-7707/chunked-stat-execute-parent
May 14, 2026
Merged

Remove chunked special case from stat execution#7928
gatesn merged 1 commit into
developfrom
ngates/stats-7707/chunked-stat-execute-parent

Conversation

@gatesn
Copy link
Copy Markdown
Contributor

@gatesn gatesn commented May 14, 2026

Part of #7707.

Stack: 1/3

Base: develop
Next: #7929

Summary

  • Remove the explicit chunked-array special case from StatFn::execute.
  • Rely on the existing chunked scalar-function pushdown path to preserve per-chunk stat results.
  • Keep the existing chunked stats regression test covering the behavior.

Checks

  • cargo test -p vortex-array stat_expr_reads_cached_sum_per_chunk

@gatesn gatesn changed the title Use chunked execute_parent for stat expressions 1: Use chunked execute_parent for stat expressions May 14, 2026
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 14, 2026

Merging this PR will degrade performance by 17.6%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

❌ 5 regressed benchmarks
✅ 1211 untouched benchmarks
⏩ 24 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation new_bp_prim_test_between[i32, 16384] 95.5 µs 109.2 µs -12.52%
Simulation new_bp_prim_test_between[i32, 32768] 141.9 µs 170.1 µs -16.58%
Simulation new_bp_prim_test_between[i64, 32768] 178.9 µs 236.8 µs -24.48%
Simulation new_bp_prim_test_between[i64, 16384] 116 µs 144.6 µs -19.77%
Simulation new_alp_prim_test_between[f64, 16384] 127.8 µs 148.8 µs -14.09%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ngates/stats-7707/chunked-stat-execute-parent (0dce6a1) with develop (95f429d)

Open in CodSpeed

Footnotes

  1. 24 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@gatesn gatesn force-pushed the ngates/stats-7707/chunked-stat-execute-parent branch from 07bfcdc to 261cbe4 Compare May 14, 2026 19:54
@gatesn gatesn changed the title 1: Use chunked execute_parent for stat expressions 1: Remove chunked special case from stat execution May 14, 2026
let input = args.get(0)?;
let dtype = stat_dtype(options.aggregate_fn(), input.dtype())?;

// Recurse into each chunk so the output keeps per-chunk granularity (one constant
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I realized we already have a rule that pushes scalar functions through chunked arrays

Signed-off-by: Nicholas Gates <nick@nickgates.com>
@gatesn gatesn added the changelog/chore A trivial change label May 14, 2026
@gatesn gatesn marked this pull request as ready for review May 14, 2026 20:09
@gatesn gatesn enabled auto-merge (squash) May 14, 2026 20:09
@gatesn gatesn force-pushed the ngates/stats-7707/chunked-stat-execute-parent branch from 261cbe4 to 0dce6a1 Compare May 14, 2026 20:27
@connortsui20 connortsui20 added the action/benchmark Trigger full benchmarks to run on this PR label May 14, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 14, 2026
Copy link
Copy Markdown
Contributor

@connortsui20 connortsui20 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yolo

@gatesn gatesn merged commit 8c5a0f1 into develop May 14, 2026
81 of 82 checks passed
@gatesn gatesn deleted the ngates/stats-7707/chunked-stat-execute-parent branch May 14, 2026 20:37
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 14, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 0dce6a1 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.145x ❌


datafusion / vortex-file-compressed (1.145x ❌, 0↑ 8↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 127263110 123549083 1.03
polarsignals_q01/datafusion:vortex-file-compressed 293518210 279253041 1.05
polarsignals_q02/datafusion:vortex-file-compressed 🚨 25627585 23168433 1.11
polarsignals_q03/datafusion:vortex-file-compressed 🚨 360968696 265386942 1.36
polarsignals_q04/datafusion:vortex-file-compressed 🚨 13656125 11887152 1.15
polarsignals_q05/datafusion:vortex-file-compressed 🚨 17370468 14985183 1.16
polarsignals_q06/datafusion:vortex-file-compressed 🚨 20920243 18610544 1.12
polarsignals_q07/datafusion:vortex-file-compressed 🚨 16973418 13707347 1.24
polarsignals_q08/datafusion:vortex-file-compressed 🚨 454694768 396129058 1.15
polarsignals_q09/datafusion:vortex-file-compressed 🚨 12461200 11147774 1.12

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Vortex (geomean): 0.936x ➖
Parquet (geomean): 0.927x ➖
Shifts: Parquet (control) -7.3% · Median polish -5.1%


datafusion / vortex-file-compressed (0.928x ➖, 3↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5264152 5654066 0.93
fineweb_q01/datafusion:vortex-file-compressed 🚀 20572909 22954963 0.90
fineweb_q02/datafusion:vortex-file-compressed 🚀 20999688 24401713 0.86
fineweb_q03/datafusion:vortex-file-compressed 77626747 81706141 0.95
fineweb_q04/datafusion:vortex-file-compressed 225573305 224204103 1.01
fineweb_q05/datafusion:vortex-file-compressed 213103386 217280632 0.98
fineweb_q06/datafusion:vortex-file-compressed 50023345 52226360 0.96
fineweb_q07/datafusion:vortex-file-compressed 56670742 59145522 0.96
fineweb_q08/datafusion:vortex-file-compressed 🚀 20957746 25352915 0.83
datafusion / vortex-compact (0.945x ➖, 1↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 5548216 6201608 0.89
fineweb_q01/datafusion:vortex-compact 88402113 94858768 0.93
fineweb_q02/datafusion:vortex-compact 103307814 105579047 0.98
fineweb_q03/datafusion:vortex-compact 861513499 883164937 0.98
fineweb_q04/datafusion:vortex-compact 906455403 960919450 0.94
fineweb_q05/datafusion:vortex-compact 813188607 858030987 0.95
fineweb_q06/datafusion:vortex-compact 467556287 481516323 0.97
fineweb_q07/datafusion:vortex-compact 475701119 501655302 0.95
fineweb_q08/datafusion:vortex-compact 17578326 19077230 0.92
datafusion / parquet (0.919x ➖, 3↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6201487 6482882 0.96
fineweb_q01/datafusion:parquet 🚀 281797305 323627470 0.87
fineweb_q02/datafusion:parquet 🚀 285146033 317779318 0.90
fineweb_q03/datafusion:parquet 284346674 300926104 0.94
fineweb_q04/datafusion:parquet 295556256 318953116 0.93
fineweb_q05/datafusion:parquet 🚀 290920160 323458854 0.90
fineweb_q06/datafusion:parquet 286678023 312433166 0.92
fineweb_q07/datafusion:parquet 284259297 300904025 0.94
fineweb_q08/datafusion:parquet 275534195 300890936 0.92
duckdb / vortex-file-compressed (0.907x ➖, 2↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 3329600 3961335 0.84
fineweb_q01/duckdb:vortex-file-compressed 21597832 22832572 0.95
fineweb_q02/duckdb:vortex-file-compressed 23174887 25575584 0.91
fineweb_q03/duckdb:vortex-file-compressed 🚀 113938204 163975778 0.69
fineweb_q04/duckdb:vortex-file-compressed 214767026 218002047 0.99
fineweb_q05/duckdb:vortex-file-compressed 204146450 211233185 0.97
fineweb_q06/duckdb:vortex-file-compressed 51375499 54643439 0.94
fineweb_q07/duckdb:vortex-file-compressed 55377770 55687356 0.99
fineweb_q08/duckdb:vortex-file-compressed 22209913 23770406 0.93
duckdb / vortex-compact (0.963x ➖, 1↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀 3993451 4449825 0.90
fineweb_q01/duckdb:vortex-compact 107795394 106036989 1.02
fineweb_q02/duckdb:vortex-compact 119481768 112765666 1.06
fineweb_q03/duckdb:vortex-compact 858270906 905631359 0.95
fineweb_q04/duckdb:vortex-compact 899047590 941405660 0.96
fineweb_q05/duckdb:vortex-compact 805975321 837389370 0.96
fineweb_q06/duckdb:vortex-compact 461443589 475919802 0.97
fineweb_q07/duckdb:vortex-compact 464467294 495413421 0.94
fineweb_q08/duckdb:vortex-compact 20174456 21748817 0.93
duckdb / parquet (0.935x ➖, 1↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 30548026 31689430 0.96
fineweb_q01/duckdb:parquet 81516979 87984989 0.93
fineweb_q02/duckdb:parquet 84339899 88916352 0.95
fineweb_q03/duckdb:parquet 310797605 326596725 0.95
fineweb_q04/duckdb:parquet 437434547 452932506 0.97
fineweb_q05/duckdb:parquet 412705107 420571904 0.98
fineweb_q06/duckdb:parquet 199539542 207137926 0.96
fineweb_q07/duckdb:parquet 208210759 219008188 0.95
fineweb_q08/duckdb:parquet 🚀 28887472 36948804 0.78
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -10.5% -4.0% -6.8% +48.2% ➖ noise
0 datafusion:vortex-file-compressed -6.9% -4.0% -3.0% +49.4% ➖ noise
0 duckdb:vortex-compact -10.3% -4.0% -6.5% +104.2% ➖ noise
0 duckdb:vortex-file-compressed -15.9% -4.0% -12.5% +79.1% ➖ noise
1 datafusion:vortex-compact -6.8% -10.2% +3.8% +21.4% ➖ noise
1 datafusion:vortex-file-compressed -10.4% -10.2% -0.2% +19.6% ➖ noise
1 duckdb:vortex-compact +1.7% -10.2% +13.2% +20.2% ➖ noise
1 duckdb:vortex-file-compressed -5.4% -10.2% +5.3% +66.8% ➖ noise
2 datafusion:vortex-compact -2.2% -7.7% +6.1% +14.4% ➖ noise
2 datafusion:vortex-file-compressed -13.9% -7.7% -6.7% +10.7% ➖ noise
2 duckdb:vortex-compact +6.0% -7.7% +14.8% +15.9% ➖ noise
2 duckdb:vortex-file-compressed -9.4% -7.7% -1.8% +10.7% ➖ noise
3 datafusion:vortex-compact -2.5% -5.2% +2.9% +10.7% ➖ noise
3 datafusion:vortex-file-compressed -5.0% -5.2% +0.2% +27.9% ➖ noise
3 duckdb:vortex-compact -5.2% -5.2% -0.1% +10.7% ➖ noise
3 duckdb:vortex-file-compressed -30.5% -5.2% -26.7% +35.5% ✅ faster
4 datafusion:vortex-compact -5.7% -5.4% -0.3% +10.7% ➖ noise
4 datafusion:vortex-file-compressed +0.6% -5.4% +6.4% +10.7% ➖ noise
4 duckdb:vortex-compact -4.5% -5.4% +1.0% +10.7% ➖ noise
4 duckdb:vortex-file-compressed -1.5% -5.4% +4.1% +10.7% ➖ noise
5 datafusion:vortex-compact -5.2% -6.1% +0.9% +10.7% ➖ noise
5 datafusion:vortex-file-compressed -1.9% -6.1% +4.4% +10.7% ➖ noise
5 duckdb:vortex-compact -3.8% -6.1% +2.5% +10.7% ➖ noise
5 duckdb:vortex-file-compressed -3.4% -6.1% +2.9% +10.7% ➖ noise
6 datafusion:vortex-compact -2.9% -6.0% +3.3% +10.7% ➖ noise
6 datafusion:vortex-file-compressed -4.2% -6.0% +1.9% +10.7% ➖ noise
6 duckdb:vortex-compact -3.0% -6.0% +3.1% +10.7% ➖ noise
6 duckdb:vortex-file-compressed -6.0% -6.0% +0.0% +10.7% ➖ noise
7 datafusion:vortex-compact -5.2% -5.2% +0.1% +10.7% ➖ noise
7 datafusion:vortex-file-compressed -4.2% -5.2% +1.1% +10.7% ➖ noise
7 duckdb:vortex-compact -6.2% -5.2% -1.1% +10.7% ➖ noise
7 duckdb:vortex-file-compressed -0.6% -5.2% +4.9% +13.0% ➖ noise
8 datafusion:vortex-compact -7.9% -15.4% +8.9% +15.7% ➖ noise
8 datafusion:vortex-file-compressed -17.3% -15.4% -2.3% +14.5% ➖ noise
8 duckdb:vortex-compact -7.2% -15.4% +9.6% +22.8% ➖ noise
8 duckdb:vortex-file-compressed -6.6% -15.4% +10.4% +19.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.0%
Vortex (geomean): 1.031x ➖
Parquet (geomean): 0.986x ➖
Shifts: Parquet (control) -1.4% · Median polish +2.7%


datafusion / vortex-file-compressed (1.029x ➖, 0↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51376284 50012568 1.03
tpch_q02/datafusion:vortex-file-compressed 23114986 22448722 1.03
tpch_q03/datafusion:vortex-file-compressed 29550171 28748302 1.03
tpch_q04/datafusion:vortex-file-compressed 22104915 21838414 1.01
tpch_q05/datafusion:vortex-file-compressed 51738053 49144084 1.05
tpch_q06/datafusion:vortex-file-compressed 12924328 12344016 1.05
tpch_q07/datafusion:vortex-file-compressed 58222224 55412303 1.05
tpch_q08/datafusion:vortex-file-compressed 41128744 40902544 1.01
tpch_q09/datafusion:vortex-file-compressed 54298231 53159213 1.02
tpch_q10/datafusion:vortex-file-compressed 41173100 40685374 1.01
tpch_q11/datafusion:vortex-file-compressed 17093629 15828253 1.08
tpch_q12/datafusion:vortex-file-compressed 27670647 25335666 1.09
tpch_q13/datafusion:vortex-file-compressed 26491709 25086029 1.06
tpch_q14/datafusion:vortex-file-compressed 17398679 17469028 1.00
tpch_q15/datafusion:vortex-file-compressed 28214384 26973984 1.05
tpch_q16/datafusion:vortex-file-compressed 20254064 21037787 0.96
tpch_q17/datafusion:vortex-file-compressed 69762812 66680662 1.05
tpch_q18/datafusion:vortex-file-compressed 82202510 84675208 0.97
tpch_q19/datafusion:vortex-file-compressed 24179700 23625631 1.02
tpch_q20/datafusion:vortex-file-compressed 32267384 31508024 1.02
tpch_q21/datafusion:vortex-file-compressed 74152685 72973080 1.02
tpch_q22/datafusion:vortex-file-compressed 13074074 12405760 1.05
datafusion / vortex-compact (1.024x ➖, 0↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 59671250 59110539 1.01
tpch_q02/datafusion:vortex-compact 27144737 25899895 1.05
tpch_q03/datafusion:vortex-compact 31129144 29752919 1.05
tpch_q04/datafusion:vortex-compact 23905592 23258737 1.03
tpch_q05/datafusion:vortex-compact 53792211 53465126 1.01
tpch_q06/datafusion:vortex-compact 14782685 14681719 1.01
tpch_q07/datafusion:vortex-compact 60947372 59607902 1.02
tpch_q08/datafusion:vortex-compact 45240628 44730938 1.01
tpch_q09/datafusion:vortex-compact 57866974 56052153 1.03
tpch_q10/datafusion:vortex-compact 47644242 46966522 1.01
tpch_q11/datafusion:vortex-compact 17694734 17573002 1.01
tpch_q12/datafusion:vortex-compact 33212766 32129458 1.03
tpch_q13/datafusion:vortex-compact 33372715 32244480 1.03
tpch_q14/datafusion:vortex-compact 20546766 20107901 1.02
tpch_q15/datafusion:vortex-compact 33996916 33371027 1.02
tpch_q16/datafusion:vortex-compact 25972042 24632256 1.05
tpch_q17/datafusion:vortex-compact 71016120 71995011 0.99
tpch_q18/datafusion:vortex-compact 87352454 85234357 1.02
tpch_q19/datafusion:vortex-compact 32298043 30592817 1.06
tpch_q20/datafusion:vortex-compact 35011573 34497095 1.01
tpch_q21/datafusion:vortex-compact 80032209 75927394 1.05
tpch_q22/datafusion:vortex-compact 13024908 13089772 1.00
datafusion / parquet (0.965x ➖, 2↑ 1↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 97877757 121097488 0.81
tpch_q02/datafusion:parquet 63859732 67120180 0.95
tpch_q03/datafusion:parquet 69805966 75867164 0.92
tpch_q04/datafusion:parquet 44625310 45873458 0.97
tpch_q05/datafusion:parquet 96751635 102734921 0.94
tpch_q06/datafusion:parquet 39183191 43506480 0.90
tpch_q07/datafusion:parquet 109086445 108640564 1.00
tpch_q08/datafusion:parquet 91250977 94198630 0.97
tpch_q09/datafusion:parquet 132029390 133211363 0.99
tpch_q10/datafusion:parquet 114706018 112547651 1.02
tpch_q11/datafusion:parquet 41793884 44089859 0.95
tpch_q12/datafusion:parquet 🚨 85174137 74919069 1.14
tpch_q13/datafusion:parquet 207537555 198544343 1.05
tpch_q14/datafusion:parquet 42563816 46923737 0.91
tpch_q15/datafusion:parquet 65544889 62862511 1.04
tpch_q16/datafusion:parquet 41922768 45575475 0.92
tpch_q17/datafusion:parquet 150120583 148704575 1.01
tpch_q18/datafusion:parquet 163472649 169117956 0.97
tpch_q19/datafusion:parquet 🚀 62938849 80667410 0.78
tpch_q20/datafusion:parquet 71921562 69448988 1.04
tpch_q21/datafusion:parquet 138101954 135102271 1.02
tpch_q22/datafusion:parquet 31984205 31820574 1.01
datafusion / arrow (1.003x ➖, 2↑ 1↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 57510977 53361595 1.08
tpch_q02/datafusion:arrow 19369085 20091883 0.96
tpch_q03/datafusion:arrow 32226701 31546338 1.02
tpch_q04/datafusion:arrow 28462681 28241620 1.01
tpch_q05/datafusion:arrow 83766858 79202184 1.06
tpch_q06/datafusion:arrow 🚨 21797117 19496987 1.12
tpch_q07/datafusion:arrow 107957653 101428786 1.06
tpch_q08/datafusion:arrow 46836512 44170863 1.06
tpch_q09/datafusion:arrow 68682226 68197277 1.01
tpch_q10/datafusion:arrow 49398773 53909107 0.92
tpch_q11/datafusion:arrow 9613618 9914885 0.97
tpch_q12/datafusion:arrow 55819131 56426170 0.99
tpch_q13/datafusion:arrow 47499476 48134855 0.99
tpch_q14/datafusion:arrow 22325145 21840909 1.02
tpch_q15/datafusion:arrow 46511901 42695306 1.09
tpch_q16/datafusion:arrow 19424704 18711513 1.04
tpch_q17/datafusion:arrow 71646356 69899457 1.02
tpch_q18/datafusion:arrow 144226514 140633176 1.03
tpch_q19/datafusion:arrow 37154275 39166189 0.95
tpch_q20/datafusion:arrow 🚀 36483883 41317783 0.88
tpch_q21/datafusion:arrow 🚀 155607727 176962079 0.88
tpch_q22/datafusion:arrow 18712503 19700113 0.95
duckdb / vortex-file-compressed (1.030x ➖, 0↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32395856 31626625 1.02
tpch_q02/duckdb:vortex-file-compressed 25192310 24482464 1.03
tpch_q03/duckdb:vortex-file-compressed 31207389 30073171 1.04
tpch_q04/duckdb:vortex-file-compressed 29907944 30457477 0.98
tpch_q05/duckdb:vortex-file-compressed 33308886 33878493 0.98
tpch_q06/duckdb:vortex-file-compressed 10641547 10779802 0.99
tpch_q07/duckdb:vortex-file-compressed 37902655 39167971 0.97
tpch_q08/duckdb:vortex-file-compressed 39763364 38842168 1.02
tpch_q09/duckdb:vortex-file-compressed 78040895 74657438 1.05
tpch_q10/duckdb:vortex-file-compressed 35285303 34414549 1.03
tpch_q11/duckdb:vortex-file-compressed 15082625 14853089 1.02
tpch_q12/duckdb:vortex-file-compressed 21635471 21297445 1.02
tpch_q13/duckdb:vortex-file-compressed 36234521 34845391 1.04
tpch_q14/duckdb:vortex-file-compressed 21451180 20406178 1.05
tpch_q15/duckdb:vortex-file-compressed 17087893 16299415 1.05
tpch_q16/duckdb:vortex-file-compressed 29650207 27865764 1.06
tpch_q17/duckdb:vortex-file-compressed 26224279 24336922 1.08
tpch_q18/duckdb:vortex-file-compressed 52250278 49477725 1.06
tpch_q19/duckdb:vortex-file-compressed 30128096 29347013 1.03
tpch_q20/duckdb:vortex-file-compressed 35579588 33121050 1.07
tpch_q21/duckdb:vortex-file-compressed 108907774 103360131 1.05
tpch_q22/duckdb:vortex-file-compressed 17679403 16994291 1.04
duckdb / vortex-compact (1.040x ➖, 0↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38866562 37569077 1.03
tpch_q02/duckdb:vortex-compact 36905647 34779150 1.06
tpch_q03/duckdb:vortex-compact 32814324 32379676 1.01
tpch_q04/duckdb:vortex-compact 33798562 33947523 1.00
tpch_q05/duckdb:vortex-compact 39429199 36798690 1.07
tpch_q06/duckdb:vortex-compact 14927902 15185436 0.98
tpch_q07/duckdb:vortex-compact 44096883 42491854 1.04
tpch_q08/duckdb:vortex-compact 45660082 44448161 1.03
tpch_q09/duckdb:vortex-compact 86930397 83316736 1.04
tpch_q10/duckdb:vortex-compact 40596352 37734165 1.08
tpch_q11/duckdb:vortex-compact 19927207 18731462 1.06
tpch_q12/duckdb:vortex-compact 35276086 34791480 1.01
tpch_q13/duckdb:vortex-compact 45298285 44322429 1.02
tpch_q14/duckdb:vortex-compact 30386371 28909599 1.05
tpch_q15/duckdb:vortex-compact 20082129 19487624 1.03
tpch_q16/duckdb:vortex-compact 36189483 34506031 1.05
tpch_q17/duckdb:vortex-compact 31096394 30227573 1.03
tpch_q18/duckdb:vortex-compact 52129383 49387827 1.06
tpch_q19/duckdb:vortex-compact 36206619 34395830 1.05
tpch_q20/duckdb:vortex-compact 43742162 41716438 1.05
tpch_q21/duckdb:vortex-compact 116760769 110050057 1.06
tpch_q22/duckdb:vortex-compact 20415898 19123645 1.07
duckdb / parquet (1.007x ➖, 0↑ 2↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77453600 77904769 0.99
tpch_q02/duckdb:parquet 39542784 39163445 1.01
tpch_q03/duckdb:parquet 69925069 75475059 0.93
tpch_q04/duckdb:parquet 48279151 48195010 1.00
tpch_q05/duckdb:parquet 66793928 65846317 1.01
tpch_q06/duckdb:parquet 20618856 20677859 1.00
tpch_q07/duckdb:parquet 68983163 69618058 0.99
tpch_q08/duckdb:parquet 82804972 87016257 0.95
tpch_q09/duckdb:parquet 🚨 160081359 143040764 1.12
tpch_q10/duckdb:parquet 126480726 128877281 0.98
tpch_q11/duckdb:parquet 21712659 21814529 1.00
tpch_q12/duckdb:parquet 46281537 46742834 0.99
tpch_q13/duckdb:parquet 265320857 267999754 0.99
tpch_q14/duckdb:parquet 47690603 51252900 0.93
tpch_q15/duckdb:parquet 🚨 33116644 25243358 1.31
tpch_q16/duckdb:parquet 56751274 59704200 0.95
tpch_q17/duckdb:parquet 54717147 52913813 1.03
tpch_q18/duckdb:parquet 123697742 117119839 1.06
tpch_q19/duckdb:parquet 71621127 73276564 0.98
tpch_q20/duckdb:parquet 64724801 63147224 1.02
tpch_q21/duckdb:parquet 164998135 175174573 0.94
tpch_q22/duckdb:parquet 52706127 51822425 1.02
duckdb / duckdb (1.027x ➖, 1↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16334030 16119770 1.01
tpch_q02/duckdb:duckdb 13091311 12162753 1.08
tpch_q03/duckdb:duckdb 19643537 19253823 1.02
tpch_q04/duckdb:duckdb 20048758 19888393 1.01
tpch_q05/duckdb:duckdb 20675435 19708334 1.05
tpch_q06/duckdb:duckdb 5352708 5321184 1.01
tpch_q07/duckdb:duckdb 23199353 21589142 1.07
tpch_q08/duckdb:duckdb 21491746 21764244 0.99
tpch_q09/duckdb:duckdb 57321379 55209430 1.04
tpch_q10/duckdb:duckdb 44717419 43215510 1.03
tpch_q11/duckdb:duckdb 6068453 5706909 1.06
tpch_q12/duckdb:duckdb 14543342 14095838 1.03
tpch_q13/duckdb:duckdb 38359429 38804773 0.99
tpch_q14/duckdb:duckdb 18606369 17493340 1.06
tpch_q15/duckdb:duckdb 🚀 12280282 13924560 0.88
tpch_q16/duckdb:duckdb 25529423 23718714 1.08
tpch_q17/duckdb:duckdb 14371794 13705029 1.05
tpch_q18/duckdb:duckdb 38968886 38764035 1.01
tpch_q19/duckdb:duckdb 28212113 26443007 1.07
tpch_q20/duckdb:duckdb 23279370 22940364 1.01
tpch_q21/duckdb:duckdb 58028680 55929239 1.04
tpch_q22/duckdb:duckdb 25087021 24470284 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +7.8% -10.4% +20.2% +19.9% 🚨 regression
1 datafusion:vortex-compact +0.9% -10.4% +12.6% +17.6% ➖ noise
1 datafusion:vortex-file-compressed +2.7% -10.4% +14.6% +18.0% ➖ noise
1 duckdb:duckdb +1.3% -10.4% +13.0% +17.6% ➖ noise
1 duckdb:vortex-compact +3.5% -10.4% +15.4% +17.6% ➖ noise
1 duckdb:vortex-file-compressed +2.4% -10.4% +14.3% +18.9% ➖ noise
2 datafusion:arrow -3.6% -2.0% -1.6% +17.6% ➖ noise
2 datafusion:vortex-compact +4.8% -2.0% +6.9% +17.6% ➖ noise
2 datafusion:vortex-file-compressed +3.0% -2.0% +5.1% +17.6% ➖ noise
2 duckdb:duckdb +7.6% -2.0% +9.8% +17.6% ➖ noise
2 duckdb:vortex-compact +6.1% -2.0% +8.3% +17.6% ➖ noise
2 duckdb:vortex-file-compressed +2.9% -2.0% +5.0% +17.6% ➖ noise
3 datafusion:arrow +2.2% -7.7% +10.6% +17.6% ➖ noise
3 datafusion:vortex-compact +4.6% -7.7% +13.3% +17.6% ➖ noise
3 datafusion:vortex-file-compressed +2.8% -7.7% +11.3% +17.6% ➖ noise
3 duckdb:duckdb +2.0% -7.7% +10.5% +17.6% ➖ noise
3 duckdb:vortex-compact +1.3% -7.7% +9.8% +17.6% ➖ noise
3 duckdb:vortex-file-compressed +3.8% -7.7% +12.4% +17.6% ➖ noise
4 datafusion:arrow +0.8% -1.3% +2.1% +17.6% ➖ noise
4 datafusion:vortex-compact +2.8% -1.3% +4.1% +17.6% ➖ noise
4 datafusion:vortex-file-compressed +1.2% -1.3% +2.5% +17.6% ➖ noise
4 duckdb:duckdb +0.8% -1.3% +2.1% +17.6% ➖ noise
4 duckdb:vortex-compact -0.4% -1.3% +0.9% +17.6% ➖ noise
4 duckdb:vortex-file-compressed -1.8% -1.3% -0.5% +17.6% ➖ noise
5 datafusion:arrow +5.8% -2.3% +8.2% +17.6% ➖ noise
5 datafusion:vortex-compact +0.6% -2.3% +2.9% +17.6% ➖ noise
5 datafusion:vortex-file-compressed +5.3% -2.3% +7.7% +17.6% ➖ noise
5 duckdb:duckdb +4.9% -2.3% +7.3% +17.6% ➖ noise
5 duckdb:vortex-compact +7.1% -2.3% +9.6% +17.6% ➖ noise
5 duckdb:vortex-file-compressed -1.7% -2.3% +0.6% +17.6% ➖ noise
6 datafusion:arrow +11.8% -5.2% +18.0% +17.6% 🚨 regression
6 datafusion:vortex-compact +0.7% -5.2% +6.2% +17.8% ➖ noise
6 datafusion:vortex-file-compressed +4.7% -5.2% +10.5% +17.6% ➖ noise
6 duckdb:duckdb +0.6% -5.2% +6.1% +17.6% ➖ noise
6 duckdb:vortex-compact -1.7% -5.2% +3.7% +17.6% ➖ noise
6 duckdb:vortex-file-compressed -1.3% -5.2% +4.2% +17.6% ➖ noise
7 datafusion:arrow +6.4% -0.3% +6.7% +17.6% ➖ noise
7 datafusion:vortex-compact +2.2% -0.3% +2.5% +17.6% ➖ noise
7 datafusion:vortex-file-compressed +5.1% -0.3% +5.3% +17.6% ➖ noise
7 duckdb:duckdb +7.5% -0.3% +7.7% +17.6% ➖ noise
7 duckdb:vortex-compact +3.8% -0.3% +4.0% +17.6% ➖ noise
7 duckdb:vortex-file-compressed -3.2% -0.3% -3.0% +17.6% ➖ noise
8 datafusion:arrow +6.0% -4.0% +10.4% +17.6% ➖ noise
8 datafusion:vortex-compact +1.1% -4.0% +5.3% +17.6% ➖ noise
8 datafusion:vortex-file-compressed +0.6% -4.0% +4.7% +17.6% ➖ noise
8 duckdb:duckdb -1.3% -4.0% +2.8% +17.6% ➖ noise
8 duckdb:vortex-compact +2.7% -4.0% +7.0% +17.6% ➖ noise
8 duckdb:vortex-file-compressed +2.4% -4.0% +6.6% +17.6% ➖ noise
9 datafusion:arrow +0.7% +5.3% -4.4% +17.6% ➖ noise
9 datafusion:vortex-compact +3.2% +5.3% -2.0% +17.6% ➖ noise
9 datafusion:vortex-file-compressed +2.1% +5.3% -3.0% +17.6% ➖ noise
9 duckdb:duckdb +3.8% +5.3% -1.4% +17.6% ➖ noise
9 duckdb:vortex-compact +4.3% +5.3% -0.9% +17.6% ➖ noise
9 duckdb:vortex-file-compressed +4.5% +5.3% -0.7% +17.6% ➖ noise
10 datafusion:arrow -8.4% +0.0% -8.4% +17.6% ➖ noise
10 datafusion:vortex-compact +1.4% +0.0% +1.4% +17.6% ➖ noise
10 datafusion:vortex-file-compressed +1.2% +0.0% +1.2% +17.6% ➖ noise
10 duckdb:duckdb +3.5% +0.0% +3.5% +17.6% ➖ noise
10 duckdb:vortex-compact +7.6% +0.0% +7.6% +17.6% ➖ noise
10 duckdb:vortex-file-compressed +2.5% +0.0% +2.5% +17.6% ➖ noise
11 datafusion:arrow -3.0% -2.9% -0.2% +17.6% ➖ noise
11 datafusion:vortex-compact +0.7% -2.9% +3.7% +17.6% ➖ noise
11 datafusion:vortex-file-compressed +8.0% -2.9% +11.2% +17.6% ➖ noise
11 duckdb:duckdb +6.3% -2.9% +9.5% +17.6% ➖ noise
11 duckdb:vortex-compact +6.4% -2.9% +9.5% +17.6% ➖ noise
11 duckdb:vortex-file-compressed +1.5% -2.9% +4.5% +17.6% ➖ noise
12 datafusion:arrow -1.1% +6.1% -6.8% +19.6% ➖ noise
12 datafusion:vortex-compact +3.4% +6.1% -2.6% +17.6% ➖ noise
12 datafusion:vortex-file-compressed +9.2% +6.1% +2.9% +17.6% ➖ noise
12 duckdb:duckdb +3.2% +6.1% -2.8% +17.6% ➖ noise
12 duckdb:vortex-compact +1.4% +6.1% -4.4% +17.6% ➖ noise
12 duckdb:vortex-file-compressed +1.6% +6.1% -4.3% +17.6% ➖ noise
13 datafusion:arrow -1.3% +1.7% -3.0% +17.6% ➖ noise
13 datafusion:vortex-compact +3.5% +1.7% +1.7% +17.6% ➖ noise
13 datafusion:vortex-file-compressed +5.6% +1.7% +3.8% +17.6% ➖ noise
13 duckdb:duckdb -1.1% +1.7% -2.8% +17.6% ➖ noise
13 duckdb:vortex-compact +2.2% +1.7% +0.5% +17.6% ➖ noise
13 duckdb:vortex-file-compressed +4.0% +1.7% +2.2% +17.6% ➖ noise
14 datafusion:arrow +2.2% -8.1% +11.3% +17.6% ➖ noise
14 datafusion:vortex-compact +2.2% -8.1% +11.2% +17.6% ➖ noise
14 datafusion:vortex-file-compressed -0.4% -8.1% +8.4% +17.6% ➖ noise
14 duckdb:duckdb +6.4% -8.1% +15.8% +19.0% ➖ noise
14 duckdb:vortex-compact +5.1% -8.1% +14.4% +17.6% ➖ noise
14 duckdb:vortex-file-compressed +5.1% -8.1% +14.4% +17.6% ➖ noise
15 datafusion:arrow +8.9% +17.0% -6.9% +17.6% ➖ noise
15 datafusion:vortex-compact +1.9% +17.0% -12.9% +17.6% ➖ noise
15 datafusion:vortex-file-compressed +4.6% +17.0% -10.6% +17.6% ➖ noise
15 duckdb:duckdb -11.8% +17.0% -24.6% +25.6% ✅ faster
15 duckdb:vortex-compact +3.1% +17.0% -11.9% +17.6% ➖ noise
15 duckdb:vortex-file-compressed +4.8% +17.0% -10.4% +17.6% ➖ noise
16 datafusion:arrow +3.8% -6.5% +11.0% +17.6% ➖ noise
16 datafusion:vortex-compact +5.4% -6.5% +12.8% +17.6% ➖ noise
16 datafusion:vortex-file-compressed -3.7% -6.5% +3.0% +17.6% ➖ noise
16 duckdb:duckdb +7.6% -6.5% +15.1% +17.6% ➖ noise
16 duckdb:vortex-compact +4.9% -6.5% +12.2% +17.6% ➖ noise
16 duckdb:vortex-file-compressed +6.4% -6.5% +13.8% +17.6% ➖ noise
17 datafusion:arrow +2.5% +2.2% +0.3% +17.6% ➖ noise
17 datafusion:vortex-compact -1.4% +2.2% -3.5% +17.6% ➖ noise
17 datafusion:vortex-file-compressed +4.6% +2.2% +2.4% +17.6% ➖ noise
17 duckdb:duckdb +4.9% +2.2% +2.6% +17.6% ➖ noise
17 duckdb:vortex-compact +2.9% +2.2% +0.7% +17.6% ➖ noise
17 duckdb:vortex-file-compressed +7.8% +2.2% +5.5% +17.6% ➖ noise
18 datafusion:arrow +2.6% +1.0% +1.5% +17.6% ➖ noise
18 datafusion:vortex-compact +2.5% +1.0% +1.4% +17.6% ➖ noise
18 datafusion:vortex-file-compressed -2.9% +1.0% -3.9% +17.6% ➖ noise
18 duckdb:duckdb +0.5% +1.0% -0.5% +17.6% ➖ noise
18 duckdb:vortex-compact +5.6% +1.0% +4.5% +17.6% ➖ noise
18 duckdb:vortex-file-compressed +5.6% +1.0% +4.5% +17.6% ➖ noise
19 datafusion:arrow -5.1% -12.7% +8.6% +17.6% ➖ noise
19 datafusion:vortex-compact +5.6% -12.7% +20.9% +17.6% 🚨 regression
19 datafusion:vortex-file-compressed +2.3% -12.7% +17.2% +17.6% ➖ noise
19 duckdb:duckdb +6.7% -12.7% +22.2% +17.6% 🚨 regression
19 duckdb:vortex-compact +5.3% -12.7% +20.5% +17.6% 🚨 regression
19 duckdb:vortex-file-compressed +2.7% -12.7% +17.6% +17.6% ➖ noise
20 datafusion:arrow -11.7% +3.0% -14.3% +17.6% ➖ noise
20 datafusion:vortex-compact +1.5% +3.0% -1.5% +17.6% ➖ noise
20 datafusion:vortex-file-compressed +2.4% +3.0% -0.6% +17.6% ➖ noise
20 duckdb:duckdb +1.5% +3.0% -1.5% +17.6% ➖ noise
20 duckdb:vortex-compact +4.9% +3.0% +1.8% +17.6% ➖ noise
20 duckdb:vortex-file-compressed +7.4% +3.0% +4.3% +17.6% ➖ noise
21 datafusion:arrow -12.1% -1.9% -10.4% +17.6% ➖ noise
21 datafusion:vortex-compact +5.4% -1.9% +7.4% +17.6% ➖ noise
21 datafusion:vortex-file-compressed +1.6% -1.9% +3.6% +17.6% ➖ noise
21 duckdb:duckdb +3.8% -1.9% +5.7% +17.6% ➖ noise
21 duckdb:vortex-compact +6.1% -1.9% +8.1% +17.6% ➖ noise
21 duckdb:vortex-file-compressed +5.4% -1.9% +7.4% +17.6% ➖ noise
22 datafusion:arrow -5.0% +1.1% -6.1% +17.6% ➖ noise
22 datafusion:vortex-compact -0.5% +1.1% -1.6% +17.6% ➖ noise
22 datafusion:vortex-file-compressed +5.4% +1.1% +4.2% +17.6% ➖ noise
22 duckdb:duckdb +2.5% +1.1% +1.4% +17.6% ➖ noise
22 duckdb:vortex-compact +6.8% +1.1% +5.6% +17.6% ➖ noise
22 duckdb:vortex-file-compressed +4.0% +1.1% +2.9% +17.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Vortex (geomean): 1.001x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.2%


datafusion / vortex-file-compressed (1.005x ➖, 0↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 25643088 24662903 1.04
tpcds_q02/datafusion:vortex-file-compressed 45660682 45815205 1.00
tpcds_q03/datafusion:vortex-file-compressed 15225064 15142535 1.01
tpcds_q04/datafusion:vortex-file-compressed 251804764 255360895 0.99
tpcds_q05/datafusion:vortex-file-compressed 41982311 41729700 1.01
tpcds_q06/datafusion:vortex-file-compressed 61786351 59384728 1.04
tpcds_q07/datafusion:vortex-file-compressed 42734958 40419892 1.06
tpcds_q08/datafusion:vortex-file-compressed 28563992 29589750 0.97
tpcds_q09/datafusion:vortex-file-compressed 42775871 43270776 0.99
tpcds_q10/datafusion:vortex-file-compressed 38043465 38362953 0.99
tpcds_q11/datafusion:vortex-file-compressed 128510869 132255433 0.97
tpcds_q12/datafusion:vortex-file-compressed 19617525 19417604 1.01
tpcds_q13/datafusion:vortex-file-compressed 44569585 44167475 1.01
tpcds_q14/datafusion:vortex-file-compressed 168188306 168123823 1.00
tpcds_q15/datafusion:vortex-file-compressed 28461450 27718717 1.03
tpcds_q16/datafusion:vortex-file-compressed 29085452 27880956 1.04
tpcds_q17/datafusion:vortex-file-compressed 63885948 61917725 1.03
tpcds_q18/datafusion:vortex-file-compressed 67174034 69416784 0.97
tpcds_q19/datafusion:vortex-file-compressed 21611014 21975749 0.98
tpcds_q20/datafusion:vortex-file-compressed 21293067 20834908 1.02
tpcds_q21/datafusion:vortex-file-compressed 36742832 35104793 1.05
tpcds_q22/datafusion:vortex-file-compressed 151163353 139620696 1.08
tpcds_q23/datafusion:vortex-file-compressed 152107520 154785481 0.98
tpcds_q24/datafusion:vortex-file-compressed 82268071 83176614 0.99
tpcds_q25/datafusion:vortex-file-compressed 65849952 66342758 0.99
tpcds_q26/datafusion:vortex-file-compressed 33525286 33163893 1.01
tpcds_q27/datafusion:vortex-file-compressed 100386842 99921239 1.00
tpcds_q28/datafusion:vortex-file-compressed 41787288 40804728 1.02
tpcds_q29/datafusion:vortex-file-compressed 63052243 62033404 1.02
tpcds_q30/datafusion:vortex-file-compressed 22919313 23290302 0.98
tpcds_q31/datafusion:vortex-file-compressed 73411705 72065499 1.02
tpcds_q32/datafusion:vortex-file-compressed 20572494 20621690 1.00
tpcds_q33/datafusion:vortex-file-compressed 31197374 29445647 1.06
tpcds_q34/datafusion:vortex-file-compressed 25283136 23933898 1.06
tpcds_q35/datafusion:vortex-file-compressed 45142878 44005090 1.03
tpcds_q36/datafusion:vortex-file-compressed 58064769 57066375 1.02
tpcds_q37/datafusion:vortex-file-compressed 25694714 25208527 1.02
tpcds_q38/datafusion:vortex-file-compressed 43993075 43909369 1.00
tpcds_q39/datafusion:vortex-file-compressed 104347422 104069723 1.00
tpcds_q40/datafusion:vortex-file-compressed 32918405 32787380 1.00
tpcds_q41/datafusion:vortex-file-compressed 16327331 15314061 1.07
tpcds_q42/datafusion:vortex-file-compressed 14356574 13378725 1.07
tpcds_q43/datafusion:vortex-file-compressed 19464300 18516228 1.05
tpcds_q44/datafusion:vortex-file-compressed 31792624 31352509 1.01
tpcds_q45/datafusion:vortex-file-compressed 28186946 26993760 1.04
tpcds_q46/datafusion:vortex-file-compressed 34515854 35265757 0.98
tpcds_q47/datafusion:vortex-file-compressed 132501603 132525751 1.00
tpcds_q48/datafusion:vortex-file-compressed 37846646 38049088 0.99
tpcds_q49/datafusion:vortex-file-compressed 59626186 57277708 1.04
tpcds_q50/datafusion:vortex-file-compressed 39838254 38931341 1.02
tpcds_q51/datafusion:vortex-file-compressed 89412274 90128204 0.99
tpcds_q52/datafusion:vortex-file-compressed 14123581 13821657 1.02
tpcds_q53/datafusion:vortex-file-compressed 21444285 21069114 1.02
tpcds_q54/datafusion:vortex-file-compressed 34659267 34336838 1.01
tpcds_q55/datafusion:vortex-file-compressed 14819370 13499409 1.10
tpcds_q56/datafusion:vortex-file-compressed 30113661 29030954 1.04
tpcds_q57/datafusion:vortex-file-compressed 107629275 108549043 0.99
tpcds_q58/datafusion:vortex-file-compressed 51153317 54063827 0.95
tpcds_q59/datafusion:vortex-file-compressed 58768154 57084947 1.03
tpcds_q60/datafusion:vortex-file-compressed 28652574 29527199 0.97
tpcds_q61/datafusion:vortex-file-compressed 39878813 41094497 0.97
tpcds_q62/datafusion:vortex-file-compressed 21627966 22560388 0.96
tpcds_q63/datafusion:vortex-file-compressed 20608957 21505866 0.96
tpcds_q64/datafusion:vortex-file-compressed 409307068 418979892 0.98
tpcds_q65/datafusion:vortex-file-compressed 39703900 39677653 1.00
tpcds_q66/datafusion:vortex-file-compressed 73242331 71757301 1.02
tpcds_q67/datafusion:vortex-file-compressed 143646083 145641243 0.99
tpcds_q68/datafusion:vortex-file-compressed 32066319 32825254 0.98
tpcds_q69/datafusion:vortex-file-compressed 35643615 36366629 0.98
tpcds_q70/datafusion:vortex-file-compressed 83913043 86095360 0.97
tpcds_q71/datafusion:vortex-file-compressed 23679737 22693331 1.04
tpcds_q72/datafusion:vortex-file-compressed 2114363672 2113087204 1.00
tpcds_q73/datafusion:vortex-file-compressed 22206792 22980004 0.97
tpcds_q74/datafusion:vortex-file-compressed 79940473 80755581 0.99
tpcds_q75/datafusion:vortex-file-compressed 105773746 105685903 1.00
tpcds_q76/datafusion:vortex-file-compressed 23538079 23338207 1.01
tpcds_q77/datafusion:vortex-file-compressed 41062821 38948567 1.05
tpcds_q78/datafusion:vortex-file-compressed 122398016 122120355 1.00
tpcds_q79/datafusion:vortex-file-compressed 27695230 27748504 1.00
tpcds_q80/datafusion:vortex-file-compressed 93329343 94582876 0.99
tpcds_q81/datafusion:vortex-file-compressed 23078483 24462660 0.94
tpcds_q82/datafusion:vortex-file-compressed 26062457 26128712 1.00
tpcds_q83/datafusion:vortex-file-compressed 33518699 33582257 1.00
tpcds_q84/datafusion:vortex-file-compressed 12587972 12621155 1.00
tpcds_q85/datafusion:vortex-file-compressed 96458878 97291737 0.99
tpcds_q86/datafusion:vortex-file-compressed 15861929 16670587 0.95
tpcds_q87/datafusion:vortex-file-compressed 42986397 42901691 1.00
tpcds_q88/datafusion:vortex-file-compressed 55281811 55279961 1.00
tpcds_q89/datafusion:vortex-file-compressed 25879666 25241769 1.03
tpcds_q90/datafusion:vortex-file-compressed 15121101 14463212 1.05
tpcds_q91/datafusion:vortex-file-compressed 18604250 18275846 1.02
tpcds_q92/datafusion:vortex-file-compressed 17599201 17964228 0.98
tpcds_q93/datafusion:vortex-file-compressed 32299685 33246978 0.97
tpcds_q94/datafusion:vortex-file-compressed 22497016 22812920 0.99
tpcds_q95/datafusion:vortex-file-compressed 60898393 59668899 1.02
tpcds_q96/datafusion:vortex-file-compressed 13331848 13665716 0.98
tpcds_q97/datafusion:vortex-file-compressed 32753672 34655182 0.95
tpcds_q98/datafusion:vortex-file-compressed 23654518 24724983 0.96
tpcds_q99/datafusion:vortex-file-compressed 32150059 32350420 0.99
datafusion / vortex-compact (1.007x ➖, 1↑ 3↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 25654003 25435107 1.01
tpcds_q02/datafusion:vortex-compact 52447053 53360232 0.98
tpcds_q03/datafusion:vortex-compact 19797371 19197214 1.03
tpcds_q04/datafusion:vortex-compact 303252327 299215839 1.01
tpcds_q05/datafusion:vortex-compact 47336846 46784092 1.01
tpcds_q06/datafusion:vortex-compact 60032408 63612257 0.94
tpcds_q07/datafusion:vortex-compact 51954704 52262472 0.99
tpcds_q08/datafusion:vortex-compact 35141056 35791579 0.98
tpcds_q09/datafusion:vortex-compact 62313001 61837223 1.01
tpcds_q10/datafusion:vortex-compact 50220728 50383053 1.00
tpcds_q11/datafusion:vortex-compact 150374560 143863535 1.05
tpcds_q12/datafusion:vortex-compact 🚨 25887008 22978290 1.13
tpcds_q13/datafusion:vortex-compact 93762618 91180443 1.03
tpcds_q14/datafusion:vortex-compact 194747177 199084038 0.98
tpcds_q15/datafusion:vortex-compact 30004121 29750621 1.01
tpcds_q16/datafusion:vortex-compact 31921320 31896790 1.00
tpcds_q17/datafusion:vortex-compact 75356245 77363795 0.97
tpcds_q18/datafusion:vortex-compact 78211174 77141867 1.01
tpcds_q19/datafusion:vortex-compact 29446469 28931731 1.02
tpcds_q20/datafusion:vortex-compact 25642821 26445984 0.97
tpcds_q21/datafusion:vortex-compact 40079146 40773125 0.98
tpcds_q22/datafusion:vortex-compact 125919091 117332841 1.07
tpcds_q23/datafusion:vortex-compact 163110830 166759335 0.98
tpcds_q24/datafusion:vortex-compact 95632570 100601614 0.95
tpcds_q25/datafusion:vortex-compact 78523244 78940257 0.99
tpcds_q26/datafusion:vortex-compact 43591455 43472062 1.00
tpcds_q27/datafusion:vortex-compact 124120035 122247299 1.02
tpcds_q28/datafusion:vortex-compact 80152443 77523045 1.03
tpcds_q29/datafusion:vortex-compact 74569422 73883736 1.01
tpcds_q30/datafusion:vortex-compact 28670734 27439036 1.04
tpcds_q31/datafusion:vortex-compact 95617863 95672185 1.00
tpcds_q32/datafusion:vortex-compact 26457327 25363433 1.04
tpcds_q33/datafusion:vortex-compact 36543386 36968341 0.99
tpcds_q34/datafusion:vortex-compact 31780420 33012463 0.96
tpcds_q35/datafusion:vortex-compact 50670872 51736566 0.98
tpcds_q36/datafusion:vortex-compact 75827263 72807104 1.04
tpcds_q37/datafusion:vortex-compact 40664677 40822114 1.00
tpcds_q38/datafusion:vortex-compact 52049269 50038010 1.04
tpcds_q39/datafusion:vortex-compact 113067138 110367862 1.02
tpcds_q40/datafusion:vortex-compact 37017575 37650978 0.98
tpcds_q41/datafusion:vortex-compact 17340608 17889517 0.97
tpcds_q42/datafusion:vortex-compact 18377036 17856001 1.03
tpcds_q43/datafusion:vortex-compact 25162396 25002831 1.01
tpcds_q44/datafusion:vortex-compact 47993453 48498103 0.99
tpcds_q45/datafusion:vortex-compact 32842315 30894291 1.06
tpcds_q46/datafusion:vortex-compact 44985807 44435290 1.01
tpcds_q47/datafusion:vortex-compact 150426314 148186389 1.02
tpcds_q48/datafusion:vortex-compact 🚀 71778237 81534826 0.88
tpcds_q49/datafusion:vortex-compact 69025851 68337502 1.01
tpcds_q50/datafusion:vortex-compact 47611305 47056199 1.01
tpcds_q51/datafusion:vortex-compact 96126808 93243576 1.03
tpcds_q52/datafusion:vortex-compact 18799055 18297831 1.03
tpcds_q53/datafusion:vortex-compact 27419876 27346996 1.00
tpcds_q54/datafusion:vortex-compact 40888051 41000121 1.00
tpcds_q55/datafusion:vortex-compact 19281909 18316645 1.05
tpcds_q56/datafusion:vortex-compact 35369984 35551414 0.99
tpcds_q57/datafusion:vortex-compact 110880469 115043016 0.96
tpcds_q58/datafusion:vortex-compact 63689411 63884985 1.00
tpcds_q59/datafusion:vortex-compact 69345197 68472506 1.01
tpcds_q60/datafusion:vortex-compact 34753498 35156419 0.99
tpcds_q61/datafusion:vortex-compact 53107668 54269207 0.98
tpcds_q62/datafusion:vortex-compact 🚨 31930603 27145418 1.18
tpcds_q63/datafusion:vortex-compact 27801679 27800782 1.00
tpcds_q64/datafusion:vortex-compact 452122665 451304545 1.00
tpcds_q65/datafusion:vortex-compact 54006275 52938171 1.02
tpcds_q66/datafusion:vortex-compact 78005762 74317453 1.05
tpcds_q67/datafusion:vortex-compact 150955901 146745591 1.03
tpcds_q68/datafusion:vortex-compact 47775770 44002032 1.09
tpcds_q69/datafusion:vortex-compact 46841666 46684673 1.00
tpcds_q70/datafusion:vortex-compact 97364204 97408631 1.00
tpcds_q71/datafusion:vortex-compact 29379811 29773379 0.99
tpcds_q72/datafusion:vortex-compact 2106864358 2123341653 0.99
tpcds_q73/datafusion:vortex-compact 30732090 30487659 1.01
tpcds_q74/datafusion:vortex-compact 95229068 92536934 1.03
tpcds_q75/datafusion:vortex-compact 124043244 123247959 1.01
tpcds_q76/datafusion:vortex-compact 31695383 32607177 0.97
tpcds_q77/datafusion:vortex-compact 50359085 50800149 0.99
tpcds_q78/datafusion:vortex-compact 137919618 137540810 1.00
tpcds_q79/datafusion:vortex-compact 38198356 38201359 1.00
tpcds_q80/datafusion:vortex-compact 102389600 102649265 1.00
tpcds_q81/datafusion:vortex-compact 27479254 27192087 1.01
tpcds_q82/datafusion:vortex-compact 41781424 41248903 1.01
tpcds_q83/datafusion:vortex-compact 33534589 33966122 0.99
tpcds_q84/datafusion:vortex-compact 13770396 14795381 0.93
tpcds_q85/datafusion:vortex-compact 133868393 129484343 1.03
tpcds_q86/datafusion:vortex-compact 🚨 21693534 19646243 1.10
tpcds_q87/datafusion:vortex-compact 51906224 51377474 1.01
tpcds_q88/datafusion:vortex-compact 75281295 75897271 0.99
tpcds_q89/datafusion:vortex-compact 30885449 30690217 1.01
tpcds_q90/datafusion:vortex-compact 15155652 15441736 0.98
tpcds_q91/datafusion:vortex-compact 32993211 34164075 0.97
tpcds_q92/datafusion:vortex-compact 24079473 23583618 1.02
tpcds_q93/datafusion:vortex-compact 37584421 38384637 0.98
tpcds_q94/datafusion:vortex-compact 25216520 26726132 0.94
tpcds_q95/datafusion:vortex-compact 65598554 63907903 1.03
tpcds_q96/datafusion:vortex-compact 17201931 17248266 1.00
tpcds_q97/datafusion:vortex-compact 36941673 36116085 1.02
tpcds_q98/datafusion:vortex-compact 29919995 29861467 1.00
tpcds_q99/datafusion:vortex-compact 31235489 30453394 1.03
datafusion / parquet (0.999x ➖, 0↑ 3↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 30225078 30877284 0.98
tpcds_q02/datafusion:parquet 41202747 43207212 0.95
tpcds_q03/datafusion:parquet 12903547 13264105 0.97
tpcds_q04/datafusion:parquet 258274809 261485662 0.99
tpcds_q05/datafusion:parquet 38415536 40333088 0.95
tpcds_q06/datafusion:parquet 60646320 58203581 1.04
tpcds_q07/datafusion:parquet 74878157 74026468 1.01
tpcds_q08/datafusion:parquet 25585329 24897683 1.03
tpcds_q09/datafusion:parquet 🚨 48538825 42961640 1.13
tpcds_q10/datafusion:parquet 72426323 66908537 1.08
tpcds_q11/datafusion:parquet 140626849 141532291 0.99
tpcds_q12/datafusion:parquet 17800210 17388250 1.02
tpcds_q13/datafusion:parquet 74522454 72991718 1.02
tpcds_q14/datafusion:parquet 161439842 155247040 1.04
tpcds_q15/datafusion:parquet 21218642 21484752 0.99
tpcds_q16/datafusion:parquet 22416374 24140158 0.93
tpcds_q17/datafusion:parquet 60552335 65702398 0.92
tpcds_q18/datafusion:parquet 111705075 114670881 0.97
tpcds_q19/datafusion:parquet 21867756 22385208 0.98
tpcds_q20/datafusion:parquet 16471376 16149494 1.02
tpcds_q21/datafusion:parquet 18274724 17745289 1.03
tpcds_q22/datafusion:parquet 🚨 156699982 138695434 1.13
tpcds_q23/datafusion:parquet 141233797 146964296 0.96
tpcds_q24/datafusion:parquet 90588208 90483283 1.00
tpcds_q25/datafusion:parquet 64045579 63878664 1.00
tpcds_q26/datafusion:parquet 64615838 64916422 1.00
tpcds_q27/datafusion:parquet 140475565 141757742 0.99
tpcds_q28/datafusion:parquet 44020470 45725156 0.96
tpcds_q29/datafusion:parquet 63004709 63648388 0.99
tpcds_q30/datafusion:parquet 33675666 35176692 0.96
tpcds_q31/datafusion:parquet 63445252 61826405 1.03
tpcds_q32/datafusion:parquet 17842165 17879844 1.00
tpcds_q33/datafusion:parquet 26466728 26291411 1.01
tpcds_q34/datafusion:parquet 20185236 20918707 0.96
tpcds_q35/datafusion:parquet 66773489 67349863 0.99
tpcds_q36/datafusion:parquet 54034426 55766835 0.97
tpcds_q37/datafusion:parquet 18488470 18100175 1.02
tpcds_q38/datafusion:parquet 38900926 39688030 0.98
tpcds_q39/datafusion:parquet 71653779 72809048 0.98
tpcds_q40/datafusion:parquet 23106775 25347333 0.91
tpcds_q41/datafusion:parquet 12946406 13023555 0.99
tpcds_q42/datafusion:parquet 11562320 11431875 1.01
tpcds_q43/datafusion:parquet 16516915 16675976 0.99
tpcds_q44/datafusion:parquet 32975296 31961128 1.03
tpcds_q45/datafusion:parquet 27198380 27339576 0.99
tpcds_q46/datafusion:parquet 31138548 31524001 0.99
tpcds_q47/datafusion:parquet 124253605 124931394 0.99
tpcds_q48/datafusion:parquet 67994339 67222282 1.01
tpcds_q49/datafusion:parquet 54155410 54266321 1.00
tpcds_q50/datafusion:parquet 42015399 42233593 0.99
tpcds_q51/datafusion:parquet 82652582 83449149 0.99
tpcds_q52/datafusion:parquet 11535342 11620493 0.99
tpcds_q53/datafusion:parquet 17403337 17185021 1.01
tpcds_q54/datafusion:parquet 34042990 32957761 1.03
tpcds_q55/datafusion:parquet 10972627 11051987 0.99
tpcds_q56/datafusion:parquet 26000602 27148532 0.96
tpcds_q57/datafusion:parquet 95242608 91160189 1.04
tpcds_q58/datafusion:parquet 49312032 49860991 0.99
tpcds_q59/datafusion:parquet 56237871 55978393 1.00
tpcds_q60/datafusion:parquet 26409999 27263554 0.97
tpcds_q61/datafusion:parquet 41843188 41750329 1.00
tpcds_q62/datafusion:parquet 🚨 24683024 20447591 1.21
tpcds_q63/datafusion:parquet 17582920 17705524 0.99
tpcds_q64/datafusion:parquet 508362852 506642359 1.00
tpcds_q65/datafusion:parquet 37365255 36660028 1.02
tpcds_q66/datafusion:parquet 66895079 69666416 0.96
tpcds_q67/datafusion:parquet 144261178 142699298 1.01
tpcds_q68/datafusion:parquet 30405055 31423242 0.97
tpcds_q69/datafusion:parquet 63663985 63641499 1.00
tpcds_q70/datafusion:parquet 86992384 86243829 1.01
tpcds_q71/datafusion:parquet 21470249 21741381 0.99
tpcds_q72/datafusion:parquet 593518711 599553178 0.99
tpcds_q73/datafusion:parquet 20568788 19726007 1.04
tpcds_q74/datafusion:parquet 78576259 80724670 0.97
tpcds_q75/datafusion:parquet 96920510 96309167 1.01
tpcds_q76/datafusion:parquet 29443298 29504953 1.00
tpcds_q77/datafusion:parquet 37413976 37031804 1.01
tpcds_q78/datafusion:parquet 110891118 112866685 0.98
tpcds_q79/datafusion:parquet 26286653 25489145 1.03
tpcds_q80/datafusion:parquet 76816500 78800639 0.97
tpcds_q81/datafusion:parquet 30726112 33340703 0.92
tpcds_q82/datafusion:parquet 18546297 19202869 0.97
tpcds_q83/datafusion:parquet 35167217 35202108 1.00
tpcds_q84/datafusion:parquet 38221000 38253211 1.00
tpcds_q85/datafusion:parquet 147656065 146353252 1.01
tpcds_q86/datafusion:parquet 15448850 15193794 1.02
tpcds_q87/datafusion:parquet 38934988 39516447 0.99
tpcds_q88/datafusion:parquet 57885443 56367592 1.03
tpcds_q89/datafusion:parquet 20671286 21008270 0.98
tpcds_q90/datafusion:parquet 13791144 13688977 1.01
tpcds_q91/datafusion:parquet 57273763 56439770 1.01
tpcds_q92/datafusion:parquet 17774900 17630593 1.01
tpcds_q93/datafusion:parquet 30727533 32498213 0.95
tpcds_q94/datafusion:parquet 20093655 19659467 1.02
tpcds_q95/datafusion:parquet 58937986 59933811 0.98
tpcds_q96/datafusion:parquet 11691881 11350913 1.03
tpcds_q97/datafusion:parquet 29060891 28708071 1.01
tpcds_q98/datafusion:parquet 20253971 21301771 0.95
tpcds_q99/datafusion:parquet 25925688 25440110 1.02
duckdb / vortex-file-compressed (0.999x ➖, 0↑ 3↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 21378910 20944183 1.02
tpcds_q02/duckdb:vortex-file-compressed 34422092 36380042 0.95
tpcds_q03/duckdb:vortex-file-compressed 32676856 31424562 1.04
tpcds_q04/duckdb:vortex-file-compressed 103387141 105062653 0.98
tpcds_q05/duckdb:vortex-file-compressed 37421411 35855720 1.04
tpcds_q06/duckdb:vortex-file-compressed 30817631 31410559 0.98
tpcds_q07/duckdb:vortex-file-compressed 18928737 19188109 0.99
tpcds_q08/duckdb:vortex-file-compressed 27777062 26790322 1.04
tpcds_q09/duckdb:vortex-file-compressed 37096735 37737070 0.98
tpcds_q10/duckdb:vortex-file-compressed 38394949 37987205 1.01
tpcds_q11/duckdb:vortex-file-compressed 60671336 60425547 1.00
tpcds_q12/duckdb:vortex-file-compressed 13663876 13815522 0.99
tpcds_q13/duckdb:vortex-file-compressed 32082174 33853121 0.95
tpcds_q14/duckdb:vortex-file-compressed 102275901 107532057 0.95
tpcds_q15/duckdb:vortex-file-compressed 26339924 25378967 1.04
tpcds_q16/duckdb:vortex-file-compressed 25627309 26316134 0.97
tpcds_q17/duckdb:vortex-file-compressed 41861611 42672272 0.98
tpcds_q18/duckdb:vortex-file-compressed 47066190 46083966 1.02
tpcds_q19/duckdb:vortex-file-compressed 33438632 32683324 1.02
tpcds_q20/duckdb:vortex-file-compressed 15415783 14681573 1.05
tpcds_q21/duckdb:vortex-file-compressed 17633674 16669775 1.06
tpcds_q22/duckdb:vortex-file-compressed 73733030 71552549 1.03
tpcds_q23/duckdb:vortex-file-compressed 106148775 103580234 1.02
tpcds_q24/duckdb:vortex-file-compressed 48332081 49239945 0.98
tpcds_q25/duckdb:vortex-file-compressed 47516070 47623852 1.00
tpcds_q26/duckdb:vortex-file-compressed 40658033 39770231 1.02
tpcds_q27/duckdb:vortex-file-compressed 46084218 46149252 1.00
tpcds_q28/duckdb:vortex-file-compressed 34226828 35122812 0.97
tpcds_q29/duckdb:vortex-file-compressed 41296808 41063528 1.01
tpcds_q30/duckdb:vortex-file-compressed 23738523 23317948 1.02
tpcds_q31/duckdb:vortex-file-compressed 36224847 35920178 1.01
tpcds_q32/duckdb:vortex-file-compressed 13505828 13421866 1.01
tpcds_q33/duckdb:vortex-file-compressed 23549511 23919798 0.98
tpcds_q34/duckdb:vortex-file-compressed 23080316 23409255 0.99
tpcds_q35/duckdb:vortex-file-compressed 62968126 64710136 0.97
tpcds_q36/duckdb:vortex-file-compressed 25094982 24290924 1.03
tpcds_q37/duckdb:vortex-file-compressed 15018101 15342092 0.98
tpcds_q38/duckdb:vortex-file-compressed 34650910 35499688 0.98
tpcds_q39/duckdb:vortex-file-compressed 33896033 34704173 0.98
tpcds_q40/duckdb:vortex-file-compressed 19246656 19713655 0.98
tpcds_q41/duckdb:vortex-file-compressed 12887127 12784582 1.01
tpcds_q42/duckdb:vortex-file-compressed 12023304 12602440 0.95
tpcds_q43/duckdb:vortex-file-compressed 23422727 22883197 1.02
tpcds_q44/duckdb:vortex-file-compressed 21019332 20379028 1.03
tpcds_q45/duckdb:vortex-file-compressed 28252520 30041818 0.94
tpcds_q46/duckdb:vortex-file-compressed 49753086 50782636 0.98
tpcds_q47/duckdb:vortex-file-compressed 45269862 47366782 0.96
tpcds_q48/duckdb:vortex-file-compressed 29113129 29882175 0.97
tpcds_q49/duckdb:vortex-file-compressed 🚨 37785334 34181271 1.11
tpcds_q50/duckdb:vortex-file-compressed 33754375 33454701 1.01
tpcds_q51/duckdb:vortex-file-compressed 96295345 97611227 0.99
tpcds_q52/duckdb:vortex-file-compressed 12644684 12415139 1.02
tpcds_q53/duckdb:vortex-file-compressed 22693991 22638637 1.00
tpcds_q54/duckdb:vortex-file-compressed 26950370 27456390 0.98
tpcds_q55/duckdb:vortex-file-compressed 12631078 12914998 0.98
tpcds_q56/duckdb:vortex-file-compressed 23493109 23845135 0.99
tpcds_q57/duckdb:vortex-file-compressed 39624873 39086523 1.01
tpcds_q58/duckdb:vortex-file-compressed 29903352 30977189 0.97
tpcds_q59/duckdb:vortex-file-compressed 66484843 68848133 0.97
tpcds_q60/duckdb:vortex-file-compressed 25099581 25814500 0.97
tpcds_q61/duckdb:vortex-file-compressed 🚨 36074157 29999655 1.20
tpcds_q62/duckdb:vortex-file-compressed 17480346 16228546 1.08
tpcds_q63/duckdb:vortex-file-compressed 20369542 21312344 0.96
tpcds_q64/duckdb:vortex-file-compressed 83227179 83831020 0.99
tpcds_q65/duckdb:vortex-file-compressed 21846056 21655580 1.01
tpcds_q66/duckdb:vortex-file-compressed 28252447 29500105 0.96
tpcds_q67/duckdb:vortex-file-compressed 137580383 137469498 1.00
tpcds_q68/duckdb:vortex-file-compressed 39433962 40142778 0.98
tpcds_q69/duckdb:vortex-file-compressed 41060948 41513009 0.99
tpcds_q70/duckdb:vortex-file-compressed 26343712 25092762 1.05
tpcds_q71/duckdb:vortex-file-compressed 20289849 20168880 1.01
tpcds_q72/duckdb:vortex-file-compressed 172766596 175903030 0.98
tpcds_q73/duckdb:vortex-file-compressed 23263869 22779027 1.02
tpcds_q74/duckdb:vortex-file-compressed 73451182 70753815 1.04
tpcds_q75/duckdb:vortex-file-compressed 58584155 55432283 1.06
tpcds_q76/duckdb:vortex-file-compressed 17639678 17770927 0.99
tpcds_q77/duckdb:vortex-file-compressed 24263194 26514467 0.92
tpcds_q78/duckdb:vortex-file-compressed 75701774 76172348 0.99
tpcds_q79/duckdb:vortex-file-compressed 31759212 31798296 1.00
tpcds_q80/duckdb:vortex-file-compressed 48245638 45955589 1.05
tpcds_q81/duckdb:vortex-file-compressed 26677920 27413830 0.97
tpcds_q82/duckdb:vortex-file-compressed 16252006 16279127 1.00
tpcds_q83/duckdb:vortex-file-compressed 23469344 23488296 1.00
tpcds_q84/duckdb:vortex-file-compressed 19081886 19329844 0.99
tpcds_q85/duckdb:vortex-file-compressed 43063496 44790113 0.96
tpcds_q86/duckdb:vortex-file-compressed 16995268 15976179 1.06
tpcds_q87/duckdb:vortex-file-compressed 39102993 41384623 0.94
tpcds_q88/duckdb:vortex-file-compressed 31998570 32154174 1.00
tpcds_q89/duckdb:vortex-file-compressed 22227777 21759526 1.02
tpcds_q90/duckdb:vortex-file-compressed 12459647 12269829 1.02
tpcds_q91/duckdb:vortex-file-compressed 30576481 31232454 0.98
tpcds_q92/duckdb:vortex-file-compressed 🚨 21499432 19398352 1.11
tpcds_q93/duckdb:vortex-file-compressed 25362178 28068239 0.90
tpcds_q94/duckdb:vortex-file-compressed 22462645 21734104 1.03
tpcds_q95/duckdb:vortex-file-compressed 144731979 151590567 0.95
tpcds_q96/duckdb:vortex-file-compressed 12943302 14069378 0.92
tpcds_q97/duckdb:vortex-file-compressed 37658389 38233042 0.98
tpcds_q98/duckdb:vortex-file-compressed 17536203 17754371 0.99
tpcds_q99/duckdb:vortex-file-compressed 26697803 26687739 1.00
duckdb / vortex-compact (0.993x ➖, 1↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 22473872 22867741 0.98
tpcds_q02/duckdb:vortex-compact 🚀 39529965 45041260 0.88
tpcds_q03/duckdb:vortex-compact 57374452 56828153 1.01
tpcds_q04/duckdb:vortex-compact 120310671 126827908 0.95
tpcds_q05/duckdb:vortex-compact 48477310 50671074 0.96
tpcds_q06/duckdb:vortex-compact 38923866 40137273 0.97
tpcds_q07/duckdb:vortex-compact 32749880 33993141 0.96
tpcds_q08/duckdb:vortex-compact 42978268 46391301 0.93
tpcds_q09/duckdb:vortex-compact 56328233 57046025 0.99
tpcds_q10/duckdb:vortex-compact 59417914 61183396 0.97
tpcds_q11/duckdb:vortex-compact 70586469 70889399 1.00
tpcds_q12/duckdb:vortex-compact 22184769 22385843 0.99
tpcds_q13/duckdb:vortex-compact 56735427 60132319 0.94
tpcds_q14/duckdb:vortex-compact 130272333 129652983 1.00
tpcds_q15/duckdb:vortex-compact 30474741 30870159 0.99
tpcds_q16/duckdb:vortex-compact 29335575 29385766 1.00
tpcds_q17/duckdb:vortex-compact 54236108 52772695 1.03
tpcds_q18/duckdb:vortex-compact 57807027 56275010 1.03
tpcds_q19/duckdb:vortex-compact 49542422 49552469 1.00
tpcds_q20/duckdb:vortex-compact 19942623 19805128 1.01
tpcds_q21/duckdb:vortex-compact 19882603 19171754 1.04
tpcds_q22/duckdb:vortex-compact 73186424 74355722 0.98
tpcds_q23/duckdb:vortex-compact 123217440 119182240 1.03
tpcds_q24/duckdb:vortex-compact 62721737 62146201 1.01
tpcds_q25/duckdb:vortex-compact 82684554 78650832 1.05
tpcds_q26/duckdb:vortex-compact 51909696 51132457 1.02
tpcds_q27/duckdb:vortex-compact 70381248 69734126 1.01
tpcds_q28/duckdb:vortex-compact 84009719 83473536 1.01
tpcds_q29/duckdb:vortex-compact 54314915 55281845 0.98
tpcds_q30/duckdb:vortex-compact 29665021 27775347 1.07
tpcds_q31/duckdb:vortex-compact 46223480 44742340 1.03
tpcds_q32/duckdb:vortex-compact 22483560 22357406 1.01
tpcds_q33/duckdb:vortex-compact 34340571 34978487 0.98
tpcds_q34/duckdb:vortex-compact 38509173 39011623 0.99
tpcds_q35/duckdb:vortex-compact 79234699 80927288 0.98
tpcds_q36/duckdb:vortex-compact 41111876 39947058 1.03
tpcds_q37/duckdb:vortex-compact 24109235 22540845 1.07
tpcds_q38/duckdb:vortex-compact 45232682 47170472 0.96
tpcds_q39/duckdb:vortex-compact 36641096 37409746 0.98
tpcds_q40/duckdb:vortex-compact 26125235 24553329 1.06
tpcds_q41/duckdb:vortex-compact 16000228 15262353 1.05
tpcds_q42/duckdb:vortex-compact 21750729 22196805 0.98
tpcds_q43/duckdb:vortex-compact 34966488 36497273 0.96
tpcds_q44/duckdb:vortex-compact 29001458 29850762 0.97
tpcds_q45/duckdb:vortex-compact 37277146 39070739 0.95
tpcds_q46/duckdb:vortex-compact 70966511 69740925 1.02
tpcds_q47/duckdb:vortex-compact 61381692 62494829 0.98
tpcds_q48/duckdb:vortex-compact 50400987 50297664 1.00
tpcds_q49/duckdb:vortex-compact 55228267 55665114 0.99
tpcds_q50/duckdb:vortex-compact 47779358 47445720 1.01
tpcds_q51/duckdb:vortex-compact 106163641 108291935 0.98
tpcds_q52/duckdb:vortex-compact 21905460 22017349 0.99
tpcds_q53/duckdb:vortex-compact 38031166 38365921 0.99
tpcds_q54/duckdb:vortex-compact 39247046 39345449 1.00
tpcds_q55/duckdb:vortex-compact 21878029 22039288 0.99
tpcds_q56/duckdb:vortex-compact 35243764 37336033 0.94
tpcds_q57/duckdb:vortex-compact 42642794 42786491 1.00
tpcds_q58/duckdb:vortex-compact 40574422 40195925 1.01
tpcds_q59/duckdb:vortex-compact 90454855 87546695 1.03
tpcds_q60/duckdb:vortex-compact 37838955 36378172 1.04
tpcds_q61/duckdb:vortex-compact 64150672 62310866 1.03
tpcds_q62/duckdb:vortex-compact 26446173 26092707 1.01
tpcds_q63/duckdb:vortex-compact 37316158 36728221 1.02
tpcds_q64/duckdb:vortex-compact 112633534 113549773 0.99
tpcds_q65/duckdb:vortex-compact 32177358 32479460 0.99
tpcds_q66/duckdb:vortex-compact 39058625 38558608 1.01
tpcds_q67/duckdb:vortex-compact 149964677 154509055 0.97
tpcds_q68/duckdb:vortex-compact 60324707 62513420 0.96
tpcds_q69/duckdb:vortex-compact 60692683 59654021 1.02
tpcds_q70/duckdb:vortex-compact 35787198 37383163 0.96
tpcds_q71/duckdb:vortex-compact 33983067 33803659 1.01
tpcds_q72/duckdb:vortex-compact 189654846 190038647 1.00
tpcds_q73/duckdb:vortex-compact 35861315 36924821 0.97
tpcds_q74/duckdb:vortex-compact 82602473 83844300 0.99
tpcds_q75/duckdb:vortex-compact 71103580 72512703 0.98
tpcds_q76/duckdb:vortex-compact 33930246 33389053 1.02
tpcds_q77/duckdb:vortex-compact 43130947 44117415 0.98
tpcds_q78/duckdb:vortex-compact 87434412 90133074 0.97
tpcds_q79/duckdb:vortex-compact 51342660 53064006 0.97
tpcds_q80/duckdb:vortex-compact 77868181 80592763 0.97
tpcds_q81/duckdb:vortex-compact 33272366 32471039 1.02
tpcds_q82/duckdb:vortex-compact 27543528 25851744 1.07
tpcds_q83/duckdb:vortex-compact 31310270 31134278 1.01
tpcds_q84/duckdb:vortex-compact 25223384 25979321 0.97
tpcds_q85/duckdb:vortex-compact 56091724 59814031 0.94
tpcds_q86/duckdb:vortex-compact 23246510 24036021 0.97
tpcds_q87/duckdb:vortex-compact 49794983 50178377 0.99
tpcds_q88/duckdb:vortex-compact 38758269 38905020 1.00
tpcds_q89/duckdb:vortex-compact 36859206 36835793 1.00
tpcds_q90/duckdb:vortex-compact 15431714 14481883 1.07
tpcds_q91/duckdb:vortex-compact 48928871 51336368 0.95
tpcds_q92/duckdb:vortex-compact 48000033 48054239 1.00
tpcds_q93/duckdb:vortex-compact 30746344 31338573 0.98
tpcds_q94/duckdb:vortex-compact 28290923 30634809 0.92
tpcds_q95/duckdb:vortex-compact 159966437 156972387 1.02
tpcds_q96/duckdb:vortex-compact 17035394 17515987 0.97
tpcds_q97/duckdb:vortex-compact 43193815 45067148 0.96
tpcds_q98/duckdb:vortex-compact 28233541 28497148 0.99
tpcds_q99/duckdb:vortex-compact 30425183 30491294 1.00
duckdb / parquet (0.996x ➖, 0↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 27650510 27379262 1.01
tpcds_q02/duckdb:parquet 22575272 23993208 0.94
tpcds_q03/duckdb:parquet 11201546 11489257 0.97
tpcds_q04/duckdb:parquet 168953289 163911741 1.03
tpcds_q05/duckdb:parquet 28653186 29936650 0.96
tpcds_q06/duckdb:parquet 27623139 27478039 1.01
tpcds_q07/duckdb:parquet 21122634 20982607 1.01
tpcds_q08/duckdb:parquet 26853479 26388830 1.02
tpcds_q09/duckdb:parquet 39632116 39165920 1.01
tpcds_q10/duckdb:parquet 33306683 32153513 1.04
tpcds_q11/duckdb:parquet 88294455 82059189 1.08
tpcds_q12/duckdb:parquet 14584337 14924330 0.98
tpcds_q13/duckdb:parquet 32446901 32862925 0.99
tpcds_q14/duckdb:parquet 95940795 101143392 0.95
tpcds_q15/duckdb:parquet 29221831 29219904 1.00
tpcds_q16/duckdb:parquet 19858204 20524406 0.97
tpcds_q17/duckdb:parquet 38126224 37909821 1.01
tpcds_q18/duckdb:parquet 43994220 46172798 0.95
tpcds_q19/duckdb:parquet 28046468 28460064 0.99
tpcds_q20/duckdb:parquet 15219578 14877581 1.02
tpcds_q21/duckdb:parquet 10058394 10116457 0.99
tpcds_q22/duckdb:parquet 66838280 67300045 0.99
tpcds_q23/duckdb:parquet 79699360 81876655 0.97
tpcds_q24/duckdb:parquet 44560102 44933272 0.99
tpcds_q25/duckdb:parquet 32833103 32911592 1.00
tpcds_q26/duckdb:parquet 35460072 35534015 1.00
tpcds_q27/duckdb:parquet 48809995 49189058 0.99
tpcds_q28/duckdb:parquet 37601006 37140222 1.01
tpcds_q29/duckdb:parquet 35125677 34904211 1.01
tpcds_q30/duckdb:parquet 33037633 34984944 0.94
tpcds_q31/duckdb:parquet 22948434 23158056 0.99
tpcds_q32/duckdb:parquet 11133626 11568332 0.96
tpcds_q33/duckdb:parquet 20842622 20628673 1.01
tpcds_q34/duckdb:parquet 21231406 20269451 1.05
tpcds_q35/duckdb:parquet 56231056 56996200 0.99
tpcds_q36/duckdb:parquet 19723774 19691948 1.00
tpcds_q37/duckdb:parquet 12370788 11895006 1.04
tpcds_q38/duckdb:parquet 34295806 32443610 1.06
tpcds_q39/duckdb:parquet 29783739 29560585 1.01
tpcds_q40/duckdb:parquet 16114731 17603921 0.92
tpcds_q41/duckdb:parquet 7679596 7352370 1.04
tpcds_q42/duckdb:parquet 9678544 9818968 0.99
tpcds_q43/duckdb:parquet 15150679 15207241 1.00
tpcds_q44/duckdb:parquet 21554278 22267262 0.97
tpcds_q45/duckdb:parquet 26255772 25804298 1.02
tpcds_q46/duckdb:parquet 43043208 45296396 0.95
tpcds_q47/duckdb:parquet 43993653 43572102 1.01
tpcds_q48/duckdb:parquet 28648405 28801337 0.99
tpcds_q49/duckdb:parquet 23595693 25973307 0.91
tpcds_q50/duckdb:parquet 23911438 24525637 0.97
tpcds_q51/duckdb:parquet 93539544 93763150 1.00
tpcds_q52/duckdb:parquet 10523611 10926616 0.96
tpcds_q53/duckdb:parquet 14784262 14876672 0.99
tpcds_q54/duckdb:parquet 24776804 25615851 0.97
tpcds_q55/duckdb:parquet 9884972 9945515 0.99
tpcds_q56/duckdb:parquet 20350672 20692785 0.98
tpcds_q57/duckdb:parquet 34662926 34329930 1.01
tpcds_q58/duckdb:parquet 21804766 21416919 1.02
tpcds_q59/duckdb:parquet 35037696 34940551 1.00
tpcds_q60/duckdb:parquet 21979273 21555633 1.02
tpcds_q61/duckdb:parquet 31171115 29871673 1.04
tpcds_q62/duckdb:parquet 11442043 11641738 0.98
tpcds_q63/duckdb:parquet 13724020 13379240 1.03
tpcds_q64/duckdb:parquet 72900074 73393457 0.99
tpcds_q65/duckdb:parquet 19283217 19496333 0.99
tpcds_q66/duckdb:parquet 30334209 28590749 1.06
tpcds_q67/duckdb:parquet 133521317 134546116 0.99
tpcds_q68/duckdb:parquet 35773378 36149469 0.99
tpcds_q69/duckdb:parquet 35849111 36422522 0.98
tpcds_q70/duckdb:parquet 18798978 19236721 0.98
tpcds_q71/duckdb:parquet 18883502 18592471 1.02
tpcds_q72/duckdb:parquet 163411628 163639642 1.00
tpcds_q73/duckdb:parquet 17514007 17987554 0.97
tpcds_q74/duckdb:parquet 128086669 125463073 1.02
tpcds_q75/duckdb:parquet 53577989 51567322 1.04
tpcds_q76/duckdb:parquet 19315893 19684859 0.98
tpcds_q77/duckdb:parquet 21278702 21295506 1.00
tpcds_q78/duckdb:parquet 74221415 74168415 1.00
tpcds_q79/duckdb:parquet 26600035 26242464 1.01
tpcds_q80/duckdb:parquet 39450504 40204626 0.98
tpcds_q81/duckdb:parquet 30223079 31708535 0.95
tpcds_q82/duckdb:parquet 13862737 13649643 1.02
tpcds_q83/duckdb:parquet 16196360 15855669 1.02
tpcds_q84/duckdb:parquet 19911047 19796915 1.01
tpcds_q85/duckdb:parquet 38840730 39157249 0.99
tpcds_q86/duckdb:parquet 12983791 12059791 1.08
tpcds_q87/duckdb:parquet 36181879 37430882 0.97
tpcds_q88/duckdb:parquet 48298607 48880932 0.99
tpcds_q89/duckdb:parquet 15963818 16072627 0.99
tpcds_q90/duckdb:parquet 7463334 7113847 1.05
tpcds_q91/duckdb:parquet 23164129 22824969 1.01
tpcds_q92/duckdb:parquet 11322407 11888832 0.95
tpcds_q93/duckdb:parquet 29618295 28293437 1.05
tpcds_q94/duckdb:parquet 15630330 16770924 0.93
tpcds_q95/duckdb:parquet 137009628 139793453 0.98
tpcds_q96/duckdb:parquet 8374923 8487962 0.99
tpcds_q97/duckdb:parquet 34914235 34222478 1.02
tpcds_q98/duckdb:parquet 16676542 17532252 0.95
tpcds_q99/duckdb:parquet 20023909 19430547 1.03
duckdb / duckdb (1.000x ➖, 1↑ 1↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20172265 19998591 1.01
tpcds_q02/duckdb:duckdb 18125554 18646832 0.97
tpcds_q03/duckdb:duckdb 8643923 8532504 1.01
tpcds_q04/duckdb:duckdb 175979360 176758802 1.00
tpcds_q05/duckdb:duckdb 19070268 19407875 0.98
tpcds_q06/duckdb:duckdb 22891569 22293416 1.03
tpcds_q07/duckdb:duckdb 37061411 38006205 0.98
tpcds_q08/duckdb:duckdb 119763807 119334039 1.00
tpcds_q09/duckdb:duckdb 19922010 20004343 1.00
tpcds_q10/duckdb:duckdb 23854447 22697113 1.05
tpcds_q11/duckdb:duckdb 88450599 92389980 0.96
tpcds_q12/duckdb:duckdb 11417758 11237149 1.02
tpcds_q13/duckdb:duckdb 24677342 23783609 1.04
tpcds_q14/duckdb:duckdb 93476919 91655920 1.02
tpcds_q15/duckdb:duckdb 25393453 23934583 1.06
tpcds_q16/duckdb:duckdb 18188446 16819038 1.08
tpcds_q17/duckdb:duckdb 22541062 21333396 1.06
tpcds_q18/duckdb:duckdb 43686206 44315323 0.99
tpcds_q19/duckdb:duckdb 16257662 16701263 0.97
tpcds_q20/duckdb:duckdb 12045865 11496496 1.05
tpcds_q21/duckdb:duckdb 6981447 6585098 1.06
tpcds_q22/duckdb:duckdb 59282289 64186619 0.92
tpcds_q23/duckdb:duckdb 80184974 85088558 0.94
tpcds_q24/duckdb:duckdb 24183440 23858080 1.01
tpcds_q25/duckdb:duckdb 17408672 16635799 1.05
tpcds_q26/duckdb:duckdb 26475383 26039619 1.02
tpcds_q27/duckdb:duckdb 37657602 39951288 0.94
tpcds_q28/duckdb:duckdb 21804637 21611788 1.01
tpcds_q29/duckdb:duckdb 20274152 20330412 1.00
tpcds_q30/duckdb:duckdb 28093228 28563921 0.98
tpcds_q31/duckdb:duckdb 46714601 46615222 1.00
tpcds_q32/duckdb:duckdb 6999780 7188984 0.97
tpcds_q33/duckdb:duckdb 12488115 12844362 0.97
tpcds_q34/duckdb:duckdb 15466740 14833986 1.04
tpcds_q35/duckdb:duckdb 32410301 32342970 1.00
tpcds_q36/duckdb:duckdb 70610422 70719293 1.00
tpcds_q37/duckdb:duckdb 7860344 7676871 1.02
tpcds_q38/duckdb:duckdb 31132946 30122111 1.03
tpcds_q39/duckdb:duckdb 25928390 28421004 0.91
tpcds_q40/duckdb:duckdb 14146423 13066293 1.08
tpcds_q41/duckdb:duckdb 8191815 7942176 1.03
tpcds_q42/duckdb:duckdb 6616488 6262269 1.06
tpcds_q43/duckdb:duckdb 11287667 11263093 1.00
tpcds_q44/duckdb:duckdb 13946008 13300811 1.05
tpcds_q45/duckdb:duckdb 17054294 16786029 1.02
tpcds_q46/duckdb:duckdb 36223916 36185998 1.00
tpcds_q47/duckdb:duckdb 40474429 41067386 0.99
tpcds_q48/duckdb:duckdb 21364894 22741142 0.94
tpcds_q49/duckdb:duckdb 17113362 17259008 0.99
tpcds_q50/duckdb:duckdb 14023852 13774469 1.02
tpcds_q51/duckdb:duckdb 89190676 88303378 1.01
tpcds_q52/duckdb:duckdb 7126131 7312161 0.97
tpcds_q53/duckdb:duckdb 13135256 13279573 0.99
tpcds_q54/duckdb:duckdb 16070834 16439719 0.98
tpcds_q55/duckdb:duckdb 6991907 6945785 1.01
tpcds_q56/duckdb:duckdb 13656540 13799985 0.99
tpcds_q57/duckdb:duckdb 32362737 32770709 0.99
tpcds_q58/duckdb:duckdb 12644800 12390735 1.02
tpcds_q59/duckdb:duckdb 34381981 35191081 0.98
tpcds_q60/duckdb:duckdb 14686811 14376123 1.02
tpcds_q61/duckdb:duckdb 13914702 14397126 0.97
tpcds_q62/duckdb:duckdb 9546835 8993822 1.06
tpcds_q63/duckdb:duckdb 12105384 11915245 1.02
tpcds_q64/duckdb:duckdb 53345476 52418028 1.02
tpcds_q65/duckdb:duckdb 34876965 34501710 1.01
tpcds_q66/duckdb:duckdb 25744265 25501193 1.01
tpcds_q67/duckdb:duckdb 128382011 131329537 0.98
tpcds_q68/duckdb:duckdb 24821409 25318871 0.98
tpcds_q69/duckdb:duckdb 24904883 24649110 1.01
tpcds_q70/duckdb:duckdb 13922581 13933642 1.00
tpcds_q71/duckdb:duckdb 12804207 12762449 1.00
tpcds_q72/duckdb:duckdb 43069952 44343173 0.97
tpcds_q73/duckdb:duckdb 10742062 10860822 0.99
tpcds_q74/duckdb:duckdb 141386818 147147921 0.96
tpcds_q75/duckdb:duckdb 43226228 42409592 1.02
tpcds_q76/duckdb:duckdb 12036569 11384330 1.06
tpcds_q77/duckdb:duckdb 12024622 12818907 0.94
tpcds_q78/duckdb:duckdb 62769665 63254533 0.99
tpcds_q79/duckdb:duckdb 18607475 18881481 0.99
tpcds_q80/duckdb:duckdb 26866419 27888336 0.96
tpcds_q81/duckdb:duckdb 39462079 39516156 1.00
tpcds_q82/duckdb:duckdb 8114867 7866431 1.03
tpcds_q83/duckdb:duckdb 9340620 9743778 0.96
tpcds_q84/duckdb:duckdb 13781641 14131584 0.98
tpcds_q85/duckdb:duckdb 24098772 22730972 1.06
tpcds_q86/duckdb:duckdb 🚨 11645351 10492200 1.11
tpcds_q87/duckdb:duckdb 32559181 33473712 0.97
tpcds_q88/duckdb:duckdb 26160972 25802265 1.01
tpcds_q89/duckdb:duckdb 14626758 14174183 1.03
tpcds_q90/duckdb:duckdb 5393809 5264590 1.02
tpcds_q91/duckdb:duckdb 12488738 13007965 0.96
tpcds_q92/duckdb:duckdb 8447464 8945022 0.94
tpcds_q93/duckdb:duckdb 22116908 22353716 0.99
tpcds_q94/duckdb:duckdb 12356211 13268866 0.93
tpcds_q95/duckdb:duckdb 🚀 107467289 126624008 0.85
tpcds_q96/duckdb:duckdb 4884982 4548480 1.07
tpcds_q97/duckdb:duckdb 29181980 30656121 0.95
tpcds_q98/duckdb:duckdb 13344825 13584996 0.98
tpcds_q99/duckdb:duckdb 16396820 15868096 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +0.9% -0.6% +1.4% +19.8% ➖ noise
1 datafusion:vortex-file-compressed +4.0% -0.6% +4.6% +19.1% ➖ noise
1 duckdb:duckdb +0.9% -0.6% +1.4% +22.5% ➖ noise
1 duckdb:vortex-compact -1.7% -0.6% -1.2% +20.7% ➖ noise
1 duckdb:vortex-file-compressed +2.1% -0.6% +2.7% +31.6% ➖ noise
2 datafusion:vortex-compact -1.7% -5.3% +3.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.3% -5.3% +5.2% +10.0% ➖ noise
2 duckdb:duckdb -2.8% -5.3% +2.6% +10.0% ➖ noise
2 duckdb:vortex-compact -12.2% -5.3% -7.3% +15.8% ➖ noise
2 duckdb:vortex-file-compressed -5.4% -5.3% -0.1% +10.9% ➖ noise
3 datafusion:vortex-compact +3.1% -2.6% +5.9% +22.5% ➖ noise
3 datafusion:vortex-file-compressed +0.5% -2.6% +3.2% +10.0% ➖ noise
3 duckdb:duckdb +1.3% -2.6% +4.0% +11.9% ➖ noise
3 duckdb:vortex-compact +1.0% -2.6% +3.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +4.0% -2.6% +6.8% +10.0% ➖ noise
4 datafusion:vortex-compact +1.3% +0.9% +0.4% +10.6% ➖ noise
4 datafusion:vortex-file-compressed -1.4% +0.9% -2.3% +11.1% ➖ noise
4 duckdb:duckdb -0.4% +0.9% -1.3% +10.4% ➖ noise
4 duckdb:vortex-compact -5.1% +0.9% -6.0% +14.8% ➖ noise
4 duckdb:vortex-file-compressed -1.6% +0.9% -2.5% +12.1% ➖ noise
5 datafusion:vortex-compact +1.2% -4.5% +6.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.6% -4.5% +5.4% +10.0% ➖ noise
5 duckdb:duckdb -1.7% -4.5% +2.9% +12.4% ➖ noise
5 duckdb:vortex-compact -4.3% -4.5% +0.2% +14.7% ➖ noise
5 duckdb:vortex-file-compressed +4.4% -4.5% +9.3% +10.3% ➖ noise
6 datafusion:vortex-compact -5.6% +2.3% -7.8% +12.6% ➖ noise
6 datafusion:vortex-file-compressed +4.0% +2.3% +1.7% +10.0% ➖ noise
6 duckdb:duckdb +2.7% +2.3% +0.3% +15.9% ➖ noise
6 duckdb:vortex-compact -3.0% +2.3% -5.2% +12.8% ➖ noise
6 duckdb:vortex-file-compressed -1.9% +2.3% -4.1% +10.0% ➖ noise
7 datafusion:vortex-compact -0.6% +0.9% -1.5% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +5.7% +0.9% +4.8% +17.2% ➖ noise
7 duckdb:duckdb -2.5% +0.9% -3.4% +17.7% ➖ noise
7 duckdb:vortex-compact -3.7% +0.9% -4.5% +16.0% ➖ noise
7 duckdb:vortex-file-compressed -1.4% +0.9% -2.2% +25.3% ➖ noise
8 datafusion:vortex-compact -1.8% +2.3% -4.0% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -3.5% +2.3% -5.6% +15.8% ➖ noise
8 duckdb:duckdb +0.4% +2.3% -1.9% +10.0% ➖ noise
8 duckdb:vortex-compact -7.4% +2.3% -9.4% +10.0% ✅ faster
8 duckdb:vortex-file-compressed +3.7% +2.3% +1.4% +12.3% ➖ noise
9 datafusion:vortex-compact +0.8% +6.9% -5.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -1.1% +6.9% -7.5% +10.0% ➖ noise
9 duckdb:duckdb -0.4% +6.9% -6.9% +10.0% ➖ noise
9 duckdb:vortex-compact -1.3% +6.9% -7.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.7% +6.9% -8.1% +14.8% ➖ noise
10 datafusion:vortex-compact -0.3% +5.9% -5.9% +10.2% ➖ noise
10 datafusion:vortex-file-compressed -0.8% +5.9% -6.3% +10.0% ➖ noise
10 duckdb:duckdb +5.1% +5.9% -0.7% +10.0% ➖ noise
10 duckdb:vortex-compact -2.9% +5.9% -8.3% +13.9% ➖ noise
10 duckdb:vortex-file-compressed +1.1% +5.9% -4.5% +10.2% ➖ noise
11 datafusion:vortex-compact +4.5% +3.4% +1.1% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -2.8% +3.4% -6.0% +12.7% ➖ noise
11 duckdb:duckdb -4.3% +3.4% -7.4% +17.4% ➖ noise
11 duckdb:vortex-compact -0.4% +3.4% -3.7% +10.9% ➖ noise
11 duckdb:vortex-file-compressed +0.4% +3.4% -2.9% +12.6% ➖ noise
12 datafusion:vortex-compact +12.7% +0.0% +12.6% +19.7% ➖ noise
12 datafusion:vortex-file-compressed +1.0% +0.0% +1.0% +10.1% ➖ noise
12 duckdb:duckdb +1.6% +0.0% +1.6% +10.0% ➖ noise
12 duckdb:vortex-compact -0.9% +0.0% -0.9% +17.2% ➖ noise
12 duckdb:vortex-file-compressed -1.1% +0.0% -1.1% +10.0% ➖ noise
13 datafusion:vortex-compact +2.8% +0.4% +2.4% +16.8% ➖ noise
13 datafusion:vortex-file-compressed +0.9% +0.4% +0.5% +10.0% ➖ noise
13 duckdb:duckdb +3.8% +0.4% +3.3% +10.0% ➖ noise
13 duckdb:vortex-compact -5.6% +0.4% -6.0% +12.0% ➖ noise
13 duckdb:vortex-file-compressed -5.2% +0.4% -5.6% +10.0% ➖ noise
14 datafusion:vortex-compact -2.2% -0.7% -1.5% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +0.0% -0.7% +0.7% +10.0% ➖ noise
14 duckdb:duckdb +2.0% -0.7% +2.7% +10.0% ➖ noise
14 duckdb:vortex-compact +0.5% -0.7% +1.2% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -4.9% -0.7% -4.2% +10.0% ➖ noise
15 datafusion:vortex-compact +0.9% -0.6% +1.5% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +2.7% -0.6% +3.3% +10.0% ➖ noise
15 duckdb:duckdb +6.1% -0.6% +6.8% +10.0% ➖ noise
15 duckdb:vortex-compact -1.3% -0.6% -0.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +3.8% -0.6% +4.4% +11.0% ➖ noise
16 datafusion:vortex-compact +0.1% -5.2% +5.6% +12.0% ➖ noise
16 datafusion:vortex-file-compressed +4.3% -5.2% +10.1% +10.0% 🚨 regression
16 duckdb:duckdb +8.1% -5.2% +14.1% +14.3% ➖ noise
16 duckdb:vortex-compact -0.2% -5.2% +5.3% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -2.6% -5.2% +2.7% +10.0% ➖ noise
17 datafusion:vortex-compact -2.6% -3.7% +1.2% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +3.2% -3.7% +7.2% +12.7% ➖ noise
17 duckdb:duckdb +5.7% -3.7% +9.7% +11.0% ➖ noise
17 duckdb:vortex-compact +2.8% -3.7% +6.8% +11.9% ➖ noise
17 duckdb:vortex-file-compressed -1.9% -3.7% +1.9% +10.0% ➖ noise
18 datafusion:vortex-compact +1.4% -3.7% +5.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -3.2% -3.7% +0.4% +10.0% ➖ noise
18 duckdb:duckdb -1.4% -3.7% +2.3% +10.0% ➖ noise
18 duckdb:vortex-compact +2.7% -3.7% +6.6% +11.3% ➖ noise
18 duckdb:vortex-file-compressed +2.1% -3.7% +6.0% +10.6% ➖ noise
19 datafusion:vortex-compact +1.8% -1.9% +3.7% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -1.7% -1.9% +0.2% +10.0% ➖ noise
19 duckdb:duckdb -2.7% -1.9% -0.8% +10.0% ➖ noise
19 duckdb:vortex-compact -0.0% -1.9% +1.9% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +2.3% -1.9% +4.3% +12.6% ➖ noise
20 datafusion:vortex-compact -3.0% +2.1% -5.1% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +2.2% +2.1% +0.1% +10.0% ➖ noise
20 duckdb:duckdb +4.8% +2.1% +2.6% +15.6% ➖ noise
20 duckdb:vortex-compact +0.7% +2.1% -1.4% +25.0% ➖ noise
20 duckdb:vortex-file-compressed +5.0% +2.1% +2.8% +13.1% ➖ noise
21 datafusion:vortex-compact -1.7% +1.2% -2.9% +13.5% ➖ noise
21 datafusion:vortex-file-compressed +4.7% +1.2% +3.4% +10.0% ➖ noise
21 duckdb:duckdb +6.0% +1.2% +4.8% +13.3% ➖ noise
21 duckdb:vortex-compact +3.7% +1.2% +2.5% +18.1% ➖ noise
21 duckdb:vortex-file-compressed +5.8% +1.2% +4.5% +11.9% ➖ noise
22 datafusion:vortex-compact +7.3% +5.9% +1.3% +24.1% ➖ noise
22 datafusion:vortex-file-compressed +8.3% +5.9% +2.2% +32.7% ➖ noise
22 duckdb:duckdb -7.6% +5.9% -12.8% +15.7% ➖ noise
22 duckdb:vortex-compact -1.6% +5.9% -7.1% +15.0% ➖ noise
22 duckdb:vortex-file-compressed +3.0% +5.9% -2.7% +15.8% ➖ noise
23 datafusion:vortex-compact -2.2% -3.3% +1.1% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -1.7% -3.3% +1.6% +10.0% ➖ noise
23 duckdb:duckdb -5.8% -3.3% -2.6% +14.1% ➖ noise
23 duckdb:vortex-compact +3.4% -3.3% +6.9% +11.4% ➖ noise
23 duckdb:vortex-file-compressed +2.5% -3.3% +6.0% +10.0% ➖ noise
24 datafusion:vortex-compact -4.9% -0.4% -4.6% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -1.1% -0.4% -0.7% +10.0% ➖ noise
24 duckdb:duckdb +1.4% -0.4% +1.7% +10.9% ➖ noise
24 duckdb:vortex-compact +0.9% -0.4% +1.3% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -1.8% -0.4% -1.5% +12.2% ➖ noise
25 datafusion:vortex-compact -0.5% +0.0% -0.5% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -0.7% +0.0% -0.8% +12.2% ➖ noise
25 duckdb:duckdb +4.6% +0.0% +4.6% +10.0% ➖ noise
25 duckdb:vortex-compact +5.1% +0.0% +5.1% +11.2% ➖ noise
25 duckdb:vortex-file-compressed -0.2% +0.0% -0.2% +10.0% ➖ noise
26 datafusion:vortex-compact +0.3% -0.3% +0.6% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +1.1% -0.3% +1.4% +10.0% ➖ noise
26 duckdb:duckdb +1.7% -0.3% +2.0% +11.7% ➖ noise
26 duckdb:vortex-compact +1.5% -0.3% +1.9% +12.9% ➖ noise
26 duckdb:vortex-file-compressed +2.2% -0.3% +2.6% +10.8% ➖ noise
27 datafusion:vortex-compact +1.5% -0.8% +2.4% +11.4% ➖ noise
27 datafusion:vortex-file-compressed +0.5% -0.8% +1.3% +10.0% ➖ noise
27 duckdb:duckdb -5.7% -0.8% -4.9% +21.0% ➖ noise
27 duckdb:vortex-compact +0.9% -0.8% +1.8% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -0.1% -0.8% +0.7% +15.1% ➖ noise
28 datafusion:vortex-compact +3.4% -1.3% +4.7% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +2.4% -1.3% +3.7% +11.3% ➖ noise
28 duckdb:duckdb +0.9% -1.3% +2.2% +10.0% ➖ noise
28 duckdb:vortex-compact +0.6% -1.3% +1.9% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -2.6% -1.3% -1.3% +10.0% ➖ noise
29 datafusion:vortex-compact +0.9% -0.2% +1.1% +19.0% ➖ noise
29 datafusion:vortex-file-compressed +1.6% -0.2% +1.8% +13.9% ➖ noise
29 duckdb:duckdb -0.3% -0.2% -0.1% +12.7% ➖ noise
29 duckdb:vortex-compact -1.7% -0.2% -1.6% +11.8% ➖ noise
29 duckdb:vortex-file-compressed +0.6% -0.2% +0.8% +11.5% ➖ noise
30 datafusion:vortex-compact +4.5% -4.9% +9.9% +17.8% ➖ noise
30 datafusion:vortex-file-compressed -1.6% -4.9% +3.5% +20.2% ➖ noise
30 duckdb:duckdb -1.6% -4.9% +3.4% +11.8% ➖ noise
30 duckdb:vortex-compact +6.8% -4.9% +12.3% +21.5% ➖ noise
30 duckdb:vortex-file-compressed +1.8% -4.9% +7.1% +11.5% ➖ noise
31 datafusion:vortex-compact -0.1% +0.8% -0.9% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +1.9% +0.8% +1.0% +10.0% ➖ noise
31 duckdb:duckdb +0.2% +0.8% -0.6% +11.4% ➖ noise
31 duckdb:vortex-compact +3.3% +0.8% +2.4% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +0.8% +0.8% +0.0% +16.7% ➖ noise
32 datafusion:vortex-compact +4.3% -2.0% +6.4% +13.7% ➖ noise
32 datafusion:vortex-file-compressed -0.2% -2.0% +1.8% +21.2% ➖ noise
32 duckdb:duckdb -2.6% -2.0% -0.6% +20.3% ➖ noise
32 duckdb:vortex-compact +0.6% -2.0% +2.6% +10.1% ➖ noise
32 duckdb:vortex-file-compressed +0.6% -2.0% +2.7% +13.2% ➖ noise
33 datafusion:vortex-compact -1.1% +0.9% -2.0% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +5.9% +0.9% +5.1% +10.0% ➖ noise
33 duckdb:duckdb -2.8% +0.9% -3.6% +11.1% ➖ noise
33 duckdb:vortex-compact -1.8% +0.9% -2.7% +13.1% ➖ noise
33 duckdb:vortex-file-compressed -1.5% +0.9% -2.4% +10.0% ➖ noise
34 datafusion:vortex-compact -3.7% +0.5% -4.2% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +5.6% +0.5% +5.1% +10.0% ➖ noise
34 duckdb:duckdb +4.3% +0.5% +3.7% +10.7% ➖ noise
34 duckdb:vortex-compact -1.3% +0.5% -1.8% +12.1% ➖ noise
34 duckdb:vortex-file-compressed -1.4% +0.5% -1.9% +10.0% ➖ noise
35 datafusion:vortex-compact -2.1% -1.1% -1.0% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +2.6% -1.1% +3.7% +10.0% ➖ noise
35 duckdb:duckdb +0.2% -1.1% +1.3% +15.2% ➖ noise
35 duckdb:vortex-compact -2.1% -1.1% -1.0% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -2.7% -1.1% -1.6% +13.6% ➖ noise
36 datafusion:vortex-compact +4.1% -1.5% +5.7% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +1.7% -1.5% +3.3% +10.0% ➖ noise
36 duckdb:duckdb -0.2% -1.5% +1.4% +10.0% ➖ noise
36 duckdb:vortex-compact +2.9% -1.5% +4.5% +14.1% ➖ noise
36 duckdb:vortex-file-compressed +3.3% -1.5% +4.9% +10.0% ➖ noise
37 datafusion:vortex-compact -0.4% +3.1% -3.4% +10.7% ➖ noise
37 datafusion:vortex-file-compressed +1.9% +3.1% -1.1% +10.0% ➖ noise
37 duckdb:duckdb +2.4% +3.1% -0.7% +12.7% ➖ noise
37 duckdb:vortex-compact +7.0% +3.1% +3.8% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -2.1% +3.1% -5.0% +10.0% ➖ noise
38 datafusion:vortex-compact +4.0% +1.8% +2.2% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +0.2% +1.8% -1.6% +13.5% ➖ noise
38 duckdb:duckdb +3.4% +1.8% +1.5% +14.1% ➖ noise
38 duckdb:vortex-compact -4.1% +1.8% -5.8% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -2.4% +1.8% -4.1% +17.2% ➖ noise
39 datafusion:vortex-compact +2.4% -0.4% +2.9% +11.9% ➖ noise
39 datafusion:vortex-file-compressed +0.3% -0.4% +0.7% +10.0% ➖ noise
39 duckdb:duckdb -8.8% -0.4% -8.4% +19.5% ➖ noise
39 duckdb:vortex-compact -2.1% -0.4% -1.6% +10.0% ➖ noise
39 duckdb:vortex-file-compressed -2.3% -0.4% -1.9% +15.6% ➖ noise
40 datafusion:vortex-compact -1.7% -8.6% +7.6% +16.0% ➖ noise
40 datafusion:vortex-file-compressed +0.4% -8.6% +9.9% +10.0% ➖ noise
40 duckdb:duckdb +8.3% -8.6% +18.5% +14.7% 🚨 regression
40 duckdb:vortex-compact +6.4% -8.6% +16.5% +13.3% 🚨 regression
40 duckdb:vortex-file-compressed -2.4% -8.6% +6.9% +16.2% ➖ noise
41 datafusion:vortex-compact -3.1% +1.9% -4.9% +10.0% ➖ noise
41 datafusion:vortex-file-compressed +6.6% +1.9% +4.6% +16.6% ➖ noise
41 duckdb:duckdb +3.1% +1.9% +1.2% +13.2% ➖ noise
41 duckdb:vortex-compact +4.8% +1.9% +2.9% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +0.8% +1.9% -1.1% +10.0% ➖ noise
42 datafusion:vortex-compact +2.9% -0.2% +3.1% +11.7% ➖ noise
42 datafusion:vortex-file-compressed +7.3% -0.2% +7.5% +10.2% ➖ noise
42 duckdb:duckdb +5.7% -0.2% +5.8% +12.5% ➖ noise
42 duckdb:vortex-compact -2.0% -0.2% -1.9% +10.0% ➖ noise
42 duckdb:vortex-file-compressed -4.6% -0.2% -4.4% +10.0% ➖ noise
43 datafusion:vortex-compact +0.6% -0.7% +1.3% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +5.1% -0.7% +5.8% +10.0% ➖ noise
43 duckdb:duckdb +0.2% -0.7% +0.9% +10.6% ➖ noise
43 duckdb:vortex-compact -4.2% -0.7% -3.6% +12.8% ➖ noise
43 duckdb:vortex-file-compressed +2.4% -0.7% +3.0% +10.0% ➖ noise
44 datafusion:vortex-compact -1.0% -0.1% -1.0% +10.0% ➖ noise
44 datafusion:vortex-file-compressed +1.4% -0.1% +1.5% +14.2% ➖ noise
44 duckdb:duckdb +4.9% -0.1% +4.9% +10.0% ➖ noise
44 duckdb:vortex-compact -2.8% -0.1% -2.8% +14.0% ➖ noise
44 duckdb:vortex-file-compressed +3.1% -0.1% +3.2% +10.0% ➖ noise
45 datafusion:vortex-compact +6.3% +0.6% +5.7% +14.4% ➖ noise
45 datafusion:vortex-file-compressed +4.4% +0.6% +3.8% +10.0% ➖ noise
45 duckdb:duckdb +1.6% +0.6% +1.0% +13.2% ➖ noise
45 duckdb:vortex-compact -4.6% +0.6% -5.2% +12.9% ➖ noise
45 duckdb:vortex-file-compressed -6.0% +0.6% -6.5% +10.0% ➖ noise
46 datafusion:vortex-compact +1.2% -3.1% +4.5% +17.6% ➖ noise
46 datafusion:vortex-file-compressed -2.1% -3.1% +1.0% +10.0% ➖ noise
46 duckdb:duckdb +0.1% -3.1% +3.3% +10.0% ➖ noise
46 duckdb:vortex-compact +1.8% -3.1% +5.0% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -2.0% -3.1% +1.1% +10.0% ➖ noise
47 datafusion:vortex-compact +1.5% +0.2% +1.3% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -0.0% +0.2% -0.2% +10.0% ➖ noise
47 duckdb:duckdb -1.4% +0.2% -1.7% +14.8% ➖ noise
47 duckdb:vortex-compact -1.8% +0.2% -2.0% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -4.4% +0.2% -4.6% +10.0% ➖ noise
48 datafusion:vortex-compact -12.0% +0.3% -12.2% +18.5% ➖ noise
48 datafusion:vortex-file-compressed -0.5% +0.3% -0.8% +10.0% ➖ noise
48 duckdb:duckdb -6.1% +0.3% -6.3% +10.0% ➖ noise
48 duckdb:vortex-compact +0.2% +0.3% -0.1% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -2.6% +0.3% -2.9% +10.0% ➖ noise
49 datafusion:vortex-compact +1.0% -4.8% +6.1% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +4.1% -4.8% +9.3% +10.0% ➖ noise
49 duckdb:duckdb -0.8% -4.8% +4.1% +17.3% ➖ noise
49 duckdb:vortex-compact -0.8% -4.8% +4.2% +20.3% ➖ noise
49 duckdb:vortex-file-compressed +10.5% -4.8% +16.1% +26.0% ➖ noise
50 datafusion:vortex-compact +1.2% -1.5% +2.7% +11.6% ➖ noise
50 datafusion:vortex-file-compressed +2.3% -1.5% +3.9% +11.6% ➖ noise
50 duckdb:duckdb +1.8% -1.5% +3.4% +14.4% ➖ noise
50 duckdb:vortex-compact +0.7% -1.5% +2.3% +11.9% ➖ noise
50 duckdb:vortex-file-compressed +0.9% -1.5% +2.4% +10.0% ➖ noise
51 datafusion:vortex-compact +3.1% -0.6% +3.7% +10.0% ➖ noise
51 datafusion:vortex-file-compressed -0.8% -0.6% -0.2% +10.0% ➖ noise
51 duckdb:duckdb +1.0% -0.6% +1.6% +10.0% ➖ noise
51 duckdb:vortex-compact -2.0% -0.6% -1.4% +12.3% ➖ noise
51 duckdb:vortex-file-compressed -1.3% -0.6% -0.8% +10.0% ➖ noise
52 datafusion:vortex-compact +2.7% -2.2% +5.1% +11.4% ➖ noise
52 datafusion:vortex-file-compressed +2.2% -2.2% +4.5% +10.0% ➖ noise
52 duckdb:duckdb -2.5% -2.2% -0.3% +15.0% ➖ noise
52 duckdb:vortex-compact -0.5% -2.2% +1.8% +17.0% ➖ noise
52 duckdb:vortex-file-compressed +1.8% -2.2% +4.2% +12.6% ➖ noise
53 datafusion:vortex-compact +0.3% +0.3% -0.1% +14.9% ➖ noise
53 datafusion:vortex-file-compressed +1.8% +0.3% +1.5% +16.5% ➖ noise
53 duckdb:duckdb -1.1% +0.3% -1.4% +15.5% ➖ noise
53 duckdb:vortex-compact -0.9% +0.3% -1.2% +14.2% ➖ noise
53 duckdb:vortex-file-compressed +0.2% +0.3% -0.1% +14.9% ➖ noise
54 datafusion:vortex-compact -0.3% -0.0% -0.2% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +0.9% -0.0% +1.0% +10.0% ➖ noise
54 duckdb:duckdb -2.2% -0.0% -2.2% +10.7% ➖ noise
54 duckdb:vortex-compact -0.3% -0.0% -0.2% +10.0% ➖ noise
54 duckdb:vortex-file-compressed -1.8% -0.0% -1.8% +10.0% ➖ noise
55 datafusion:vortex-compact +5.3% -0.7% +6.0% +12.0% ➖ noise
55 datafusion:vortex-file-compressed +9.8% -0.7% +10.5% +10.0% 🚨 regression
55 duckdb:duckdb +0.7% -0.7% +1.3% +16.5% ➖ noise
55 duckdb:vortex-compact -0.7% -0.7% -0.1% +10.0% ➖ noise
55 duckdb:vortex-file-compressed -2.2% -0.7% -1.5% +10.0% ➖ noise
56 datafusion:vortex-compact -0.5% -2.9% +2.5% +10.0% ➖ noise
56 datafusion:vortex-file-compressed +3.7% -2.9% +6.9% +12.8% ➖ noise
56 duckdb:duckdb -1.0% -2.9% +2.0% +10.0% ➖ noise
56 duckdb:vortex-compact -5.6% -2.9% -2.7% +11.0% ➖ noise
56 duckdb:vortex-file-compressed -1.5% -2.9% +1.5% +16.2% ➖ noise
57 datafusion:vortex-compact -3.6% +2.7% -6.2% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -0.8% +2.7% -3.5% +10.0% ➖ noise
57 duckdb:duckdb -1.2% +2.7% -3.8% +10.0% ➖ noise
57 duckdb:vortex-compact -0.3% +2.7% -3.0% +10.0% ➖ noise
57 duckdb:vortex-file-compressed +1.4% +2.7% -1.3% +12.3% ➖ noise
58 datafusion:vortex-compact -0.3% +0.3% -0.6% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -5.4% +0.3% -5.7% +11.4% ➖ noise
58 duckdb:duckdb +2.1% +0.3% +1.7% +15.8% ➖ noise
58 duckdb:vortex-compact +0.9% +0.3% +0.6% +13.4% ➖ noise
58 duckdb:vortex-file-compressed -3.5% +0.3% -3.8% +10.0% ➖ noise
59 datafusion:vortex-compact +1.3% +0.4% +0.9% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +2.9% +0.4% +2.6% +10.0% ➖ noise
59 duckdb:duckdb -2.3% +0.4% -2.7% +10.0% ➖ noise
59 duckdb:vortex-compact +3.3% +0.4% +2.9% +10.0% ➖ noise
59 duckdb:vortex-file-compressed -3.4% +0.4% -3.8% +10.0% ➖ noise
60 datafusion:vortex-compact -1.1% -0.6% -0.5% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -3.0% -0.6% -2.4% +10.4% ➖ noise
60 duckdb:duckdb +2.2% -0.6% +2.8% +10.0% ➖ noise
60 duckdb:vortex-compact +4.0% -0.6% +4.7% +10.0% ➖ noise
60 duckdb:vortex-file-compressed -2.8% -0.6% -2.2% +13.4% ➖ noise
61 datafusion:vortex-compact -2.1% +2.3% -4.3% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -3.0% +2.3% -5.1% +10.0% ➖ noise
61 duckdb:duckdb -3.4% +2.3% -5.5% +10.2% ➖ noise
61 duckdb:vortex-compact +3.0% +2.3% +0.7% +10.3% ➖ noise
61 duckdb:vortex-file-compressed +20.2% +2.3% +17.6% +19.2% ➖ noise
62 datafusion:vortex-compact +17.6% +8.9% +8.0% +24.6% ➖ noise
62 datafusion:vortex-file-compressed -4.1% +8.9% -12.0% +19.4% ➖ noise
62 duckdb:duckdb +6.1% +8.9% -2.5% +16.8% ➖ noise
62 duckdb:vortex-compact +1.4% +8.9% -6.9% +23.1% ➖ noise
62 duckdb:vortex-file-compressed +7.7% +8.9% -1.1% +25.6% ➖ noise
63 datafusion:vortex-compact +0.0% +0.9% -0.9% +20.6% ➖ noise
63 datafusion:vortex-file-compressed -4.2% +0.9% -5.1% +11.0% ➖ noise
63 duckdb:duckdb +1.6% +0.9% +0.7% +12.0% ➖ noise
63 duckdb:vortex-compact +1.6% +0.9% +0.7% +10.2% ➖ noise
63 duckdb:vortex-file-compressed -4.4% +0.9% -5.3% +10.0% ➖ noise
64 datafusion:vortex-compact +0.2% -0.2% +0.3% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -2.3% -0.2% -2.1% +10.0% ➖ noise
64 duckdb:duckdb +1.8% -0.2% +1.9% +10.0% ➖ noise
64 duckdb:vortex-compact -0.8% -0.2% -0.6% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -0.7% -0.2% -0.6% +10.0% ➖ noise
65 datafusion:vortex-compact +2.0% +0.4% +1.6% +10.0% ➖ noise
65 datafusion:vortex-file-compressed +0.1% +0.4% -0.3% +13.1% ➖ noise
65 duckdb:duckdb +1.1% +0.4% +0.7% +15.3% ➖ noise
65 duckdb:vortex-compact -0.9% +0.4% -1.3% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +0.9% +0.4% +0.5% +10.0% ➖ noise
66 datafusion:vortex-compact +5.0% +0.9% +4.0% +15.9% ➖ noise
66 datafusion:vortex-file-compressed +2.1% +0.9% +1.1% +11.3% ➖ noise
66 duckdb:duckdb +1.0% +0.9% +0.0% +10.0% ➖ noise
66 duckdb:vortex-compact +1.3% +0.9% +0.4% +11.3% ➖ noise
66 duckdb:vortex-file-compressed -4.2% +0.9% -5.1% +10.3% ➖ noise
67 datafusion:vortex-compact +2.9% +0.2% +2.7% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -1.4% +0.2% -1.5% +10.0% ➖ noise
67 duckdb:duckdb -2.2% +0.2% -2.4% +10.0% ➖ noise
67 duckdb:vortex-compact -2.9% +0.2% -3.1% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +0.1% +0.2% -0.1% +10.0% ➖ noise
68 datafusion:vortex-compact +8.6% -2.1% +11.0% +20.4% ➖ noise
68 datafusion:vortex-file-compressed -2.3% -2.1% -0.2% +10.0% ➖ noise
68 duckdb:duckdb -2.0% -2.1% +0.2% +10.0% ➖ noise
68 duckdb:vortex-compact -3.5% -2.1% -1.4% +13.8% ➖ noise
68 duckdb:vortex-file-compressed -1.8% -2.1% +0.4% +10.0% ➖ noise
69 datafusion:vortex-compact +0.3% -0.8% +1.1% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -2.0% -0.8% -1.2% +10.0% ➖ noise
69 duckdb:duckdb +1.0% -0.8% +1.8% +14.1% ➖ noise
69 duckdb:vortex-compact +1.7% -0.8% +2.5% +10.0% ➖ noise
69 duckdb:vortex-file-compressed -1.1% -0.8% -0.3% +14.1% ➖ noise
70 datafusion:vortex-compact -0.0% -0.7% +0.7% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -2.5% -0.7% -1.8% +10.0% ➖ noise
70 duckdb:duckdb -0.1% -0.7% +0.6% +13.2% ➖ noise
70 duckdb:vortex-compact -4.3% -0.7% -3.6% +10.2% ➖ noise
70 duckdb:vortex-file-compressed +5.0% -0.7% +5.7% +10.0% ➖ noise
71 datafusion:vortex-compact -1.3% +0.1% -1.5% +10.9% ➖ noise
71 datafusion:vortex-file-compressed +4.3% +0.1% +4.2% +11.0% ➖ noise
71 duckdb:duckdb +0.3% +0.1% +0.2% +14.0% ➖ noise
71 duckdb:vortex-compact +0.5% +0.1% +0.4% +12.1% ➖ noise
71 duckdb:vortex-file-compressed +0.6% +0.1% +0.4% +10.0% ➖ noise
72 datafusion:vortex-compact -0.8% -0.6% -0.2% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +0.1% -0.6% +0.6% +10.0% ➖ noise
72 duckdb:duckdb -2.9% -0.6% -2.3% +12.2% ➖ noise
72 duckdb:vortex-compact -0.2% -0.6% +0.4% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -1.8% -0.6% -1.2% +10.0% ➖ noise
73 datafusion:vortex-compact +0.8% +0.8% +0.0% +10.0% ➖ noise
73 datafusion:vortex-file-compressed -3.4% +0.8% -4.1% +15.8% ➖ noise
73 duckdb:duckdb -1.1% +0.8% -1.8% +11.4% ➖ noise
73 duckdb:vortex-compact -2.9% +0.8% -3.6% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +2.1% +0.8% +1.4% +10.0% ➖ noise
74 datafusion:vortex-compact +2.9% -0.3% +3.2% +22.0% ➖ noise
74 datafusion:vortex-file-compressed -1.0% -0.3% -0.7% +14.9% ➖ noise
74 duckdb:duckdb -3.9% -0.3% -3.6% +10.0% ➖ noise
74 duckdb:vortex-compact -1.5% -0.3% -1.2% +28.8% ➖ noise
74 duckdb:vortex-file-compressed +3.8% -0.3% +4.1% +23.9% ➖ noise
75 datafusion:vortex-compact +0.6% +2.3% -1.6% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +0.1% +2.3% -2.1% +10.0% ➖ noise
75 duckdb:duckdb +1.9% +2.3% -0.3% +12.9% ➖ noise
75 duckdb:vortex-compact -1.9% +2.3% -4.1% +13.7% ➖ noise
75 duckdb:vortex-file-compressed +5.7% +2.3% +3.4% +13.2% ➖ noise
76 datafusion:vortex-compact -2.8% -1.0% -1.8% +26.8% ➖ noise
76 datafusion:vortex-file-compressed +0.9% -1.0% +1.9% +10.0% ➖ noise
76 duckdb:duckdb +5.7% -1.0% +6.8% +20.3% ➖ noise
76 duckdb:vortex-compact +1.6% -1.0% +2.7% +10.0% ➖ noise
76 duckdb:vortex-file-compressed -0.7% -1.0% +0.3% +10.0% ➖ noise
77 datafusion:vortex-compact -0.9% +0.5% -1.3% +10.0% ➖ noise
77 datafusion:vortex-file-compressed +5.4% +0.5% +4.9% +16.4% ➖ noise
77 duckdb:duckdb -6.2% +0.5% -6.6% +11.3% ➖ noise
77 duckdb:vortex-compact -2.2% +0.5% -2.7% +10.1% ➖ noise
77 duckdb:vortex-file-compressed -8.5% +0.5% -8.9% +17.8% ➖ noise
78 datafusion:vortex-compact +0.3% -0.8% +1.1% +11.4% ➖ noise
78 datafusion:vortex-file-compressed +0.2% -0.8% +1.1% +10.0% ➖ noise
78 duckdb:duckdb -0.8% -0.8% +0.1% +11.5% ➖ noise
78 duckdb:vortex-compact -3.0% -0.8% -2.2% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -0.6% -0.8% +0.2% +10.1% ➖ noise
79 datafusion:vortex-compact -0.0% +2.2% -2.2% +14.6% ➖ noise
79 datafusion:vortex-file-compressed -0.2% +2.2% -2.4% +10.0% ➖ noise
79 duckdb:duckdb -1.5% +2.2% -3.6% +10.0% ➖ noise
79 duckdb:vortex-compact -3.2% +2.2% -5.4% +10.1% ➖ noise
79 duckdb:vortex-file-compressed -0.1% +2.2% -2.3% +10.0% ➖ noise
80 datafusion:vortex-compact -0.3% -2.2% +2.0% +10.0% ➖ noise
80 datafusion:vortex-file-compressed -1.3% -2.2% +0.9% +10.0% ➖ noise
80 duckdb:duckdb -3.7% -2.2% -1.5% +16.4% ➖ noise
80 duckdb:vortex-compact -3.4% -2.2% -1.2% +12.1% ➖ noise
80 duckdb:vortex-file-compressed +5.0% -2.2% +7.3% +22.3% ➖ noise
81 datafusion:vortex-compact +1.1% -6.3% +7.8% +10.0% ➖ noise
81 datafusion:vortex-file-compressed -5.7% -6.3% +0.7% +10.9% ➖ noise
81 duckdb:duckdb -0.1% -6.3% +6.6% +10.2% ➖ noise
81 duckdb:vortex-compact +2.5% -6.3% +9.3% +12.9% ➖ noise
81 duckdb:vortex-file-compressed -2.7% -6.3% +3.8% +10.8% ➖ noise
82 datafusion:vortex-compact +1.3% -1.0% +2.3% +11.6% ➖ noise
82 datafusion:vortex-file-compressed -0.3% -1.0% +0.7% +10.0% ➖ noise
82 duckdb:duckdb +3.2% -1.0% +4.2% +12.7% ➖ noise
82 duckdb:vortex-compact +6.5% -1.0% +7.6% +13.1% ➖ noise
82 duckdb:vortex-file-compressed -0.2% -1.0% +0.8% +12.7% ➖ noise
83 datafusion:vortex-compact -1.3% +1.0% -2.3% +10.9% ➖ noise
83 datafusion:vortex-file-compressed -0.2% +1.0% -1.2% +10.0% ➖ noise
83 duckdb:duckdb -4.1% +1.0% -5.1% +11.6% ➖ noise
83 duckdb:vortex-compact +0.6% +1.0% -0.4% +11.5% ➖ noise
83 duckdb:vortex-file-compressed -0.1% +1.0% -1.1% +11.2% ➖ noise
84 datafusion:vortex-compact -6.9% +0.2% -7.2% +10.0% ➖ noise
84 datafusion:vortex-file-compressed -0.3% +0.2% -0.5% +10.0% ➖ noise
84 duckdb:duckdb -2.5% +0.2% -2.7% +10.0% ➖ noise
84 duckdb:vortex-compact -2.9% +0.2% -3.1% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -1.3% +0.2% -1.5% +10.0% ➖ noise
85 datafusion:vortex-compact +3.4% +0.0% +3.3% +12.2% ➖ noise
85 datafusion:vortex-file-compressed -0.9% +0.0% -0.9% +10.0% ➖ noise
85 duckdb:duckdb +6.0% +0.0% +6.0% +10.0% ➖ noise
85 duckdb:vortex-compact -6.2% +0.0% -6.3% +10.4% ➖ noise
85 duckdb:vortex-file-compressed -3.9% +0.0% -3.9% +17.7% ➖ noise
86 datafusion:vortex-compact +10.4% +4.6% +5.5% +16.6% ➖ noise
86 datafusion:vortex-file-compressed -4.9% +4.6% -9.1% +16.6% ➖ noise
86 duckdb:duckdb +11.0% +4.6% +6.1% +15.8% ➖ noise
86 duckdb:vortex-compact -3.3% +4.6% -7.6% +22.7% ➖ noise
86 duckdb:vortex-file-compressed +6.4% +4.6% +1.7% +15.5% ➖ noise
87 datafusion:vortex-compact +1.0% -2.4% +3.5% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +0.2% -2.4% +2.7% +10.0% ➖ noise
87 duckdb:duckdb -2.7% -2.4% -0.3% +14.3% ➖ noise
87 duckdb:vortex-compact -0.8% -2.4% +1.7% +10.8% ➖ noise
87 duckdb:vortex-file-compressed -5.5% -2.4% -3.2% +10.0% ➖ noise
88 datafusion:vortex-compact -0.8% +0.7% -1.5% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +0.0% +0.7% -0.7% +11.2% ➖ noise
88 duckdb:duckdb +1.4% +0.7% +0.7% +10.0% ➖ noise
88 duckdb:vortex-compact -0.4% +0.7% -1.1% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -0.5% +0.7% -1.2% +10.0% ➖ noise
89 datafusion:vortex-compact +0.6% -1.1% +1.8% +19.5% ➖ noise
89 datafusion:vortex-file-compressed +2.5% -1.1% +3.7% +26.3% ➖ noise
89 duckdb:duckdb +3.2% -1.1% +4.4% +10.7% ➖ noise
89 duckdb:vortex-compact +0.1% -1.1% +1.2% +12.7% ➖ noise
89 duckdb:vortex-file-compressed +2.2% -1.1% +3.3% +19.9% ➖ noise
90 datafusion:vortex-compact -1.9% +2.8% -4.5% +12.0% ➖ noise
90 datafusion:vortex-file-compressed +4.5% +2.8% +1.7% +10.0% ➖ noise
90 duckdb:duckdb +2.5% +2.8% -0.3% +15.5% ➖ noise
90 duckdb:vortex-compact +6.6% +2.8% +3.6% +13.2% ➖ noise
90 duckdb:vortex-file-compressed +1.5% +2.8% -1.2% +10.0% ➖ noise
91 datafusion:vortex-compact -3.4% +1.5% -4.8% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +1.8% +1.5% +0.3% +10.0% ➖ noise
91 duckdb:duckdb -4.0% +1.5% -5.4% +10.0% ➖ noise
91 duckdb:vortex-compact -4.7% +1.5% -6.1% +10.0% ➖ noise
91 duckdb:vortex-file-compressed -2.1% +1.5% -3.5% +10.0% ➖ noise
92 datafusion:vortex-compact +2.1% -2.0% +4.2% +16.4% ➖ noise
92 datafusion:vortex-file-compressed -2.0% -2.0% -0.0% +10.0% ➖ noise
92 duckdb:duckdb -5.6% -2.0% -3.6% +13.3% ➖ noise
92 duckdb:vortex-compact -0.1% -2.0% +1.9% +25.8% ➖ noise
92 duckdb:vortex-file-compressed +10.8% -2.0% +13.1% +17.5% ➖ noise
93 datafusion:vortex-compact -2.1% -0.5% -1.6% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -2.8% -0.5% -2.3% +10.0% ➖ noise
93 duckdb:duckdb -1.1% -0.5% -0.6% +14.2% ➖ noise
93 duckdb:vortex-compact -1.9% -0.5% -1.4% +14.0% ➖ noise
93 duckdb:vortex-file-compressed -9.6% -0.5% -9.2% +10.0% ✅ faster
94 datafusion:vortex-compact -5.6% -2.4% -3.3% +17.6% ➖ noise
94 datafusion:vortex-file-compressed -1.4% -2.4% +1.0% +14.6% ➖ noise
94 duckdb:duckdb -6.9% -2.4% -4.6% +15.4% ➖ noise
94 duckdb:vortex-compact -7.7% -2.4% -5.4% +14.1% ➖ noise
94 duckdb:vortex-file-compressed +3.4% -2.4% +5.9% +18.9% ➖ noise
95 datafusion:vortex-compact +2.6% -1.8% +4.6% +13.6% ➖ noise
95 datafusion:vortex-file-compressed +2.1% -1.8% +4.0% +10.4% ➖ noise
95 duckdb:duckdb -15.1% -1.8% -13.5% +13.7% ✅ faster
95 duckdb:vortex-compact +1.9% -1.8% +3.8% +18.4% ➖ noise
95 duckdb:vortex-file-compressed -4.5% -1.8% -2.7% +21.1% ➖ noise
96 datafusion:vortex-compact -0.3% +0.8% -1.1% +10.0% ➖ noise
96 datafusion:vortex-file-compressed -2.4% +0.8% -3.2% +18.5% ➖ noise
96 duckdb:duckdb +7.4% +0.8% +6.5% +17.6% ➖ noise
96 duckdb:vortex-compact -2.7% +0.8% -3.5% +14.4% ➖ noise
96 duckdb:vortex-file-compressed -8.0% +0.8% -8.7% +22.4% ➖ noise
97 datafusion:vortex-compact +2.3% +1.6% +0.7% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -5.5% +1.6% -7.0% +11.6% ➖ noise
97 duckdb:duckdb -4.8% +1.6% -6.3% +12.6% ➖ noise
97 duckdb:vortex-compact -4.2% +1.6% -5.7% +13.9% ➖ noise
97 duckdb:vortex-file-compressed -1.5% +1.6% -3.1% +11.7% ➖ noise
98 datafusion:vortex-compact +0.2% -4.9% +5.4% +10.0% ➖ noise
98 datafusion:vortex-file-compressed -4.3% -4.9% +0.6% +10.0% ➖ noise
98 duckdb:duckdb -1.8% -4.9% +3.3% +16.6% ➖ noise
98 duckdb:vortex-compact -0.9% -4.9% +4.2% +16.2% ➖ noise
98 duckdb:vortex-file-compressed -1.2% -4.9% +3.9% +10.0% ➖ noise
99 datafusion:vortex-compact +2.6% +2.5% +0.1% +24.9% ➖ noise
99 datafusion:vortex-file-compressed -0.6% +2.5% -3.0% +21.9% ➖ noise
99 duckdb:duckdb +3.3% +2.5% +0.8% +44.6% ➖ noise
99 duckdb:vortex-compact -0.2% +2.5% -2.6% +16.1% ➖ noise
99 duckdb:vortex-file-compressed +0.0% +2.5% -2.4% +15.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.6%
Vortex (geomean): 1.037x ➖
Parquet (geomean): 1.042x ➖
Shifts: Parquet (control) +4.2% · Median polish +0.6%


datafusion / vortex-file-compressed (1.033x ➖, 0↑ 1↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 53628708 34478655 1.56
fineweb_q01/datafusion:vortex-file-compressed 591863213 626017259 0.95
fineweb_q02/datafusion:vortex-file-compressed 547629784 552400553 0.99
fineweb_q03/datafusion:vortex-file-compressed 1398432377 1387296344 1.01
fineweb_q04/datafusion:vortex-file-compressed 1361135981 1366875768 1.00
fineweb_q05/datafusion:vortex-file-compressed 1351262093 1381913345 0.98
fineweb_q06/datafusion:vortex-file-compressed 1449582796 1528952008 0.95
fineweb_q07/datafusion:vortex-file-compressed 1370645286 1393870644 0.98
fineweb_q08/datafusion:vortex-file-compressed 523762192 520093681 1.01
datafusion / vortex-compact (1.070x ➖, 0↑ 1↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 34872874 33018553 1.06
fineweb_q01/datafusion:vortex-compact 🚨 623641699 469024508 1.33
fineweb_q02/datafusion:vortex-compact 595341059 521602042 1.14
fineweb_q03/datafusion:vortex-compact 1382629873 1326208465 1.04
fineweb_q04/datafusion:vortex-compact 1572345141 1569547678 1.00
fineweb_q05/datafusion:vortex-compact 1386108898 1372220954 1.01
fineweb_q06/datafusion:vortex-compact 1312432754 1260931642 1.04
fineweb_q07/datafusion:vortex-compact 1291118721 1201894034 1.07
fineweb_q08/datafusion:vortex-compact 423471743 434285174 0.98
datafusion / parquet (1.064x ➖, 0↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1233268165 1059804552 1.16
fineweb_q01/datafusion:parquet 1879837856 2115632510 0.89
fineweb_q02/datafusion:parquet 1927610200 1784390832 1.08
fineweb_q03/datafusion:parquet 1927927286 1857461190 1.04
fineweb_q04/datafusion:parquet 2293008997 1819995639 1.26
fineweb_q05/datafusion:parquet 2028052489 1972449849 1.03
fineweb_q06/datafusion:parquet 1845676575 1858980037 0.99
fineweb_q07/datafusion:parquet 2111145943 1831236338 1.15
fineweb_q08/datafusion:parquet 2048780777 2007048281 1.02
duckdb / vortex-file-compressed (1.006x ➖, 0↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 93255567 85883476 1.09
fineweb_q01/duckdb:vortex-file-compressed 595473546 690215412 0.86
fineweb_q02/duckdb:vortex-file-compressed 559185849 588045868 0.95
fineweb_q03/duckdb:vortex-file-compressed 1571646268 1445086219 1.09
fineweb_q04/duckdb:vortex-file-compressed 1620768630 1580837836 1.03
fineweb_q05/duckdb:vortex-file-compressed 1482536789 1524368702 0.97
fineweb_q06/duckdb:vortex-file-compressed 1801362481 1676137942 1.07
fineweb_q07/duckdb:vortex-file-compressed 1564161393 1563554169 1.00
fineweb_q08/duckdb:vortex-file-compressed 684333457 674618751 1.01
duckdb / vortex-compact (1.038x ➖, 0↑ 1↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 91426040 62162607 1.47
fineweb_q01/duckdb:vortex-compact 603255641 561585683 1.07
fineweb_q02/duckdb:vortex-compact 565816894 585908772 0.97
fineweb_q03/duckdb:vortex-compact 1731025897 1678600935 1.03
fineweb_q04/duckdb:vortex-compact 1755724437 1720983183 1.02
fineweb_q05/duckdb:vortex-compact 1586207088 1491626516 1.06
fineweb_q06/duckdb:vortex-compact 1445806067 1608768976 0.90
fineweb_q07/duckdb:vortex-compact 1503389048 1375058463 1.09
fineweb_q08/duckdb:vortex-compact 522912546 627919436 0.83
duckdb / parquet (1.021x ➖, 0↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1231453324 1118903851 1.10
fineweb_q01/duckdb:parquet 1479791400 1559060978 0.95
fineweb_q02/duckdb:parquet 1290829220 1392210613 0.93
fineweb_q03/duckdb:parquet 3542187092 3850493781 0.92
fineweb_q04/duckdb:parquet 2052557688 1869562254 1.10
fineweb_q05/duckdb:parquet 2344709650 2069387956 1.13
fineweb_q06/duckdb:parquet 4436779856 4262176171 1.04
fineweb_q07/duckdb:parquet 2670553934 2624637418 1.02
fineweb_q08/duckdb:parquet 1170014245 1139939370 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +5.6% +13.2% -6.7% +277.1% ➖ noise
0 datafusion:vortex-file-compressed +55.5% +13.2% +37.4% +155.9% ➖ noise
0 duckdb:vortex-compact +47.1% +13.2% +30.0% +46.1% ➖ noise
0 duckdb:vortex-file-compressed +8.6% +13.2% -4.1% +51.9% ➖ noise
1 datafusion:vortex-compact +33.0% -8.2% +44.8% +64.1% ➖ noise
1 datafusion:vortex-file-compressed -5.5% -8.2% +2.9% +72.0% ➖ noise
1 duckdb:vortex-compact +7.4% -8.2% +17.0% +31.0% ➖ noise
1 duckdb:vortex-file-compressed -13.7% -8.2% -6.1% +37.2% ➖ noise
2 datafusion:vortex-compact +14.1% +0.1% +14.0% +34.5% ➖ noise
2 datafusion:vortex-file-compressed -0.9% +0.1% -0.9% +30.0% ➖ noise
2 duckdb:vortex-compact -3.4% +0.1% -3.5% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -4.9% +0.1% -5.0% +57.7% ➖ noise
3 datafusion:vortex-compact +4.3% -2.3% +6.7% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +0.8% -2.3% +3.2% +30.0% ➖ noise
3 duckdb:vortex-compact +3.1% -2.3% +5.5% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +8.8% -2.3% +11.3% +30.0% ➖ noise
4 datafusion:vortex-compact +0.2% +17.6% -14.8% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -0.4% +17.6% -15.3% +30.0% ➖ noise
4 duckdb:vortex-compact +2.0% +17.6% -13.3% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +2.5% +17.6% -12.8% +30.0% ➖ noise
5 datafusion:vortex-compact +1.0% +7.9% -6.4% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -2.2% +7.9% -9.4% +30.0% ➖ noise
5 duckdb:vortex-compact +6.3% +7.9% -1.5% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -2.7% +7.9% -9.9% +30.0% ➖ noise
6 datafusion:vortex-compact +4.1% +1.7% +2.4% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -5.2% +1.7% -6.7% +30.0% ➖ noise
6 duckdb:vortex-compact -10.1% +1.7% -11.6% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +7.5% +1.7% +5.7% +30.0% ➖ noise
7 datafusion:vortex-compact +7.4% +8.3% -0.8% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -1.7% +8.3% -9.2% +30.0% ➖ noise
7 duckdb:vortex-compact +9.3% +8.3% +0.9% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +0.0% +8.3% -7.6% +30.0% ➖ noise
8 datafusion:vortex-compact -2.5% +2.4% -4.7% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +0.7% +2.4% -1.6% +30.0% ➖ noise
8 duckdb:vortex-compact -16.7% +2.4% -18.6% +42.6% ➖ noise
8 duckdb:vortex-file-compressed +1.4% +2.4% -0.9% +48.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.994x ➖
Parquet (geomean): 1.007x ➖


unknown / unknown (1.010x ➖, 1↑ 1↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 2466518 2625397 0.94
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1558845 1459943 1.07
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8369323329 8121406923 1.03
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8477083894 8178337817 1.04
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7862958 7717979 1.02
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 7046990 7394308 0.95
random-access/feature-vectors/uniform/lance-tokio-local-disk 🚨 6577549 5762832 1.14
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 7175681 6561451 1.09
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8375938140 8324897242 1.01
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8340811634 8280742325 1.01
random-access/feature-vectors/uniform/vortex-tokio-local-disk 13569268 13305004 1.02
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 13280042 13098789 1.01
random-access/lance-tokio-local-disk 740841 744497 1.00
random-access/lance-tokio-local-disk-footer 1296682 1302401 1.00
random-access/nested-lists/correlated/lance-tokio-local-disk 258591 252194 1.03
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 651883 626897 1.04
random-access/nested-lists/correlated/parquet-tokio-local-disk 131531521 127789037 1.03
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 128405909 129011885 1.00
random-access/nested-lists/correlated/vortex-tokio-local-disk 613737 588380 1.04
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 618618 607076 1.02
random-access/nested-lists/uniform/lance-tokio-local-disk 1101980 1073842 1.03
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1485281 1454333 1.02
random-access/nested-lists/uniform/parquet-tokio-local-disk 130511510 127164874 1.03
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 128041553 127398528 1.01
random-access/nested-lists/uniform/vortex-tokio-local-disk 2119792 2068287 1.02
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2124464 2059491 1.03
random-access/nested-structs/correlated/lance-tokio-local-disk 407958 390954 1.04
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 614960 591153 1.04
random-access/nested-structs/correlated/parquet-tokio-local-disk 21721285 21401229 1.01
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 20891367 20878232 1.00
random-access/nested-structs/correlated/vortex-tokio-local-disk 787991 723267 1.09
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 798150 761307 1.05
random-access/nested-structs/uniform/lance-tokio-local-disk 2742207 2632135 1.04
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2950124 2838953 1.04
random-access/nested-structs/uniform/parquet-tokio-local-disk 20986013 20885464 1.00
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 22031596 21611041 1.02
random-access/nested-structs/uniform/vortex-tokio-local-disk 1622143 1553366 1.04
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1735453 1668035 1.04
random-access/parquet-tokio-local-disk 165450429 166769491 0.99
random-access/parquet-tokio-local-disk-footer 165524139 167657257 0.99
random-access/taxi/correlated/lance-tokio-local-disk 930485 933417 1.00
random-access/taxi/correlated/lance-tokio-local-disk-footer 1574842 1564058 1.01
random-access/taxi/correlated/parquet-tokio-local-disk 248246924 247380745 1.00
random-access/taxi/correlated/parquet-tokio-local-disk-footer 248179765 250635247 0.99
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1509634 1796422 0.84
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1695830 1797151 0.94
random-access/taxi/uniform/lance-tokio-local-disk 9400310 9459782 0.99
random-access/taxi/uniform/lance-tokio-local-disk-footer 10176045 10109966 1.01
random-access/taxi/uniform/parquet-tokio-local-disk 262808255 265092075 0.99
random-access/taxi/uniform/parquet-tokio-local-disk-footer 263509085 265554628 0.99
random-access/taxi/uniform/vortex-tokio-local-disk 4438264 4568423 0.97
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4405752 4543144 0.97
random-access/vortex-tokio-local-disk 1163670 1248646 0.93
random-access/vortex-tokio-local-disk-footer 1181104 1282113 0.92

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.8%
Vortex (geomean): 1.019x ➖
Parquet (geomean): 0.991x ➖
Shifts: Parquet (control) -0.9% · Median polish -0.2%


duckdb / vortex-file-compressed (1.006x ➖, 0↑ 1↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11352148 11884009 0.96
statpopgen_q01/duckdb:vortex-file-compressed 🚨 30596859 26363505 1.16
statpopgen_q02/duckdb:vortex-file-compressed 1388866221 1393116191 1.00
statpopgen_q03/duckdb:vortex-file-compressed 3154119065 3124438916 1.01
statpopgen_q04/duckdb:vortex-file-compressed 3140943487 3112749238 1.01
statpopgen_q05/duckdb:vortex-file-compressed 1466999478 1449779882 1.01
statpopgen_q06/duckdb:vortex-file-compressed 2140790134 2148536564 1.00
statpopgen_q07/duckdb:vortex-file-compressed 207085033 209186911 0.99
statpopgen_q08/duckdb:vortex-file-compressed 235462599 241541487 0.97
statpopgen_q09/duckdb:vortex-file-compressed 2915512894 2976345263 0.98
statpopgen_q10/duckdb:vortex-file-compressed 4729954027 4759937961 0.99
duckdb / vortex-compact (1.032x ➖, 0↑ 1↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11232900 11254878 1.00
statpopgen_q01/duckdb:vortex-compact 🚨 169594053 116819510 1.45
statpopgen_q02/duckdb:vortex-compact 1832914409 1819600861 1.01
statpopgen_q03/duckdb:vortex-compact 3517109280 3558535388 0.99
statpopgen_q04/duckdb:vortex-compact 3575735681 3551258365 1.01
statpopgen_q05/duckdb:vortex-compact 1851047113 1852012178 1.00
statpopgen_q06/duckdb:vortex-compact 2683551483 2683103138 1.00
statpopgen_q07/duckdb:vortex-compact 877601435 886951951 0.99
statpopgen_q08/duckdb:vortex-compact 911753912 913673947 1.00
statpopgen_q09/duckdb:vortex-compact 3341063906 3376689597 0.99
statpopgen_q10/duckdb:vortex-compact 5396287774 5437559156 0.99
duckdb / parquet (0.991x ➖, 0↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 331020923 331787515 1.00
statpopgen_q01/duckdb:parquet 417641492 415892488 1.00
statpopgen_q02/duckdb:parquet 1007405844 1006914840 1.00
statpopgen_q03/duckdb:parquet 1508942662 1528392515 0.99
statpopgen_q04/duckdb:parquet 1531387409 1549192253 0.99
statpopgen_q05/duckdb:parquet 1011595092 1038180066 0.97
statpopgen_q06/duckdb:parquet 1516548405 1487828341 1.02
statpopgen_q07/duckdb:parquet 1312383803 1337906119 0.98
statpopgen_q08/duckdb:parquet 1307071829 1355820841 0.96
statpopgen_q09/duckdb:parquet 1359148062 1377351687 0.99
statpopgen_q10/duckdb:parquet 2703925937 2722418455 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -0.2% -0.2% +0.0% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -4.5% -0.2% -4.3% +10.0% ➖ noise
1 duckdb:vortex-compact +45.2% +0.4% +44.6% +31.3% 🚨 regression
1 duckdb:vortex-file-compressed +16.1% +0.4% +15.6% +178.8% ➖ noise
2 duckdb:vortex-compact +0.7% +0.0% +0.7% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -0.3% +0.0% -0.4% +10.0% ➖ noise
3 duckdb:vortex-compact -1.2% -1.3% +0.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.9% -1.3% +2.3% +10.0% ➖ noise
4 duckdb:vortex-compact +0.7% -1.1% +1.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.9% -1.1% +2.1% +10.0% ➖ noise
5 duckdb:vortex-compact -0.1% -2.6% +2.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.2% -2.6% +3.8% +10.0% ➖ noise
6 duckdb:vortex-compact +0.0% +1.9% -1.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.4% +1.9% -2.2% +10.0% ➖ noise
7 duckdb:vortex-compact -1.1% -1.9% +0.9% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -1.0% -1.9% +0.9% +10.0% ➖ noise
8 duckdb:vortex-compact -0.2% -3.6% +3.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -2.5% -3.6% +1.1% +10.0% ➖ noise
9 duckdb:vortex-compact -1.1% -1.3% +0.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -2.0% -1.3% -0.7% +10.0% ➖ noise
10 duckdb:vortex-compact -0.8% -0.7% -0.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.6% -0.7% +0.0% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -4.6%
Vortex (geomean): 0.864x ✅
Parquet (geomean): 0.913x ➖
Shifts: Parquet (control) -8.7% · Median polish -12.3%


datafusion / vortex-file-compressed (0.832x ✅, 21↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 378927756 456155451 0.83
tpch_q02/datafusion:vortex-file-compressed 🚀 103866855 126249394 0.82
tpch_q03/datafusion:vortex-file-compressed 🚀 212442045 270917360 0.78
tpch_q04/datafusion:vortex-file-compressed 🚀 111863244 138831381 0.81
tpch_q05/datafusion:vortex-file-compressed 🚀 364932465 460064263 0.79
tpch_q06/datafusion:vortex-file-compressed 🚀 41573470 51635815 0.81
tpch_q07/datafusion:vortex-file-compressed 🚀 495626164 612108183 0.81
tpch_q08/datafusion:vortex-file-compressed 🚀 350305400 424431263 0.83
tpch_q09/datafusion:vortex-file-compressed 🚀 615997741 726532583 0.85
tpch_q10/datafusion:vortex-file-compressed 🚀 223364635 268286581 0.83
tpch_q11/datafusion:vortex-file-compressed 🚀 78862294 93279544 0.85
tpch_q12/datafusion:vortex-file-compressed 🚀 117318434 137742171 0.85
tpch_q13/datafusion:vortex-file-compressed 🚀 208905630 250957863 0.83
tpch_q14/datafusion:vortex-file-compressed 🚀 54720460 63096147 0.87
tpch_q15/datafusion:vortex-file-compressed 🚀 103360713 122395001 0.84
tpch_q16/datafusion:vortex-file-compressed 🚀 74640857 87869565 0.85
tpch_q17/datafusion:vortex-file-compressed 🚀 615851690 765318904 0.80
tpch_q18/datafusion:vortex-file-compressed 🚀 821846275 999663363 0.82
tpch_q19/datafusion:vortex-file-compressed 92028431 100861290 0.91
tpch_q20/datafusion:vortex-file-compressed 🚀 160913872 190931059 0.84
tpch_q21/datafusion:vortex-file-compressed 🚀 642203712 781429207 0.82
tpch_q22/datafusion:vortex-file-compressed 🚀 64844969 74368012 0.87
datafusion / vortex-compact (0.843x ✅, 22↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚀 443062294 494503368 0.90
tpch_q02/datafusion:vortex-compact 🚀 108239113 124142448 0.87
tpch_q03/datafusion:vortex-compact 🚀 210495834 243955730 0.86
tpch_q04/datafusion:vortex-compact 🚀 118732422 136403326 0.87
tpch_q05/datafusion:vortex-compact 🚀 365616624 435181820 0.84
tpch_q06/datafusion:vortex-compact 🚀 61502240 72969536 0.84
tpch_q07/datafusion:vortex-compact 🚀 507148534 598283008 0.85
tpch_q08/datafusion:vortex-compact 🚀 351569182 430456741 0.82
tpch_q09/datafusion:vortex-compact 🚀 617903601 750023741 0.82
tpch_q10/datafusion:vortex-compact 🚀 235485134 283482017 0.83
tpch_q11/datafusion:vortex-compact 🚀 81617586 96994965 0.84
tpch_q12/datafusion:vortex-compact 🚀 159743641 186996471 0.85
tpch_q13/datafusion:vortex-compact 🚀 263148366 309041510 0.85
tpch_q14/datafusion:vortex-compact 🚀 73770704 86290971 0.85
tpch_q15/datafusion:vortex-compact 🚀 157997336 190295198 0.83
tpch_q16/datafusion:vortex-compact 🚀 77837228 92926443 0.84
tpch_q17/datafusion:vortex-compact 🚀 620912497 767565305 0.81
tpch_q18/datafusion:vortex-compact 🚀 821283722 1024248514 0.80
tpch_q19/datafusion:vortex-compact 🚀 130433160 146054870 0.89
tpch_q20/datafusion:vortex-compact 🚀 185681409 223903075 0.83
tpch_q21/datafusion:vortex-compact 🚀 648553685 809955866 0.80
tpch_q22/datafusion:vortex-compact 🚀 71075410 82984261 0.86
datafusion / parquet (0.892x ✅, 13↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 453917897 538334645 0.84
tpch_q02/datafusion:parquet 168207699 186332101 0.90
tpch_q03/datafusion:parquet 🚀 273482097 325140857 0.84
tpch_q04/datafusion:parquet 🚀 124200845 143360653 0.87
tpch_q05/datafusion:parquet 🚀 422063118 496649281 0.85
tpch_q06/datafusion:parquet 125713287 132091624 0.95
tpch_q07/datafusion:parquet 🚀 589864825 696557936 0.85
tpch_q08/datafusion:parquet 🚀 450341779 524824605 0.86
tpch_q09/datafusion:parquet 🚀 721660929 827049477 0.87
tpch_q10/datafusion:parquet 484949328 533171008 0.91
tpch_q11/datafusion:parquet 🚀 113991124 127341482 0.90
tpch_q12/datafusion:parquet 199993518 207369086 0.96
tpch_q13/datafusion:parquet 328145922 347272209 0.94
tpch_q14/datafusion:parquet 155006048 156623101 0.99
tpch_q15/datafusion:parquet 🚀 239652294 268389389 0.89
tpch_q16/datafusion:parquet 128884750 134376604 0.96
tpch_q17/datafusion:parquet 🚀 659961735 780147051 0.85
tpch_q18/datafusion:parquet 🚀 856599893 983628108 0.87
tpch_q19/datafusion:parquet 250661789 275809440 0.91
tpch_q20/datafusion:parquet 🚀 283485895 318544920 0.89
tpch_q21/datafusion:parquet 🚀 673566694 826636986 0.81
tpch_q22/datafusion:parquet 210484062 227726651 0.92
datafusion / arrow (0.849x ✅, 20↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 577636679 685903136 0.84
tpch_q02/datafusion:arrow 🚀 163129953 193678780 0.84
tpch_q03/datafusion:arrow 🚀 463054386 568920934 0.81
tpch_q04/datafusion:arrow 🚀 338852200 415532955 0.82
tpch_q05/datafusion:arrow 🚀 929714771 1117792650 0.83
tpch_q06/datafusion:arrow 🚀 275767373 331058770 0.83
tpch_q07/datafusion:arrow 🚀 1130512487 1354733605 0.83
tpch_q08/datafusion:arrow 🚀 1106970926 1312415006 0.84
tpch_q09/datafusion:arrow 🚀 1323369263 1503989389 0.88
tpch_q10/datafusion:arrow 🚀 573432162 663239993 0.86
tpch_q11/datafusion:arrow 137506663 145121280 0.95
tpch_q12/datafusion:arrow 🚀 734223420 877727537 0.84
tpch_q13/datafusion:arrow 497422352 540527952 0.92
tpch_q14/datafusion:arrow 🚀 307608897 364736947 0.84
tpch_q15/datafusion:arrow 🚀 660298088 821225011 0.80
tpch_q16/datafusion:arrow 🚀 104448582 120428203 0.87
tpch_q17/datafusion:arrow 🚀 1317704075 1564338143 0.84
tpch_q18/datafusion:arrow 🚀 1854002090 2209425616 0.84
tpch_q19/datafusion:arrow 🚀 478533015 572308454 0.84
tpch_q20/datafusion:arrow 🚀 472945979 569884270 0.83
tpch_q21/datafusion:arrow 🚀 2929505083 3309752990 0.89
tpch_q22/datafusion:arrow 🚀 128260541 152956337 0.84
duckdb / vortex-file-compressed (0.914x ➖, 7↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 170786861 187187801 0.91
tpch_q02/duckdb:vortex-file-compressed 50782641 54567367 0.93
tpch_q03/duckdb:vortex-file-compressed 123026164 136364726 0.90
tpch_q04/duckdb:vortex-file-compressed 🚀 148872112 166838559 0.89
tpch_q05/duckdb:vortex-file-compressed 🚀 126312991 140651307 0.90
tpch_q06/duckdb:vortex-file-compressed 🚀 48560369 54854232 0.89
tpch_q07/duckdb:vortex-file-compressed 142212953 156586055 0.91
tpch_q08/duckdb:vortex-file-compressed 🚀 169916292 189784475 0.90
tpch_q09/duckdb:vortex-file-compressed 320303544 340658730 0.94
tpch_q10/duckdb:vortex-file-compressed 142023553 157441470 0.90
tpch_q11/duckdb:vortex-file-compressed 32877716 33622489 0.98
tpch_q12/duckdb:vortex-file-compressed 93274977 99034823 0.94
tpch_q13/duckdb:vortex-file-compressed 223953356 248406134 0.90
tpch_q14/duckdb:vortex-file-compressed 67492231 73087414 0.92
tpch_q15/duckdb:vortex-file-compressed 85320079 93987935 0.91
tpch_q16/duckdb:vortex-file-compressed 🚀 76439930 84955895 0.90
tpch_q17/duckdb:vortex-file-compressed 96698937 105787528 0.91
tpch_q18/duckdb:vortex-file-compressed 283963966 303623900 0.94
tpch_q19/duckdb:vortex-file-compressed 84131922 88093303 0.96
tpch_q20/duckdb:vortex-file-compressed 🚀 156238147 176576747 0.88
tpch_q21/duckdb:vortex-file-compressed 561508748 623504498 0.90
tpch_q22/duckdb:vortex-file-compressed 🚀 70876988 78817120 0.90
duckdb / vortex-compact (0.871x ✅, 20↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 227556978 251420924 0.91
tpch_q02/duckdb:vortex-compact 🚀 54813027 61136835 0.90
tpch_q03/duckdb:vortex-compact 🚀 136753770 160345442 0.85
tpch_q04/duckdb:vortex-compact 🚀 169637925 195171968 0.87
tpch_q05/duckdb:vortex-compact 🚀 144184997 163534564 0.88
tpch_q06/duckdb:vortex-compact 🚀 82629266 96173850 0.86
tpch_q07/duckdb:vortex-compact 🚀 195155713 222942545 0.88
tpch_q08/duckdb:vortex-compact 🚀 185085875 213474736 0.87
tpch_q09/duckdb:vortex-compact 🚀 349738392 402385677 0.87
tpch_q10/duckdb:vortex-compact 🚀 173925300 199824291 0.87
tpch_q11/duckdb:vortex-compact 🚀 39618286 44837453 0.88
tpch_q12/duckdb:vortex-compact 🚀 201429482 232633512 0.87
tpch_q13/duckdb:vortex-compact 🚀 275245249 317208297 0.87
tpch_q14/duckdb:vortex-compact 🚀 98593053 115801732 0.85
tpch_q15/duckdb:vortex-compact 🚀 111481751 127038283 0.88
tpch_q16/duckdb:vortex-compact 🚀 80567165 93208127 0.86
tpch_q17/duckdb:vortex-compact 🚀 111322487 132816854 0.84
tpch_q18/duckdb:vortex-compact 🚀 284712973 327794157 0.87
tpch_q19/duckdb:vortex-compact 107105830 118741124 0.90
tpch_q20/duckdb:vortex-compact 🚀 199205288 234472310 0.85
tpch_q21/duckdb:vortex-compact 🚀 602291855 714593974 0.84
tpch_q22/duckdb:vortex-compact 🚀 84190652 93748922 0.90
duckdb / parquet (0.935x ➖, 2↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 256806847 274534188 0.94
tpch_q02/duckdb:parquet 93774953 101292207 0.93
tpch_q03/duckdb:parquet 207347915 224634861 0.92
tpch_q04/duckdb:parquet 133692891 142816504 0.94
tpch_q05/duckdb:parquet 217925399 233513985 0.93
tpch_q06/duckdb:parquet 66525556 72123814 0.92
tpch_q07/duckdb:parquet 178968672 194618010 0.92
tpch_q08/duckdb:parquet 🚀 247078159 276607289 0.89
tpch_q09/duckdb:parquet 491624315 515592242 0.95
tpch_q10/duckdb:parquet 611826059 639767295 0.96
tpch_q11/duckdb:parquet 56756492 60139466 0.94
tpch_q12/duckdb:parquet 123306042 132130140 0.93
tpch_q13/duckdb:parquet 445057806 463974084 0.96
tpch_q14/duckdb:parquet 172340693 186205882 0.93
tpch_q15/duckdb:parquet 97350117 103857073 0.94
tpch_q16/duckdb:parquet 157256255 170741371 0.92
tpch_q17/duckdb:parquet 174824297 182299895 0.96
tpch_q18/duckdb:parquet 349086856 369062415 0.95
tpch_q19/duckdb:parquet 282649722 297773753 0.95
tpch_q20/duckdb:parquet 228455189 241956651 0.94
tpch_q21/duckdb:parquet 🚀 555699255 631905713 0.88
tpch_q22/duckdb:parquet 289146319 297120316 0.97
duckdb / duckdb (0.922x ➖, 5↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 🚀 116460033 129702792 0.90
tpch_q02/duckdb:duckdb 🚀 44867509 52046338 0.86
tpch_q03/duckdb:duckdb 96648692 107202809 0.90
tpch_q04/duckdb:duckdb 🚀 130376407 148707098 0.88
tpch_q05/duckdb:duckdb 🚀 108612473 120870656 0.90
tpch_q06/duckdb:duckdb 37356115 40569257 0.92
tpch_q07/duckdb:duckdb 86310950 94290920 0.92
tpch_q08/duckdb:duckdb 🚀 109370567 123697413 0.88
tpch_q09/duckdb:duckdb 274652122 302836161 0.91
tpch_q10/duckdb:duckdb 204733746 223461361 0.92
tpch_q11/duckdb:duckdb 15701933 16406009 0.96
tpch_q12/duckdb:duckdb 84456792 91506800 0.92
tpch_q13/duckdb:duckdb 219692740 234639587 0.94
tpch_q14/duckdb:duckdb 69695239 74149376 0.94
tpch_q15/duckdb:duckdb 77751074 81824182 0.95
tpch_q16/duckdb:duckdb 72465843 77983649 0.93
tpch_q17/duckdb:duckdb 84645776 88452786 0.96
tpch_q18/duckdb:duckdb 213452512 228284292 0.94
tpch_q19/duckdb:duckdb 116584501 125129528 0.93
tpch_q20/duckdb:duckdb 112305517 116421038 0.96
tpch_q21/duckdb:duckdb 293335498 316302725 0.93
tpch_q22/duckdb:duckdb 69672026 71729152 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -15.8% -11.2% -5.2% +10.0% ➖ noise
1 datafusion:vortex-compact -10.4% -11.2% +0.9% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -16.9% -11.2% -6.5% +10.0% ➖ noise
1 duckdb:duckdb -10.2% -11.2% +1.1% +10.0% ➖ noise
1 duckdb:vortex-compact -9.5% -11.2% +1.9% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -8.8% -11.2% +2.7% +10.0% ➖ noise
2 datafusion:arrow -15.8% -8.6% -7.9% +10.0% ➖ noise
2 datafusion:vortex-compact -12.8% -8.6% -4.6% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -17.7% -8.6% -10.0% +10.0% ✅ faster
2 duckdb:duckdb -13.8% -8.6% -5.7% +10.0% ➖ noise
2 duckdb:vortex-compact -10.3% -8.6% -1.9% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -6.9% -8.6% +1.8% +10.0% ➖ noise
3 datafusion:arrow -18.6% -11.9% -7.6% +10.0% ➖ noise
3 datafusion:vortex-compact -13.7% -11.9% -2.1% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -21.6% -11.9% -11.0% +10.0% ✅ faster
3 duckdb:duckdb -9.8% -11.9% +2.3% +10.0% ➖ noise
3 duckdb:vortex-compact -14.7% -11.9% -3.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -9.8% -11.9% +2.4% +10.0% ➖ noise
4 datafusion:arrow -18.5% -9.9% -9.4% +10.0% ✅ faster
4 datafusion:vortex-compact -13.0% -9.9% -3.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -19.4% -9.9% -10.5% +10.0% ✅ faster
4 duckdb:duckdb -12.3% -9.9% -2.6% +10.0% ➖ noise
4 duckdb:vortex-compact -13.1% -9.9% -3.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -10.8% -9.9% -0.9% +10.0% ➖ noise
5 datafusion:arrow -16.8% -10.9% -6.6% +10.0% ➖ noise
5 datafusion:vortex-compact -16.0% -10.9% -5.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -20.7% -10.9% -10.9% +10.0% ✅ faster
5 duckdb:duckdb -10.1% -10.9% +0.9% +10.0% ➖ noise
5 duckdb:vortex-compact -11.8% -10.9% -1.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -10.2% -10.9% +0.8% +10.0% ➖ noise
6 datafusion:arrow -16.7% -6.3% -11.1% +10.0% ✅ faster
6 datafusion:vortex-compact -15.7% -6.3% -10.0% +10.0% ✅ faster
6 datafusion:vortex-file-compressed -19.5% -6.3% -14.1% +10.0% ✅ faster
6 duckdb:duckdb -7.9% -6.3% -1.7% +11.9% ➖ noise
6 duckdb:vortex-compact -14.1% -6.3% -8.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -11.5% -6.3% -5.5% +10.0% ➖ noise
7 datafusion:arrow -16.6% -11.8% -5.4% +10.0% ➖ noise
7 datafusion:vortex-compact -15.2% -11.8% -3.9% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -19.0% -11.8% -8.2% +10.0% ➖ noise
7 duckdb:duckdb -8.5% -11.8% +3.7% +10.0% ➖ noise
7 duckdb:vortex-compact -12.5% -11.8% -0.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -9.2% -11.8% +2.9% +10.0% ➖ noise
8 datafusion:arrow -15.7% -12.5% -3.7% +10.0% ➖ noise
8 datafusion:vortex-compact -18.3% -12.5% -6.7% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -17.5% -12.5% -5.7% +10.0% ➖ noise
8 duckdb:duckdb -11.6% -12.5% +1.0% +10.0% ➖ noise
8 duckdb:vortex-compact -13.3% -12.5% -1.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -10.5% -12.5% +2.3% +10.0% ➖ noise
9 datafusion:arrow -12.0% -8.8% -3.5% +10.0% ➖ noise
9 datafusion:vortex-compact -17.6% -8.8% -9.7% +10.0% ✅ faster
9 datafusion:vortex-file-compressed -15.2% -8.8% -7.0% +10.0% ➖ noise
9 duckdb:duckdb -9.3% -8.8% -0.6% +10.0% ➖ noise
9 duckdb:vortex-compact -13.1% -8.8% -4.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -6.0% -8.8% +3.1% +10.0% ➖ noise
10 datafusion:arrow -13.5% -6.7% -7.3% +10.0% ➖ noise
10 datafusion:vortex-compact -16.9% -6.7% -10.9% +10.0% ✅ faster
10 datafusion:vortex-file-compressed -16.7% -6.7% -10.7% +10.0% ✅ faster
10 duckdb:duckdb -8.4% -6.7% -1.8% +10.0% ➖ noise
10 duckdb:vortex-compact -13.0% -6.7% -6.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -9.8% -6.7% -3.3% +10.0% ➖ noise
11 datafusion:arrow -5.2% -8.1% +3.1% +10.0% ➖ noise
11 datafusion:vortex-compact -15.9% -8.1% -8.5% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -15.5% -8.1% -8.0% +10.0% ➖ noise
11 duckdb:duckdb -4.3% -8.1% +4.1% +11.8% ➖ noise
11 duckdb:vortex-compact -11.6% -8.1% -3.9% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -2.2% -8.1% +6.4% +10.3% ➖ noise
12 datafusion:arrow -16.3% -5.1% -11.8% +28.9% ➖ noise
12 datafusion:vortex-compact -14.6% -5.1% -10.0% +10.0% ✅ faster
12 datafusion:vortex-file-compressed -14.8% -5.1% -10.2% +10.0% ✅ faster
12 duckdb:duckdb -7.7% -5.1% -2.7% +10.0% ➖ noise
12 duckdb:vortex-compact -13.4% -5.1% -8.7% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -5.8% -5.1% -0.7% +10.0% ➖ noise
13 datafusion:arrow -8.0% -4.8% -3.3% +10.0% ➖ noise
13 datafusion:vortex-compact -14.9% -4.8% -10.6% +10.0% ✅ faster
13 datafusion:vortex-file-compressed -16.8% -4.8% -12.6% +10.0% ✅ faster
13 duckdb:duckdb -6.4% -4.8% -1.7% +10.0% ➖ noise
13 duckdb:vortex-compact -13.2% -4.8% -8.9% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -9.8% -4.8% -5.3% +10.0% ➖ noise
14 datafusion:arrow -15.7% -4.3% -11.9% +10.0% ✅ faster
14 datafusion:vortex-compact -14.5% -4.3% -10.7% +10.0% ✅ faster
14 datafusion:vortex-file-compressed -13.3% -4.3% -9.4% +10.0% ✅ faster
14 duckdb:duckdb -6.0% -4.3% -1.8% +10.0% ➖ noise
14 duckdb:vortex-compact -14.9% -4.3% -11.0% +10.0% ✅ faster
14 duckdb:vortex-file-compressed -7.7% -4.3% -3.5% +10.0% ➖ noise
15 datafusion:arrow -19.6% -8.5% -12.1% +10.0% ✅ faster
15 datafusion:vortex-compact -17.0% -8.5% -9.2% +10.0% ✅ faster
15 datafusion:vortex-file-compressed -15.6% -8.5% -7.7% +10.0% ➖ noise
15 duckdb:duckdb -5.0% -8.5% +3.9% +10.0% ➖ noise
15 duckdb:vortex-compact -12.2% -8.5% -4.1% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -9.2% -8.5% -0.8% +10.0% ➖ noise
16 datafusion:arrow -13.3% -6.0% -7.7% +10.0% ➖ noise
16 datafusion:vortex-compact -16.2% -6.0% -10.9% +10.0% ✅ faster
16 datafusion:vortex-file-compressed -15.1% -6.0% -9.6% +10.0% ✅ faster
16 duckdb:duckdb -7.1% -6.0% -1.1% +10.0% ➖ noise
16 duckdb:vortex-compact -13.6% -6.0% -8.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -10.0% -6.0% -4.3% +10.0% ➖ noise
17 datafusion:arrow -15.8% -9.9% -6.5% +10.0% ➖ noise
17 datafusion:vortex-compact -19.1% -9.9% -10.2% +10.0% ✅ faster
17 datafusion:vortex-file-compressed -19.5% -9.9% -10.7% +10.0% ✅ faster
17 duckdb:duckdb -4.3% -9.9% +6.2% +10.0% ➖ noise
17 duckdb:vortex-compact -16.2% -9.9% -6.9% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -8.6% -9.9% +1.5% +10.0% ➖ noise
18 datafusion:arrow -16.1% -9.2% -7.5% +10.0% ➖ noise
18 datafusion:vortex-compact -19.8% -9.2% -11.7% +10.0% ✅ faster
18 datafusion:vortex-file-compressed -17.8% -9.2% -9.4% +10.0% ✅ faster
18 duckdb:duckdb -6.5% -9.2% +3.0% +10.0% ➖ noise
18 duckdb:vortex-compact -13.1% -9.2% -4.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -6.5% -9.2% +3.0% +10.0% ➖ noise
19 datafusion:arrow -16.4% -7.1% -10.0% +10.0% ✅ faster
19 datafusion:vortex-compact -10.7% -7.1% -3.8% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -8.8% -7.1% -1.8% +10.0% ➖ noise
19 duckdb:duckdb -6.8% -7.1% +0.3% +10.0% ➖ noise
19 duckdb:vortex-compact -9.8% -7.1% -2.9% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -4.5% -7.1% +2.8% +10.0% ➖ noise
20 datafusion:arrow -17.0% -8.3% -9.5% +10.0% ✅ faster
20 datafusion:vortex-compact -17.1% -8.3% -9.5% +10.0% ✅ faster
20 datafusion:vortex-file-compressed -15.7% -8.3% -8.1% +10.0% ➖ noise
20 duckdb:duckdb -3.5% -8.3% +5.2% +10.0% ➖ noise
20 duckdb:vortex-compact -15.0% -8.3% -7.3% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -11.5% -8.3% -3.5% +10.0% ➖ noise
21 datafusion:arrow -11.5% -15.4% +4.6% +10.0% ➖ noise
21 datafusion:vortex-compact -19.9% -15.4% -5.4% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -17.8% -15.4% -2.9% +10.0% ➖ noise
21 duckdb:duckdb -7.3% -15.4% +9.6% +10.0% ➖ noise
21 duckdb:vortex-compact -15.7% -15.4% -0.4% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -9.9% -15.4% +6.4% +10.0% ➖ noise
22 datafusion:arrow -16.1% -5.2% -11.6% +10.0% ✅ faster
22 datafusion:vortex-compact -14.4% -5.2% -9.7% +10.0% ✅ faster
22 datafusion:vortex-file-compressed -12.8% -5.2% -8.1% +10.0% ➖ noise
22 duckdb:duckdb -2.9% -5.2% +2.4% +10.0% ➖ noise
22 duckdb:vortex-compact -10.2% -5.2% -5.3% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -10.1% -5.2% -5.2% +10.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Vortex (geomean): 0.995x ➖
Parquet (geomean): 1.005x ➖
Shifts: Parquet (control) +0.5% · Median polish +0.4%


datafusion / vortex-file-compressed (1.011x ➖, 0↑ 2↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚨 1908973 1705927 1.12
clickbench_q01/datafusion:vortex-file-compressed 19956358 20980706 0.95
clickbench_q02/datafusion:vortex-file-compressed 41438063 38515299 1.08
clickbench_q03/datafusion:vortex-file-compressed 44798175 43976929 1.02
clickbench_q04/datafusion:vortex-file-compressed 304273530 297524853 1.02
clickbench_q05/datafusion:vortex-file-compressed 318999929 330394816 0.97
clickbench_q06/datafusion:vortex-file-compressed 1728339 1711404 1.01
clickbench_q07/datafusion:vortex-file-compressed 23070561 23202081 0.99
clickbench_q08/datafusion:vortex-file-compressed 375628212 377008130 1.00
clickbench_q09/datafusion:vortex-file-compressed 605493596 586606056 1.03
clickbench_q10/datafusion:vortex-file-compressed 76801418 78000625 0.98
clickbench_q11/datafusion:vortex-file-compressed 88032308 90176855 0.98
clickbench_q12/datafusion:vortex-file-compressed 281132396 283773303 0.99
clickbench_q13/datafusion:vortex-file-compressed 437050878 428179790 1.02
clickbench_q14/datafusion:vortex-file-compressed 268899552 268221470 1.00
clickbench_q15/datafusion:vortex-file-compressed 351809548 346812114 1.01
clickbench_q16/datafusion:vortex-file-compressed 693875594 674683828 1.03
clickbench_q17/datafusion:vortex-file-compressed 672191332 663158480 1.01
clickbench_q18/datafusion:vortex-file-compressed 1377211372 1353778788 1.02
clickbench_q19/datafusion:vortex-file-compressed 🚨 36942774 31949670 1.16
clickbench_q20/datafusion:vortex-file-compressed 347904214 344562683 1.01
clickbench_q21/datafusion:vortex-file-compressed 377874635 384021683 0.98
clickbench_q22/datafusion:vortex-file-compressed 467576146 461078999 1.01
clickbench_q23/datafusion:vortex-file-compressed 667689144 645841671 1.03
clickbench_q24/datafusion:vortex-file-compressed 45872328 43506193 1.05
clickbench_q25/datafusion:vortex-file-compressed 73426499 70875339 1.04
clickbench_q26/datafusion:vortex-file-compressed 43139124 47073645 0.92
clickbench_q27/datafusion:vortex-file-compressed 715328714 707930376 1.01
clickbench_q28/datafusion:vortex-file-compressed 6785733482 6575909166 1.03
clickbench_q29/datafusion:vortex-file-compressed 231811824 237585381 0.98
clickbench_q30/datafusion:vortex-file-compressed 227792548 228294219 1.00
clickbench_q31/datafusion:vortex-file-compressed 271426106 268325556 1.01
clickbench_q32/datafusion:vortex-file-compressed 1205741286 1165195169 1.03
clickbench_q33/datafusion:vortex-file-compressed 1362638204 1350451663 1.01
clickbench_q34/datafusion:vortex-file-compressed 1353123585 1348044826 1.00
clickbench_q35/datafusion:vortex-file-compressed 469002214 483436681 0.97
clickbench_q36/datafusion:vortex-file-compressed 78879391 73677893 1.07
clickbench_q37/datafusion:vortex-file-compressed 36917355 37054800 1.00
clickbench_q38/datafusion:vortex-file-compressed 20029542 20130744 0.99
clickbench_q39/datafusion:vortex-file-compressed 137604909 139088971 0.99
clickbench_q40/datafusion:vortex-file-compressed 17269801 17065629 1.01
clickbench_q41/datafusion:vortex-file-compressed 15927327 16223455 0.98
clickbench_q42/datafusion:vortex-file-compressed 18399159 18500170 0.99
datafusion / parquet (1.009x ➖, 0↑ 1↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1616238 1628025 0.99
clickbench_q01/datafusion:parquet 19081607 19603283 0.97
clickbench_q02/datafusion:parquet 46992638 47875606 0.98
clickbench_q03/datafusion:parquet 38242138 38472238 0.99
clickbench_q04/datafusion:parquet 312900116 309561393 1.01
clickbench_q05/datafusion:parquet 363050430 350180667 1.04
clickbench_q06/datafusion:parquet 🚨 1749747 1558301 1.12
clickbench_q07/datafusion:parquet 23788575 23013216 1.03
clickbench_q08/datafusion:parquet 389124211 372926476 1.04
clickbench_q09/datafusion:parquet 660666740 645724294 1.02
clickbench_q10/datafusion:parquet 110626352 107297233 1.03
clickbench_q11/datafusion:parquet 136976303 132879609 1.03
clickbench_q12/datafusion:parquet 355549119 372994260 0.95
clickbench_q13/datafusion:parquet 520819514 520129794 1.00
clickbench_q14/datafusion:parquet 351517300 351708598 1.00
clickbench_q15/datafusion:parquet 351052084 355893679 0.99
clickbench_q16/datafusion:parquet 682071144 693147243 0.98
clickbench_q17/datafusion:parquet 677384242 677691709 1.00
clickbench_q18/datafusion:parquet 1387352211 1413098307 0.98
clickbench_q19/datafusion:parquet 30147249 29753889 1.01
clickbench_q20/datafusion:parquet 620450276 638258773 0.97
clickbench_q21/datafusion:parquet 675324701 676851051 1.00
clickbench_q22/datafusion:parquet 1004233212 982530703 1.02
clickbench_q23/datafusion:parquet 3783123488 3780915596 1.00
clickbench_q24/datafusion:parquet 86416241 79592937 1.09
clickbench_q25/datafusion:parquet 136283812 136792707 1.00
clickbench_q26/datafusion:parquet 85624410 85757321 1.00
clickbench_q27/datafusion:parquet 1066078734 1070125732 1.00
clickbench_q28/datafusion:parquet 6764762181 6612575460 1.02
clickbench_q29/datafusion:parquet 232947800 245515041 0.95
clickbench_q30/datafusion:parquet 340827687 329179272 1.04
clickbench_q31/datafusion:parquet 386455771 365070609 1.06
clickbench_q32/datafusion:parquet 1245061680 1260649542 0.99
clickbench_q33/datafusion:parquet 1528511295 1531204301 1.00
clickbench_q34/datafusion:parquet 1562403098 1537556287 1.02
clickbench_q35/datafusion:parquet 490708833 483007253 1.02
clickbench_q36/datafusion:parquet 151101931 151703102 1.00
clickbench_q37/datafusion:parquet 58493817 58915053 0.99
clickbench_q38/datafusion:parquet 87944292 88407155 0.99
clickbench_q39/datafusion:parquet 274080484 267045521 1.03
clickbench_q40/datafusion:parquet 32838400 31553638 1.04
clickbench_q41/datafusion:parquet 28139289 28311366 0.99
clickbench_q42/datafusion:parquet 31229389 31217047 1.00
duckdb / vortex-file-compressed (0.979x ➖, 6↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6778755 6772038 1.00
clickbench_q01/duckdb:vortex-file-compressed 13505261 13717825 0.98
clickbench_q02/duckdb:vortex-file-compressed 27202394 25379264 1.07
clickbench_q03/duckdb:vortex-file-compressed 30091106 30060025 1.00
clickbench_q04/duckdb:vortex-file-compressed 186075471 185297701 1.00
clickbench_q05/duckdb:vortex-file-compressed 175648979 173279834 1.01
clickbench_q06/duckdb:vortex-file-compressed 20819373 21030707 0.99
clickbench_q07/duckdb:vortex-file-compressed 14605240 15141344 0.96
clickbench_q08/duckdb:vortex-file-compressed 261729644 261683202 1.00
clickbench_q09/duckdb:vortex-file-compressed 341908878 337300327 1.01
clickbench_q10/duckdb:vortex-file-compressed 67840733 67009102 1.01
clickbench_q11/duckdb:vortex-file-compressed 78162253 77455267 1.01
clickbench_q12/duckdb:vortex-file-compressed 208151191 200703892 1.04
clickbench_q13/duckdb:vortex-file-compressed 405886539 414518973 0.98
clickbench_q14/duckdb:vortex-file-compressed 244861464 234343955 1.04
clickbench_q15/duckdb:vortex-file-compressed 247300867 250261936 0.99
clickbench_q16/duckdb:vortex-file-compressed 598621913 623212272 0.96
clickbench_q17/duckdb:vortex-file-compressed 486952485 486047917 1.00
clickbench_q18/duckdb:vortex-file-compressed 1017541526 1012636688 1.00
clickbench_q19/duckdb:vortex-file-compressed 21312137 21386711 1.00
clickbench_q20/duckdb:vortex-file-compressed 355524603 342264888 1.04
clickbench_q21/duckdb:vortex-file-compressed 372458497 361477323 1.03
clickbench_q22/duckdb:vortex-file-compressed 🚀 499800646 631294354 0.79
clickbench_q23/duckdb:vortex-file-compressed 389020603 409640592 0.95
clickbench_q24/duckdb:vortex-file-compressed 🚀 32800756 36847865 0.89
clickbench_q25/duckdb:vortex-file-compressed 69243133 69527169 1.00
clickbench_q26/duckdb:vortex-file-compressed 🚀 42064923 48628474 0.87
clickbench_q27/duckdb:vortex-file-compressed 487637755 472699654 1.03
clickbench_q28/duckdb:vortex-file-compressed 3024408771 3021353193 1.00
clickbench_q29/duckdb:vortex-file-compressed 28818702 28081426 1.03
clickbench_q30/duckdb:vortex-file-compressed 192915375 195314767 0.99
clickbench_q31/duckdb:vortex-file-compressed 290596323 290876531 1.00
clickbench_q32/duckdb:vortex-file-compressed 1197372518 1146882066 1.04
clickbench_q33/duckdb:vortex-file-compressed 1170972744 1226404422 0.95
clickbench_q34/duckdb:vortex-file-compressed 1285856830 1244989970 1.03
clickbench_q35/duckdb:vortex-file-compressed 384471137 388879166 0.99
clickbench_q36/duckdb:vortex-file-compressed 27993865 29989592 0.93
clickbench_q37/duckdb:vortex-file-compressed 22072928 22173803 1.00
clickbench_q38/duckdb:vortex-file-compressed 🚀 22265065 25045986 0.89
clickbench_q39/duckdb:vortex-file-compressed 41906575 41083205 1.02
clickbench_q40/duckdb:vortex-file-compressed 🚀 20262071 25336702 0.80
clickbench_q41/duckdb:vortex-file-compressed 🚀 20251050 23456669 0.86
clickbench_q42/duckdb:vortex-file-compressed 21819471 22056411 0.99
duckdb / parquet (1.002x ➖, 0↑ 1↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 28190461 28709668 0.98
clickbench_q01/duckdb:parquet 27259662 28021897 0.97
clickbench_q02/duckdb:parquet 48224467 48177129 1.00
clickbench_q03/duckdb:parquet 39913742 40171665 0.99
clickbench_q04/duckdb:parquet 209532163 209010189 1.00
clickbench_q05/duckdb:parquet 276458543 272065211 1.02
clickbench_q06/duckdb:parquet 45978108 47753684 0.96
clickbench_q07/duckdb:parquet 30074655 30150579 1.00
clickbench_q08/duckdb:parquet 271928095 274252665 0.99
clickbench_q09/duckdb:parquet 402786522 408580622 0.99
clickbench_q10/duckdb:parquet 84080901 83293038 1.01
clickbench_q11/duckdb:parquet 100341994 100206714 1.00
clickbench_q12/duckdb:parquet 294140488 299399182 0.98
clickbench_q13/duckdb:parquet 492709528 494360507 1.00
clickbench_q14/duckdb:parquet 333949090 332621079 1.00
clickbench_q15/duckdb:parquet 264509253 260604693 1.01
clickbench_q16/duckdb:parquet 658896514 679307102 0.97
clickbench_q17/duckdb:parquet 556492893 552259563 1.01
clickbench_q18/duckdb:parquet 1106576102 1125388913 0.98
clickbench_q19/duckdb:parquet 26582131 26203091 1.01
clickbench_q20/duckdb:parquet 432299402 434420616 1.00
clickbench_q21/duckdb:parquet 552110367 551644414 1.00
clickbench_q22/duckdb:parquet 946340658 940052730 1.01
clickbench_q23/duckdb:parquet 312051736 313190786 1.00
clickbench_q24/duckdb:parquet 67503772 70245238 0.96
clickbench_q25/duckdb:parquet 158331602 158007268 1.00
clickbench_q26/duckdb:parquet 50246881 48495814 1.04
clickbench_q27/duckdb:parquet 659043050 657060071 1.00
clickbench_q28/duckdb:parquet 4916709526 4883969396 1.01
clickbench_q29/duckdb:parquet 41578017 40668666 1.02
clickbench_q30/duckdb:parquet 304565261 303875159 1.00
clickbench_q31/duckdb:parquet 366194902 363128300 1.01
clickbench_q32/duckdb:parquet 1244418191 1218912940 1.02
clickbench_q33/duckdb:parquet 1264904053 1336806462 0.95
clickbench_q34/duckdb:parquet 1331680829 1367511158 0.97
clickbench_q35/duckdb:parquet 373172103 362845125 1.03
clickbench_q36/duckdb:parquet 45912690 45237390 1.01
clickbench_q37/duckdb:parquet 32347633 33468448 0.97
clickbench_q38/duckdb:parquet 34330811 33646558 1.02
clickbench_q39/duckdb:parquet 🚨 90537079 76877720 1.18
clickbench_q40/duckdb:parquet 19498212 19082581 1.02
clickbench_q41/duckdb:parquet 19120074 17744110 1.08
clickbench_q42/duckdb:parquet 20913720 22156569 0.94
duckdb / duckdb (1.022x ➖, 0↑ 3↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18206922 18810771 0.97
clickbench_q01/duckdb:duckdb 33541020 32141429 1.04
clickbench_q02/duckdb:duckdb 46670243 45841399 1.02
clickbench_q03/duckdb:duckdb 47690197 47533001 1.00
clickbench_q04/duckdb:duckdb 195632138 191812989 1.02
clickbench_q05/duckdb:duckdb 272505889 271806044 1.00
clickbench_q06/duckdb:duckdb 35994044 35948586 1.00
clickbench_q07/duckdb:duckdb 36160299 35112452 1.03
clickbench_q08/duckdb:duckdb 258995778 257521216 1.01
clickbench_q09/duckdb:duckdb 380711245 376941421 1.01
clickbench_q10/duckdb:duckdb 99053185 101049493 0.98
clickbench_q11/duckdb:duckdb 108801631 110586781 0.98
clickbench_q12/duckdb:duckdb 244700624 249485156 0.98
clickbench_q13/duckdb:duckdb 526940278 481271653 1.09
clickbench_q14/duckdb:duckdb 286672797 280699456 1.02
clickbench_q15/duckdb:duckdb 225684952 221891672 1.02
clickbench_q16/duckdb:duckdb 678432366 654687935 1.04
clickbench_q17/duckdb:duckdb 565892558 559378308 1.01
clickbench_q18/duckdb:duckdb 1294392280 1195510957 1.08
clickbench_q19/duckdb:duckdb 34971776 35488520 0.99
clickbench_q20/duckdb:duckdb 🚨 1060330017 839126097 1.26
clickbench_q21/duckdb:duckdb 🚨 1123000738 935259228 1.20
clickbench_q22/duckdb:duckdb 1115602483 1106603884 1.01
clickbench_q23/duckdb:duckdb 263388460 265739220 0.99
clickbench_q24/duckdb:duckdb 60123852 62199488 0.97
clickbench_q25/duckdb:duckdb 145101360 142713581 1.02
clickbench_q26/duckdb:duckdb 60528919 60992510 0.99
clickbench_q27/duckdb:duckdb 🚨 1122323478 937508477 1.20
clickbench_q28/duckdb:duckdb 4636114726 4712250995 0.98
clickbench_q29/duckdb:duckdb 49757697 48483741 1.03
clickbench_q30/duckdb:duckdb 265623960 267213331 0.99
clickbench_q31/duckdb:duckdb 433078983 447925343 0.97
clickbench_q32/duckdb:duckdb 1430236080 1559167207 0.92
clickbench_q33/duckdb:duckdb 1944405597 1873200298 1.04
clickbench_q34/duckdb:duckdb 2003159948 1973492658 1.02
clickbench_q35/duckdb:duckdb 294455402 278722292 1.06
clickbench_q36/duckdb:duckdb 42325198 40307594 1.05
clickbench_q37/duckdb:duckdb 30570230 32021077 0.95
clickbench_q38/duckdb:duckdb 32625102 31583456 1.03
clickbench_q39/duckdb:duckdb 67107518 63554378 1.06
clickbench_q40/duckdb:duckdb 31861721 32065670 0.99
clickbench_q41/duckdb:duckdb 30843417 30451930 1.01
clickbench_q42/duckdb:duckdb 31925068 31816750 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +11.9% -1.3% +13.3% +753.0% ➖ noise
0 duckdb:duckdb -3.2% -1.3% -2.0% +287.4% ➖ noise
0 duckdb:vortex-file-compressed +0.1% -1.3% +1.4% +468.3% ➖ noise
1 datafusion:vortex-file-compressed -4.9% -2.7% -2.3% +26.5% ➖ noise
1 duckdb:duckdb +4.4% -2.7% +7.2% +61.0% ➖ noise
1 duckdb:vortex-file-compressed -1.5% -2.7% +1.2% +24.2% ➖ noise
2 datafusion:vortex-file-compressed +7.6% -0.9% +8.5% +11.0% ➖ noise
2 duckdb:duckdb +1.8% -0.9% +2.7% +19.7% ➖ noise
2 duckdb:vortex-file-compressed +7.2% -0.9% +8.1% +14.4% ➖ noise
3 datafusion:vortex-file-compressed +1.9% -0.6% +2.5% +136.8% ➖ noise
3 duckdb:duckdb +0.3% -0.6% +1.0% +43.9% ➖ noise
3 duckdb:vortex-file-compressed +0.1% -0.6% +0.7% +59.2% ➖ noise
4 datafusion:vortex-file-compressed +2.3% +0.7% +1.6% +10.0% ➖ noise
4 duckdb:duckdb +2.0% +0.7% +1.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.4% +0.7% -0.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -3.4% +2.6% -5.9% +10.0% ➖ noise
5 duckdb:duckdb +0.3% +2.6% -2.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.4% +2.6% -1.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.0% +4.0% -2.9% +38.4% ➖ noise
6 duckdb:duckdb +0.1% +4.0% -3.7% +25.1% ➖ noise
6 duckdb:vortex-file-compressed -1.0% +4.0% -4.8% +15.0% ➖ noise
7 datafusion:vortex-file-compressed -0.6% +1.5% -2.1% +11.2% ➖ noise
7 duckdb:duckdb +3.0% +1.5% +1.4% +10.9% ➖ noise
7 duckdb:vortex-file-compressed -3.5% +1.5% -5.0% +30.1% ➖ noise
8 datafusion:vortex-file-compressed -0.4% +1.7% -2.0% +10.0% ➖ noise
8 duckdb:duckdb +0.6% +1.7% -1.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.0% +1.7% -1.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +3.2% +0.4% +2.8% +10.0% ➖ noise
9 duckdb:duckdb +1.0% +0.4% +0.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.4% +0.4% +0.9% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -1.5% +2.0% -3.5% +10.0% ➖ noise
10 duckdb:duckdb -2.0% +2.0% -3.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +1.2% +2.0% -0.8% +10.3% ➖ noise
11 datafusion:vortex-file-compressed -2.4% +1.6% -3.9% +10.0% ➖ noise
11 duckdb:duckdb -1.6% +1.6% -3.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +0.9% +1.6% -0.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -0.9% -3.2% +2.4% +10.0% ➖ noise
12 duckdb:duckdb -1.9% -3.2% +1.4% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +3.7% -3.2% +7.2% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +2.1% -0.1% +2.2% +10.0% ➖ noise
13 duckdb:duckdb +9.5% -0.1% +9.6% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -2.1% -0.1% -2.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +0.3% +0.2% +0.1% +10.0% ➖ noise
14 duckdb:duckdb +2.1% +0.2% +2.0% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +4.5% +0.2% +4.3% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +1.4% +0.1% +1.4% +10.0% ➖ noise
15 duckdb:duckdb +1.7% +0.1% +1.6% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -1.2% +0.1% -1.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +2.8% -2.3% +5.3% +10.0% ➖ noise
16 duckdb:duckdb +3.6% -2.3% +6.1% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -3.9% -2.3% -1.7% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +1.4% +0.4% +1.0% +10.0% ➖ noise
17 duckdb:duckdb +1.2% +0.4% +0.8% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +0.2% +0.4% -0.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +1.7% -1.7% +3.5% +10.0% ➖ noise
18 duckdb:duckdb +8.3% -1.7% +10.2% +10.0% 🚨 regression
18 duckdb:vortex-file-compressed +0.5% -1.7% +2.3% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +15.6% +1.4% +14.0% +30.0% ➖ noise
19 duckdb:duckdb -1.5% +1.4% -2.8% +13.3% ➖ noise
19 duckdb:vortex-file-compressed -0.3% +1.4% -1.7% +12.2% ➖ noise
20 datafusion:vortex-file-compressed +1.0% -1.6% +2.7% +204.9% ➖ noise
20 duckdb:duckdb +26.4% -1.6% +28.5% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +3.9% -1.6% +5.6% +47.7% ➖ noise
21 datafusion:vortex-file-compressed -1.6% -0.1% -1.5% +10.0% ➖ noise
21 duckdb:duckdb +20.1% -0.1% +20.2% +10.0% 🚨 regression
21 duckdb:vortex-file-compressed +3.0% -0.1% +3.1% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +1.4% +1.4% -0.0% +14.0% ➖ noise
22 duckdb:duckdb +0.8% +1.4% -0.6% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -20.8% +1.4% -21.9% +10.0% ✅ faster
23 datafusion:vortex-file-compressed +3.4% -0.2% +3.5% +46.7% ➖ noise
23 duckdb:duckdb -0.9% -0.2% -0.7% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -5.0% -0.2% -4.9% +12.2% ➖ noise
24 datafusion:vortex-file-compressed +5.4% +2.1% +3.2% +10.0% ➖ noise
24 duckdb:duckdb -3.3% +2.1% -5.4% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -11.0% +2.1% -12.9% +10.0% ✅ faster
25 datafusion:vortex-file-compressed +3.6% -0.1% +3.7% +10.0% ➖ noise
25 duckdb:duckdb +1.7% -0.1% +1.8% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -0.4% -0.1% -0.3% +10.7% ➖ noise
26 datafusion:vortex-file-compressed -8.4% +1.7% -9.9% +10.8% ✅ faster
26 duckdb:duckdb -0.8% +1.7% -2.4% +13.7% ➖ noise
26 duckdb:vortex-file-compressed -13.5% +1.7% -15.0% +31.4% ➖ noise
27 datafusion:vortex-file-compressed +1.0% -0.0% +1.1% +10.0% ➖ noise
27 duckdb:duckdb +19.7% -0.0% +19.8% +10.0% 🚨 regression
27 duckdb:vortex-file-compressed +3.2% -0.0% +3.2% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +3.2% +1.5% +1.7% +10.0% ➖ noise
28 duckdb:duckdb -1.6% +1.5% -3.1% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.1% +1.5% -1.4% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -2.4% -1.5% -0.9% +10.0% ➖ noise
29 duckdb:duckdb +2.6% -1.5% +4.2% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +2.6% -1.5% +4.2% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -0.2% +1.9% -2.1% +10.0% ➖ noise
30 duckdb:duckdb -0.6% +1.9% -2.4% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -1.2% +1.9% -3.0% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +1.2% +3.3% -2.1% +10.0% ➖ noise
31 duckdb:duckdb -3.3% +3.3% -6.4% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -0.1% +3.3% -3.3% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +3.5% +0.4% +3.1% +18.4% ➖ noise
32 duckdb:duckdb -8.3% +0.4% -8.6% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +4.4% +0.4% +4.0% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +0.9% -2.8% +3.8% +10.0% ➖ noise
33 duckdb:duckdb +3.8% -2.8% +6.8% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -4.5% -2.8% -1.8% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +0.4% -0.5% +0.9% +10.0% ➖ noise
34 duckdb:duckdb +1.5% -0.5% +2.0% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +3.3% -0.5% +3.8% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -3.0% +2.2% -5.1% +10.0% ➖ noise
35 duckdb:duckdb +5.6% +2.2% +3.4% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -1.1% +2.2% -3.3% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +7.1% +0.5% +6.5% +10.0% ➖ noise
36 duckdb:duckdb +5.0% +0.5% +4.4% +14.4% ➖ noise
36 duckdb:vortex-file-compressed -6.7% +0.5% -7.2% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -0.4% -2.0% +1.7% +10.0% ➖ noise
37 duckdb:duckdb -4.5% -2.0% -2.5% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -0.5% -2.0% +1.6% +13.1% ➖ noise
38 datafusion:vortex-file-compressed -0.5% +0.7% -1.2% +10.0% ➖ noise
38 duckdb:duckdb +3.3% +0.7% +2.5% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -11.1% +0.7% -11.8% +28.4% ➖ noise
39 datafusion:vortex-file-compressed -1.1% +9.9% -10.0% +10.0% ✅ faster
39 duckdb:duckdb +5.6% +9.9% -4.0% +18.5% ➖ noise
39 duckdb:vortex-file-compressed +2.0% +9.9% -7.2% +19.4% ➖ noise
40 datafusion:vortex-file-compressed +1.2% +3.1% -1.9% +10.0% ➖ noise
40 duckdb:duckdb -0.6% +3.1% -3.6% +10.2% ➖ noise
40 duckdb:vortex-file-compressed -20.0% +3.1% -22.4% +10.3% ✅ faster
41 datafusion:vortex-file-compressed -1.8% +3.5% -5.1% +10.1% ➖ noise
41 duckdb:duckdb +1.3% +3.5% -2.1% +11.1% ➖ noise
41 duckdb:vortex-file-compressed -13.7% +3.5% -16.6% +13.6% ✅ faster
42 datafusion:vortex-file-compressed -0.5% -2.8% +2.3% +11.3% ➖ noise
42 duckdb:duckdb +0.3% -2.8% +3.3% +11.8% ➖ noise
42 duckdb:vortex-file-compressed -1.1% -2.8% +1.8% +13.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.3%
Vortex (geomean): 1.011x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish +1.2%


datafusion / vortex-file-compressed (0.983x ➖, 2↑ 2↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 414397867 341817606 1.21
tpch_q02/datafusion:vortex-file-compressed 630469194 496900057 1.27
tpch_q03/datafusion:vortex-file-compressed 🚨 608476890 412161170 1.48
tpch_q04/datafusion:vortex-file-compressed 260962206 298074757 0.88
tpch_q05/datafusion:vortex-file-compressed 638362099 510961031 1.25
tpch_q06/datafusion:vortex-file-compressed 421782537 386190568 1.09
tpch_q07/datafusion:vortex-file-compressed 597683087 523340150 1.14
tpch_q08/datafusion:vortex-file-compressed 763377416 717383672 1.06
tpch_q09/datafusion:vortex-file-compressed 🚨 697210638 530684435 1.31
tpch_q10/datafusion:vortex-file-compressed 700886118 714628549 0.98
tpch_q11/datafusion:vortex-file-compressed 387014377 400212927 0.97
tpch_q12/datafusion:vortex-file-compressed 500134632 489186433 1.02
tpch_q13/datafusion:vortex-file-compressed 160870019 181398100 0.89
tpch_q14/datafusion:vortex-file-compressed 🚀 296223595 528025166 0.56
tpch_q15/datafusion:vortex-file-compressed 555852837 661886097 0.84
tpch_q16/datafusion:vortex-file-compressed 236510397 291234360 0.81
tpch_q17/datafusion:vortex-file-compressed 422767293 509564978 0.83
tpch_q18/datafusion:vortex-file-compressed 304046276 414417226 0.73
tpch_q19/datafusion:vortex-file-compressed 🚀 427076106 613518456 0.70
tpch_q20/datafusion:vortex-file-compressed 490991898 493862284 0.99
tpch_q21/datafusion:vortex-file-compressed 620234430 603941478 1.03
tpch_q22/datafusion:vortex-file-compressed 130522623 117981501 1.11
datafusion / vortex-compact (1.120x ➖, 1↑ 5↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 354491587 246072158 1.44
tpch_q02/datafusion:vortex-compact 472502788 403731193 1.17
tpch_q03/datafusion:vortex-compact 520771700 405144053 1.29
tpch_q04/datafusion:vortex-compact 306996861 256745899 1.20
tpch_q05/datafusion:vortex-compact 429812798 498328810 0.86
tpch_q06/datafusion:vortex-compact 🚀 284669491 409451451 0.70
tpch_q07/datafusion:vortex-compact 415329210 457197507 0.91
tpch_q08/datafusion:vortex-compact 463076022 535944025 0.86
tpch_q09/datafusion:vortex-compact 386669437 379532313 1.02
tpch_q10/datafusion:vortex-compact 415232710 435641630 0.95
tpch_q11/datafusion:vortex-compact 281586486 275996800 1.02
tpch_q12/datafusion:vortex-compact 🚨 849965483 426361682 1.99
tpch_q13/datafusion:vortex-compact 🚨 307188424 143068445 2.15
tpch_q14/datafusion:vortex-compact 363244223 409600369 0.89
tpch_q15/datafusion:vortex-compact 557019016 575699047 0.97
tpch_q16/datafusion:vortex-compact 194008680 182808761 1.06
tpch_q17/datafusion:vortex-compact 🚨 548276306 418737935 1.31
tpch_q18/datafusion:vortex-compact 379489826 329361203 1.15
tpch_q19/datafusion:vortex-compact 641765901 512682380 1.25
tpch_q20/datafusion:vortex-compact 🚨 656826703 452697036 1.45
tpch_q21/datafusion:vortex-compact 681375322 535388669 1.27
tpch_q22/datafusion:vortex-compact 140977557 189887217 0.74
datafusion / parquet (0.990x ➖, 0↑ 1↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 236629952 280522683 0.84
tpch_q02/datafusion:parquet 423059273 403144287 1.05
tpch_q03/datafusion:parquet 315865912 443555374 0.71
tpch_q04/datafusion:parquet 207964068 286909310 0.72
tpch_q05/datafusion:parquet 457520677 461257892 0.99
tpch_q06/datafusion:parquet 134515641 191683880 0.70
tpch_q07/datafusion:parquet 474762078 478600119 0.99
tpch_q08/datafusion:parquet 598493725 558937679 1.07
tpch_q09/datafusion:parquet 542467650 519669259 1.04
tpch_q10/datafusion:parquet 562115696 539070776 1.04
tpch_q11/datafusion:parquet 361349239 338337772 1.07
tpch_q12/datafusion:parquet 237223469 234504906 1.01
tpch_q13/datafusion:parquet 439714811 430330721 1.02
tpch_q14/datafusion:parquet 🚨 222395926 170303498 1.31
tpch_q15/datafusion:parquet 319128807 298355685 1.07
tpch_q16/datafusion:parquet 167439640 182462878 0.92
tpch_q17/datafusion:parquet 401066840 358224069 1.12
tpch_q18/datafusion:parquet 503164630 431069332 1.17
tpch_q19/datafusion:parquet 457757414 374706526 1.22
tpch_q20/datafusion:parquet 391679718 369341591 1.06
tpch_q21/datafusion:parquet 618629364 620645222 1.00
tpch_q22/datafusion:parquet 115429314 125581767 0.92
duckdb / vortex-file-compressed (0.993x ➖, 0↑ 1↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 286535929 296849986 0.97
tpch_q02/duckdb:vortex-file-compressed 1001365901 1144235036 0.88
tpch_q03/duckdb:vortex-file-compressed 707822633 804094121 0.88
tpch_q04/duckdb:vortex-file-compressed 🚨 554658078 372999580 1.49
tpch_q05/duckdb:vortex-file-compressed 966187921 943600251 1.02
tpch_q06/duckdb:vortex-file-compressed 453067645 383358001 1.18
tpch_q07/duckdb:vortex-file-compressed 875332122 891882721 0.98
tpch_q08/duckdb:vortex-file-compressed 1178277663 1186645813 0.99
tpch_q09/duckdb:vortex-file-compressed 876330455 921068535 0.95
tpch_q10/duckdb:vortex-file-compressed 841315612 898428689 0.94
tpch_q11/duckdb:vortex-file-compressed 553765435 540634232 1.02
tpch_q12/duckdb:vortex-file-compressed 491667979 446679756 1.10
tpch_q13/duckdb:vortex-file-compressed 505686223 474193500 1.07
tpch_q14/duckdb:vortex-file-compressed 523564030 523359151 1.00
tpch_q15/duckdb:vortex-file-compressed 275387208 309658697 0.89
tpch_q16/duckdb:vortex-file-compressed 396654731 417569924 0.95
tpch_q17/duckdb:vortex-file-compressed 773715309 772293211 1.00
tpch_q18/duckdb:vortex-file-compressed 558981281 653578876 0.86
tpch_q19/duckdb:vortex-file-compressed 537840810 508343383 1.06
tpch_q20/duckdb:vortex-file-compressed 790747655 1032500550 0.77
tpch_q21/duckdb:vortex-file-compressed 1134911914 1134130971 1.00
tpch_q22/duckdb:vortex-file-compressed 388880998 371563617 1.05
duckdb / vortex-compact (0.954x ➖, 0↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 285905559 321511006 0.89
tpch_q02/duckdb:vortex-compact 1041927379 965277212 1.08
tpch_q03/duckdb:vortex-compact 695629496 637798389 1.09
tpch_q04/duckdb:vortex-compact 357195946 376529897 0.95
tpch_q05/duckdb:vortex-compact 998747442 896884745 1.11
tpch_q06/duckdb:vortex-compact 495066255 439799085 1.13
tpch_q07/duckdb:vortex-compact 916710002 941133710 0.97
tpch_q08/duckdb:vortex-compact 960978275 1066838788 0.90
tpch_q09/duckdb:vortex-compact 884612825 919223480 0.96
tpch_q10/duckdb:vortex-compact 716956055 806466382 0.89
tpch_q11/duckdb:vortex-compact 480322762 525889761 0.91
tpch_q12/duckdb:vortex-compact 471656771 492042012 0.96
tpch_q13/duckdb:vortex-compact 448363398 451590653 0.99
tpch_q14/duckdb:vortex-compact 498564663 482633155 1.03
tpch_q15/duckdb:vortex-compact 282866571 349383397 0.81
tpch_q16/duckdb:vortex-compact 333508753 393230179 0.85
tpch_q17/duckdb:vortex-compact 603237346 685782901 0.88
tpch_q18/duckdb:vortex-compact 529860027 535668927 0.99
tpch_q19/duckdb:vortex-compact 556410638 508184015 1.09
tpch_q20/duckdb:vortex-compact 826125729 941628636 0.88
tpch_q21/duckdb:vortex-compact 1088489694 1268886042 0.86
tpch_q22/duckdb:vortex-compact 380966693 444663310 0.86
duckdb / parquet (1.006x ➖, 0↑ 1↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 501464870 462868169 1.08
tpch_q02/duckdb:parquet 1002622834 1160163931 0.86
tpch_q03/duckdb:parquet 1044183972 1066483027 0.98
tpch_q04/duckdb:parquet 675012169 672706012 1.00
tpch_q05/duckdb:parquet 🚨 1617803810 1228932375 1.32
tpch_q06/duckdb:parquet 452699214 402670142 1.12
tpch_q07/duckdb:parquet 1203783043 1298312771 0.93
tpch_q08/duckdb:parquet 1507012344 1743878291 0.86
tpch_q09/duckdb:parquet 1385095788 1586287246 0.87
tpch_q10/duckdb:parquet 1419864841 1427731530 0.99
tpch_q11/duckdb:parquet 778238310 755590526 1.03
tpch_q12/duckdb:parquet 757228897 723840246 1.05
tpch_q13/duckdb:parquet 966674367 939290258 1.03
tpch_q14/duckdb:parquet 704337769 718391289 0.98
tpch_q15/duckdb:parquet 609534977 526365176 1.16
tpch_q16/duckdb:parquet 704282870 706586067 1.00
tpch_q17/duckdb:parquet 769914896 893246756 0.86
tpch_q18/duckdb:parquet 912712493 876796685 1.04
tpch_q19/duckdb:parquet 883620932 880966850 1.00
tpch_q20/duckdb:parquet 1249021389 1180632993 1.06
tpch_q21/duckdb:parquet 1110046233 1102297514 1.01
tpch_q22/duckdb:parquet 579876613 583945870 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +44.1% -4.4% +50.7% +70.8% ➖ noise
1 datafusion:vortex-file-compressed +21.2% -4.4% +26.8% +64.5% ➖ noise
1 duckdb:vortex-compact -11.1% -4.4% -7.0% +38.9% ➖ noise
1 duckdb:vortex-file-compressed -3.5% -4.4% +1.0% +94.8% ➖ noise
2 datafusion:vortex-compact +17.0% -4.8% +22.9% +30.0% ➖ noise
2 datafusion:vortex-file-compressed +26.9% -4.8% +33.2% +30.0% 🚨 regression
2 duckdb:vortex-compact +7.9% -4.8% +13.3% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -12.5% -4.8% -8.1% +30.0% ➖ noise
3 datafusion:vortex-compact +28.5% -16.5% +53.9% +46.2% 🚨 regression
3 datafusion:vortex-file-compressed +47.6% -16.5% +76.8% +52.9% 🚨 regression
3 duckdb:vortex-compact +9.1% -16.5% +30.6% +30.8% ➖ noise
3 duckdb:vortex-file-compressed -12.0% -16.5% +5.4% +39.7% ➖ noise
4 datafusion:vortex-compact +19.6% -14.7% +40.2% +37.9% 🚨 regression
4 datafusion:vortex-file-compressed -12.5% -14.7% +2.7% +47.4% ➖ noise
4 duckdb:vortex-compact -5.1% -14.7% +11.2% +52.3% ➖ noise
4 duckdb:vortex-file-compressed +48.7% -14.7% +74.4% +48.8% 🚨 regression
5 datafusion:vortex-compact -13.7% +14.3% -24.5% +31.0% ✅ faster
5 datafusion:vortex-file-compressed +24.9% +14.3% +9.3% +36.2% ➖ noise
5 duckdb:vortex-compact +11.4% +14.3% -2.5% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +2.4% +14.3% -10.4% +30.0% ➖ noise
6 datafusion:vortex-compact -30.5% -11.2% -21.7% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +9.2% -11.2% +23.0% +38.5% ➖ noise
6 duckdb:vortex-compact +12.6% -11.2% +26.7% +34.9% ➖ noise
6 duckdb:vortex-file-compressed +18.2% -11.2% +33.1% +30.5% 🚨 regression
7 datafusion:vortex-compact -9.2% -4.1% -5.3% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +14.2% -4.1% +19.1% +35.8% ➖ noise
7 duckdb:vortex-compact -2.6% -4.1% +1.6% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -1.9% -4.1% +2.3% +30.0% ➖ noise
8 datafusion:vortex-compact -13.6% -3.8% -10.2% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +6.4% -3.8% +10.6% +35.7% ➖ noise
8 duckdb:vortex-compact -9.9% -3.8% -6.4% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -0.7% -3.8% +3.2% +30.0% ➖ noise
9 datafusion:vortex-compact +1.9% -4.5% +6.7% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +31.4% -4.5% +37.6% +30.0% 🚨 regression
9 duckdb:vortex-compact -3.8% -4.5% +0.8% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -4.9% -4.5% -0.3% +30.0% ➖ noise
10 datafusion:vortex-compact -4.7% +1.8% -6.4% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -1.9% +1.8% -3.7% +32.8% ➖ noise
10 duckdb:vortex-compact -11.1% +1.8% -12.7% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -6.4% +1.8% -8.0% +30.0% ➖ noise
11 datafusion:vortex-compact +2.0% +4.9% -2.7% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -3.3% +4.9% -7.8% +34.1% ➖ noise
11 duckdb:vortex-compact -8.7% +4.9% -12.9% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +2.4% +4.9% -2.3% +30.0% ➖ noise
12 datafusion:vortex-compact +99.4% +2.9% +93.8% +30.0% 🚨 regression
12 datafusion:vortex-file-compressed +2.2% +2.9% -0.6% +30.0% ➖ noise
12 duckdb:vortex-compact -4.1% +2.9% -6.8% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +10.1% +2.9% +7.0% +30.0% ➖ noise
13 datafusion:vortex-compact +114.7% +2.5% +109.4% +45.8% 🚨 regression
13 datafusion:vortex-file-compressed -11.3% +2.5% -13.5% +43.3% ➖ noise
13 duckdb:vortex-compact -0.7% +2.5% -3.2% +30.0% ➖ noise
13 duckdb:vortex-file-compressed +6.6% +2.5% +4.0% +30.0% ➖ noise
14 datafusion:vortex-compact -11.3% +13.2% -21.6% +40.0% ➖ noise
14 datafusion:vortex-file-compressed -43.9% +13.2% -50.4% +30.2% ✅ faster
14 duckdb:vortex-compact +3.3% +13.2% -8.7% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +0.0% +13.2% -11.6% +30.0% ➖ noise
15 datafusion:vortex-compact -3.2% +11.3% -13.1% +30.8% ➖ noise
15 datafusion:vortex-file-compressed -16.0% +11.3% -24.5% +30.0% ✅ faster
15 duckdb:vortex-compact -19.0% +11.3% -27.3% +30.0% ✅ faster
15 duckdb:vortex-file-compressed -11.1% +11.3% -20.1% +30.0% ➖ noise
16 datafusion:vortex-compact +6.1% -4.4% +11.0% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -18.8% -4.4% -15.1% +31.2% ➖ noise
16 duckdb:vortex-compact -15.2% -4.4% -11.3% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -5.0% -4.4% -0.7% +30.0% ➖ noise
17 datafusion:vortex-compact +30.9% -1.8% +33.3% +30.0% 🚨 regression
17 datafusion:vortex-file-compressed -17.0% -1.8% -15.5% +30.0% ➖ noise
17 duckdb:vortex-compact -12.0% -1.8% -10.5% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +0.2% -1.8% +2.0% +30.0% ➖ noise
18 datafusion:vortex-compact +15.2% +10.2% +4.5% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -26.6% +10.2% -33.4% +30.0% ✅ faster
18 duckdb:vortex-compact -1.1% +10.2% -10.3% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -14.5% +10.2% -22.4% +30.0% ➖ noise
19 datafusion:vortex-compact +25.2% +10.7% +13.1% +32.8% ➖ noise
19 datafusion:vortex-file-compressed -30.4% +10.7% -37.1% +30.0% ✅ faster
19 duckdb:vortex-compact +9.5% +10.7% -1.1% +33.1% ➖ noise
19 duckdb:vortex-file-compressed +5.8% +10.7% -4.4% +30.0% ➖ noise
20 datafusion:vortex-compact +45.1% +5.9% +37.0% +35.0% 🚨 regression
20 datafusion:vortex-file-compressed -0.6% +5.9% -6.1% +30.0% ➖ noise
20 duckdb:vortex-compact -12.3% +5.9% -17.2% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -23.4% +5.9% -27.7% +30.0% ✅ faster
21 datafusion:vortex-compact +27.3% +0.2% +27.0% +35.5% ➖ noise
21 datafusion:vortex-file-compressed +2.7% +0.2% +2.5% +30.0% ➖ noise
21 duckdb:vortex-compact -14.2% +0.2% -14.4% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +0.1% +0.2% -0.1% +30.0% ➖ noise
22 datafusion:vortex-compact -25.8% -4.5% -22.3% +56.2% ➖ noise
22 datafusion:vortex-file-compressed +10.6% -4.5% +15.8% +43.1% ➖ noise
22 duckdb:vortex-compact -14.3% -4.5% -10.3% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +4.7% -4.5% +9.5% +31.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 0.988x ➖
Parquet (geomean): 0.978x ➖


unknown / unknown (0.971x ➖, 12↑ 2↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
compress time/Arade 1150705018 1199373791 0.96
compress time/Bimbo 6731581836 7272378576 0.93
compress time/CMSprovider 2854509372 2989396660 0.95
compress time/Euro2016 421112491 446114990 0.94
compress time/Food 383106733 409250985 0.94
compress time/HashTags 824030355 832103964 0.99
compress time/TPC-H l_comment canonical 1296501869 1345869393 0.96
compress time/TPC-H l_comment chunked 1291983508 1349409919 0.96
compress time/taxi 717842929 741154393 0.97
compress time/wide table cols=100 chunks=1 rows=1000 🚀 11338261 13650538 0.83
compress time/wide table cols=100 chunks=50 rows=1000 11568097 12458528 0.93
compress time/wide table cols=1000 chunks=1 rows=1000 132905258 136084135 0.98
compress time/wide table cols=1000 chunks=50 rows=1000 131072735 130793815 1.00
compress time/wide table cols=10000 chunks=1 rows=1000 1469076914 1478322727 0.99
compress time/wide table cols=10000 chunks=50 rows=1000 1460811536 1490633176 0.98
decompress time/Arade 26277238 27757911 0.95
decompress time/Bimbo 🚀 77668231 87431173 0.89
decompress time/CMSprovider 🚀 76697103 89675098 0.86
decompress time/Euro2016 🚀 17285922 19936152 0.87
decompress time/Food 🚀 7630706 8930638 0.85
decompress time/HashTags 71615395 70014126 1.02
decompress time/TPC-H l_comment canonical 39204034 42216616 0.93
decompress time/TPC-H l_comment chunked 39750074 41275244 0.96
decompress time/taxi 🚀 14253363 16189481 0.88
decompress time/wide table cols=100 chunks=1 rows=1000 2677184 2915045 0.92
decompress time/wide table cols=100 chunks=50 rows=1000 2657908 2710505 0.98
decompress time/wide table cols=1000 chunks=1 rows=1000 24291372 25893089 0.94
decompress time/wide table cols=1000 chunks=50 rows=1000 23925499 26366275 0.91
decompress time/wide table cols=10000 chunks=1 rows=1000 253511600 281561974 0.90
decompress time/wide table cols=10000 chunks=50 rows=1000 262575594 270680281 0.97
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2593914909 2670054353 0.97
parquet_rs-zstd compress time/Bimbo 12406468227 13024615144 0.95
parquet_rs-zstd compress time/CMSprovider 6813210002 7153696189 0.95
parquet_rs-zstd compress time/Euro2016 1292987353 1377427187 0.94
parquet_rs-zstd compress time/Food 788357209 806907391 0.98
parquet_rs-zstd compress time/HashTags 2225257658 2309133479 0.96
parquet_rs-zstd compress time/TPC-H l_comment canonical 3202067115 3220711939 0.99
parquet_rs-zstd compress time/TPC-H l_comment chunked 3160462026 3207923073 0.99
parquet_rs-zstd compress time/taxi 1196868458 1214983838 0.99
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚀 6189603 7069250 0.88
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚀 6208738 7552495 0.82
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 77898437 77672005 1.00
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 76349459 78919010 0.97
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 774315095 810254540 0.96
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 770458318 823856974 0.94
parquet_rs-zstd decompress time/Arade 619788855 628809575 0.99
parquet_rs-zstd decompress time/Bimbo 1685100787 1710782223 0.98
parquet_rs-zstd decompress time/CMSprovider 1704513021 1736327724 0.98
parquet_rs-zstd decompress time/Euro2016 370587556 383733833 0.97
parquet_rs-zstd decompress time/Food 197729441 200390198 0.99
parquet_rs-zstd decompress time/HashTags 632929048 687862357 0.92
parquet_rs-zstd decompress time/TPC-H l_comment canonical 588599467 604548726 0.97
parquet_rs-zstd decompress time/TPC-H l_comment chunked 589564182 593271047 0.99
parquet_rs-zstd decompress time/taxi 244965612 246607480 0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2783955 3014117 0.92
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2792682 2975862 0.94
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 33634835 33455611 1.01
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 33049748 35567177 0.93
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 341005135 351963572 0.97
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 341989834 351846351 0.97
vortex-file-compressed size/Arade 145363796 145363796 1.00
vortex-file-compressed size/Bimbo 468763332 468763332 1.00
vortex-file-compressed size/CMSprovider 417907812 417907812 1.00
vortex-file-compressed size/Euro2016 163497796 163394740 1.00
vortex-file-compressed size/Food 41926936 41926936 1.00
vortex-file-compressed size/HashTags 195647828 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087360 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087360 179087360 1.00
vortex-file-compressed size/taxi 52363948 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.99
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.97
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.00
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.01
vortex:parquet-zstd ratio compress time/Food 0 0 0.96
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.03
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.97
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.97
vortex:parquet-zstd ratio compress time/taxi 0 0 0.98
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 0.95
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 🚨 1 1 1.13
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.97
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.04
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.04
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.05
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.96
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.90
vortex:parquet-zstd ratio decompress time/CMSprovider 🚀 0 0 0.87
vortex:parquet-zstd ratio decompress time/Euro2016 🚀 0 0 0.90
vortex:parquet-zstd ratio decompress time/Food 🚀 0 0 0.87
vortex:parquet-zstd ratio decompress time/HashTags 🚨 0 0 1.11
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.95
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.97
vortex:parquet-zstd ratio decompress time/taxi 🚀 0 0 0.89
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.93
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.93
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.3%
Vortex (geomean): 0.992x ➖
Parquet (geomean): 1.005x ➖
Shifts: Parquet (control) +0.5% · Median polish -5.4%


datafusion / vortex-file-compressed (1.068x ➖, 0↑ 3↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 827428219 671017126 1.23
tpch_q02/datafusion:vortex-file-compressed 🚨 1092961353 731622751 1.49
tpch_q03/datafusion:vortex-file-compressed 1131729635 968985842 1.17
tpch_q04/datafusion:vortex-file-compressed 768389911 636240379 1.21
tpch_q05/datafusion:vortex-file-compressed 1262552607 1117924489 1.13
tpch_q06/datafusion:vortex-file-compressed 721564231 733834075 0.98
tpch_q07/datafusion:vortex-file-compressed 1118165214 1051435414 1.06
tpch_q08/datafusion:vortex-file-compressed 1282010157 1442712770 0.89
tpch_q09/datafusion:vortex-file-compressed 1486851236 1336060454 1.11
tpch_q10/datafusion:vortex-file-compressed 976884271 1272200031 0.77
tpch_q11/datafusion:vortex-file-compressed 553935630 551058729 1.01
tpch_q12/datafusion:vortex-file-compressed 🚨 2008226090 1010785755 1.99
tpch_q13/datafusion:vortex-file-compressed 498894949 494999993 1.01
tpch_q14/datafusion:vortex-file-compressed 732615227 654690272 1.12
tpch_q15/datafusion:vortex-file-compressed 1258024699 1234444660 1.02
tpch_q16/datafusion:vortex-file-compressed 594309256 621240029 0.96
tpch_q17/datafusion:vortex-file-compressed 1262798139 1168816591 1.08
tpch_q18/datafusion:vortex-file-compressed 1325509526 1400330885 0.95
tpch_q19/datafusion:vortex-file-compressed 795144286 1111397601 0.72
tpch_q20/datafusion:vortex-file-compressed 1160255414 1239067448 0.94
tpch_q21/datafusion:vortex-file-compressed 1725900904 1962927167 0.88
tpch_q22/datafusion:vortex-file-compressed 🚨 662248943 483377236 1.37
datafusion / vortex-compact (1.004x ➖, 1↑ 2↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 691241805 680119817 1.02
tpch_q02/datafusion:vortex-compact 640673215 756626882 0.85
tpch_q03/datafusion:vortex-compact 870382968 754350016 1.15
tpch_q04/datafusion:vortex-compact 628012813 622662441 1.01
tpch_q05/datafusion:vortex-compact 🚨 1273960030 905677635 1.41
tpch_q06/datafusion:vortex-compact 777563318 619400388 1.26
tpch_q07/datafusion:vortex-compact 🚨 1553288909 950352817 1.63
tpch_q08/datafusion:vortex-compact 1484154596 1275025389 1.16
tpch_q09/datafusion:vortex-compact 1356371597 1370988645 0.99
tpch_q10/datafusion:vortex-compact 1107211019 946370476 1.17
tpch_q11/datafusion:vortex-compact 390551262 466878204 0.84
tpch_q12/datafusion:vortex-compact 979964894 1088455520 0.90
tpch_q13/datafusion:vortex-compact 419951845 469606828 0.89
tpch_q14/datafusion:vortex-compact 690052810 652208311 1.06
tpch_q15/datafusion:vortex-compact 1234786117 1082922694 1.14
tpch_q16/datafusion:vortex-compact 327132809 437309187 0.75
tpch_q17/datafusion:vortex-compact 1208763814 1247682887 0.97
tpch_q18/datafusion:vortex-compact 1158110014 1101659445 1.05
tpch_q19/datafusion:vortex-compact 817208628 1081057786 0.76
tpch_q20/datafusion:vortex-compact 🚀 980107270 1427110697 0.69
tpch_q21/datafusion:vortex-compact 1656168335 1774886682 0.93
tpch_q22/datafusion:vortex-compact 717844496 772714434 0.93
datafusion / parquet (1.123x ➖, 0↑ 2↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 865974233 886082533 0.98
tpch_q02/datafusion:parquet 🚨 1269030848 699340079 1.81
tpch_q03/datafusion:parquet 992405787 1071878555 0.93
tpch_q04/datafusion:parquet 620671288 508996416 1.22
tpch_q05/datafusion:parquet 1183676624 1245514363 0.95
tpch_q06/datafusion:parquet 514504110 502538444 1.02
tpch_q07/datafusion:parquet 1677504904 1316211615 1.27
tpch_q08/datafusion:parquet 1627648797 1612567973 1.01
tpch_q09/datafusion:parquet 2021872705 1820765699 1.11
tpch_q10/datafusion:parquet 2538505267 2005884016 1.27
tpch_q11/datafusion:parquet 620870163 558419510 1.11
tpch_q12/datafusion:parquet 712665072 740547326 0.96
tpch_q13/datafusion:parquet 794975728 734291967 1.08
tpch_q14/datafusion:parquet 812474317 792355697 1.03
tpch_q15/datafusion:parquet 1302140762 1408463331 0.92
tpch_q16/datafusion:parquet 🚨 861230070 420056936 2.05
tpch_q17/datafusion:parquet 1493468821 1374656529 1.09
tpch_q18/datafusion:parquet 1625600562 1436861788 1.13
tpch_q19/datafusion:parquet 897597694 929667226 0.97
tpch_q20/datafusion:parquet 1164025150 1137160145 1.02
tpch_q21/datafusion:parquet 2139607729 1784846326 1.20
tpch_q22/datafusion:parquet 790929389 710985212 1.11
duckdb / vortex-file-compressed (0.962x ➖, 0↑ 1↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 652471658 714693096 0.91
tpch_q02/duckdb:vortex-file-compressed 1624006289 1338436801 1.21
tpch_q03/duckdb:vortex-file-compressed 983506355 1370452177 0.72
tpch_q04/duckdb:vortex-file-compressed 928347216 741685638 1.25
tpch_q05/duckdb:vortex-file-compressed 1116137767 1266683064 0.88
tpch_q06/duckdb:vortex-file-compressed 833021959 969788495 0.86
tpch_q07/duckdb:vortex-file-compressed 1310413703 1369434643 0.96
tpch_q08/duckdb:vortex-file-compressed 1714971195 1725543554 0.99
tpch_q09/duckdb:vortex-file-compressed 1594989187 1636664187 0.97
tpch_q10/duckdb:vortex-file-compressed 1299933532 1374134445 0.95
tpch_q11/duckdb:vortex-file-compressed 786873594 744365442 1.06
tpch_q12/duckdb:vortex-file-compressed 764384221 876929583 0.87
tpch_q13/duckdb:vortex-file-compressed 955627769 1247214299 0.77
tpch_q14/duckdb:vortex-file-compressed 883021736 923619009 0.96
tpch_q15/duckdb:vortex-file-compressed 665129443 725083909 0.92
tpch_q16/duckdb:vortex-file-compressed 532203056 671086649 0.79
tpch_q17/duckdb:vortex-file-compressed 1096900898 1075512276 1.02
tpch_q18/duckdb:vortex-file-compressed 🚨 1330790648 1006228701 1.32
tpch_q19/duckdb:vortex-file-compressed 770262973 781132599 0.99
tpch_q20/duckdb:vortex-file-compressed 1519299476 1407301590 1.08
tpch_q21/duckdb:vortex-file-compressed 2121092763 2296080889 0.92
tpch_q22/duckdb:vortex-file-compressed 739504087 750295289 0.99
duckdb / vortex-compact (0.940x ➖, 0↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 626246458 641259206 0.98
tpch_q02/duckdb:vortex-compact 1152783456 1320803010 0.87
tpch_q03/duckdb:vortex-compact 929872723 925269031 1.00
tpch_q04/duckdb:vortex-compact 608734589 636836464 0.96
tpch_q05/duckdb:vortex-compact 1103245991 1176000931 0.94
tpch_q06/duckdb:vortex-compact 839358165 920887603 0.91
tpch_q07/duckdb:vortex-compact 1239360010 1203704820 1.03
tpch_q08/duckdb:vortex-compact 1430021375 1625871816 0.88
tpch_q09/duckdb:vortex-compact 1481250886 1479416069 1.00
tpch_q10/duckdb:vortex-compact 1130216230 1410466015 0.80
tpch_q11/duckdb:vortex-compact 658323776 808094775 0.81
tpch_q12/duckdb:vortex-compact 729495547 816649225 0.89
tpch_q13/duckdb:vortex-compact 865928212 981987588 0.88
tpch_q14/duckdb:vortex-compact 931490844 924549935 1.01
tpch_q15/duckdb:vortex-compact 565585528 645352253 0.88
tpch_q16/duckdb:vortex-compact 471156617 482467872 0.98
tpch_q17/duckdb:vortex-compact 1034201124 1181993408 0.87
tpch_q18/duckdb:vortex-compact 883211233 1047939287 0.84
tpch_q19/duckdb:vortex-compact 819720767 780582123 1.05
tpch_q20/duckdb:vortex-compact 1344233193 1498462922 0.90
tpch_q21/duckdb:vortex-compact 2154697930 1820197449 1.18
tpch_q22/duckdb:vortex-compact 770795046 692520370 1.11
duckdb / parquet (0.899x ➖, 0↑ 0↓)
name PR 0dce6a1 (ns) base 95f429d (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 854156117 912087721 0.94
tpch_q02/duckdb:parquet 1320907826 1621352202 0.81
tpch_q03/duckdb:parquet 1794426145 1855082192 0.97
tpch_q04/duckdb:parquet 1084033756 1128898937 0.96
tpch_q05/duckdb:parquet 2028950621 2384210820 0.85
tpch_q06/duckdb:parquet 793337444 834950423 0.95
tpch_q07/duckdb:parquet 1856649157 2237967173 0.83
tpch_q08/duckdb:parquet 2752361229 2820780206 0.98
tpch_q09/duckdb:parquet 2482522948 3437024370 0.72
tpch_q10/duckdb:parquet 3159789577 3608994871 0.88
tpch_q11/duckdb:parquet 988683718 1036220376 0.95
tpch_q12/duckdb:parquet 1276335342 1500297367 0.85
tpch_q13/duckdb:parquet 1357739328 1331141157 1.02
tpch_q14/duckdb:parquet 1245819913 1376203276 0.91
tpch_q15/duckdb:parquet 986331337 1025359905 0.96
tpch_q16/duckdb:parquet 839763297 903915498 0.93
tpch_q17/duckdb:parquet 1341693889 1542184078 0.87
tpch_q18/duckdb:parquet 1499564357 1714244701 0.87
tpch_q19/duckdb:parquet 1741756407 1661765322 1.05
tpch_q20/duckdb:parquet 1746991305 2010147066 0.87
tpch_q21/duckdb:parquet 1735037082 2023639690 0.86
tpch_q22/duckdb:parquet 1086604772 1313999357 0.83
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +1.6% -4.3% +6.2% +71.1% ➖ noise
1 datafusion:vortex-file-compressed +23.3% -4.3% +28.9% +80.2% ➖ noise
1 duckdb:vortex-compact -2.3% -4.3% +2.1% +69.5% ➖ noise
1 duckdb:vortex-file-compressed -8.7% -4.3% -4.6% +76.3% ➖ noise
2 datafusion:vortex-compact -15.3% +21.6% -30.4% +54.4% ➖ noise
2 datafusion:vortex-file-compressed +49.4% +21.6% +22.9% +53.7% ➖ noise
2 duckdb:vortex-compact -12.7% +21.6% -28.2% +51.6% ➖ noise
2 duckdb:vortex-file-compressed +21.3% +21.6% -0.2% +47.6% ➖ noise
3 datafusion:vortex-compact +15.4% -5.4% +21.9% +49.6% ➖ noise
3 datafusion:vortex-file-compressed +16.8% -5.4% +23.4% +45.0% ➖ noise
3 duckdb:vortex-compact +0.5% -5.4% +6.2% +40.7% ➖ noise
3 duckdb:vortex-file-compressed -28.2% -5.4% -24.2% +46.2% ➖ noise
4 datafusion:vortex-compact +0.9% +8.2% -6.8% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +20.8% +8.2% +11.6% +30.0% ➖ noise
4 duckdb:vortex-compact -4.4% +8.2% -11.7% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +25.2% +8.2% +15.7% +43.4% ➖ noise
5 datafusion:vortex-compact +40.7% -10.1% +56.4% +30.0% 🚨 regression
5 datafusion:vortex-file-compressed +12.9% -10.1% +25.6% +30.0% ➖ noise
5 duckdb:vortex-compact -6.2% -10.1% +4.3% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -11.9% -10.1% -2.0% +30.0% ➖ noise
6 datafusion:vortex-compact +25.5% -1.4% +27.3% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -1.7% -1.4% -0.3% +30.0% ➖ noise
6 duckdb:vortex-compact -8.9% -1.4% -7.6% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -14.1% -1.4% -12.9% +30.0% ➖ noise
7 datafusion:vortex-compact +63.4% +2.8% +58.9% +41.7% 🚨 regression
7 datafusion:vortex-file-compressed +6.3% +2.8% +3.4% +42.6% ➖ noise
7 duckdb:vortex-compact +3.0% +2.8% +0.1% +42.6% ➖ noise
7 duckdb:vortex-file-compressed -4.3% +2.8% -6.9% +43.6% ➖ noise
8 datafusion:vortex-compact +16.4% -0.8% +17.3% +32.7% ➖ noise
8 datafusion:vortex-file-compressed -11.1% -0.8% -10.5% +30.0% ➖ noise
8 duckdb:vortex-compact -12.0% -0.8% -11.4% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -0.6% -0.8% +0.1% +30.0% ➖ noise
9 datafusion:vortex-compact -1.1% -10.4% +10.5% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +11.3% -10.4% +24.3% +30.0% ➖ noise
9 duckdb:vortex-compact +0.1% -10.4% +11.8% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -2.5% -10.4% +8.8% +30.0% ➖ noise
10 datafusion:vortex-compact +17.0% +5.3% +11.1% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -23.2% +5.3% -27.1% +30.0% ✅ faster
10 duckdb:vortex-compact -19.9% +5.3% -23.9% +39.1% ➖ noise
10 duckdb:vortex-file-compressed -5.4% +5.3% -10.1% +39.3% ➖ noise
11 datafusion:vortex-compact -16.3% +3.0% -18.8% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +0.5% +3.0% -2.4% +30.0% ➖ noise
11 duckdb:vortex-compact -18.5% +3.0% -20.9% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +5.7% +3.0% +2.6% +30.0% ➖ noise
12 datafusion:vortex-compact -10.0% -9.5% -0.5% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +98.7% -9.5% +119.6% +30.0% 🚨 regression
12 duckdb:vortex-compact -10.7% -9.5% -1.3% +30.5% ➖ noise
12 duckdb:vortex-file-compressed -12.8% -9.5% -3.7% +30.0% ➖ noise
13 datafusion:vortex-compact -10.6% +5.1% -14.9% +30.0% ➖ noise
13 datafusion:vortex-file-compressed +0.8% +5.1% -4.1% +31.6% ➖ noise
13 duckdb:vortex-compact -11.8% +5.1% -16.1% +46.3% ➖ noise
13 duckdb:vortex-file-compressed -23.4% +5.1% -27.1% +40.0% ➖ noise
14 datafusion:vortex-compact +5.8% -3.7% +9.8% +58.3% ➖ noise
14 datafusion:vortex-file-compressed +11.9% -3.7% +16.1% +61.6% ➖ noise
14 duckdb:vortex-compact +0.8% -3.7% +4.6% +55.6% ➖ noise
14 duckdb:vortex-file-compressed -4.4% -3.7% -0.8% +57.1% ➖ noise
15 datafusion:vortex-compact +14.0% -5.7% +20.9% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +1.9% -5.7% +8.1% +30.0% ➖ noise
15 duckdb:vortex-compact -12.4% -5.7% -7.1% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -8.3% -5.7% -2.7% +30.0% ➖ noise
16 datafusion:vortex-compact -25.2% +38.0% -45.8% +30.0% ✅ faster
16 datafusion:vortex-file-compressed -4.3% +38.0% -30.7% +49.7% ➖ noise
16 duckdb:vortex-compact -2.3% +38.0% -29.2% +30.0% ✅ faster
16 duckdb:vortex-file-compressed -20.7% +38.0% -42.5% +30.0% ✅ faster
17 datafusion:vortex-compact -3.1% -2.8% -0.3% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +8.0% -2.8% +11.1% +30.0% ➖ noise
17 duckdb:vortex-compact -12.5% -2.8% -10.0% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +2.0% -2.8% +4.9% +30.0% ➖ noise
18 datafusion:vortex-compact +5.1% -0.5% +5.7% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -5.3% -0.5% -4.9% +30.0% ➖ noise
18 duckdb:vortex-compact -15.7% -0.5% -15.3% +44.2% ➖ noise
18 duckdb:vortex-file-compressed +32.3% -0.5% +32.9% +30.0% 🚨 regression
19 datafusion:vortex-compact -24.4% +0.6% -24.9% +30.0% ✅ faster
19 datafusion:vortex-file-compressed -28.5% +0.6% -28.9% +30.0% ✅ faster
19 duckdb:vortex-compact +5.0% +0.6% +4.4% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -1.4% +0.6% -2.0% +30.0% ➖ noise
20 datafusion:vortex-compact -31.3% -5.7% -27.2% +39.3% ➖ noise
20 datafusion:vortex-file-compressed -6.4% -5.7% -0.7% +30.0% ➖ noise
20 duckdb:vortex-compact -10.3% -5.7% -4.9% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +8.0% -5.7% +14.5% +30.0% ➖ noise
21 datafusion:vortex-compact -6.7% +1.4% -8.0% +63.5% ➖ noise
21 datafusion:vortex-file-compressed -12.1% +1.4% -13.3% +61.7% ➖ noise
21 duckdb:vortex-compact +18.4% +1.4% +16.8% +65.6% ➖ noise
21 duckdb:vortex-file-compressed -7.6% +1.4% -8.9% +62.5% ➖ noise
22 datafusion:vortex-compact -7.1% -4.1% -3.1% +37.0% ➖ noise
22 datafusion:vortex-file-compressed +37.0% -4.1% +42.8% +51.1% ➖ noise
22 duckdb:vortex-compact +11.3% -4.1% +16.0% +32.8% ➖ noise
22 duckdb:vortex-file-compressed -1.4% -4.1% +2.8% +30.0% ➖ noise

@gatesn gatesn changed the title 1: Remove chunked special case from stat execution Remove chunked special case from stat execution May 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants