Skip to content

Expression pushdown for duckdb#7727

Draft
myrrc wants to merge 3 commits into
developfrom
myrrc/duckdb-pushdown-expression
Draft

Expression pushdown for duckdb#7727
myrrc wants to merge 3 commits into
developfrom
myrrc/duckdb-pushdown-expression

Conversation

@myrrc
Copy link
Copy Markdown
Contributor

@myrrc myrrc commented Apr 30, 2026

  • Support expression pushdown similarly to how it's done for
    filter pushdown.
  • Support pushing down constants, comparisons and IN/NOT in, and also some functions.

@myrrc myrrc added changelog/feature A new feature ext/duckdb Relates to the DuckDB integration labels Apr 30, 2026
@myrrc myrrc force-pushed the myrrc/duckdb-pushdown-expression branch from 0f6d6f3 to 87d7c5a Compare April 30, 2026 11:44
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Apr 30, 2026

Merging this PR will not alter performance

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

✅ 1210 untouched benchmarks


Comparing myrrc/duckdb-pushdown-expression (7b2bcbe) with develop (2ee2033)

Open in CodSpeed

@myrrc myrrc marked this pull request as draft April 30, 2026 12:21
@myrrc myrrc force-pushed the myrrc/duckdb-pushdown-expression branch 2 times, most recently from 90f46e6 to 86ce16f Compare April 30, 2026 15:25
@myrrc myrrc added action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Apr 30, 2026
@github-actions github-actions Bot removed action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Apr 30, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 7b2bcbe 1 Explore Profiling Data
Previous Runs (2)
Status Commit Job Attempt Link
🟢 Done 7736c90 1 Explore Profiling Data
🟢 Done 86ce16f 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.091x ➖


datafusion / vortex-file-compressed (1.091x ➖, 0↑ 5↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 126290969 125144294 1.01
polarsignals_q01/datafusion:vortex-file-compressed 272597237 277126414 0.98
polarsignals_q02/datafusion:vortex-file-compressed 25123052 22958943 1.09
polarsignals_q03/datafusion:vortex-file-compressed 🚨 308971656 269966148 1.14
polarsignals_q04/datafusion:vortex-file-compressed 🚨 12567481 11030754 1.14
polarsignals_q05/datafusion:vortex-file-compressed 🚨 17111364 14684278 1.17
polarsignals_q06/datafusion:vortex-file-compressed 19577941 18193282 1.08
polarsignals_q07/datafusion:vortex-file-compressed 🚨 15323984 13674574 1.12
polarsignals_q08/datafusion:vortex-file-compressed 439995955 409722319 1.07
polarsignals_q09/datafusion:vortex-file-compressed 🚨 12039838 10820397 1.11

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Vortex (geomean): 1.021x ➖
Parquet (geomean): 1.006x ➖
Shifts: Parquet (control) +0.6% · Median polish +0.2%


datafusion / vortex-file-compressed (1.000x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51856937 52538291 0.99
tpch_q02/datafusion:vortex-file-compressed 21746454 22375689 0.97
tpch_q03/datafusion:vortex-file-compressed 28015403 27524100 1.02
tpch_q04/datafusion:vortex-file-compressed 20980229 20562594 1.02
tpch_q05/datafusion:vortex-file-compressed 47526426 48616176 0.98
tpch_q06/datafusion:vortex-file-compressed 12055238 12081150 1.00
tpch_q07/datafusion:vortex-file-compressed 54041064 54250092 1.00
tpch_q08/datafusion:vortex-file-compressed 39236841 38871279 1.01
tpch_q09/datafusion:vortex-file-compressed 50917921 50294902 1.01
tpch_q10/datafusion:vortex-file-compressed 39385389 40353013 0.98
tpch_q11/datafusion:vortex-file-compressed 15605829 15516750 1.01
tpch_q12/datafusion:vortex-file-compressed 25708950 25062444 1.03
tpch_q13/datafusion:vortex-file-compressed 24950985 24596957 1.01
tpch_q14/datafusion:vortex-file-compressed 16719730 16596386 1.01
tpch_q15/datafusion:vortex-file-compressed 26013000 26498980 0.98
tpch_q16/datafusion:vortex-file-compressed 18904869 18818135 1.00
tpch_q17/datafusion:vortex-file-compressed 65987155 70410880 0.94
tpch_q18/datafusion:vortex-file-compressed 78875640 80543416 0.98
tpch_q19/datafusion:vortex-file-compressed 23445964 23290888 1.01
tpch_q20/datafusion:vortex-file-compressed 30091712 28546626 1.05
tpch_q21/datafusion:vortex-file-compressed 71962005 71977735 1.00
tpch_q22/datafusion:vortex-file-compressed 12163751 11979696 1.02
datafusion / vortex-compact (0.995x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 58738236 59008800 1.00
tpch_q02/datafusion:vortex-compact 25255638 25188705 1.00
tpch_q03/datafusion:vortex-compact 29740474 29130726 1.02
tpch_q04/datafusion:vortex-compact 23835707 24001073 0.99
tpch_q05/datafusion:vortex-compact 50617054 51011141 0.99
tpch_q06/datafusion:vortex-compact 14652892 13859523 1.06
tpch_q07/datafusion:vortex-compact 59266882 59793800 0.99
tpch_q08/datafusion:vortex-compact 43496413 42921540 1.01
tpch_q09/datafusion:vortex-compact 54980524 56078101 0.98
tpch_q10/datafusion:vortex-compact 46599542 45976162 1.01
tpch_q11/datafusion:vortex-compact 16619083 16578986 1.00
tpch_q12/datafusion:vortex-compact 31613776 33709270 0.94
tpch_q13/datafusion:vortex-compact 30940798 31424166 0.98
tpch_q14/datafusion:vortex-compact 20021686 20079030 1.00
tpch_q15/datafusion:vortex-compact 32832474 32566502 1.01
tpch_q16/datafusion:vortex-compact 23638573 23913242 0.99
tpch_q17/datafusion:vortex-compact 68783147 69226150 0.99
tpch_q18/datafusion:vortex-compact 83603257 86369421 0.97
tpch_q19/datafusion:vortex-compact 31111445 31605077 0.98
tpch_q20/datafusion:vortex-compact 33748359 34035342 0.99
tpch_q21/datafusion:vortex-compact 77752830 77559054 1.00
tpch_q22/datafusion:vortex-compact 12238347 12601589 0.97
datafusion / parquet (1.005x ➖, 1↑ 3↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 101579235 114086559 0.89
tpch_q02/datafusion:parquet 61051732 60379567 1.01
tpch_q03/datafusion:parquet 71303208 69105173 1.03
tpch_q04/datafusion:parquet 43175671 43687031 0.99
tpch_q05/datafusion:parquet 93998426 93956026 1.00
tpch_q06/datafusion:parquet 🚨 37052679 33575786 1.10
tpch_q07/datafusion:parquet 103460939 103952304 1.00
tpch_q08/datafusion:parquet 98247264 94975149 1.03
tpch_q09/datafusion:parquet 126458400 126546946 1.00
tpch_q10/datafusion:parquet 108848065 109323048 1.00
tpch_q11/datafusion:parquet 39880776 40256515 0.99
tpch_q12/datafusion:parquet 🚨 87177218 78314201 1.11
tpch_q13/datafusion:parquet 195782298 194165148 1.01
tpch_q14/datafusion:parquet 40389842 44177106 0.91
tpch_q15/datafusion:parquet 59709510 60574682 0.99
tpch_q16/datafusion:parquet 38981517 39649349 0.98
tpch_q17/datafusion:parquet 135728418 134435112 1.01
tpch_q18/datafusion:parquet 160242540 158821471 1.01
tpch_q19/datafusion:parquet 🚨 77159237 67880122 1.14
tpch_q20/datafusion:parquet 65063237 68174629 0.95
tpch_q21/datafusion:parquet 129552604 131399921 0.99
tpch_q22/datafusion:parquet 30855713 30618064 1.01
datafusion / arrow (1.008x ➖, 0↑ 1↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 49496081 50164142 0.99
tpch_q02/datafusion:arrow 18785506 18610365 1.01
tpch_q03/datafusion:arrow 29129687 28815005 1.01
tpch_q04/datafusion:arrow 25667958 25165091 1.02
tpch_q05/datafusion:arrow 79416318 73476026 1.08
tpch_q06/datafusion:arrow 🚨 21652340 19076855 1.14
tpch_q07/datafusion:arrow 102524859 98661331 1.04
tpch_q08/datafusion:arrow 42876924 40445616 1.06
tpch_q09/datafusion:arrow 61939009 64265110 0.96
tpch_q10/datafusion:arrow 45655658 47051706 0.97
tpch_q11/datafusion:arrow 8873268 9365444 0.95
tpch_q12/datafusion:arrow 51082732 52184812 0.98
tpch_q13/datafusion:arrow 48168052 50635329 0.95
tpch_q14/datafusion:arrow 21221331 20854392 1.02
tpch_q15/datafusion:arrow 43548237 41224818 1.06
tpch_q16/datafusion:arrow 18809144 18555080 1.01
tpch_q17/datafusion:arrow 67426581 66437120 1.01
tpch_q18/datafusion:arrow 132677423 134061900 0.99
tpch_q19/datafusion:arrow 33893244 33689930 1.01
tpch_q20/datafusion:arrow 32990926 33288120 0.99
tpch_q21/datafusion:arrow 144447695 148316146 0.97
tpch_q22/datafusion:arrow 17272272 17824755 0.97
duckdb / vortex-file-compressed (1.071x ➖, 4↑ 8↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31139970 31189312 1.00
tpch_q02/duckdb:vortex-file-compressed 🚨 27356167 23971554 1.14
tpch_q03/duckdb:vortex-file-compressed 30362961 29106303 1.04
tpch_q04/duckdb:vortex-file-compressed 26950560 28966827 0.93
tpch_q05/duckdb:vortex-file-compressed 🚨 37161336 32044482 1.16
tpch_q06/duckdb:vortex-file-compressed 🚀 8361366 10245171 0.82
tpch_q07/duckdb:vortex-file-compressed 34691659 36090458 0.96
tpch_q08/duckdb:vortex-file-compressed 🚨 45632734 37732829 1.21
tpch_q09/duckdb:vortex-file-compressed 🚀 60594592 72398532 0.84
tpch_q10/duckdb:vortex-file-compressed 🚨 53841296 34452300 1.56
tpch_q11/duckdb:vortex-file-compressed 13965220 14291212 0.98
tpch_q12/duckdb:vortex-file-compressed 🚨 34365089 20637056 1.67
tpch_q13/duckdb:vortex-file-compressed 🚨 37944326 34363059 1.10
tpch_q14/duckdb:vortex-file-compressed 19109340 20615766 0.93
tpch_q15/duckdb:vortex-file-compressed 16153278 16423878 0.98
tpch_q16/duckdb:vortex-file-compressed 26053098 28287016 0.92
tpch_q17/duckdb:vortex-file-compressed 🚨 59082984 24693465 2.39
tpch_q18/duckdb:vortex-file-compressed 49743661 49134763 1.01
tpch_q19/duckdb:vortex-file-compressed 🚀 21947141 28455623 0.77
tpch_q20/duckdb:vortex-file-compressed 33418182 33292883 1.00
tpch_q21/duckdb:vortex-file-compressed 🚨 116829885 103056255 1.13
tpch_q22/duckdb:vortex-file-compressed 🚀 14702184 16438033 0.89
duckdb / vortex-compact (1.021x ➖, 7↑ 5↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 37973644 38053589 1.00
tpch_q02/duckdb:vortex-compact 35113341 34651061 1.01
tpch_q03/duckdb:vortex-compact 32566517 31836563 1.02
tpch_q04/duckdb:vortex-compact 🚀 30553582 34309966 0.89
tpch_q05/duckdb:vortex-compact 38929671 36945443 1.05
tpch_q06/duckdb:vortex-compact 🚀 10308684 14782450 0.70
tpch_q07/duckdb:vortex-compact 41289026 42629442 0.97
tpch_q08/duckdb:vortex-compact 🚨 52998556 44778742 1.18
tpch_q09/duckdb:vortex-compact 🚀 69320538 81892660 0.85
tpch_q10/duckdb:vortex-compact 🚨 57283908 38560439 1.49
tpch_q11/duckdb:vortex-compact 18973814 19475054 0.97
tpch_q12/duckdb:vortex-compact 🚨 41415716 34661214 1.19
tpch_q13/duckdb:vortex-compact 45326608 43449483 1.04
tpch_q14/duckdb:vortex-compact 🚀 24781687 28335492 0.87
tpch_q15/duckdb:vortex-compact 19511972 19230113 1.01
tpch_q16/duckdb:vortex-compact 🚀 29390021 34846646 0.84
tpch_q17/duckdb:vortex-compact 🚨 63744025 29560411 2.16
tpch_q18/duckdb:vortex-compact 49048256 49456575 0.99
tpch_q19/duckdb:vortex-compact 🚀 29107408 33889779 0.86
tpch_q20/duckdb:vortex-compact 42021960 41236853 1.02
tpch_q21/duckdb:vortex-compact 🚨 121851187 108665957 1.12
tpch_q22/duckdb:vortex-compact 🚀 16687732 19645607 0.85
duckdb / parquet (1.007x ➖, 0↑ 2↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 75380355 76103852 0.99
tpch_q02/duckdb:parquet 37980890 38482116 0.99
tpch_q03/duckdb:parquet 68492270 68010823 1.01
tpch_q04/duckdb:parquet 47209415 46833196 1.01
tpch_q05/duckdb:parquet 65720872 66219253 0.99
tpch_q06/duckdb:parquet 20141374 19836806 1.02
tpch_q07/duckdb:parquet 66019623 66350947 1.00
tpch_q08/duckdb:parquet 🚨 87880979 79344229 1.11
tpch_q09/duckdb:parquet 151784912 154080481 0.99
tpch_q10/duckdb:parquet 126478084 123829853 1.02
tpch_q11/duckdb:parquet 20748570 20667858 1.00
tpch_q12/duckdb:parquet 🚨 50759690 44652577 1.14
tpch_q13/duckdb:parquet 249363577 248799113 1.00
tpch_q14/duckdb:parquet 48828754 48877194 1.00
tpch_q15/duckdb:parquet 24777829 23954290 1.03
tpch_q16/duckdb:parquet 55691460 55534196 1.00
tpch_q17/duckdb:parquet 51570824 53283694 0.97
tpch_q18/duckdb:parquet 113383775 119266068 0.95
tpch_q19/duckdb:parquet 67386351 67471250 1.00
tpch_q20/duckdb:parquet 64233042 62756026 1.02
tpch_q21/duckdb:parquet 156426994 167723681 0.93
tpch_q22/duckdb:parquet 51667206 51204435 1.01
duckdb / duckdb (1.000x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16011770 16484639 0.97
tpch_q02/duckdb:duckdb 11974456 12832857 0.93
tpch_q03/duckdb:duckdb 18256103 18763551 0.97
tpch_q04/duckdb:duckdb 18653198 19375693 0.96
tpch_q05/duckdb:duckdb 20312305 19266724 1.05
tpch_q06/duckdb:duckdb 5308419 5305618 1.00
tpch_q07/duckdb:duckdb 22370918 21870204 1.02
tpch_q08/duckdb:duckdb 21095760 20966306 1.01
tpch_q09/duckdb:duckdb 54468368 54370643 1.00
tpch_q10/duckdb:duckdb 43165694 42473999 1.02
tpch_q11/duckdb:duckdb 5859670 5868820 1.00
tpch_q12/duckdb:duckdb 13817174 13872826 1.00
tpch_q13/duckdb:duckdb 37000983 38145760 0.97
tpch_q14/duckdb:duckdb 16061077 16409611 0.98
tpch_q15/duckdb:duckdb 11736100 12042695 0.97
tpch_q16/duckdb:duckdb 24203311 23952878 1.01
tpch_q17/duckdb:duckdb 14113909 13404266 1.05
tpch_q18/duckdb:duckdb 38516376 38064283 1.01
tpch_q19/duckdb:duckdb 25827387 25856366 1.00
tpch_q20/duckdb:duckdb 23047349 22417826 1.03
tpch_q21/duckdb:duckdb 56162943 55915795 1.00
tpch_q22/duckdb:duckdb 24339055 23589755 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -1.3% -6.1% +5.1% +19.9% ➖ noise
1 datafusion:vortex-compact -0.5% -6.1% +6.0% +18.2% ➖ noise
1 datafusion:vortex-file-compressed -1.3% -6.1% +5.1% +19.0% ➖ noise
1 duckdb:duckdb -2.9% -6.1% +3.4% +17.8% ➖ noise
1 duckdb:vortex-compact -0.2% -6.1% +6.3% +17.6% ➖ noise
1 duckdb:vortex-file-compressed -0.2% -6.1% +6.3% +20.0% ➖ noise
2 datafusion:arrow +0.9% -0.1% +1.0% +11.0% ➖ noise
2 datafusion:vortex-compact +0.3% -0.1% +0.4% +11.0% ➖ noise
2 datafusion:vortex-file-compressed -2.8% -0.1% -2.7% +11.0% ➖ noise
2 duckdb:duckdb -6.7% -0.1% -6.6% +11.0% ➖ noise
2 duckdb:vortex-compact +1.3% -0.1% +1.4% +11.0% ➖ noise
2 duckdb:vortex-file-compressed +14.1% -0.1% +14.2% +11.0% 🚨 regression
3 datafusion:arrow +1.1% +1.9% -0.8% +11.0% ➖ noise
3 datafusion:vortex-compact +2.1% +1.9% +0.2% +11.0% ➖ noise
3 datafusion:vortex-file-compressed +1.8% +1.9% -0.1% +11.0% ➖ noise
3 duckdb:duckdb -2.7% +1.9% -4.6% +11.0% ➖ noise
3 duckdb:vortex-compact +2.3% +1.9% +0.3% +11.0% ➖ noise
3 duckdb:vortex-file-compressed +4.3% +1.9% +2.3% +14.8% ➖ noise
4 datafusion:arrow +2.0% -0.2% +2.2% +11.0% ➖ noise
4 datafusion:vortex-compact -0.7% -0.2% -0.5% +11.0% ➖ noise
4 datafusion:vortex-file-compressed +2.0% -0.2% +2.2% +12.0% ➖ noise
4 duckdb:duckdb -3.7% -0.2% -3.5% +12.3% ➖ noise
4 duckdb:vortex-compact -10.9% -0.2% -10.8% +11.0% ✅ faster
4 duckdb:vortex-file-compressed -7.0% -0.2% -6.8% +11.0% ➖ noise
5 datafusion:arrow +8.1% -0.4% +8.5% +11.0% ➖ noise
5 datafusion:vortex-compact -0.8% -0.4% -0.4% +11.0% ➖ noise
5 datafusion:vortex-file-compressed -2.2% -0.4% -1.9% +11.0% ➖ noise
5 duckdb:duckdb +5.4% -0.4% +5.8% +11.0% ➖ noise
5 duckdb:vortex-compact +5.4% -0.4% +5.7% +11.0% ➖ noise
5 duckdb:vortex-file-compressed +16.0% -0.4% +16.4% +11.0% 🚨 regression
6 datafusion:arrow +13.5% +5.9% +7.2% +13.7% ➖ noise
6 datafusion:vortex-compact +5.7% +5.9% -0.1% +13.9% ➖ noise
6 datafusion:vortex-file-compressed -0.2% +5.9% -5.7% +13.4% ➖ noise
6 duckdb:duckdb +0.1% +5.9% -5.5% +15.8% ➖ noise
6 duckdb:vortex-compact -30.3% +5.9% -34.1% +20.8% ✅ faster
6 duckdb:vortex-file-compressed -18.4% +5.9% -22.9% +16.1% ✅ faster
7 datafusion:arrow +3.9% -0.5% +4.4% +11.1% ➖ noise
7 datafusion:vortex-compact -0.9% -0.5% -0.4% +11.0% ➖ noise
7 datafusion:vortex-file-compressed -0.4% -0.5% +0.1% +11.0% ➖ noise
7 duckdb:duckdb +2.3% -0.5% +2.8% +11.0% ➖ noise
7 duckdb:vortex-compact -3.1% -0.5% -2.7% +11.0% ➖ noise
7 duckdb:vortex-file-compressed -3.9% -0.5% -3.4% +11.0% ➖ noise
8 datafusion:arrow +6.0% +7.0% -1.0% +11.0% ➖ noise
8 datafusion:vortex-compact +1.3% +7.0% -5.3% +11.0% ➖ noise
8 datafusion:vortex-file-compressed +0.9% +7.0% -5.7% +11.0% ➖ noise
8 duckdb:duckdb +0.6% +7.0% -6.0% +11.0% ➖ noise
8 duckdb:vortex-compact +18.4% +7.0% +10.6% +11.0% ➖ noise
8 duckdb:vortex-file-compressed +20.9% +7.0% +13.0% +12.4% 🚨 regression
9 datafusion:arrow -3.6% -0.8% -2.9% +11.0% ➖ noise
9 datafusion:vortex-compact -2.0% -0.8% -1.2% +11.0% ➖ noise
9 datafusion:vortex-file-compressed +1.2% -0.8% +2.0% +11.0% ➖ noise
9 duckdb:duckdb +0.2% -0.8% +1.0% +11.0% ➖ noise
9 duckdb:vortex-compact -15.4% -0.8% -14.7% +11.0% ✅ faster
9 duckdb:vortex-file-compressed -16.3% -0.8% -15.6% +11.0% ✅ faster
10 datafusion:arrow -3.0% +0.8% -3.8% +11.0% ➖ noise
10 datafusion:vortex-compact +1.4% +0.8% +0.5% +11.0% ➖ noise
10 datafusion:vortex-file-compressed -2.4% +0.8% -3.2% +11.0% ➖ noise
10 duckdb:duckdb +1.6% +0.8% +0.8% +11.2% ➖ noise
10 duckdb:vortex-compact +48.6% +0.8% +47.3% +11.0% 🚨 regression
10 duckdb:vortex-file-compressed +56.3% +0.8% +55.0% +11.0% 🚨 regression
11 datafusion:arrow -5.3% -0.3% -5.0% +11.0% ➖ noise
11 datafusion:vortex-compact +0.2% -0.3% +0.5% +11.0% ➖ noise
11 datafusion:vortex-file-compressed +0.6% -0.3% +0.9% +11.0% ➖ noise
11 duckdb:duckdb -0.2% -0.3% +0.1% +11.0% ➖ noise
11 duckdb:vortex-compact -2.6% -0.3% -2.3% +11.0% ➖ noise
11 duckdb:vortex-file-compressed -2.3% -0.3% -2.0% +11.0% ➖ noise
12 datafusion:arrow -2.1% +12.5% -13.0% +18.2% ➖ noise
12 datafusion:vortex-compact -6.2% +12.5% -16.6% +11.0% ✅ faster
12 datafusion:vortex-file-compressed +2.6% +12.5% -8.8% +12.7% ➖ noise
12 duckdb:duckdb -0.4% +12.5% -11.5% +11.0% ✅ faster
12 duckdb:vortex-compact +19.5% +12.5% +6.2% +11.0% ➖ noise
12 duckdb:vortex-file-compressed +66.5% +12.5% +48.0% +11.0% 🚨 regression
13 datafusion:arrow -4.9% +0.5% -5.4% +11.0% ➖ noise
13 datafusion:vortex-compact -1.5% +0.5% -2.1% +11.0% ➖ noise
13 datafusion:vortex-file-compressed +1.4% +0.5% +0.9% +11.0% ➖ noise
13 duckdb:duckdb -3.0% +0.5% -3.5% +11.9% ➖ noise
13 duckdb:vortex-compact +4.3% +0.5% +3.8% +11.0% ➖ noise
13 duckdb:vortex-file-compressed +10.4% +0.5% +9.8% +11.0% ➖ noise
14 datafusion:arrow +1.8% -4.4% +6.5% +12.4% ➖ noise
14 datafusion:vortex-compact -0.3% -4.4% +4.3% +11.2% ➖ noise
14 datafusion:vortex-file-compressed +0.7% -4.4% +5.4% +11.0% ➖ noise
14 duckdb:duckdb -2.1% -4.4% +2.4% +17.5% ➖ noise
14 duckdb:vortex-compact -12.5% -4.4% -8.5% +11.0% ➖ noise
14 duckdb:vortex-file-compressed -7.3% -4.4% -3.0% +11.0% ➖ noise
15 datafusion:arrow +5.6% +1.0% +4.6% +11.0% ➖ noise
15 datafusion:vortex-compact +0.8% +1.0% -0.2% +12.4% ➖ noise
15 datafusion:vortex-file-compressed -1.8% +1.0% -2.8% +11.9% ➖ noise
15 duckdb:duckdb -2.5% +1.0% -3.5% +15.2% ➖ noise
15 duckdb:vortex-compact +1.5% +1.0% +0.5% +15.1% ➖ noise
15 duckdb:vortex-file-compressed -1.6% +1.0% -2.6% +12.5% ➖ noise
16 datafusion:arrow +1.4% -0.7% +2.1% +11.0% ➖ noise
16 datafusion:vortex-compact -1.1% -0.7% -0.4% +11.0% ➖ noise
16 datafusion:vortex-file-compressed +0.5% -0.7% +1.2% +11.0% ➖ noise
16 duckdb:duckdb +1.0% -0.7% +1.8% +11.0% ➖ noise
16 duckdb:vortex-compact -15.7% -0.7% -15.1% +11.0% ✅ faster
16 duckdb:vortex-file-compressed -7.9% -0.7% -7.2% +11.0% ➖ noise
17 datafusion:arrow +1.5% -1.1% +2.7% +11.0% ➖ noise
17 datafusion:vortex-compact -0.6% -1.1% +0.5% +11.0% ➖ noise
17 datafusion:vortex-file-compressed -6.3% -1.1% -5.2% +11.0% ➖ noise
17 duckdb:duckdb +5.3% -1.1% +6.5% +11.0% ➖ noise
17 duckdb:vortex-compact +115.6% -1.1% +118.1% +11.0% 🚨 regression
17 duckdb:vortex-file-compressed +139.3% -1.1% +142.0% +11.5% 🚨 regression
18 datafusion:arrow -1.0% -2.1% +1.1% +11.0% ➖ noise
18 datafusion:vortex-compact -3.2% -2.1% -1.2% +11.0% ➖ noise
18 datafusion:vortex-file-compressed -2.1% -2.1% -0.0% +11.0% ➖ noise
18 duckdb:duckdb +1.2% -2.1% +3.3% +11.0% ➖ noise
18 duckdb:vortex-compact -0.8% -2.1% +1.3% +11.0% ➖ noise
18 duckdb:vortex-file-compressed +1.2% -2.1% +3.4% +11.0% ➖ noise
19 datafusion:arrow +0.6% +6.5% -5.6% +11.9% ➖ noise
19 datafusion:vortex-compact -1.6% +6.5% -7.6% +12.8% ➖ noise
19 datafusion:vortex-file-compressed +0.7% +6.5% -5.5% +11.0% ➖ noise
19 duckdb:duckdb -0.1% +6.5% -6.3% +14.3% ➖ noise
19 duckdb:vortex-compact -14.1% +6.5% -19.4% +11.5% ✅ faster
19 duckdb:vortex-file-compressed -22.9% +6.5% -27.6% +13.7% ✅ faster
20 datafusion:arrow -0.9% -1.2% +0.3% +11.0% ➖ noise
20 datafusion:vortex-compact -0.8% -1.2% +0.3% +11.0% ➖ noise
20 datafusion:vortex-file-compressed +5.4% -1.2% +6.7% +12.5% ➖ noise
20 duckdb:duckdb +2.8% -1.2% +4.0% +11.0% ➖ noise
20 duckdb:vortex-compact +1.9% -1.2% +3.1% +11.6% ➖ noise
20 duckdb:vortex-file-compressed +0.4% -1.2% +1.6% +11.0% ➖ noise
21 datafusion:arrow -2.6% -4.1% +1.6% +11.0% ➖ noise
21 datafusion:vortex-compact +0.2% -4.1% +4.5% +11.0% ➖ noise
21 datafusion:vortex-file-compressed -0.0% -4.1% +4.3% +11.0% ➖ noise
21 duckdb:duckdb +0.4% -4.1% +4.7% +11.0% ➖ noise
21 duckdb:vortex-compact +12.1% -4.1% +16.9% +11.0% 🚨 regression
21 duckdb:vortex-file-compressed +13.4% -4.1% +18.2% +11.0% 🚨 regression
22 datafusion:arrow -3.1% +0.8% -3.9% +11.0% ➖ noise
22 datafusion:vortex-compact -2.9% +0.8% -3.7% +11.6% ➖ noise
22 datafusion:vortex-file-compressed +1.5% +0.8% +0.7% +11.0% ➖ noise
22 duckdb:duckdb +3.2% +0.8% +2.3% +11.0% ➖ noise
22 duckdb:vortex-compact -15.1% +0.8% -15.8% +11.0% ✅ faster
22 duckdb:vortex-file-compressed -10.6% +0.8% -11.3% +11.0% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.7%
Vortex (geomean): 1.100x ❌
Parquet (geomean): 1.131x ❌
Shifts: Parquet (control) +13.1% · Median polish +10.3%


datafusion / vortex-file-compressed (1.098x ➖, 0↑ 6↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 6027555 5012171 1.20
fineweb_q01/datafusion:vortex-file-compressed 🚨 24931565 21295910 1.17
fineweb_q02/datafusion:vortex-file-compressed 🚨 23669045 21349782 1.11
fineweb_q03/datafusion:vortex-file-compressed 67915815 71885802 0.94
fineweb_q04/datafusion:vortex-file-compressed 245258806 234326346 1.05
fineweb_q05/datafusion:vortex-file-compressed 220099121 215959219 1.02
fineweb_q06/datafusion:vortex-file-compressed 🚨 56650158 51236456 1.11
fineweb_q07/datafusion:vortex-file-compressed 🚨 64697351 55731032 1.16
fineweb_q08/datafusion:vortex-file-compressed 🚨 23578751 20595723 1.14
datafusion / vortex-compact (1.101x ❌, 0↑ 4↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 6463533 5984553 1.08
fineweb_q01/datafusion:vortex-compact 133899296 124688478 1.07
fineweb_q02/datafusion:vortex-compact 132349136 127998654 1.03
fineweb_q03/datafusion:vortex-compact 🚨 1138046564 1010824979 1.13
fineweb_q04/datafusion:vortex-compact 🚨 1260378282 1105979909 1.14
fineweb_q05/datafusion:vortex-compact 1039438031 948320162 1.10
fineweb_q06/datafusion:vortex-compact 572906116 525244936 1.09
fineweb_q07/datafusion:vortex-compact 🚨 622195128 541559871 1.15
fineweb_q08/datafusion:vortex-compact 🚨 21208407 18915035 1.12
datafusion / parquet (1.138x ❌, 0↑ 8↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 6953008 6096856 1.14
fineweb_q01/datafusion:parquet 311621218 284009204 1.10
fineweb_q02/datafusion:parquet 🚨 328557310 289171111 1.14
fineweb_q03/datafusion:parquet 🚨 314823512 279711957 1.13
fineweb_q04/datafusion:parquet 🚨 331209230 295203391 1.12
fineweb_q05/datafusion:parquet 🚨 329134581 294121609 1.12
fineweb_q06/datafusion:parquet 🚨 330478748 287925674 1.15
fineweb_q07/datafusion:parquet 🚨 331999990 277995625 1.19
fineweb_q08/datafusion:parquet 🚨 317240504 273512496 1.16
duckdb / vortex-file-compressed (1.117x ❌, 0↑ 5↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 3570659 3110341 1.15
fineweb_q01/duckdb:vortex-file-compressed 23767947 21718396 1.09
fineweb_q02/duckdb:vortex-file-compressed 22823729 23397818 0.98
fineweb_q03/duckdb:vortex-file-compressed 🚨 161453747 119139064 1.36
fineweb_q04/duckdb:vortex-file-compressed 226704837 215269245 1.05
fineweb_q05/duckdb:vortex-file-compressed 218540140 212871627 1.03
fineweb_q06/duckdb:vortex-file-compressed 🚨 58739151 51280539 1.15
fineweb_q07/duckdb:vortex-file-compressed 🚨 60912700 52231488 1.17
fineweb_q08/duckdb:vortex-file-compressed 🚨 24595821 21877407 1.12
duckdb / vortex-compact (1.086x ➖, 0↑ 3↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4269032 3936249 1.08
fineweb_q01/duckdb:vortex-compact 113442524 112402544 1.01
fineweb_q02/duckdb:vortex-compact 115299111 108260837 1.07
fineweb_q03/duckdb:vortex-compact 🚨 941138714 851112043 1.11
fineweb_q04/duckdb:vortex-compact 980809500 898666148 1.09
fineweb_q05/duckdb:vortex-compact 🚨 894782561 802065179 1.12
fineweb_q06/duckdb:vortex-compact 500494678 475415367 1.05
fineweb_q07/duckdb:vortex-compact 508274455 473286575 1.07
fineweb_q08/duckdb:vortex-compact 🚨 24670083 20749204 1.19
duckdb / parquet (1.124x ❌, 0↑ 3↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚨 32895206 25220581 1.30
fineweb_q01/duckdb:parquet 90379024 87748214 1.03
fineweb_q02/duckdb:parquet 🚨 91663757 83165436 1.10
fineweb_q03/duckdb:parquet 336257425 308369256 1.09
fineweb_q04/duckdb:parquet 468282049 437185560 1.07
fineweb_q05/duckdb:parquet 433572223 408124617 1.06
fineweb_q06/duckdb:parquet 214645565 199034154 1.08
fineweb_q07/duckdb:parquet 223606535 207410850 1.08
fineweb_q08/duckdb:parquet 🚨 37771959 28197486 1.34
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +8.0% +22.0% -11.4% +57.9% ➖ noise
0 datafusion:vortex-file-compressed +20.3% +22.0% -1.4% +50.6% ➖ noise
0 duckdb:vortex-compact +8.5% +22.0% -11.1% +111.0% ➖ noise
0 duckdb:vortex-file-compressed +14.8% +22.0% -5.9% +87.7% ➖ noise
1 datafusion:vortex-compact +7.4% +6.3% +1.0% +14.5% ➖ noise
1 datafusion:vortex-file-compressed +17.1% +6.3% +10.1% +24.1% ➖ noise
1 duckdb:vortex-compact +0.9% +6.3% -5.1% +20.7% ➖ noise
1 duckdb:vortex-file-compressed +9.4% +6.3% +2.9% +67.9% ➖ noise
2 datafusion:vortex-compact +3.4% +11.9% -7.6% +14.5% ➖ noise
2 datafusion:vortex-file-compressed +10.9% +11.9% -0.9% +14.5% ➖ noise
2 duckdb:vortex-compact +6.5% +11.9% -4.8% +14.5% ➖ noise
2 duckdb:vortex-file-compressed -2.5% +11.9% -12.8% +14.5% ✅ faster
3 datafusion:vortex-compact +12.6% +10.8% +1.6% +14.5% ➖ noise
3 datafusion:vortex-file-compressed -5.5% +10.8% -14.7% +56.4% ➖ noise
3 duckdb:vortex-compact +10.6% +10.8% -0.2% +14.5% ➖ noise
3 duckdb:vortex-file-compressed +35.5% +10.8% +22.3% +28.2% ➖ noise
4 datafusion:vortex-compact +14.0% +9.6% +4.0% +14.5% ➖ noise
4 datafusion:vortex-file-compressed +4.7% +9.6% -4.5% +14.5% ➖ noise
4 duckdb:vortex-compact +9.1% +9.6% -0.4% +14.5% ➖ noise
4 duckdb:vortex-file-compressed +5.3% +9.6% -3.9% +14.5% ➖ noise
5 datafusion:vortex-compact +9.6% +9.0% +0.5% +14.5% ➖ noise
5 datafusion:vortex-file-compressed +1.9% +9.0% -6.5% +14.5% ➖ noise
5 duckdb:vortex-compact +11.6% +9.0% +2.3% +14.5% ➖ noise
5 duckdb:vortex-file-compressed +2.7% +9.0% -5.8% +14.5% ➖ noise
6 datafusion:vortex-compact +9.1% +11.3% -2.0% +14.5% ➖ noise
6 datafusion:vortex-file-compressed +10.6% +11.3% -0.6% +14.5% ➖ noise
6 duckdb:vortex-compact +5.3% +11.3% -5.4% +14.5% ➖ noise
6 duckdb:vortex-file-compressed +14.5% +11.3% +3.0% +17.2% ➖ noise
7 datafusion:vortex-compact +14.9% +13.5% +1.3% +14.5% ➖ noise
7 datafusion:vortex-file-compressed +16.1% +13.5% +2.3% +23.0% ➖ noise
7 duckdb:vortex-compact +7.4% +13.5% -5.4% +14.5% ➖ noise
7 duckdb:vortex-file-compressed +16.6% +13.5% +2.8% +14.5% ➖ noise
8 datafusion:vortex-compact +12.1% +24.6% -10.0% +19.2% ➖ noise
8 datafusion:vortex-file-compressed +14.5% +24.6% -8.2% +14.5% ➖ noise
8 duckdb:vortex-compact +18.9% +24.6% -4.6% +58.1% ➖ noise
8 duckdb:vortex-file-compressed +12.4% +24.6% -9.8% +14.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Vortex (geomean): 1.081x ➖
Parquet (geomean): 1.082x ➖
Shifts: Parquet (control) +8.2% · Median polish +8.2%


datafusion / vortex-file-compressed (1.089x ➖, 0↑ 39↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚨 28794038 25918858 1.11
tpcds_q02/datafusion:vortex-file-compressed 49682502 46940003 1.06
tpcds_q03/datafusion:vortex-file-compressed 🚨 16771768 15142815 1.11
tpcds_q04/datafusion:vortex-file-compressed 🚨 277740421 247808811 1.12
tpcds_q05/datafusion:vortex-file-compressed 🚨 47525118 43033381 1.10
tpcds_q06/datafusion:vortex-file-compressed 61112814 58820230 1.04
tpcds_q07/datafusion:vortex-file-compressed 🚨 45669380 40746701 1.12
tpcds_q08/datafusion:vortex-file-compressed 30927687 28748362 1.08
tpcds_q09/datafusion:vortex-file-compressed 46585626 43668440 1.07
tpcds_q10/datafusion:vortex-file-compressed 🚨 42339756 37903892 1.12
tpcds_q11/datafusion:vortex-file-compressed 136419164 129791243 1.05
tpcds_q12/datafusion:vortex-file-compressed 20581788 19037425 1.08
tpcds_q13/datafusion:vortex-file-compressed 48901608 44562277 1.10
tpcds_q14/datafusion:vortex-file-compressed 189430427 175993174 1.08
tpcds_q15/datafusion:vortex-file-compressed 🚨 33223713 28011433 1.19
tpcds_q16/datafusion:vortex-file-compressed 30240629 28388087 1.07
tpcds_q17/datafusion:vortex-file-compressed 65227954 63515931 1.03
tpcds_q18/datafusion:vortex-file-compressed 75835162 69691350 1.09
tpcds_q19/datafusion:vortex-file-compressed 23475806 21737378 1.08
tpcds_q20/datafusion:vortex-file-compressed 2406578 21924505 1.10
tpcds_q21/datafusion:vortex-file-compressed 🚨 39730807 35628403 1.12
tpcds_q22/datafusion:vortex-file-compressed 🚨 124957462 112035356 1.12
tpcds_q23/datafusion:vortex-file-compressed 🚨 175466790 151326710 1.16
tpcds_q24/datafusion:vortex-file-compressed 91125183 83853175 1.09
tpcds_q25/datafusion:vortex-file-compressed 69317133 67003972 1.03
tpcds_q26/datafusion:vortex-file-compressed 36291206 34527133 1.05
tpcds_q27/datafusion:vortex-file-compressed 🚨 121447319 104506381 1.16
tpcds_q28/datafusion:vortex-file-compressed 41613047 41675995 1.00
tpcds_q29/datafusion:vortex-file-compressed 65869518 62157487 1.06
tpcds_q30/datafusion:vortex-file-compressed 24163155 23084044 1.05
tpcds_q31/datafusion:vortex-file-compressed 80453925 73830991 1.09
tpcds_q32/datafusion:vortex-file-compressed 🚨 23455529 20186875 1.16
tpcds_q33/datafusion:vortex-file-compressed 32287800 29528934 1.09
tpcds_q34/datafusion:vortex-file-compressed 25560266 23910949 1.07
tpcds_q35/datafusion:vortex-file-compressed 49722414 46055874 1.08
tpcds_q36/datafusion:vortex-file-compressed 61450205 57781054 1.06
tpcds_q37/datafusion:vortex-file-compressed 27856835 26098156 1.07
tpcds_q38/datafusion:vortex-file-compressed 🚨 49140769 44533586 1.10
tpcds_q39/datafusion:vortex-file-compressed 🚨 117011473 104174176 1.12
tpcds_q40/datafusion:vortex-file-compressed 🚨 38696466 32865768 1.18
tpcds_q41/datafusion:vortex-file-compressed 🚨 17607842 15416885 1.14
tpcds_q42/datafusion:vortex-file-compressed 15577684 14600734 1.07
tpcds_q43/datafusion:vortex-file-compressed 20232874 18526964 1.09
tpcds_q44/datafusion:vortex-file-compressed 34288296 31799422 1.08
tpcds_q45/datafusion:vortex-file-compressed 🚨 29573912 26568264 1.11
tpcds_q46/datafusion:vortex-file-compressed 36468676 34884348 1.05
tpcds_q47/datafusion:vortex-file-compressed 🚨 146115765 131320369 1.11
tpcds_q48/datafusion:vortex-file-compressed 40795072 41221552 0.99
tpcds_q49/datafusion:vortex-file-compressed 61984958 59075351 1.05
tpcds_q50/datafusion:vortex-file-compressed 41974242 38902023 1.08
tpcds_q51/datafusion:vortex-file-compressed 93660105 88826389 1.05
tpcds_q52/datafusion:vortex-file-compressed 15013757 15083378 1.00
tpcds_q53/datafusion:vortex-file-compressed 23298282 21452096 1.09
tpcds_q54/datafusion:vortex-file-compressed 37126244 34336035 1.08
tpcds_q55/datafusion:vortex-file-compressed 14900082 13727070 1.09
tpcds_q56/datafusion:vortex-file-compressed 31609683 29502439 1.07
tpcds_q57/datafusion:vortex-file-compressed 🚨 119494758 106436431 1.12
tpcds_q58/datafusion:vortex-file-compressed 🚨 59285357 52425518 1.13
tpcds_q59/datafusion:vortex-file-compressed 60862293 56551092 1.08
tpcds_q60/datafusion:vortex-file-compressed 30667712 29890704 1.03
tpcds_q61/datafusion:vortex-file-compressed 42720827 42029386 1.02
tpcds_q62/datafusion:vortex-file-compressed 23565029 22506684 1.05
tpcds_q63/datafusion:vortex-file-compressed 22635151 21488550 1.05
tpcds_q64/datafusion:vortex-file-compressed 453745878 416885459 1.09
tpcds_q65/datafusion:vortex-file-compressed 42377061 39763578 1.07
tpcds_q66/datafusion:vortex-file-compressed 75445703 73974199 1.02
tpcds_q67/datafusion:vortex-file-compressed 🚨 160995898 145368007 1.11
tpcds_q68/datafusion:vortex-file-compressed 35303278 33454086 1.06
tpcds_q69/datafusion:vortex-file-compressed 40634562 37702712 1.08
tpcds_q70/datafusion:vortex-file-compressed 92733878 84370643 1.10
tpcds_q71/datafusion:vortex-file-compressed 24702073 22816830 1.08
tpcds_q72/datafusion:vortex-file-compressed 🚨 2388909710 2128630305 1.12
tpcds_q73/datafusion:vortex-file-compressed 🚨 25542952 22655375 1.13
tpcds_q74/datafusion:vortex-file-compressed 🚨 86735104 78212483 1.11
tpcds_q75/datafusion:vortex-file-compressed 🚨 116920792 105862820 1.10
tpcds_q76/datafusion:vortex-file-compressed 🚨 26799120 23564210 1.14
tpcds_q77/datafusion:vortex-file-compressed 43199432 39494367 1.09
tpcds_q78/datafusion:vortex-file-compressed 132504393 125169433 1.06
tpcds_q79/datafusion:vortex-file-compressed 🚨 30721333 27704455 1.11
tpcds_q80/datafusion:vortex-file-compressed 🚨 102536357 91974092 1.11
tpcds_q81/datafusion:vortex-file-compressed 🚨 27721049 23431162 1.18
tpcds_q82/datafusion:vortex-file-compressed 28573250 27112712 1.05
tpcds_q83/datafusion:vortex-file-compressed 🚨 36105377 32398424 1.11
tpcds_q84/datafusion:vortex-file-compressed 🚨 14973273 13145304 1.14
tpcds_q85/datafusion:vortex-file-compressed 🚨 107326940 93077079 1.15
tpcds_q86/datafusion:vortex-file-compressed 16614318 15485380 1.07
tpcds_q87/datafusion:vortex-file-compressed 47837884 44767600 1.07
tpcds_q88/datafusion:vortex-file-compressed 🚨 60992826 54585539 1.12
tpcds_q89/datafusion:vortex-file-compressed 25612071 24193333 1.06
tpcds_q90/datafusion:vortex-file-compressed 🚨 16827342 14360672 1.17
tpcds_q91/datafusion:vortex-file-compressed 🚨 20213066 17716212 1.14
tpcds_q92/datafusion:vortex-file-compressed 🚨 21797263 18423752 1.18
tpcds_q93/datafusion:vortex-file-compressed 35354220 33125395 1.07
tpcds_q94/datafusion:vortex-file-compressed 24786896 24321453 1.02
tpcds_q95/datafusion:vortex-file-compressed 64070614 61223800 1.05
tpcds_q96/datafusion:vortex-file-compressed 🚨 14912815 13302105 1.12
tpcds_q97/datafusion:vortex-file-compressed 🚨 35455926 32172083 1.10
tpcds_q98/datafusion:vortex-file-compressed 🚨 26682865 23143963 1.15
tpcds_q99/datafusion:vortex-file-compressed 34565855 32206621 1.07
datafusion / vortex-compact (1.084x ➖, 0↑ 35↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 27104988 25980516 1.04
tpcds_q02/datafusion:vortex-compact 55810502 53212349 1.05
tpcds_q03/datafusion:vortex-compact 20622128 19390135 1.06
tpcds_q04/datafusion:vortex-compact 317312402 297710606 1.07
tpcds_q05/datafusion:vortex-compact 49884693 48084073 1.04
tpcds_q06/datafusion:vortex-compact 65450938 60503679 1.08
tpcds_q07/datafusion:vortex-compact 56595561 51973739 1.09
tpcds_q08/datafusion:vortex-compact 37376934 35847192 1.04
tpcds_q09/datafusion:vortex-compact 63481702 62447026 1.02
tpcds_q10/datafusion:vortex-compact 52796541 50698360 1.04
tpcds_q11/datafusion:vortex-compact 🚨 172839541 154091149 1.12
tpcds_q12/datafusion:vortex-compact 24569510 25752688 0.95
tpcds_q13/datafusion:vortex-compact 95068359 94606544 1.00
tpcds_q14/datafusion:vortex-compact 204972009 192077170 1.07
tpcds_q15/datafusion:vortex-compact 🚨 34792303 30086795 1.16
tpcds_q16/datafusion:vortex-compact 35988532 32903220 1.09
tpcds_q17/datafusion:vortex-compact 🚨 81644722 72328304 1.13
tpcds_q18/datafusion:vortex-compact 85591221 78715303 1.09
tpcds_q19/datafusion:vortex-compact 31305054 28938883 1.08
tpcds_q20/datafusion:vortex-compact 27604738 26227420 1.05
tpcds_q21/datafusion:vortex-compact 40861361 39346368 1.04
tpcds_q22/datafusion:vortex-compact 133562714 122230378 1.09
tpcds_q23/datafusion:vortex-compact 175401332 162171602 1.08
tpcds_q24/datafusion:vortex-compact 106155563 99238059 1.07
tpcds_q25/datafusion:vortex-compact 🚨 86856331 77219066 1.12
tpcds_q26/datafusion:vortex-compact 46125215 45702301 1.01
tpcds_q27/datafusion:vortex-compact 🚨 142572368 125055579 1.14
tpcds_q28/datafusion:vortex-compact 80529431 78711617 1.02
tpcds_q29/datafusion:vortex-compact 76994370 72139152 1.07
tpcds_q30/datafusion:vortex-compact 🚨 30350671 27256041 1.11
tpcds_q31/datafusion:vortex-compact 104429082 96214483 1.09
tpcds_q32/datafusion:vortex-compact 🚨 29048902 24844535 1.17
tpcds_q33/datafusion:vortex-compact 38048750 36301899 1.05
tpcds_q34/datafusion:vortex-compact 33823231 31921386 1.06
tpcds_q35/datafusion:vortex-compact 53287236 50730721 1.05
tpcds_q36/datafusion:vortex-compact 78884094 75039807 1.05
tpcds_q37/datafusion:vortex-compact 41430587 40263131 1.03
tpcds_q38/datafusion:vortex-compact 54821228 50655208 1.08
tpcds_q39/datafusion:vortex-compact 🚨 127691806 109603694 1.17
tpcds_q40/datafusion:vortex-compact 🚨 42008203 36556862 1.15
tpcds_q41/datafusion:vortex-compact 🚨 19361821 17525176 1.10
tpcds_q42/datafusion:vortex-compact 🚨 19748948 17932502 1.10
tpcds_q43/datafusion:vortex-compact 25379237 24530902 1.03
tpcds_q44/datafusion:vortex-compact 🚨 52860355 47352578 1.12
tpcds_q45/datafusion:vortex-compact 33435865 31375442 1.07
tpcds_q46/datafusion:vortex-compact 🚨 48659387 44186876 1.10
tpcds_q47/datafusion:vortex-compact 161292384 147424059 1.09
tpcds_q48/datafusion:vortex-compact 73837088 71440964 1.03
tpcds_q49/datafusion:vortex-compact 72136136 67796601 1.06
tpcds_q50/datafusion:vortex-compact 🚨 54376805 46061442 1.18
tpcds_q51/datafusion:vortex-compact 101350593 95587053 1.06
tpcds_q52/datafusion:vortex-compact 19396162 19747556 0.98
tpcds_q53/datafusion:vortex-compact 29658405 27214549 1.09
tpcds_q54/datafusion:vortex-compact 🚨 46839713 42001122 1.12
tpcds_q55/datafusion:vortex-compact 🚨 20570635 17957756 1.15
tpcds_q56/datafusion:vortex-compact 🚨 39632859 34596492 1.15
tpcds_q57/datafusion:vortex-compact 124711354 115072582 1.08
tpcds_q58/datafusion:vortex-compact 🚨 67589681 60231664 1.12
tpcds_q59/datafusion:vortex-compact 72724604 68711385 1.06
tpcds_q60/datafusion:vortex-compact 37592590 36363112 1.03
tpcds_q61/datafusion:vortex-compact 56985625 55398654 1.03
tpcds_q62/datafusion:vortex-compact 29195032 31351644 0.93
tpcds_q63/datafusion:vortex-compact 🚨 30537309 27339018 1.12
tpcds_q64/datafusion:vortex-compact 488960820 452942212 1.08
tpcds_q65/datafusion:vortex-compact 58457508 53431003 1.09
tpcds_q66/datafusion:vortex-compact 80755789 76534825 1.06
tpcds_q67/datafusion:vortex-compact 161127925 152784023 1.05
tpcds_q68/datafusion:vortex-compact 46560356 44579187 1.04
tpcds_q69/datafusion:vortex-compact 49528024 47552161 1.04
tpcds_q70/datafusion:vortex-compact 103074414 97854175 1.05
tpcds_q71/datafusion:vortex-compact 30187795 29011368 1.04
tpcds_q72/datafusion:vortex-compact 🚨 2411486493 2116294403 1.14
tpcds_q73/datafusion:vortex-compact 🚨 33604051 30441065 1.10
tpcds_q74/datafusion:vortex-compact 97547793 91989009 1.06
tpcds_q75/datafusion:vortex-compact 137169785 125620461 1.09
tpcds_q76/datafusion:vortex-compact 🚨 35316902 31373541 1.13
tpcds_q77/datafusion:vortex-compact 53269085 49723060 1.07
tpcds_q78/datafusion:vortex-compact 🚨 158827655 136176100 1.17
tpcds_q79/datafusion:vortex-compact 🚨 41405066 37020192 1.12
tpcds_q80/datafusion:vortex-compact 🚨 130220614 101646638 1.28
tpcds_q81/datafusion:vortex-compact 30207410 28657530 1.05
tpcds_q82/datafusion:vortex-compact 43604155 40785644 1.07
tpcds_q83/datafusion:vortex-compact 🚨 41051570 32707122 1.26
tpcds_q84/datafusion:vortex-compact 🚨 16643698 14334660 1.16
tpcds_q85/datafusion:vortex-compact 142598659 130280070 1.09
tpcds_q86/datafusion:vortex-compact 🚨 20160708 18317038 1.10
tpcds_q87/datafusion:vortex-compact 55060576 52097747 1.06
tpcds_q88/datafusion:vortex-compact 81630785 76227596 1.07
tpcds_q89/datafusion:vortex-compact 33629581 31516632 1.07
tpcds_q90/datafusion:vortex-compact 🚨 17604601 15235207 1.16
tpcds_q91/datafusion:vortex-compact 🚨 35165497 31807979 1.11
tpcds_q92/datafusion:vortex-compact 🚨 26737935 24169061 1.11
tpcds_q93/datafusion:vortex-compact 41657521 38109583 1.09
tpcds_q94/datafusion:vortex-compact 28504261 26512188 1.08
tpcds_q95/datafusion:vortex-compact 🚨 70681616 62784254 1.13
tpcds_q96/datafusion:vortex-compact 🚨 19337080 16965980 1.14
tpcds_q97/datafusion:vortex-compact 40459708 36965130 1.09
tpcds_q98/datafusion:vortex-compact 🚨 34084777 29452607 1.16
tpcds_q99/datafusion:vortex-compact 🚨 34795052 31249267 1.11
datafusion / parquet (1.091x ➖, 0↑ 35↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 🚨 33341296 28792909 1.16
tpcds_q02/datafusion:parquet 43749358 43458548 1.01
tpcds_q03/datafusion:parquet 13692908 12629798 1.08
tpcds_q04/datafusion:parquet 287032935 280871827 1.02
tpcds_q05/datafusion:parquet 43316628 41702381 1.04
tpcds_q06/datafusion:parquet 63928221 58453088 1.09
tpcds_q07/datafusion:parquet 🚨 83439479 75566693 1.10
tpcds_q08/datafusion:parquet 🚨 28453423 25125675 1.13
tpcds_q09/datafusion:parquet 47780137 43759193 1.09
tpcds_q10/datafusion:parquet 🚨 80627321 66235832 1.22
tpcds_q11/datafusion:parquet 160524792 148568534 1.08
tpcds_q12/datafusion:parquet 18364256 17401525 1.06
tpcds_q13/datafusion:parquet 79430990 73341339 1.08
tpcds_q14/datafusion:parquet 166263203 157650437 1.05
tpcds_q15/datafusion:parquet 22296155 20916627 1.07
tpcds_q16/datafusion:parquet 🚨 26572992 23536933 1.13
tpcds_q17/datafusion:parquet 66749794 67127359 0.99
tpcds_q18/datafusion:parquet 119106565 115647108 1.03
tpcds_q19/datafusion:parquet 🚨 26458269 22098658 1.20
tpcds_q20/datafusion:parquet 🚨 20536032 16552964 1.24
tpcds_q21/datafusion:parquet 🚨 22692667 18180184 1.25
tpcds_q22/datafusion:parquet 🚨 181270650 135275650 1.34
tpcds_q23/datafusion:parquet 🚨 165564390 141400876 1.17
tpcds_q24/datafusion:parquet 95653027 89093808 1.07
tpcds_q25/datafusion:parquet 69426278 63340249 1.10
tpcds_q26/datafusion:parquet 70202653 63940884 1.10
tpcds_q27/datafusion:parquet 🚨 162342518 143711824 1.13
tpcds_q28/datafusion:parquet 46719438 42684825 1.09
tpcds_q29/datafusion:parquet 68751874 65600024 1.05
tpcds_q30/datafusion:parquet 35767028 34855276 1.03
tpcds_q31/datafusion:parquet 🚨 67444634 61272233 1.10
tpcds_q32/datafusion:parquet 🚨 19806614 17705114 1.12
tpcds_q33/datafusion:parquet 27714350 26212017 1.06
tpcds_q34/datafusion:parquet 21701316 20538071 1.06
tpcds_q35/datafusion:parquet 72926638 68148795 1.07
tpcds_q36/datafusion:parquet 🚨 62228305 56308931 1.11
tpcds_q37/datafusion:parquet 19605396 18751534 1.05
tpcds_q38/datafusion:parquet 42886035 40277232 1.06
tpcds_q39/datafusion:parquet 76900931 73144510 1.05
tpcds_q40/datafusion:parquet 24982172 23218295 1.08
tpcds_q41/datafusion:parquet 14488015 13875083 1.04
tpcds_q42/datafusion:parquet 12506152 11976768 1.04
tpcds_q43/datafusion:parquet 18027006 16609715 1.09
tpcds_q44/datafusion:parquet 32904409 32052749 1.03
tpcds_q45/datafusion:parquet 29360998 28080930 1.05
tpcds_q46/datafusion:parquet 🚨 34821986 31542884 1.10
tpcds_q47/datafusion:parquet 🚨 135844652 122338411 1.11
tpcds_q48/datafusion:parquet 74924325 69188303 1.08
tpcds_q49/datafusion:parquet 🚨 59589680 53827408 1.11
tpcds_q50/datafusion:parquet 44929423 42735135 1.05
tpcds_q51/datafusion:parquet 🚨 93052215 84534426 1.10
tpcds_q52/datafusion:parquet 12257032 11447202 1.07
tpcds_q53/datafusion:parquet 19008808 17307716 1.10
tpcds_q54/datafusion:parquet 36372113 33965926 1.07
tpcds_q55/datafusion:parquet 🚨 12285393 10935641 1.12
tpcds_q56/datafusion:parquet 28525236 26695881 1.07
tpcds_q57/datafusion:parquet 🚨 107230543 91080602 1.18
tpcds_q58/datafusion:parquet 54879900 50949391 1.08
tpcds_q59/datafusion:parquet 60929784 56919978 1.07
tpcds_q60/datafusion:parquet 27822954 27718556 1.00
tpcds_q61/datafusion:parquet 43686575 42351166 1.03
tpcds_q62/datafusion:parquet 🚨 28301364 24297971 1.16
tpcds_q63/datafusion:parquet 19073800 17484652 1.09
tpcds_q64/datafusion:parquet 553137868 503768587 1.10
tpcds_q65/datafusion:parquet 39899221 36913032 1.08
tpcds_q66/datafusion:parquet 74343796 69429151 1.07
tpcds_q67/datafusion:parquet 151312338 144622660 1.05
tpcds_q68/datafusion:parquet 32964121 31854348 1.03
tpcds_q69/datafusion:parquet 68064629 66259533 1.03
tpcds_q70/datafusion:parquet 🚨 92714178 82682756 1.12
tpcds_q71/datafusion:parquet 22796353 21555309 1.06
tpcds_q72/datafusion:parquet 🚨 700000169 610734364 1.15
tpcds_q73/datafusion:parquet 22511707 20714471 1.09
tpcds_q74/datafusion:parquet 🚨 89576075 77901275 1.15
tpcds_q75/datafusion:parquet 🚨 108576499 98525972 1.10
tpcds_q76/datafusion:parquet 🚨 34060372 28948271 1.18
tpcds_q77/datafusion:parquet 🚨 41670507 37808359 1.10
tpcds_q78/datafusion:parquet 🚨 130315142 110904693 1.18
tpcds_q79/datafusion:parquet 27581357 27605526 1.00
tpcds_q80/datafusion:parquet 85273997 77824183 1.10
tpcds_q81/datafusion:parquet 🚨 34977725 30999883 1.13
tpcds_q82/datafusion:parquet 19932965 18674027 1.07
tpcds_q83/datafusion:parquet 37627899 36797699 1.02
tpcds_q84/datafusion:parquet 41555158 38790343 1.07
tpcds_q85/datafusion:parquet 157124381 146593546 1.07
tpcds_q86/datafusion:parquet 🚨 17279751 13984975 1.24
tpcds_q87/datafusion:parquet 🚨 44000340 39702911 1.11
tpcds_q88/datafusion:parquet 60151729 58447745 1.03
tpcds_q89/datafusion:parquet 22310505 20632148 1.08
tpcds_q90/datafusion:parquet 🚨 15922889 14202095 1.12
tpcds_q91/datafusion:parquet 62192109 58045144 1.07
tpcds_q92/datafusion:parquet 🚨 20238876 18009633 1.12
tpcds_q93/datafusion:parquet 34246782 31210870 1.10
tpcds_q94/datafusion:parquet 21404629 20334439 1.05
tpcds_q95/datafusion:parquet 🚨 63872985 57800911 1.11
tpcds_q96/datafusion:parquet 🚨 13583498 11308380 1.20
tpcds_q97/datafusion:parquet 32375837 29495062 1.10
tpcds_q98/datafusion:parquet 21670935 21239611 1.02
tpcds_q99/datafusion:parquet 27095656 25729077 1.05
duckdb / vortex-file-compressed (1.087x ➖, 12↑ 47↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 🚨 26323266 20815383 1.26
tpcds_q02/duckdb:vortex-file-compressed 33618171 36436985 0.92
tpcds_q03/duckdb:vortex-file-compressed 32105957 31641290 1.01
tpcds_q04/duckdb:vortex-file-compressed 99392044 108268401 0.92
tpcds_q05/duckdb:vortex-file-compressed 37263965 35844667 1.04
tpcds_q06/duckdb:vortex-file-compressed 34034269 31993431 1.06
tpcds_q07/duckdb:vortex-file-compressed 🚨 27697616 19207707 1.44
tpcds_q08/duckdb:vortex-file-compressed 🚨 33523041 28483739 1.18
tpcds_q09/duckdb:vortex-file-compressed 🚀 17759210 37299964 0.48
tpcds_q10/duckdb:vortex-file-compressed 39691888 39468698 1.01
tpcds_q11/duckdb:vortex-file-compressed 66656085 60986679 1.09
tpcds_q12/duckdb:vortex-file-compressed 14249742 13821890 1.03
tpcds_q13/duckdb:vortex-file-compressed 🚨 47694832 31926436 1.49
tpcds_q14/duckdb:vortex-file-compressed 107352070 105407411 1.02
tpcds_q15/duckdb:vortex-file-compressed 28367352 25923848 1.09
tpcds_q16/duckdb:vortex-file-compressed 🚨 38422757 26443979 1.45
tpcds_q17/duckdb:vortex-file-compressed 43006257 42282950 1.02
tpcds_q18/duckdb:vortex-file-compressed 43127560 46798536 0.92
tpcds_q19/duckdb:vortex-file-compressed 🚨 129288168 31727532 4.07
tpcds_q20/duckdb:vortex-file-compressed 15552560 14912637 1.04
tpcds_q21/duckdb:vortex-file-compressed 18101457 16812002 1.08
tpcds_q22/duckdb:vortex-file-compressed 🚨 83610056 70315797 1.19
tpcds_q23/duckdb:vortex-file-compressed 🚨 133871270 107622528 1.24
tpcds_q24/duckdb:vortex-file-compressed 50837635 47154003 1.08
tpcds_q25/duckdb:vortex-file-compressed 🚀 41471905 47345463 0.88
tpcds_q26/duckdb:vortex-file-compressed 🚀 22484624 40230617 0.56
tpcds_q27/duckdb:vortex-file-compressed 🚀 28504562 46081594 0.62
tpcds_q28/duckdb:vortex-file-compressed 🚀 14908859 34434839 0.43
tpcds_q29/duckdb:vortex-file-compressed 🚨 63822532 41626715 1.53
tpcds_q30/duckdb:vortex-file-compressed 24518397 23185278 1.06
tpcds_q31/duckdb:vortex-file-compressed 🚀 29418667 34793071 0.85
tpcds_q32/duckdb:vortex-file-compressed 🚨 17781541 13564601 1.31
tpcds_q33/duckdb:vortex-file-compressed 🚨 27020419 23447465 1.15
tpcds_q34/duckdb:vortex-file-compressed 🚨 25320221 22738459 1.11
tpcds_q35/duckdb:vortex-file-compressed 🚀 52632278 63840173 0.82
tpcds_q36/duckdb:vortex-file-compressed 🚨 27679115 24119730 1.15
tpcds_q37/duckdb:vortex-file-compressed 16005549 14825436 1.08
tpcds_q38/duckdb:vortex-file-compressed 38149539 37033305 1.03
tpcds_q39/duckdb:vortex-file-compressed 34566162 34891535 0.99
tpcds_q40/duckdb:vortex-file-compressed 🚨 21476241 18623723 1.15
tpcds_q41/duckdb:vortex-file-compressed 11792739 12678822 0.93
tpcds_q42/duckdb:vortex-file-compressed 🚨 14659936 12620553 1.16
tpcds_q43/duckdb:vortex-file-compressed 24833156 22753624 1.09
tpcds_q44/duckdb:vortex-file-compressed 22810262 21117819 1.08
tpcds_q45/duckdb:vortex-file-compressed 🚨 32941071 27934157 1.18
tpcds_q46/duckdb:vortex-file-compressed 🚀 32912993 49760673 0.66
tpcds_q47/duckdb:vortex-file-compressed 🚨 51870047 46665535 1.11
tpcds_q48/duckdb:vortex-file-compressed 🚨 44629741 29482566 1.51
tpcds_q49/duckdb:vortex-file-compressed 31577177 32709797 0.97
tpcds_q50/duckdb:vortex-file-compressed 🚨 36885923 32814276 1.12
tpcds_q51/duckdb:vortex-file-compressed 99612116 95905311 1.04
tpcds_q52/duckdb:vortex-file-compressed 13131722 13224271 0.99
tpcds_q53/duckdb:vortex-file-compressed 23780897 22452415 1.06
tpcds_q54/duckdb:vortex-file-compressed 🚨 34024316 27321842 1.25
tpcds_q55/duckdb:vortex-file-compressed 🚨 14768145 12940310 1.14
tpcds_q56/duckdb:vortex-file-compressed 🚨 28736376 23233490 1.24
tpcds_q57/duckdb:vortex-file-compressed 40047658 39132622 1.02
tpcds_q58/duckdb:vortex-file-compressed 31452287 30635991 1.03
tpcds_q59/duckdb:vortex-file-compressed 🚨 77084385 67458802 1.14
tpcds_q60/duckdb:vortex-file-compressed 🚨 27917681 25268915 1.10
tpcds_q61/duckdb:vortex-file-compressed 🚨 36129701 32531076 1.11
tpcds_q62/duckdb:vortex-file-compressed 🚨 18774126 16074006 1.17
tpcds_q63/duckdb:vortex-file-compressed 🚨 22527901 20435035 1.10
tpcds_q64/duckdb:vortex-file-compressed 🚨 93757093 81858427 1.15
tpcds_q65/duckdb:vortex-file-compressed 🚨 40025707 21758162 1.84
tpcds_q66/duckdb:vortex-file-compressed 30796041 28847182 1.07
tpcds_q67/duckdb:vortex-file-compressed 🚨 150437776 133707830 1.13
tpcds_q68/duckdb:vortex-file-compressed 🚀 34922909 38914917 0.90
tpcds_q69/duckdb:vortex-file-compressed 🚨 47715707 42557030 1.12
tpcds_q70/duckdb:vortex-file-compressed 🚨 43505932 24593502 1.77
tpcds_q71/duckdb:vortex-file-compressed 21765181 20165584 1.08
tpcds_q72/duckdb:vortex-file-compressed 🚀 145912019 174345168 0.84
tpcds_q73/duckdb:vortex-file-compressed 🚨 28764063 22703639 1.27
tpcds_q74/duckdb:vortex-file-compressed 🚀 48449654 73305308 0.66
tpcds_q75/duckdb:vortex-file-compressed 54149578 56156402 0.96
tpcds_q76/duckdb:vortex-file-compressed 🚨 21488755 17071100 1.26
tpcds_q77/duckdb:vortex-file-compressed 🚨 26951896 23675673 1.14
tpcds_q78/duckdb:vortex-file-compressed 🚨 87292846 74929693 1.16
tpcds_q79/duckdb:vortex-file-compressed 30067137 31595346 0.95
tpcds_q80/duckdb:vortex-file-compressed 49416268 47102342 1.05
tpcds_q81/duckdb:vortex-file-compressed 🚨 30659722 27338729 1.12
tpcds_q82/duckdb:vortex-file-compressed 🚨 18505844 16694139 1.11
tpcds_q83/duckdb:vortex-file-compressed 🚨 29922006 23912111 1.25
tpcds_q84/duckdb:vortex-file-compressed 🚨 34550023 18322444 1.89
tpcds_q85/duckdb:vortex-file-compressed 🚨 55314029 45871453 1.21
tpcds_q86/duckdb:vortex-file-compressed 🚨 18138559 15960674 1.14
tpcds_q87/duckdb:vortex-file-compressed 🚨 43489725 39255486 1.11
tpcds_q88/duckdb:vortex-file-compressed 33292194 32475371 1.03
tpcds_q89/duckdb:vortex-file-compressed 24201199 23100482 1.05
tpcds_q90/duckdb:vortex-file-compressed 12344040 12800608 0.96
tpcds_q91/duckdb:vortex-file-compressed 🚀 22896721 30784779 0.74
tpcds_q92/duckdb:vortex-file-compressed 20891850 20726810 1.01
tpcds_q93/duckdb:vortex-file-compressed 29802154 27748927 1.07
tpcds_q94/duckdb:vortex-file-compressed 🚨 47382482 22602893 2.10
tpcds_q95/duckdb:vortex-file-compressed 🚨 213232017 133093756 1.60
tpcds_q96/duckdb:vortex-file-compressed 🚨 14659148 12213024 1.20
tpcds_q97/duckdb:vortex-file-compressed 36226516 38152027 0.95
tpcds_q98/duckdb:vortex-file-compressed 🚨 20241300 17787372 1.14
tpcds_q99/duckdb:vortex-file-compressed 28079635 26986307 1.04
duckdb / vortex-compact (1.065x ➖, 12↑ 37↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚨 30481351 22907668 1.33
tpcds_q02/duckdb:vortex-compact 🚨 45624416 39964208 1.14
tpcds_q03/duckdb:vortex-compact 58131275 55374566 1.05
tpcds_q04/duckdb:vortex-compact 107972220 118452132 0.91
tpcds_q05/duckdb:vortex-compact 51736143 50090820 1.03
tpcds_q06/duckdb:vortex-compact 40820002 38915608 1.05
tpcds_q07/duckdb:vortex-compact 🚨 49052548 32861416 1.49
tpcds_q08/duckdb:vortex-compact 🚨 51092509 43753334 1.17
tpcds_q09/duckdb:vortex-compact 🚀 23017808 56642565 0.41
tpcds_q10/duckdb:vortex-compact 62336095 57839173 1.08
tpcds_q11/duckdb:vortex-compact 75174001 72566427 1.04
tpcds_q12/duckdb:vortex-compact 🚨 23571331 20596085 1.14
tpcds_q13/duckdb:vortex-compact 🚨 79134645 58777634 1.35
tpcds_q14/duckdb:vortex-compact 🚨 138680307 124263800 1.12
tpcds_q15/duckdb:vortex-compact 🚨 34501717 30567865 1.13
tpcds_q16/duckdb:vortex-compact 🚨 43034736 29621564 1.45
tpcds_q17/duckdb:vortex-compact 🚨 68122747 53312372 1.28
tpcds_q18/duckdb:vortex-compact 56796805 58026821 0.98
tpcds_q19/duckdb:vortex-compact 🚨 150673056 50225436 3.00
tpcds_q20/duckdb:vortex-compact 21453899 20067491 1.07
tpcds_q21/duckdb:vortex-compact 🚨 20910309 18385603 1.14
tpcds_q22/duckdb:vortex-compact 🚨 90388766 76043729 1.19
tpcds_q23/duckdb:vortex-compact 🚨 155646999 117480838 1.32
tpcds_q24/duckdb:vortex-compact 63898432 63447194 1.01
tpcds_q25/duckdb:vortex-compact 🚀 69696261 86041506 0.81
tpcds_q26/duckdb:vortex-compact 🚀 35276794 51297788 0.69
tpcds_q27/duckdb:vortex-compact 🚀 49309796 66495797 0.74
tpcds_q28/duckdb:vortex-compact 🚀 24037849 84539061 0.28
tpcds_q29/duckdb:vortex-compact 🚨 88029942 52735736 1.67
tpcds_q30/duckdb:vortex-compact 🚨 33813855 27327847 1.24
tpcds_q31/duckdb:vortex-compact 🚀 38802153 44665555 0.87
tpcds_q32/duckdb:vortex-compact 🚨 23786524 21577889 1.10
tpcds_q33/duckdb:vortex-compact 37739043 34566906 1.09
tpcds_q34/duckdb:vortex-compact 36198492 36620912 0.99
tpcds_q35/duckdb:vortex-compact 70695435 78388308 0.90
tpcds_q36/duckdb:vortex-compact 41321182 40885160 1.01
tpcds_q37/duckdb:vortex-compact 24864415 23258837 1.07
tpcds_q38/duckdb:vortex-compact 46493171 45926065 1.01
tpcds_q39/duckdb:vortex-compact 38079308 35855810 1.06
tpcds_q40/duckdb:vortex-compact 🚨 27322541 24833552 1.10
tpcds_q41/duckdb:vortex-compact 🚀 12872315 15499830 0.83
tpcds_q42/duckdb:vortex-compact 🚨 25286448 22178328 1.14
tpcds_q43/duckdb:vortex-compact 36878197 34720619 1.06
tpcds_q44/duckdb:vortex-compact 30093152 29098850 1.03
tpcds_q45/duckdb:vortex-compact 40334629 37133233 1.09
tpcds_q46/duckdb:vortex-compact 🚀 55423630 72382838 0.77
tpcds_q47/duckdb:vortex-compact 🚨 68165900 61253175 1.11
tpcds_q48/duckdb:vortex-compact 🚨 66665919 51034380 1.31
tpcds_q49/duckdb:vortex-compact 54378406 53968245 1.01
tpcds_q50/duckdb:vortex-compact 45578527 45612931 1.00
tpcds_q51/duckdb:vortex-compact 104376253 108155062 0.97
tpcds_q52/duckdb:vortex-compact 🚨 23622709 21330224 1.11
tpcds_q53/duckdb:vortex-compact 38752121 37804014 1.03
tpcds_q54/duckdb:vortex-compact 39871945 39207572 1.02
tpcds_q55/duckdb:vortex-compact 23755910 22297499 1.07
tpcds_q56/duckdb:vortex-compact 37605777 35236585 1.07
tpcds_q57/duckdb:vortex-compact 45501939 42951941 1.06
tpcds_q58/duckdb:vortex-compact 🚨 45220305 39794231 1.14
tpcds_q59/duckdb:vortex-compact 🚨 98856559 87367886 1.13
tpcds_q60/duckdb:vortex-compact 41671973 38548199 1.08
tpcds_q61/duckdb:vortex-compact 67940247 62711778 1.08
tpcds_q62/duckdb:vortex-compact 27013222 25785978 1.05
tpcds_q63/duckdb:vortex-compact 39267607 37992207 1.03
tpcds_q64/duckdb:vortex-compact 🚨 140416589 116133511 1.21
tpcds_q65/duckdb:vortex-compact 🚨 54862045 32214864 1.70
tpcds_q66/duckdb:vortex-compact 40158558 38583333 1.04
tpcds_q67/duckdb:vortex-compact 165606863 151337408 1.09
tpcds_q68/duckdb:vortex-compact 57877438 58921374 0.98
tpcds_q69/duckdb:vortex-compact 66291602 61467787 1.08
tpcds_q70/duckdb:vortex-compact 🚨 71654301 37280640 1.92
tpcds_q71/duckdb:vortex-compact 34940749 33503778 1.04
tpcds_q72/duckdb:vortex-compact 🚀 161441552 195545481 0.83
tpcds_q73/duckdb:vortex-compact 36212814 36564262 0.99
tpcds_q74/duckdb:vortex-compact 🚀 51715858 84097171 0.61
tpcds_q75/duckdb:vortex-compact 66339116 66879807 0.99
tpcds_q76/duckdb:vortex-compact 🚀 31534201 35141832 0.90
tpcds_q77/duckdb:vortex-compact 🚨 45156676 40273868 1.12
tpcds_q78/duckdb:vortex-compact 92789444 86930836 1.07
tpcds_q79/duckdb:vortex-compact 51379545 52020719 0.99
tpcds_q80/duckdb:vortex-compact 84106089 85446033 0.98
tpcds_q81/duckdb:vortex-compact 🚨 38415371 32855261 1.17
tpcds_q82/duckdb:vortex-compact 🚨 29329693 25186219 1.16
tpcds_q83/duckdb:vortex-compact 🚨 39438687 31360637 1.26
tpcds_q84/duckdb:vortex-compact 🚨 42092028 26499585 1.59
tpcds_q85/duckdb:vortex-compact 🚨 77335621 56245485 1.37
tpcds_q86/duckdb:vortex-compact 23156013 23387848 0.99
tpcds_q87/duckdb:vortex-compact 50025858 50529078 0.99
tpcds_q88/duckdb:vortex-compact 38511168 38902025 0.99
tpcds_q89/duckdb:vortex-compact 39814315 37443945 1.06
tpcds_q90/duckdb:vortex-compact 13204427 14173239 0.93
tpcds_q91/duckdb:vortex-compact 🚀 40363240 50587447 0.80
tpcds_q92/duckdb:vortex-compact 43565276 45148015 0.96
tpcds_q93/duckdb:vortex-compact 31754138 31501091 1.01
tpcds_q94/duckdb:vortex-compact 🚨 56426026 30699348 1.84
tpcds_q95/duckdb:vortex-compact 🚨 217091945 160957571 1.35
tpcds_q96/duckdb:vortex-compact 18219656 17744337 1.03
tpcds_q97/duckdb:vortex-compact 47706138 44729188 1.07
tpcds_q98/duckdb:vortex-compact 🚨 31923950 27908678 1.14
tpcds_q99/duckdb:vortex-compact 🚨 34511372 30293193 1.14
duckdb / parquet (1.074x ➖, 0↑ 27↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 28388742 27110581 1.05
tpcds_q02/duckdb:parquet 25366994 23918506 1.06
tpcds_q03/duckdb:parquet 🚨 12198866 10971134 1.11
tpcds_q04/duckdb:parquet 181740123 170632685 1.07
tpcds_q05/duckdb:parquet 31502117 29372476 1.07
tpcds_q06/duckdb:parquet 🚨 31118372 27309625 1.14
tpcds_q07/duckdb:parquet 21351040 20141967 1.06
tpcds_q08/duckdb:parquet 28487935 27494740 1.04
tpcds_q09/duckdb:parquet 40711744 39281325 1.04
tpcds_q10/duckdb:parquet 35686143 32505609 1.10
tpcds_q11/duckdb:parquet 94450180 85930566 1.10
tpcds_q12/duckdb:parquet 16087573 14648789 1.10
tpcds_q13/duckdb:parquet 32943600 32068882 1.03
tpcds_q14/duckdb:parquet 99844791 101164194 0.99
tpcds_q15/duckdb:parquet 31716204 29371047 1.08
tpcds_q16/duckdb:parquet 23801641 22009377 1.08
tpcds_q17/duckdb:parquet 38979903 37761448 1.03
tpcds_q18/duckdb:parquet 46588387 44476250 1.05
tpcds_q19/duckdb:parquet 29700512 27934148 1.06
tpcds_q20/duckdb:parquet 16444462 15028276 1.09
tpcds_q21/duckdb:parquet 🚨 10995276 9944174 1.11
tpcds_q22/duckdb:parquet 🚨 78968880 67389191 1.17
tpcds_q23/duckdb:parquet 81222323 79009459 1.03
tpcds_q24/duckdb:parquet 46762471 43553740 1.07
tpcds_q25/duckdb:parquet 34750851 32273678 1.08
tpcds_q26/duckdb:parquet 38868307 37834085 1.03
tpcds_q27/duckdb:parquet 51223005 48412803 1.06
tpcds_q28/duckdb:parquet 40080770 36745318 1.09
tpcds_q29/duckdb:parquet 35582678 35621200 1.00
tpcds_q30/duckdb:parquet 37433896 34326780 1.09
tpcds_q31/duckdb:parquet 24361382 22315524 1.09
tpcds_q32/duckdb:parquet 11596749 10855005 1.07
tpcds_q33/duckdb:parquet 22019072 20501266 1.07
tpcds_q34/duckdb:parquet 21048126 20368364 1.03
tpcds_q35/duckdb:parquet 61725143 56949957 1.08
tpcds_q36/duckdb:parquet 🚨 21477995 19369647 1.11
tpcds_q37/duckdb:parquet 🚨 13131985 11678598 1.12
tpcds_q38/duckdb:parquet 🚨 36165247 32600625 1.11
tpcds_q39/duckdb:parquet 🚨 31321180 28038281 1.12
tpcds_q40/duckdb:parquet 17837548 16745709 1.07
tpcds_q41/duckdb:parquet 7841967 7704428 1.02
tpcds_q42/duckdb:parquet 🚨 10163854 9058627 1.12
tpcds_q43/duckdb:parquet 15981939 15058234 1.06
tpcds_q44/duckdb:parquet 23068070 22091013 1.04
tpcds_q45/duckdb:parquet 🚨 28952643 25610853 1.13
tpcds_q46/duckdb:parquet 🚨 48573807 43772094 1.11
tpcds_q47/duckdb:parquet 47223861 44256398 1.07
tpcds_q48/duckdb:parquet 🚨 31799485 28888932 1.10
tpcds_q49/duckdb:parquet 24905836 25357855 0.98
tpcds_q50/duckdb:parquet 24459972 23660503 1.03
tpcds_q51/duckdb:parquet 98412062 91820575 1.07
tpcds_q52/duckdb:parquet 10678172 10133786 1.05
tpcds_q53/duckdb:parquet 15155325 14859181 1.02
tpcds_q54/duckdb:parquet 🚨 28216044 24302808 1.16
tpcds_q55/duckdb:parquet 10204914 9774392 1.04
tpcds_q56/duckdb:parquet 22718983 20754647 1.09
tpcds_q57/duckdb:parquet 33941139 33931257 1.00
tpcds_q58/duckdb:parquet 🚨 24183847 21606895 1.12
tpcds_q59/duckdb:parquet 35529660 35093011 1.01
tpcds_q60/duckdb:parquet 🚨 24568626 20514934 1.20
tpcds_q61/duckdb:parquet 32085218 31172490 1.03
tpcds_q62/duckdb:parquet 🚨 13029085 11284793 1.15
tpcds_q63/duckdb:parquet 14733296 13990631 1.05
tpcds_q64/duckdb:parquet 79419665 74483400 1.07
tpcds_q65/duckdb:parquet 20904861 19687817 1.06
tpcds_q66/duckdb:parquet 28586717 27514188 1.04
tpcds_q67/duckdb:parquet 143601761 134382046 1.07
tpcds_q68/duckdb:parquet 37318142 35802064 1.04
tpcds_q69/duckdb:parquet 38650235 36744845 1.05
tpcds_q70/duckdb:parquet 🚨 21772002 18889233 1.15
tpcds_q71/duckdb:parquet 20135303 18570794 1.08
tpcds_q72/duckdb:parquet 170188569 165023240 1.03
tpcds_q73/duckdb:parquet 18038899 17207282 1.05
tpcds_q74/duckdb:parquet 🚨 137940546 124979685 1.10
tpcds_q75/duckdb:parquet 🚨 57612304 52207974 1.10
tpcds_q76/duckdb:parquet 20378701 19638516 1.04
tpcds_q77/duckdb:parquet 21937149 21358867 1.03
tpcds_q78/duckdb:parquet 79185653 73576322 1.08
tpcds_q79/duckdb:parquet 29115081 27133304 1.07
tpcds_q80/duckdb:parquet 41457498 40966221 1.01
tpcds_q81/duckdb:parquet 🚨 34288724 30656921 1.12
tpcds_q82/duckdb:parquet 🚨 14367177 13000491 1.11
tpcds_q83/duckdb:parquet 🚨 18102576 15255192 1.19
tpcds_q84/duckdb:parquet 19214502 18891977 1.02
tpcds_q85/duckdb:parquet 39806509 37333608 1.07
tpcds_q86/duckdb:parquet 12773781 11735102 1.09
tpcds_q87/duckdb:parquet 🚨 39825755 35421970 1.12
tpcds_q88/duckdb:parquet 50616904 48240348 1.05
tpcds_q89/duckdb:parquet 16534608 15930925 1.04
tpcds_q90/duckdb:parquet 8559479 8152156 1.05
tpcds_q91/duckdb:parquet 24866078 22869425 1.09
tpcds_q92/duckdb:parquet 🚨 12817253 10975072 1.17
tpcds_q93/duckdb:parquet 🚨 31236967 28105510 1.11
tpcds_q94/duckdb:parquet 16109765 16198353 0.99
tpcds_q95/duckdb:parquet 🚨 151111637 117154560 1.29
tpcds_q96/duckdb:parquet 8777571 8652869 1.01
tpcds_q97/duckdb:parquet 🚨 37990693 33386634 1.14
tpcds_q98/duckdb:parquet 18691857 18661224 1.00
tpcds_q99/duckdb:parquet 20418522 19281438 1.06
duckdb / duckdb (1.072x ➖, 1↑ 32↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 22292504 20695014 1.08
tpcds_q02/duckdb:duckdb 19100811 18138189 1.05
tpcds_q03/duckdb:duckdb 🚨 9565171 8588051 1.11
tpcds_q04/duckdb:duckdb 183683185 178040742 1.03
tpcds_q05/duckdb:duckdb 🚨 21592205 19182133 1.13
tpcds_q06/duckdb:duckdb 🚨 25712413 22722247 1.13
tpcds_q07/duckdb:duckdb 🚨 41040703 37222343 1.10
tpcds_q08/duckdb:duckdb 124017246 119980600 1.03
tpcds_q09/duckdb:duckdb 20809124 19891752 1.05
tpcds_q10/duckdb:duckdb 25754951 23611797 1.09
tpcds_q11/duckdb:duckdb 95763918 92591762 1.03
tpcds_q12/duckdb:duckdb 🚨 13287459 10941538 1.21
tpcds_q13/duckdb:duckdb 🚨 26211742 23468707 1.12
tpcds_q14/duckdb:duckdb 97824279 90705956 1.08
tpcds_q15/duckdb:duckdb 27041712 24658387 1.10
tpcds_q16/duckdb:duckdb 🚨 19156924 16313373 1.17
tpcds_q17/duckdb:duckdb 23433930 22321907 1.05
tpcds_q18/duckdb:duckdb 46981988 44786084 1.05
tpcds_q19/duckdb:duckdb 16819929 16406562 1.03
tpcds_q20/duckdb:duckdb 🚨 13547396 11354659 1.19
tpcds_q21/duckdb:duckdb 🚨 7975857 6865791 1.16
tpcds_q22/duckdb:duckdb 🚨 67819434 59322729 1.14
tpcds_q23/duckdb:duckdb 75778593 77205503 0.98
tpcds_q24/duckdb:duckdb 26054707 27390399 0.95
tpcds_q25/duckdb:duckdb 🚨 20278190 18256270 1.11
tpcds_q26/duckdb:duckdb 28869347 26611474 1.08
tpcds_q27/duckdb:duckdb 🚨 41136569 35984821 1.14
tpcds_q28/duckdb:duckdb 22651232 21514786 1.05
tpcds_q29/duckdb:duckdb 🚨 22851334 20181734 1.13
tpcds_q30/duckdb:duckdb 31520862 30960529 1.02
tpcds_q31/duckdb:duckdb 🚨 52828313 47745720 1.11
tpcds_q32/duckdb:duckdb 7966556 7332646 1.09
tpcds_q33/duckdb:duckdb 🚨 14181946 12351779 1.15
tpcds_q34/duckdb:duckdb 🚀 15601402 18477698 0.84
tpcds_q35/duckdb:duckdb 36168989 33697556 1.07
tpcds_q36/duckdb:duckdb 75186648 70308267 1.07
tpcds_q37/duckdb:duckdb 🚨 8484133 7124345 1.19
tpcds_q38/duckdb:duckdb 32401689 33573359 0.97
tpcds_q39/duckdb:duckdb 27574216 25755985 1.07
tpcds_q40/duckdb:duckdb 14823626 13826572 1.07
tpcds_q41/duckdb:duckdb 🚨 9428200 8061467 1.17
tpcds_q42/duckdb:duckdb 🚨 7675153 6256071 1.23
tpcds_q43/duckdb:duckdb 12127655 11288711 1.07
tpcds_q44/duckdb:duckdb 15208806 13978741 1.09
tpcds_q45/duckdb:duckdb 18393874 17508399 1.05
tpcds_q46/duckdb:duckdb 40197248 38489420 1.04
tpcds_q47/duckdb:duckdb 43576682 41228594 1.06
tpcds_q48/duckdb:duckdb 🚨 24582703 21814856 1.13
tpcds_q49/duckdb:duckdb 🚨 19188117 16877238 1.14
tpcds_q50/duckdb:duckdb 15620242 15236304 1.03
tpcds_q51/duckdb:duckdb 93272178 89519439 1.04
tpcds_q52/duckdb:duckdb 7640817 7553502 1.01
tpcds_q53/duckdb:duckdb 13889970 13356097 1.04
tpcds_q54/duckdb:duckdb 🚨 18080014 15911891 1.14
tpcds_q55/duckdb:duckdb 7278509 6967847 1.04
tpcds_q56/duckdb:duckdb 14508293 13214384 1.10
tpcds_q57/duckdb:duckdb 32591103 32180993 1.01
tpcds_q58/duckdb:duckdb 13861549 13520232 1.03
tpcds_q59/duckdb:duckdb 37000350 35200654 1.05
tpcds_q60/duckdb:duckdb 15573977 14395683 1.08
tpcds_q61/duckdb:duckdb 15855739 14471844 1.10
tpcds_q62/duckdb:duckdb 🚨 10766397 9192573 1.17
tpcds_q63/duckdb:duckdb 13036121 12025907 1.08
tpcds_q64/duckdb:duckdb 57208069 55244784 1.04
tpcds_q65/duckdb:duckdb 37895512 34643671 1.09
tpcds_q66/duckdb:duckdb 27303654 24896148 1.10
tpcds_q67/duckdb:duckdb 141027052 129016031 1.09
tpcds_q68/duckdb:duckdb 26702106 27870330 0.96
tpcds_q69/duckdb:duckdb 26262299 24476897 1.07
tpcds_q70/duckdb:duckdb 14837807 14225750 1.04
tpcds_q71/duckdb:duckdb 13177789 12891203 1.02
tpcds_q72/duckdb:duckdb 43509628 42133756 1.03
tpcds_q73/duckdb:duckdb 10630123 10894215 0.98
tpcds_q74/duckdb:duckdb 151578810 145319773 1.04
tpcds_q75/duckdb:duckdb 43911165 42257563 1.04
tpcds_q76/duckdb:duckdb 🚨 12806147 11565560 1.11
tpcds_q77/duckdb:duckdb 🚨 14025625 12589394 1.11
tpcds_q78/duckdb:duckdb 69248825 62954892 1.10
tpcds_q79/duckdb:duckdb 20186270 21552244 0.94
tpcds_q80/duckdb:duckdb 28822850 28821305 1.00
tpcds_q81/duckdb:duckdb 41456056 42758706 0.97
tpcds_q82/duckdb:duckdb 🚨 9535912 7939457 1.20
tpcds_q83/duckdb:duckdb 🚨 10997261 9108422 1.21
tpcds_q84/duckdb:duckdb 14576326 16138399 0.90
tpcds_q85/duckdb:duckdb 🚨 26091793 23079162 1.13
tpcds_q86/duckdb:duckdb 11284939 10537513 1.07
tpcds_q87/duckdb:duckdb 35448365 34664521 1.02
tpcds_q88/duckdb:duckdb 27620328 25520441 1.08
tpcds_q89/duckdb:duckdb 15998645 15323115 1.04
tpcds_q90/duckdb:duckdb 🚨 6301342 5637697 1.12
tpcds_q91/duckdb:duckdb 13435968 12889758 1.04
tpcds_q92/duckdb:duckdb 🚨 10483685 8419096 1.25
tpcds_q93/duckdb:duckdb 22780621 21779027 1.05
tpcds_q94/duckdb:duckdb 🚨 14624537 12684501 1.15
tpcds_q95/duckdb:duckdb 115798151 127337511 0.91
tpcds_q96/duckdb:duckdb 🚨 4940193 4450548 1.11
tpcds_q97/duckdb:duckdb 31070933 31219179 1.00
tpcds_q98/duckdb:duckdb 🚨 14745154 13067480 1.13
tpcds_q99/duckdb:duckdb 17223209 16354334 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +4.3% +10.1% -5.3% +22.3% ➖ noise
1 datafusion:vortex-file-compressed +11.1% +10.1% +0.9% +21.6% ➖ noise
1 duckdb:duckdb +7.7% +10.1% -2.2% +23.3% ➖ noise
1 duckdb:vortex-compact +33.1% +10.1% +20.8% +24.4% ➖ noise
1 duckdb:vortex-file-compressed +26.5% +10.1% +14.8% +34.5% ➖ noise
2 datafusion:vortex-compact +4.9% +3.3% +1.5% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +5.8% +3.3% +2.4% +10.0% ➖ noise
2 duckdb:duckdb +5.3% +3.3% +1.9% +10.0% ➖ noise
2 duckdb:vortex-compact +14.2% +3.3% +10.5% +19.7% ➖ noise
2 duckdb:vortex-file-compressed -7.7% +3.3% -10.7% +27.6% ➖ noise
3 datafusion:vortex-compact +6.4% +9.8% -3.1% +15.9% ➖ noise
3 datafusion:vortex-file-compressed +10.8% +9.8% +0.9% +10.0% ➖ noise
3 duckdb:duckdb +11.4% +9.8% +1.4% +11.8% ➖ noise
3 duckdb:vortex-compact +5.0% +9.8% -4.4% +11.0% ➖ noise
3 duckdb:vortex-file-compressed +1.5% +9.8% -7.6% +10.1% ➖ noise
4 datafusion:vortex-compact +6.6% +4.3% +2.2% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +12.1% +4.3% +7.4% +10.0% ➖ noise
4 duckdb:duckdb +3.2% +4.3% -1.1% +10.0% ➖ noise
4 duckdb:vortex-compact -8.8% +4.3% -12.6% +11.3% ✅ faster
4 duckdb:vortex-file-compressed -8.2% +4.3% -12.0% +14.0% ➖ noise
5 datafusion:vortex-compact +3.7% +5.5% -1.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +10.4% +5.5% +4.6% +10.0% ➖ noise
5 duckdb:duckdb +12.6% +5.5% +6.6% +12.1% ➖ noise
5 duckdb:vortex-compact +3.3% +5.5% -2.1% +14.5% ➖ noise
5 duckdb:vortex-file-compressed +4.0% +5.5% -1.5% +10.0% ➖ noise
6 datafusion:vortex-compact +8.2% +11.6% -3.1% +10.8% ➖ noise
6 datafusion:vortex-file-compressed +3.9% +11.6% -6.9% +10.2% ➖ noise
6 duckdb:duckdb +13.2% +11.6% +1.4% +11.9% ➖ noise
6 duckdb:vortex-compact +4.9% +11.6% -6.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +6.4% +11.6% -4.7% +10.0% ➖ noise
7 datafusion:vortex-compact +8.9% +8.2% +0.7% +14.7% ➖ noise
7 datafusion:vortex-file-compressed +12.1% +8.2% +3.6% +10.0% ➖ noise
7 duckdb:duckdb +10.3% +8.2% +1.9% +18.5% ➖ noise
7 duckdb:vortex-compact +49.3% +8.2% +38.0% +17.7% 🚨 regression
7 duckdb:vortex-file-compressed +44.2% +8.2% +33.3% +32.2% 🚨 regression
8 datafusion:vortex-compact +4.3% +8.3% -3.7% +13.1% ➖ noise
8 datafusion:vortex-file-compressed +7.6% +8.3% -0.7% +10.0% ➖ noise
8 duckdb:duckdb +3.4% +8.3% -4.6% +10.0% ➖ noise
8 duckdb:vortex-compact +16.8% +8.3% +7.8% +12.9% ➖ noise
8 duckdb:vortex-file-compressed +17.7% +8.3% +8.7% +11.3% ➖ noise
9 datafusion:vortex-compact +1.7% +6.4% -4.4% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +6.7% +6.4% +0.3% +10.0% ➖ noise
9 duckdb:duckdb +4.6% +6.4% -1.7% +10.0% ➖ noise
9 duckdb:vortex-compact -59.4% +6.4% -61.8% +10.0% ✅ faster
9 duckdb:vortex-file-compressed -52.4% +6.4% -55.2% +10.0% ✅ faster
10 datafusion:vortex-compact +4.1% +15.6% -9.9% +10.0% ✅ faster
10 datafusion:vortex-file-compressed +11.7% +15.6% -3.4% +10.0% ➖ noise
10 duckdb:duckdb +9.1% +15.6% -5.6% +10.0% ➖ noise
10 duckdb:vortex-compact +7.8% +15.6% -6.8% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.6% +15.6% -13.0% +10.0% ✅ faster
11 datafusion:vortex-compact +12.2% +9.0% +2.9% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +5.1% +9.0% -3.6% +10.9% ➖ noise
11 duckdb:duckdb +3.4% +9.0% -5.1% +10.4% ➖ noise
11 duckdb:vortex-compact +3.6% +9.0% -4.9% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +9.3% +9.0% +0.3% +11.9% ➖ noise
12 datafusion:vortex-compact -4.6% +7.7% -11.4% +16.0% ➖ noise
12 datafusion:vortex-file-compressed +8.1% +7.7% +0.4% +13.4% ➖ noise
12 duckdb:duckdb +21.4% +7.7% +12.8% +11.7% 🚨 regression
12 duckdb:vortex-compact +14.4% +7.7% +6.3% +12.6% ➖ noise
12 duckdb:vortex-file-compressed +3.1% +7.7% -4.2% +10.2% ➖ noise
13 datafusion:vortex-compact +0.5% +5.5% -4.7% +18.7% ➖ noise
13 datafusion:vortex-file-compressed +9.7% +5.5% +4.0% +16.1% ➖ noise
13 duckdb:duckdb +11.7% +5.5% +5.9% +10.0% ➖ noise
13 duckdb:vortex-compact +34.6% +5.5% +27.6% +10.0% 🚨 regression
13 duckdb:vortex-file-compressed +49.4% +5.5% +41.6% +10.0% 🚨 regression
14 datafusion:vortex-compact +6.7% +2.0% +4.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +7.6% +2.0% +5.5% +10.0% ➖ noise
14 duckdb:duckdb +7.8% +2.0% +5.7% +10.0% ➖ noise
14 duckdb:vortex-compact +11.6% +2.0% +9.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +1.8% +2.0% -0.2% +10.0% ➖ noise
15 datafusion:vortex-compact +15.6% +7.3% +7.8% +25.0% ➖ noise
15 datafusion:vortex-file-compressed +18.6% +7.3% +10.6% +10.0% 🚨 regression
15 duckdb:duckdb +9.7% +7.3% +2.2% +11.1% ➖ noise
15 duckdb:vortex-compact +12.9% +7.3% +5.2% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +9.4% +7.3% +2.0% +10.3% ➖ noise
16 datafusion:vortex-compact +9.4% +10.5% -1.0% +10.8% ➖ noise
16 datafusion:vortex-file-compressed +6.5% +10.5% -3.6% +11.0% ➖ noise
16 duckdb:duckdb +17.4% +10.5% +6.3% +12.2% ➖ noise
16 duckdb:vortex-compact +45.3% +10.5% +31.5% +10.0% 🚨 regression
16 duckdb:vortex-file-compressed +45.3% +10.5% +31.5% +11.4% 🚨 regression
17 datafusion:vortex-compact +12.9% +1.3% +11.4% +10.0% 🚨 regression
17 datafusion:vortex-file-compressed +2.7% +1.3% +1.4% +10.0% ➖ noise
17 duckdb:duckdb +5.0% +1.3% +3.6% +10.0% ➖ noise
17 duckdb:vortex-compact +27.8% +1.3% +26.1% +10.0% 🚨 regression
17 duckdb:vortex-file-compressed +1.7% +1.3% +0.4% +21.7% ➖ noise
18 datafusion:vortex-compact +8.7% +3.9% +4.7% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +8.8% +3.9% +4.8% +10.0% ➖ noise
18 duckdb:duckdb +4.9% +3.9% +1.0% +10.0% ➖ noise
18 duckdb:vortex-compact -2.1% +3.9% -5.8% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -7.8% +3.9% -11.3% +10.0% ✅ faster
19 datafusion:vortex-compact +8.2% +12.8% -4.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +8.0% +12.8% -4.3% +10.0% ➖ noise
19 duckdb:duckdb +2.5% +12.8% -9.1% +10.5% ➖ noise
19 duckdb:vortex-compact +200.0% +12.8% +165.9% +11.1% 🚨 regression
19 duckdb:vortex-file-compressed +307.5% +12.8% +261.2% +10.0% 🚨 regression
20 datafusion:vortex-compact +5.3% +16.5% -9.7% +10.0% ✅ faster
20 datafusion:vortex-file-compressed +9.8% +16.5% -5.8% +16.2% ➖ noise
20 duckdb:duckdb +19.3% +16.5% +2.4% +10.0% ➖ noise
20 duckdb:vortex-compact +6.9% +16.5% -8.2% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +4.3% +16.5% -10.5% +10.0% ✅ faster
21 datafusion:vortex-compact +3.9% +17.5% -11.6% +10.0% ✅ faster
21 datafusion:vortex-file-compressed +11.5% +17.5% -5.1% +13.1% ➖ noise
21 duckdb:duckdb +16.2% +17.5% -1.1% +16.2% ➖ noise
21 duckdb:vortex-compact +13.7% +17.5% -3.2% +11.7% ➖ noise
21 duckdb:vortex-file-compressed +7.7% +17.5% -8.4% +12.9% ➖ noise
22 datafusion:vortex-compact +9.3% +25.3% -12.8% +26.5% ➖ noise
22 datafusion:vortex-file-compressed +11.5% +25.3% -11.0% +27.0% ➖ noise
22 duckdb:duckdb +14.3% +25.3% -8.8% +13.4% ➖ noise
22 duckdb:vortex-compact +18.9% +25.3% -5.1% +16.8% ➖ noise
22 duckdb:vortex-file-compressed +18.9% +25.3% -5.1% +14.1% ➖ noise
23 datafusion:vortex-compact +8.2% +9.7% -1.4% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +16.0% +9.7% +5.7% +10.0% ➖ noise
23 duckdb:duckdb -1.8% +9.7% -10.5% +16.2% ➖ noise
23 duckdb:vortex-compact +32.5% +9.7% +20.8% +14.5% 🚨 regression
23 duckdb:vortex-file-compressed +24.4% +9.7% +13.4% +11.8% 🚨 regression
24 datafusion:vortex-compact +7.0% +7.4% -0.4% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +8.7% +7.4% +1.2% +10.5% ➖ noise
24 duckdb:duckdb -4.9% +7.4% -11.4% +10.8% ✅ faster
24 duckdb:vortex-compact +0.7% +7.4% -6.2% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +7.8% +7.4% +0.4% +12.6% ➖ noise
25 datafusion:vortex-compact +12.5% +8.6% +3.5% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +3.5% +8.6% -4.8% +13.0% ➖ noise
25 duckdb:duckdb +11.1% +8.6% +2.2% +14.9% ➖ noise
25 duckdb:vortex-compact -19.0% +8.6% -25.4% +10.0% ✅ faster
25 duckdb:vortex-file-compressed -12.4% +8.6% -19.4% +10.0% ✅ faster
26 datafusion:vortex-compact +0.9% +6.2% -5.0% +20.0% ➖ noise
26 datafusion:vortex-file-compressed +5.1% +6.2% -1.0% +15.1% ➖ noise
26 duckdb:duckdb +8.5% +6.2% +2.1% +15.5% ➖ noise
26 duckdb:vortex-compact -31.2% +6.2% -35.2% +13.4% ✅ faster
26 duckdb:vortex-file-compressed -44.1% +6.2% -47.4% +10.8% ✅ faster
27 datafusion:vortex-compact +14.0% +9.3% +4.3% +11.3% ➖ noise
27 datafusion:vortex-file-compressed +16.2% +9.3% +6.3% +12.9% ➖ noise
27 duckdb:duckdb +14.3% +9.3% +4.6% +17.9% ➖ noise
27 duckdb:vortex-compact -25.8% +9.3% -32.2% +15.9% ✅ faster
27 duckdb:vortex-file-compressed -38.1% +9.3% -43.4% +19.3% ✅ faster
28 datafusion:vortex-compact +2.3% +9.3% -6.4% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -0.2% +9.3% -8.6% +12.5% ➖ noise
28 duckdb:duckdb +5.3% +9.3% -3.6% +10.0% ➖ noise
28 duckdb:vortex-compact -71.6% +9.3% -74.0% +16.7% ✅ faster
28 duckdb:vortex-file-compressed -56.7% +9.3% -60.4% +11.7% ✅ faster
29 datafusion:vortex-compact +6.7% +2.3% +4.3% +11.2% ➖ noise
29 datafusion:vortex-file-compressed +6.0% +2.3% +3.6% +10.0% ➖ noise
29 duckdb:duckdb +13.2% +2.3% +10.7% +10.0% 🚨 regression
29 duckdb:vortex-compact +66.9% +2.3% +63.1% +10.0% 🚨 regression
29 duckdb:vortex-file-compressed +53.3% +2.3% +49.8% +10.0% 🚨 regression
30 datafusion:vortex-compact +11.4% +5.8% +5.3% +10.5% ➖ noise
30 datafusion:vortex-file-compressed +4.7% +5.8% -1.0% +11.6% ➖ noise
30 duckdb:duckdb +1.8% +5.8% -3.8% +10.0% ➖ noise
30 duckdb:vortex-compact +23.7% +5.8% +17.0% +10.0% 🚨 regression
30 duckdb:vortex-file-compressed +5.7% +5.8% -0.0% +10.0% ➖ noise
31 datafusion:vortex-compact +8.5% +9.6% -1.0% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +9.0% +9.6% -0.6% +10.0% ➖ noise
31 duckdb:duckdb +10.6% +9.6% +0.9% +10.0% ➖ noise
31 duckdb:vortex-compact -13.1% +9.6% -20.8% +14.5% ✅ faster
31 duckdb:vortex-file-compressed -15.4% +9.6% -22.9% +26.4% ✅ faster
32 datafusion:vortex-compact +16.9% +9.3% +7.0% +12.9% ➖ noise
32 datafusion:vortex-file-compressed +16.2% +9.3% +6.3% +13.9% ➖ noise
32 duckdb:duckdb +8.6% +9.3% -0.6% +15.7% ➖ noise
32 duckdb:vortex-compact +10.2% +9.3% +0.8% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +31.1% +9.3% +19.9% +10.0% 🚨 regression
33 datafusion:vortex-compact +4.8% +6.6% -1.6% +13.4% ➖ noise
33 datafusion:vortex-file-compressed +9.3% +6.6% +2.6% +10.0% ➖ noise
33 duckdb:duckdb +14.8% +6.6% +7.7% +10.0% ➖ noise
33 duckdb:vortex-compact +9.2% +6.6% +2.5% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +15.2% +6.6% +8.1% +16.5% ➖ noise
34 datafusion:vortex-compact +6.0% +4.5% +1.4% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +6.9% +4.5% +2.3% +10.0% ➖ noise
34 duckdb:duckdb -15.6% +4.5% -19.2% +16.6% ✅ faster
34 duckdb:vortex-compact -1.2% +4.5% -5.4% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +11.4% +4.5% +6.6% +10.0% ➖ noise
35 datafusion:vortex-compact +5.0% +7.7% -2.5% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +8.0% +7.7% +0.2% +10.0% ➖ noise
35 duckdb:duckdb +7.3% +7.7% -0.3% +24.4% ➖ noise
35 duckdb:vortex-compact -9.8% +7.7% -16.3% +10.0% ✅ faster
35 duckdb:vortex-file-compressed -17.6% +7.7% -23.4% +16.8% ✅ faster
36 datafusion:vortex-compact +5.1% +10.7% -5.0% +10.6% ➖ noise
36 datafusion:vortex-file-compressed +6.4% +10.7% -3.9% +10.0% ➖ noise
36 duckdb:duckdb +6.9% +10.7% -3.4% +10.0% ➖ noise
36 duckdb:vortex-compact +1.1% +10.7% -8.7% +17.4% ➖ noise
36 duckdb:vortex-file-compressed +14.8% +10.7% +3.7% +10.0% ➖ noise
37 datafusion:vortex-compact +2.9% +8.4% -5.1% +10.1% ➖ noise
37 datafusion:vortex-file-compressed +6.7% +8.4% -1.6% +12.4% ➖ noise
37 duckdb:duckdb +19.1% +8.4% +9.8% +13.0% ➖ noise
37 duckdb:vortex-compact +6.9% +8.4% -1.4% +10.5% ➖ noise
37 duckdb:vortex-file-compressed +8.0% +8.4% -0.4% +10.0% ➖ noise
38 datafusion:vortex-compact +8.2% +8.7% -0.4% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +10.3% +8.7% +1.5% +10.0% ➖ noise
38 duckdb:duckdb -3.5% +8.7% -11.2% +11.3% ✅ faster
38 duckdb:vortex-compact +1.2% +8.7% -6.9% +13.5% ➖ noise
38 duckdb:vortex-file-compressed +3.0% +8.7% -5.2% +12.3% ➖ noise
39 datafusion:vortex-compact +16.5% +8.4% +7.5% +10.0% ➖ noise
39 datafusion:vortex-file-compressed +12.3% +8.4% +3.6% +11.1% ➖ noise
39 duckdb:duckdb +7.1% +8.4% -1.2% +28.6% ➖ noise
39 duckdb:vortex-compact +6.2% +8.4% -2.0% +10.0% ➖ noise
39 duckdb:vortex-file-compressed -0.9% +8.4% -8.6% +13.7% ➖ noise
40 datafusion:vortex-compact +14.9% +7.1% +7.3% +10.6% ➖ noise
40 datafusion:vortex-file-compressed +17.7% +7.1% +10.0% +16.9% ➖ noise
40 duckdb:duckdb +7.2% +7.1% +0.1% +15.4% ➖ noise
40 duckdb:vortex-compact +10.0% +7.1% +2.8% +10.3% ➖ noise
40 duckdb:vortex-file-compressed +15.3% +7.1% +7.7% +15.1% ➖ noise
41 datafusion:vortex-compact +10.5% +3.1% +7.2% +10.2% ➖ noise
41 datafusion:vortex-file-compressed +14.2% +3.1% +10.8% +10.0% 🚨 regression
41 duckdb:duckdb +17.0% +3.1% +13.4% +10.0% 🚨 regression
41 duckdb:vortex-compact -17.0% +3.1% -19.4% +14.0% ✅ faster
41 duckdb:vortex-file-compressed -7.0% +3.1% -9.8% +11.8% ➖ noise
42 datafusion:vortex-compact +10.1% +8.2% +1.7% +14.7% ➖ noise
42 datafusion:vortex-file-compressed +6.7% +8.2% -1.4% +11.6% ➖ noise
42 duckdb:duckdb +22.7% +8.2% +13.3% +15.6% ➖ noise
42 duckdb:vortex-compact +14.0% +8.2% +5.3% +10.0% ➖ noise
42 duckdb:vortex-file-compressed +16.2% +8.2% +7.3% +10.0% ➖ noise
43 datafusion:vortex-compact +3.5% +7.3% -3.6% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +9.2% +7.3% +1.8% +10.0% ➖ noise
43 duckdb:duckdb +7.4% +7.3% +0.1% +10.0% ➖ noise
43 duckdb:vortex-compact +6.2% +7.3% -1.0% +15.3% ➖ noise
43 duckdb:vortex-file-compressed +9.1% +7.3% +1.7% +12.1% ➖ noise
44 datafusion:vortex-compact +11.6% +3.5% +7.8% +10.4% ➖ noise
44 datafusion:vortex-file-compressed +7.8% +3.5% +4.1% +10.0% ➖ noise
44 duckdb:duckdb +8.8% +3.5% +5.1% +11.9% ➖ noise
44 duckdb:vortex-compact +3.4% +3.5% -0.1% +10.0% ➖ noise
44 duckdb:vortex-file-compressed +8.0% +3.5% +4.3% +12.0% ➖ noise
45 datafusion:vortex-compact +6.6% +8.7% -2.0% +12.3% ➖ noise
45 datafusion:vortex-file-compressed +11.3% +8.7% +2.4% +10.4% ➖ noise
45 duckdb:duckdb +5.1% +8.7% -3.4% +11.0% ➖ noise
45 duckdb:vortex-compact +8.6% +8.7% -0.1% +10.1% ➖ noise
45 duckdb:vortex-file-compressed +17.9% +8.7% +8.5% +11.6% ➖ noise
46 datafusion:vortex-compact +10.1% +10.7% -0.5% +10.0% ➖ noise
46 datafusion:vortex-file-compressed +4.5% +10.7% -5.5% +10.0% ➖ noise
46 duckdb:duckdb +4.4% +10.7% -5.6% +10.3% ➖ noise
46 duckdb:vortex-compact -23.4% +10.7% -30.8% +10.0% ✅ faster
46 duckdb:vortex-file-compressed -33.9% +10.7% -40.2% +11.2% ✅ faster
47 datafusion:vortex-compact +9.4% +8.9% +0.5% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +11.3% +8.9% +2.2% +10.0% ➖ noise
47 duckdb:duckdb +5.7% +8.9% -2.9% +10.3% ➖ noise
47 duckdb:vortex-compact +11.3% +8.9% +2.2% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +11.2% +8.9% +2.1% +14.6% ➖ noise
48 datafusion:vortex-compact +3.4% +9.2% -5.3% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -1.0% +9.2% -9.4% +10.7% ➖ noise
48 duckdb:duckdb +12.7% +9.2% +3.2% +10.0% ➖ noise
48 duckdb:vortex-compact +30.6% +9.2% +19.6% +10.0% 🚨 regression
48 duckdb:vortex-file-compressed +51.4% +9.2% +38.6% +10.0% 🚨 regression
49 datafusion:vortex-compact +6.4% +4.3% +2.0% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +4.9% +4.3% +0.6% +10.0% ➖ noise
49 duckdb:duckdb +13.7% +4.3% +9.0% +17.2% ➖ noise
49 duckdb:vortex-compact +0.8% +4.3% -3.4% +13.8% ➖ noise
49 duckdb:vortex-file-compressed -3.5% +4.3% -7.4% +19.7% ➖ noise
50 datafusion:vortex-compact +18.1% +4.3% +13.2% +12.9% 🚨 regression
50 datafusion:vortex-file-compressed +7.9% +4.3% +3.5% +10.0% ➖ noise
50 duckdb:duckdb +2.5% +4.3% -1.7% +13.4% ➖ noise
50 duckdb:vortex-compact -0.1% +4.3% -4.2% +12.2% ➖ noise
50 duckdb:vortex-file-compressed +12.4% +4.3% +7.8% +10.0% ➖ noise
51 datafusion:vortex-compact +6.0% +8.6% -2.4% +10.0% ➖ noise
51 datafusion:vortex-file-compressed +5.4% +8.6% -2.9% +10.1% ➖ noise
51 duckdb:duckdb +4.2% +8.6% -4.1% +11.4% ➖ noise
51 duckdb:vortex-compact -3.5% +8.6% -11.2% +10.3% ✅ faster
51 duckdb:vortex-file-compressed +3.9% +8.6% -4.4% +16.4% ➖ noise
52 datafusion:vortex-compact -1.8% +6.2% -7.5% +15.8% ➖ noise
52 datafusion:vortex-file-compressed -0.5% +6.2% -6.3% +25.7% ➖ noise
52 duckdb:duckdb +1.2% +6.2% -4.8% +14.4% ➖ noise
52 duckdb:vortex-compact +10.7% +6.2% +4.3% +10.0% ➖ noise
52 duckdb:vortex-file-compressed -0.7% +6.2% -6.5% +10.2% ➖ noise
53 datafusion:vortex-compact +9.0% +5.8% +3.0% +10.0% ➖ noise
53 datafusion:vortex-file-compressed +8.6% +5.8% +2.6% +10.0% ➖ noise
53 duckdb:duckdb +4.0% +5.8% -1.7% +10.0% ➖ noise
53 duckdb:vortex-compact +2.5% +5.8% -3.1% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +5.9% +5.8% +0.1% +10.0% ➖ noise
54 datafusion:vortex-compact +11.5% +11.5% +0.0% +15.3% ➖ noise
54 datafusion:vortex-file-compressed +8.1% +11.5% -3.0% +10.0% ➖ noise
54 duckdb:duckdb +13.6% +11.5% +1.9% +13.5% ➖ noise
54 duckdb:vortex-compact +1.7% +11.5% -8.8% +11.4% ➖ noise
54 duckdb:vortex-file-compressed +24.5% +11.5% +11.7% +16.7% ➖ noise
55 datafusion:vortex-compact +14.6% +8.3% +5.8% +13.1% ➖ noise
55 datafusion:vortex-file-compressed +8.5% +8.3% +0.2% +10.0% ➖ noise
55 duckdb:duckdb +4.5% +8.3% -3.5% +19.4% ➖ noise
55 duckdb:vortex-compact +6.5% +8.3% -1.6% +17.5% ➖ noise
55 duckdb:vortex-file-compressed +14.1% +8.3% +5.4% +11.7% ➖ noise
56 datafusion:vortex-compact +14.6% +8.2% +5.9% +10.0% ➖ noise
56 datafusion:vortex-file-compressed +7.1% +8.2% -0.9% +15.2% ➖ noise
56 duckdb:duckdb +9.8% +8.2% +1.5% +10.0% ➖ noise
56 duckdb:vortex-compact +6.7% +8.2% -1.3% +10.0% ➖ noise
56 duckdb:vortex-file-compressed +23.7% +8.2% +14.4% +10.0% 🚨 regression
57 datafusion:vortex-compact +8.4% +8.5% -0.1% +11.9% ➖ noise
57 datafusion:vortex-file-compressed +12.3% +8.5% +3.5% +10.0% ➖ noise
57 duckdb:duckdb +1.3% +8.5% -6.7% +10.0% ➖ noise
57 duckdb:vortex-compact +5.9% +8.5% -2.4% +10.2% ➖ noise
57 duckdb:vortex-file-compressed +2.3% +8.5% -5.7% +10.0% ➖ noise
58 datafusion:vortex-compact +12.2% +9.8% +2.2% +11.4% ➖ noise
58 datafusion:vortex-file-compressed +13.1% +9.8% +3.0% +10.1% ➖ noise
58 duckdb:duckdb +2.5% +9.8% -6.6% +14.9% ➖ noise
58 duckdb:vortex-compact +13.6% +9.8% +3.5% +15.1% ➖ noise
58 duckdb:vortex-file-compressed +2.7% +9.8% -6.5% +11.0% ➖ noise
59 datafusion:vortex-compact +5.8% +4.1% +1.7% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +7.6% +4.1% +3.4% +10.0% ➖ noise
59 duckdb:duckdb +5.1% +4.1% +1.0% +10.0% ➖ noise
59 duckdb:vortex-compact +13.1% +4.1% +8.7% +10.0% ➖ noise
59 duckdb:vortex-file-compressed +14.3% +4.1% +9.8% +24.7% ➖ noise
60 datafusion:vortex-compact +3.4% +9.6% -5.7% +17.0% ➖ noise
60 datafusion:vortex-file-compressed +2.6% +9.6% -6.4% +14.8% ➖ noise
60 duckdb:duckdb +8.2% +9.6% -1.3% +16.0% ➖ noise
60 duckdb:vortex-compact +8.1% +9.6% -1.4% +16.6% ➖ noise
60 duckdb:vortex-file-compressed +10.5% +9.6% +0.8% +17.3% ➖ noise
61 datafusion:vortex-compact +2.9% +3.0% -0.2% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +1.6% +3.0% -1.4% +12.1% ➖ noise
61 duckdb:duckdb +9.6% +3.0% +6.3% +11.6% ➖ noise
61 duckdb:vortex-compact +8.3% +3.0% +5.1% +10.0% ➖ noise
61 duckdb:vortex-file-compressed +11.1% +3.0% +7.8% +12.6% ➖ noise
62 datafusion:vortex-compact -6.9% +16.0% -19.7% +22.7% ✅ faster
62 datafusion:vortex-file-compressed +4.7% +16.0% -9.7% +25.9% ➖ noise
62 duckdb:duckdb +17.1% +16.0% +1.0% +28.1% ➖ noise
62 duckdb:vortex-compact +4.8% +16.0% -9.7% +23.8% ➖ noise
62 duckdb:vortex-file-compressed +16.8% +16.0% +0.7% +14.8% ➖ noise
63 datafusion:vortex-compact +11.7% +7.2% +4.2% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +5.3% +7.2% -1.7% +10.0% ➖ noise
63 duckdb:duckdb +8.4% +7.2% +1.1% +10.0% ➖ noise
63 duckdb:vortex-compact +3.4% +7.2% -3.6% +10.8% ➖ noise
63 duckdb:vortex-file-compressed +10.2% +7.2% +2.9% +10.2% ➖ noise
64 datafusion:vortex-compact +8.0% +8.2% -0.2% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +8.8% +8.2% +0.6% +10.0% ➖ noise
64 duckdb:duckdb +3.6% +8.2% -4.3% +10.1% ➖ noise
64 duckdb:vortex-compact +20.9% +8.2% +11.7% +10.0% 🚨 regression
64 duckdb:vortex-file-compressed +14.5% +8.2% +5.9% +11.3% ➖ noise
65 datafusion:vortex-compact +9.4% +7.1% +2.1% +13.0% ➖ noise
65 datafusion:vortex-file-compressed +6.6% +7.1% -0.5% +10.9% ➖ noise
65 duckdb:duckdb +9.4% +7.1% +2.1% +23.9% ➖ noise
65 duckdb:vortex-compact +70.3% +7.1% +59.0% +15.3% 🚨 regression
65 duckdb:vortex-file-compressed +84.0% +7.1% +71.7% +13.6% 🚨 regression
66 datafusion:vortex-compact +5.5% +5.5% +0.0% +10.2% ➖ noise
66 datafusion:vortex-file-compressed +2.0% +5.5% -3.3% +12.6% ➖ noise
66 duckdb:duckdb +9.7% +5.5% +4.0% +10.6% ➖ noise
66 duckdb:vortex-compact +4.1% +5.5% -1.3% +11.2% ➖ noise
66 duckdb:vortex-file-compressed +6.8% +5.5% +1.2% +10.0% ➖ noise
67 datafusion:vortex-compact +5.5% +5.7% -0.3% +10.0% ➖ noise
67 datafusion:vortex-file-compressed +10.8% +5.7% +4.7% +10.9% ➖ noise
67 duckdb:duckdb +9.3% +5.7% +3.4% +10.0% ➖ noise
67 duckdb:vortex-compact +9.4% +5.7% +3.5% +10.9% ➖ noise
67 duckdb:vortex-file-compressed +12.5% +5.7% +6.4% +10.2% ➖ noise
68 datafusion:vortex-compact +4.4% +3.9% +0.6% +10.0% ➖ noise
68 datafusion:vortex-file-compressed +5.5% +3.9% +1.6% +10.3% ➖ noise
68 duckdb:duckdb -4.2% +3.9% -7.8% +10.4% ➖ noise
68 duckdb:vortex-compact -1.8% +3.9% -5.4% +12.3% ➖ noise
68 duckdb:vortex-file-compressed -10.3% +3.9% -13.6% +26.0% ➖ noise
69 datafusion:vortex-compact +4.2% +3.9% +0.2% +12.7% ➖ noise
69 datafusion:vortex-file-compressed +7.8% +3.9% +3.7% +12.0% ➖ noise
69 duckdb:duckdb +7.3% +3.9% +3.2% +12.1% ➖ noise
69 duckdb:vortex-compact +7.8% +3.9% +3.8% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +12.1% +3.9% +7.9% +10.0% ➖ noise
70 datafusion:vortex-compact +5.3% +13.7% -7.3% +10.0% ➖ noise
70 datafusion:vortex-file-compressed +9.9% +13.7% -3.3% +11.4% ➖ noise
70 duckdb:duckdb +4.3% +13.7% -8.3% +14.0% ➖ noise
70 duckdb:vortex-compact +92.2% +13.7% +69.1% +14.4% 🚨 regression
70 duckdb:vortex-file-compressed +76.9% +13.7% +55.6% +10.0% 🚨 regression
71 datafusion:vortex-compact +4.1% +7.1% -2.8% +10.2% ➖ noise
71 datafusion:vortex-file-compressed +8.3% +7.1% +1.1% +10.0% ➖ noise
71 duckdb:duckdb +2.2% +7.1% -4.5% +18.3% ➖ noise
71 duckdb:vortex-compact +4.3% +7.1% -2.6% +10.4% ➖ noise
71 duckdb:vortex-file-compressed +7.9% +7.1% +0.8% +23.6% ➖ noise
72 datafusion:vortex-compact +13.9% +8.7% +4.8% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +12.2% +8.7% +3.2% +10.0% ➖ noise
72 duckdb:duckdb +3.3% +8.7% -5.0% +10.0% ➖ noise
72 duckdb:vortex-compact -17.4% +8.7% -24.1% +10.0% ✅ faster
72 duckdb:vortex-file-compressed -16.3% +8.7% -23.0% +10.0% ✅ faster
73 datafusion:vortex-compact +10.4% +6.7% +3.4% +15.9% ➖ noise
73 datafusion:vortex-file-compressed +12.7% +6.7% +5.6% +10.5% ➖ noise
73 duckdb:duckdb -2.4% +6.7% -8.6% +14.5% ➖ noise
73 duckdb:vortex-compact -1.0% +6.7% -7.2% +12.2% ➖ noise
73 duckdb:vortex-file-compressed +26.7% +6.7% +18.7% +12.3% 🚨 regression
74 datafusion:vortex-compact +6.0% +12.7% -5.9% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +10.9% +12.7% -1.6% +10.0% ➖ noise
74 duckdb:duckdb +4.3% +12.7% -7.4% +10.0% ➖ noise
74 duckdb:vortex-compact -38.5% +12.7% -45.4% +21.4% ✅ faster
74 duckdb:vortex-file-compressed -33.9% +12.7% -41.3% +18.5% ✅ faster
75 datafusion:vortex-compact +9.2% +10.3% -1.0% +11.6% ➖ noise
75 datafusion:vortex-file-compressed +10.4% +10.3% +0.2% +11.3% ➖ noise
75 duckdb:duckdb +3.9% +10.3% -5.8% +10.0% ➖ noise
75 duckdb:vortex-compact -0.8% +10.3% -10.1% +12.5% ➖ noise
75 duckdb:vortex-file-compressed -3.6% +10.3% -12.6% +14.1% ✅ faster
76 datafusion:vortex-compact +12.6% +10.5% +1.9% +10.0% ➖ noise
76 datafusion:vortex-file-compressed +13.7% +10.5% +2.9% +10.1% ➖ noise
76 duckdb:duckdb +10.7% +10.5% +0.2% +15.6% ➖ noise
76 duckdb:vortex-compact -10.3% +10.5% -18.8% +13.1% ✅ faster
76 duckdb:vortex-file-compressed +25.9% +10.5% +13.9% +21.6% ➖ noise
77 datafusion:vortex-compact +7.1% +6.4% +0.7% +10.0% ➖ noise
77 datafusion:vortex-file-compressed +9.4% +6.4% +2.8% +11.4% ➖ noise
77 duckdb:duckdb +11.4% +6.4% +4.7% +10.8% ➖ noise
77 duckdb:vortex-compact +12.1% +6.4% +5.4% +10.0% ➖ noise
77 duckdb:vortex-file-compressed +13.8% +6.4% +7.0% +11.1% ➖ noise
78 datafusion:vortex-compact +16.6% +12.5% +3.7% +10.8% ➖ noise
78 datafusion:vortex-file-compressed +5.9% +12.5% -5.9% +10.0% ➖ noise
78 duckdb:duckdb +10.0% +12.5% -2.2% +12.2% ➖ noise
78 duckdb:vortex-compact +6.7% +12.5% -5.1% +14.5% ➖ noise
78 duckdb:vortex-file-compressed +16.5% +12.5% +3.6% +12.1% ➖ noise
79 datafusion:vortex-compact +11.8% +3.5% +8.0% +10.0% ➖ noise
79 datafusion:vortex-file-compressed +10.9% +3.5% +7.1% +10.0% ➖ noise
79 duckdb:duckdb -6.3% +3.5% -9.5% +10.0% ✅ faster
79 duckdb:vortex-compact -1.2% +3.5% -4.6% +10.0% ➖ noise
79 duckdb:vortex-file-compressed -4.8% +3.5% -8.1% +10.0% ➖ noise
80 datafusion:vortex-compact +28.1% +5.3% +21.7% +13.5% 🚨 regression
80 datafusion:vortex-file-compressed +11.5% +5.3% +5.9% +10.0% ➖ noise
80 duckdb:duckdb +0.0% +5.3% -5.0% +16.4% ➖ noise
80 duckdb:vortex-compact -1.6% +5.3% -6.5% +10.8% ➖ noise
80 duckdb:vortex-file-compressed +4.9% +5.3% -0.4% +14.3% ➖ noise
81 datafusion:vortex-compact +5.4% +12.3% -6.2% +10.0% ➖ noise
81 datafusion:vortex-file-compressed +18.3% +12.3% +5.3% +10.0% ➖ noise
81 duckdb:duckdb -3.0% +12.3% -13.7% +10.0% ✅ faster
81 duckdb:vortex-compact +16.9% +12.3% +4.1% +11.2% ➖ noise
81 duckdb:vortex-file-compressed +12.1% +12.3% -0.2% +12.0% ➖ noise
82 datafusion:vortex-compact +6.9% +8.6% -1.6% +10.0% ➖ noise
82 datafusion:vortex-file-compressed +5.4% +8.6% -3.0% +10.0% ➖ noise
82 duckdb:duckdb +20.1% +8.6% +10.6% +13.5% ➖ noise
82 duckdb:vortex-compact +16.5% +8.6% +7.2% +12.4% ➖ noise
82 duckdb:vortex-file-compressed +10.9% +8.6% +2.1% +10.0% ➖ noise
83 datafusion:vortex-compact +25.5% +10.2% +13.9% +14.8% ➖ noise
83 datafusion:vortex-file-compressed +11.4% +10.2% +1.2% +10.8% ➖ noise
83 duckdb:duckdb +20.7% +10.2% +9.6% +12.4% ➖ noise
83 duckdb:vortex-compact +25.8% +10.2% +14.2% +10.1% 🚨 regression
83 duckdb:vortex-file-compressed +25.1% +10.2% +13.6% +20.9% ➖ noise
84 datafusion:vortex-compact +16.1% +4.4% +11.2% +10.5% 🚨 regression
84 datafusion:vortex-file-compressed +13.9% +4.4% +9.1% +10.0% ➖ noise
84 duckdb:duckdb -9.7% +4.4% -13.5% +10.0% ✅ faster
84 duckdb:vortex-compact +58.8% +4.4% +52.2% +11.6% 🚨 regression
84 duckdb:vortex-file-compressed +88.6% +4.4% +80.7% +11.1% 🚨 regression
85 datafusion:vortex-compact +9.5% +6.9% +2.4% +13.4% ➖ noise
85 datafusion:vortex-file-compressed +15.3% +6.9% +7.9% +10.0% ➖ noise
85 duckdb:duckdb +13.1% +6.9% +5.8% +11.9% ➖ noise
85 duckdb:vortex-compact +37.5% +6.9% +28.6% +10.0% 🚨 regression
85 duckdb:vortex-file-compressed +20.6% +6.9% +12.8% +13.5% ➖ noise
86 datafusion:vortex-compact +10.1% +16.0% -5.1% +21.4% ➖ noise
86 datafusion:vortex-file-compressed +7.3% +16.0% -7.5% +14.5% ➖ noise
86 duckdb:duckdb +7.1% +16.0% -7.7% +11.3% ➖ noise
86 duckdb:vortex-compact -1.0% +16.0% -14.6% +13.6% ✅ faster
86 duckdb:vortex-file-compressed +13.6% +16.0% -2.0% +14.4% ➖ noise
87 datafusion:vortex-compact +5.7% +11.6% -5.3% +11.5% ➖ noise
87 datafusion:vortex-file-compressed +6.9% +11.6% -4.3% +14.2% ➖ noise
87 duckdb:duckdb +2.3% +11.6% -8.4% +13.8% ➖ noise
87 duckdb:vortex-compact -1.0% +11.6% -11.3% +16.4% ➖ noise
87 duckdb:vortex-file-compressed +10.8% +11.6% -0.8% +14.0% ➖ noise
88 datafusion:vortex-compact +7.1% +3.9% +3.1% +10.3% ➖ noise
88 datafusion:vortex-file-compressed +11.7% +3.9% +7.5% +10.0% ➖ noise
88 duckdb:duckdb +8.2% +3.9% +4.1% +10.0% ➖ noise
88 duckdb:vortex-compact -1.0% +3.9% -4.7% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +2.5% +3.9% -1.3% +10.0% ➖ noise
89 datafusion:vortex-compact +6.7% +5.9% +0.7% +10.0% ➖ noise
89 datafusion:vortex-file-compressed +5.9% +5.9% -0.1% +10.0% ➖ noise
89 duckdb:duckdb +4.4% +5.9% -1.4% +14.4% ➖ noise
89 duckdb:vortex-compact +6.3% +5.9% +0.4% +10.0% ➖ noise
89 duckdb:vortex-file-compressed +4.8% +5.9% -1.1% +11.7% ➖ noise
90 datafusion:vortex-compact +15.6% +8.5% +6.5% +22.6% ➖ noise
90 datafusion:vortex-file-compressed +17.2% +8.5% +8.0% +16.7% ➖ noise
90 duckdb:duckdb +11.8% +8.5% +3.0% +12.5% ➖ noise
90 duckdb:vortex-compact -6.8% +8.5% -14.1% +10.7% ✅ faster
90 duckdb:vortex-file-compressed -3.6% +8.5% -11.1% +12.4% ✅ faster
91 datafusion:vortex-compact +10.6% +7.9% +2.4% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +14.1% +7.9% +5.7% +10.0% ➖ noise
91 duckdb:duckdb +4.2% +7.9% -3.4% +11.2% ➖ noise
91 duckdb:vortex-compact -20.2% +7.9% -26.1% +15.7% ✅ faster
91 duckdb:vortex-file-compressed -25.6% +7.9% -31.1% +10.0% ✅ faster
92 datafusion:vortex-compact +10.6% +14.6% -3.4% +18.3% ➖ noise
92 datafusion:vortex-file-compressed +18.3% +14.6% +3.3% +11.4% ➖ noise
92 duckdb:duckdb +24.5% +14.6% +8.7% +16.8% ➖ noise
92 duckdb:vortex-compact -3.5% +14.6% -15.8% +19.2% ➖ noise
92 duckdb:vortex-file-compressed +0.8% +14.6% -12.0% +16.4% ➖ noise
93 datafusion:vortex-compact +9.3% +10.4% -1.0% +10.7% ➖ noise
93 datafusion:vortex-file-compressed +6.7% +10.4% -3.4% +16.4% ➖ noise
93 duckdb:duckdb +4.6% +10.4% -5.3% +14.6% ➖ noise
93 duckdb:vortex-compact +0.8% +10.4% -8.7% +13.6% ➖ noise
93 duckdb:vortex-file-compressed +7.4% +10.4% -2.7% +10.0% ➖ noise
94 datafusion:vortex-compact +7.5% +2.3% +5.1% +12.5% ➖ noise
94 datafusion:vortex-file-compressed +1.9% +2.3% -0.4% +10.0% ➖ noise
94 duckdb:duckdb +15.3% +2.3% +12.7% +10.0% 🚨 regression
94 duckdb:vortex-compact +83.8% +2.3% +79.6% +11.0% 🚨 regression
94 duckdb:vortex-file-compressed +109.6% +2.3% +104.9% +13.1% 🚨 regression
95 datafusion:vortex-compact +12.6% +19.4% -5.7% +11.7% ➖ noise
95 datafusion:vortex-file-compressed +4.6% +19.4% -12.3% +11.4% ✅ faster
95 duckdb:duckdb -9.1% +19.4% -23.8% +16.1% ✅ faster
95 duckdb:vortex-compact +34.9% +19.4% +13.0% +14.7% ➖ noise
95 duckdb:vortex-file-compressed +60.2% +19.4% +34.2% +15.1% 🚨 regression
96 datafusion:vortex-compact +14.0% +10.4% +3.3% +10.0% ➖ noise
96 datafusion:vortex-file-compressed +12.1% +10.4% +1.6% +11.0% ➖ noise
96 duckdb:duckdb +11.0% +10.4% +0.6% +15.1% ➖ noise
96 duckdb:vortex-compact +2.7% +10.4% -7.0% +16.2% ➖ noise
96 duckdb:vortex-file-compressed +20.0% +10.4% +8.7% +11.9% ➖ noise
97 datafusion:vortex-compact +9.5% +11.8% -2.1% +10.4% ➖ noise
97 datafusion:vortex-file-compressed +10.2% +11.8% -1.4% +14.6% ➖ noise
97 duckdb:duckdb -0.5% +11.8% -10.9% +10.6% ✅ faster
97 duckdb:vortex-compact +6.7% +11.8% -4.6% +16.8% ➖ noise
97 duckdb:vortex-file-compressed -5.0% +11.8% -15.0% +10.0% ✅ faster
98 datafusion:vortex-compact +15.7% +1.1% +14.5% +10.0% 🚨 regression
98 datafusion:vortex-file-compressed +15.3% +1.1% +14.0% +10.0% 🚨 regression
98 duckdb:duckdb +12.8% +1.1% +11.6% +14.2% ➖ noise
98 duckdb:vortex-compact +14.4% +1.1% +13.2% +10.0% 🚨 regression
98 duckdb:vortex-file-compressed +13.8% +1.1% +12.6% +14.0% ➖ noise
99 datafusion:vortex-compact +11.3% +5.6% +5.4% +25.9% ➖ noise
99 datafusion:vortex-file-compressed +7.3% +5.6% +1.6% +30.1% ➖ noise
99 duckdb:duckdb +5.3% +5.6% -0.3% +22.1% ➖ noise
99 duckdb:vortex-compact +13.9% +5.6% +7.9% +27.9% ➖ noise
99 duckdb:vortex-file-compressed +4.1% +5.6% -1.5% +22.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.8%
Vortex (geomean): 0.973x ➖
Parquet (geomean): 0.980x ➖
Shifts: Parquet (control) -2.0% · Median polish -1.5%


datafusion / vortex-file-compressed (0.945x ➖, 1↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 47391662 36646217 1.29
fineweb_q01/datafusion:vortex-file-compressed 501480533 655371681 0.77
fineweb_q02/datafusion:vortex-file-compressed 🚀 410632831 603812856 0.68
fineweb_q03/datafusion:vortex-file-compressed 1369172457 1461401001 0.94
fineweb_q04/datafusion:vortex-file-compressed 1364267412 1361282132 1.00
fineweb_q05/datafusion:vortex-file-compressed 1330511569 1354855510 0.98
fineweb_q06/datafusion:vortex-file-compressed 1479417193 1501633599 0.99
fineweb_q07/datafusion:vortex-file-compressed 1412582015 1365542122 1.03
fineweb_q08/datafusion:vortex-file-compressed 521686476 548110123 0.95
datafusion / vortex-compact (0.939x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 34002924 41363738 0.82
fineweb_q01/datafusion:vortex-compact 564774077 673724115 0.84
fineweb_q02/datafusion:vortex-compact 592441445 648857255 0.91
fineweb_q03/datafusion:vortex-compact 1415545814 1455766155 0.97
fineweb_q04/datafusion:vortex-compact 1753547430 1787458064 0.98
fineweb_q05/datafusion:vortex-compact 1443562409 1465989237 0.98
fineweb_q06/datafusion:vortex-compact 1300531831 1310477663 0.99
fineweb_q07/datafusion:vortex-compact 1197363471 1240773009 0.97
fineweb_q08/datafusion:vortex-compact 389534843 389823082 1.00
datafusion / parquet (0.979x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1081645198 1193806833 0.91
fineweb_q01/datafusion:parquet 1832096374 1950750933 0.94
fineweb_q02/datafusion:parquet 1994227404 2262157470 0.88
fineweb_q03/datafusion:parquet 1842313815 1680813110 1.10
fineweb_q04/datafusion:parquet 1980164805 1838660750 1.08
fineweb_q05/datafusion:parquet 1762784419 1929833655 0.91
fineweb_q06/datafusion:parquet 1954398912 1923671678 1.02
fineweb_q07/datafusion:parquet 1826548307 1847192801 0.99
fineweb_q08/datafusion:parquet 1787133592 1761968028 1.01
duckdb / vortex-file-compressed (0.958x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 80667292 80545183 1.00
fineweb_q01/duckdb:vortex-file-compressed 548783405 711218800 0.77
fineweb_q02/duckdb:vortex-file-compressed 473596227 440631934 1.07
fineweb_q03/duckdb:vortex-file-compressed 1437368594 1479062832 0.97
fineweb_q04/duckdb:vortex-file-compressed 1503352504 1605555643 0.94
fineweb_q05/duckdb:vortex-file-compressed 1424939839 1464686990 0.97
fineweb_q06/duckdb:vortex-file-compressed 1621993015 1635067069 0.99
fineweb_q07/duckdb:vortex-file-compressed 1434128020 1543625205 0.93
fineweb_q08/duckdb:vortex-file-compressed 595764933 591573995 1.01
duckdb / vortex-compact (1.053x ➖, 0↑ 1↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 84805741 60895689 1.39
fineweb_q01/duckdb:vortex-compact 531734722 590824220 0.90
fineweb_q02/duckdb:vortex-compact 699656595 578932118 1.21
fineweb_q03/duckdb:vortex-compact 1687672258 1572482307 1.07
fineweb_q04/duckdb:vortex-compact 1831039733 1737692985 1.05
fineweb_q05/duckdb:vortex-compact 1524969604 1494142173 1.02
fineweb_q06/duckdb:vortex-compact 1465576030 1469654379 1.00
fineweb_q07/duckdb:vortex-compact 1282794905 1319111241 0.97
fineweb_q08/duckdb:vortex-compact 459935578 489648795 0.94
duckdb / parquet (0.982x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1099440124 1071699314 1.03
fineweb_q01/duckdb:parquet 1311212063 1340951988 0.98
fineweb_q02/duckdb:parquet 1356452833 1444619709 0.94
fineweb_q03/duckdb:parquet 3684637431 3764830221 0.98
fineweb_q04/duckdb:parquet 2008431742 1941450430 1.03
fineweb_q05/duckdb:parquet 2069209294 2143372763 0.97
fineweb_q06/duckdb:parquet 4202475593 4404409374 0.95
fineweb_q07/duckdb:parquet 2497370159 2683434944 0.93
fineweb_q08/duckdb:parquet 1111154817 1074240979 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -17.8% -3.6% -14.7% +214.8% ➖ noise
0 datafusion:vortex-file-compressed +29.3% -3.6% +34.1% +250.6% ➖ noise
0 duckdb:vortex-compact +39.3% -3.6% +44.4% +104.0% ➖ noise
0 duckdb:vortex-file-compressed +0.2% -3.6% +3.9% +34.2% ➖ noise
1 datafusion:vortex-compact -16.2% -4.2% -12.5% +59.7% ➖ noise
1 datafusion:vortex-file-compressed -23.5% -4.2% -20.2% +62.2% ➖ noise
1 duckdb:vortex-compact -10.0% -4.2% -6.1% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -22.8% -4.2% -19.5% +30.0% ➖ noise
2 datafusion:vortex-compact -8.7% -9.0% +0.4% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -32.0% -9.0% -25.3% +43.9% ➖ noise
2 duckdb:vortex-compact +20.9% -9.0% +32.8% +30.0% 🚨 regression
2 duckdb:vortex-file-compressed +7.5% -9.0% +18.1% +30.0% ➖ noise
3 datafusion:vortex-compact -2.8% +3.6% -6.1% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -6.3% +3.6% -9.5% +30.0% ➖ noise
3 duckdb:vortex-compact +7.3% +3.6% +3.6% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -2.8% +3.6% -6.2% +30.0% ➖ noise
4 datafusion:vortex-compact -1.9% +5.6% -7.1% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +0.2% +5.6% -5.1% +30.0% ➖ noise
4 duckdb:vortex-compact +5.4% +5.6% -0.2% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -6.4% +5.6% -11.3% +30.0% ➖ noise
5 datafusion:vortex-compact -1.5% -6.1% +4.9% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -1.8% -6.1% +4.6% +30.0% ➖ noise
5 duckdb:vortex-compact +2.1% -6.1% +8.7% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -2.7% -6.1% +3.6% +30.0% ➖ noise
6 datafusion:vortex-compact -0.8% -1.5% +0.8% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -1.5% -1.5% +0.1% +30.0% ➖ noise
6 duckdb:vortex-compact -0.3% -1.5% +1.3% +34.4% ➖ noise
6 duckdb:vortex-file-compressed -0.8% -1.5% +0.8% +30.0% ➖ noise
7 datafusion:vortex-compact -3.5% -4.1% +0.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +3.4% -4.1% +7.8% +30.0% ➖ noise
7 duckdb:vortex-compact -2.8% -4.1% +1.4% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -7.1% -4.1% -3.2% +30.0% ➖ noise
8 datafusion:vortex-compact -0.1% +2.4% -2.4% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -4.8% +2.4% -7.1% +30.0% ➖ noise
8 duckdb:vortex-compact -6.1% +2.4% -8.3% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +0.7% +2.4% -1.7% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +6.5%
Vortex (geomean): 1.090x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.7%


datafusion / vortex-file-compressed (1.008x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 400748602 381052889 1.05
tpch_q02/datafusion:vortex-file-compressed 105555701 106143847 0.99
tpch_q03/datafusion:vortex-file-compressed 213662220 212532544 1.01
tpch_q04/datafusion:vortex-file-compressed 114586044 113558174 1.01
tpch_q05/datafusion:vortex-file-compressed 374406991 366248176 1.02
tpch_q06/datafusion:vortex-file-compressed 43530867 42915019 1.01
tpch_q07/datafusion:vortex-file-compressed 503856876 495743094 1.02
tpch_q08/datafusion:vortex-file-compressed 361521648 352281042 1.03
tpch_q09/datafusion:vortex-file-compressed 632318513 617991949 1.02
tpch_q10/datafusion:vortex-file-compressed 231401433 228921767 1.01
tpch_q11/datafusion:vortex-file-compressed 82560655 81729181 1.01
tpch_q12/datafusion:vortex-file-compressed 118926397 120450154 0.99
tpch_q13/datafusion:vortex-file-compressed 212125940 211756470 1.00
tpch_q14/datafusion:vortex-file-compressed 57074969 56557604 1.01
tpch_q15/datafusion:vortex-file-compressed 105895948 105813869 1.00
tpch_q16/datafusion:vortex-file-compressed 74583872 74438680 1.00
tpch_q17/datafusion:vortex-file-compressed 628743192 623672736 1.01
tpch_q18/datafusion:vortex-file-compressed 836099131 822135743 1.02
tpch_q19/datafusion:vortex-file-compressed 92204055 97893029 0.94
tpch_q20/datafusion:vortex-file-compressed 164127955 165736682 0.99
tpch_q21/datafusion:vortex-file-compressed 649058529 639355499 1.02
tpch_q22/datafusion:vortex-file-compressed 65103410 64174930 1.01
datafusion / vortex-compact (1.005x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 438064105 433935554 1.01
tpch_q02/datafusion:vortex-compact 107668374 107956252 1.00
tpch_q03/datafusion:vortex-compact 216700904 216903701 1.00
tpch_q04/datafusion:vortex-compact 121807990 122361527 1.00
tpch_q05/datafusion:vortex-compact 374565243 370102644 1.01
tpch_q06/datafusion:vortex-compact 62308628 63084942 0.99
tpch_q07/datafusion:vortex-compact 519065658 512024111 1.01
tpch_q08/datafusion:vortex-compact 356554582 356639975 1.00
tpch_q09/datafusion:vortex-compact 628539621 627893152 1.00
tpch_q10/datafusion:vortex-compact 247391270 244791377 1.01
tpch_q11/datafusion:vortex-compact 82505215 81071446 1.02
tpch_q12/datafusion:vortex-compact 164074910 165281804 0.99
tpch_q13/datafusion:vortex-compact 263597805 259825484 1.01
tpch_q14/datafusion:vortex-compact 73716493 72883959 1.01
tpch_q15/datafusion:vortex-compact 160040906 158874949 1.01
tpch_q16/datafusion:vortex-compact 80080510 77216951 1.04
tpch_q17/datafusion:vortex-compact 630339735 626066681 1.01
tpch_q18/datafusion:vortex-compact 839219554 829119822 1.01
tpch_q19/datafusion:vortex-compact 132673981 136983038 0.97
tpch_q20/datafusion:vortex-compact 189235360 188715006 1.00
tpch_q21/datafusion:vortex-compact 660102761 651770323 1.01
tpch_q22/datafusion:vortex-compact 72239546 72073928 1.00
datafusion / parquet (1.005x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 441153122 451697134 0.98
tpch_q02/datafusion:parquet 172277938 168569829 1.02
tpch_q03/datafusion:parquet 277594068 272458516 1.02
tpch_q04/datafusion:parquet 125849558 123329771 1.02
tpch_q05/datafusion:parquet 429180107 424935818 1.01
tpch_q06/datafusion:parquet 125151911 124063868 1.01
tpch_q07/datafusion:parquet 595763245 591551752 1.01
tpch_q08/datafusion:parquet 455004866 448938167 1.01
tpch_q09/datafusion:parquet 726015262 729311034 1.00
tpch_q10/datafusion:parquet 495729364 483720371 1.02
tpch_q11/datafusion:parquet 116720474 113822720 1.03
tpch_q12/datafusion:parquet 195359974 187219147 1.04
tpch_q13/datafusion:parquet 329858882 329941050 1.00
tpch_q14/datafusion:parquet 153290739 155385750 0.99
tpch_q15/datafusion:parquet 240687740 245271634 0.98
tpch_q16/datafusion:parquet 122901866 127862062 0.96
tpch_q17/datafusion:parquet 672124190 671297487 1.00
tpch_q18/datafusion:parquet 871090391 866515580 1.01
tpch_q19/datafusion:parquet 249867281 248712023 1.00
tpch_q20/datafusion:parquet 287548068 284159360 1.01
tpch_q21/datafusion:parquet 684765966 677162614 1.01
tpch_q22/datafusion:parquet 213417982 214641013 0.99
datafusion / arrow (1.016x ➖, 0↑ 1↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 590562744 586184670 1.01
tpch_q02/datafusion:arrow 164607995 163820347 1.00
tpch_q03/datafusion:arrow 470156293 467169398 1.01
tpch_q04/datafusion:arrow 341770596 341798929 1.00
tpch_q05/datafusion:arrow 933906279 916442685 1.02
tpch_q06/datafusion:arrow 284313716 280673824 1.01
tpch_q07/datafusion:arrow 1169290454 1155610801 1.01
tpch_q08/datafusion:arrow 1131969706 1143868237 0.99
tpch_q09/datafusion:arrow 1344356522 1346182862 1.00
tpch_q10/datafusion:arrow 597177431 582248041 1.03
tpch_q11/datafusion:arrow 137568228 137107569 1.00
tpch_q12/datafusion:arrow 🚨 784136396 707167522 1.11
tpch_q13/datafusion:arrow 495917724 499261267 0.99
tpch_q14/datafusion:arrow 323612820 315395058 1.03
tpch_q15/datafusion:arrow 715246259 693632814 1.03
tpch_q16/datafusion:arrow 105372058 103613601 1.02
tpch_q17/datafusion:arrow 1327098284 1314514850 1.01
tpch_q18/datafusion:arrow 1869030232 1863435818 1.00
tpch_q19/datafusion:arrow 489360590 483135690 1.01
tpch_q20/datafusion:arrow 487357385 480643365 1.01
tpch_q21/datafusion:arrow 3006122522 2953520416 1.02
tpch_q22/datafusion:arrow 132216406 126624337 1.04
duckdb / vortex-file-compressed (1.210x ❌, 2↑ 12↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 169998164 169869858 1.00
tpch_q02/duckdb:vortex-file-compressed 🚨 67737090 50839587 1.33
tpch_q03/duckdb:vortex-file-compressed 🚨 140850406 123859123 1.14
tpch_q04/duckdb:vortex-file-compressed 🚨 168622914 150783508 1.12
tpch_q05/duckdb:vortex-file-compressed 🚨 149456169 124815608 1.20
tpch_q06/duckdb:vortex-file-compressed 🚀 32084338 45692104 0.70
tpch_q07/duckdb:vortex-file-compressed 🚨 160382007 142494476 1.13
tpch_q08/duckdb:vortex-file-compressed 🚨 228149814 168084183 1.36
tpch_q09/duckdb:vortex-file-compressed 🚨 408839400 318498288 1.28
tpch_q10/duckdb:vortex-file-compressed 🚨 191707223 140630401 1.36
tpch_q11/duckdb:vortex-file-compressed 34886142 32569992 1.07
tpch_q12/duckdb:vortex-file-compressed 🚨 187272951 91125711 2.06
tpch_q13/duckdb:vortex-file-compressed 🚨 264378622 225844463 1.17
tpch_q14/duckdb:vortex-file-compressed 🚀 57590002 67150834 0.86
tpch_q15/duckdb:vortex-file-compressed 87728540 88666497 0.99
tpch_q16/duckdb:vortex-file-compressed 75430250 75881353 0.99
tpch_q17/duckdb:vortex-file-compressed 🚨 530296487 98255539 5.40
tpch_q18/duckdb:vortex-file-compressed 284345254 283293628 1.00
tpch_q19/duckdb:vortex-file-compressed 75111679 82636370 0.91
tpch_q20/duckdb:vortex-file-compressed 159459708 155901254 1.02
tpch_q21/duckdb:vortex-file-compressed 🚨 984191932 564554189 1.74
tpch_q22/duckdb:vortex-file-compressed 63696144 69770456 0.91
duckdb / vortex-compact (1.154x ❌, 4↑ 10↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 228265251 226866863 1.01
tpch_q02/duckdb:vortex-compact 🚨 77056871 55073248 1.40
tpch_q03/duckdb:vortex-compact 🚨 157765354 136712132 1.15
tpch_q04/duckdb:vortex-compact 179984792 170095710 1.06
tpch_q05/duckdb:vortex-compact 🚨 181068086 144938044 1.25
tpch_q06/duckdb:vortex-compact 🚀 54184834 79888910 0.68
tpch_q07/duckdb:vortex-compact 203078665 195395486 1.04
tpch_q08/duckdb:vortex-compact 🚨 266853984 181085224 1.47
tpch_q09/duckdb:vortex-compact 🚨 442324083 349804766 1.26
tpch_q10/duckdb:vortex-compact 🚨 229338295 174642247 1.31
tpch_q11/duckdb:vortex-compact 41280402 40459141 1.02
tpch_q12/duckdb:vortex-compact 🚨 249900002 199900523 1.25
tpch_q13/duckdb:vortex-compact 🚨 327188693 274130736 1.19
tpch_q14/duckdb:vortex-compact 🚀 72898965 97808906 0.75
tpch_q15/duckdb:vortex-compact 111161747 113052323 0.98
tpch_q16/duckdb:vortex-compact 78807918 81506420 0.97
tpch_q17/duckdb:vortex-compact 🚨 542467297 111612169 4.86
tpch_q18/duckdb:vortex-compact 286230561 289428226 0.99
tpch_q19/duckdb:vortex-compact 🚀 90333993 106933416 0.84
tpch_q20/duckdb:vortex-compact 196557140 199777921 0.98
tpch_q21/duckdb:vortex-compact 🚨 1013448977 601812448 1.68
tpch_q22/duckdb:vortex-compact 🚀 72448443 83973227 0.86
duckdb / parquet (0.991x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 260881061 258549971 1.01
tpch_q02/duckdb:parquet 96522542 101981224 0.95
tpch_q03/duckdb:parquet 207238790 204780831 1.01
tpch_q04/duckdb:parquet 130822431 131604740 0.99
tpch_q05/duckdb:parquet 212190009 212036568 1.00
tpch_q06/duckdb:parquet 66797615 68081094 0.98
tpch_q07/duckdb:parquet 179421230 181421154 0.99
tpch_q08/duckdb:parquet 248045525 253922836 0.98
tpch_q09/duckdb:parquet 492864520 496858548 0.99
tpch_q10/duckdb:parquet 612806636 607363102 1.01
tpch_q11/duckdb:parquet 57370839 57929963 0.99
tpch_q12/duckdb:parquet 121178430 123051705 0.98
tpch_q13/duckdb:parquet 443857278 451480750 0.98
tpch_q14/duckdb:parquet 175597394 176384900 1.00
tpch_q15/duckdb:parquet 96773621 96476364 1.00
tpch_q16/duckdb:parquet 160359801 162505152 0.99
tpch_q17/duckdb:parquet 173910751 175161290 0.99
tpch_q18/duckdb:parquet 352852213 357239041 0.99
tpch_q19/duckdb:parquet 279101793 284912179 0.98
tpch_q20/duckdb:parquet 223851476 223628157 1.00
tpch_q21/duckdb:parquet 554337871 560310275 0.99
tpch_q22/duckdb:parquet 290519884 289366568 1.00
duckdb / duckdb (1.004x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116477553 116148475 1.00
tpch_q02/duckdb:duckdb 47589315 46513065 1.02
tpch_q03/duckdb:duckdb 96786732 96534837 1.00
tpch_q04/duckdb:duckdb 133751045 131830388 1.01
tpch_q05/duckdb:duckdb 110014287 109635237 1.00
tpch_q06/duckdb:duckdb 38812210 37609936 1.03
tpch_q07/duckdb:duckdb 87100687 86148583 1.01
tpch_q08/duckdb:duckdb 110389887 110266835 1.00
tpch_q09/duckdb:duckdb 277372556 278601739 1.00
tpch_q10/duckdb:duckdb 202447649 205165243 0.99
tpch_q11/duckdb:duckdb 15639706 15380283 1.02
tpch_q12/duckdb:duckdb 84263367 85512668 0.99
tpch_q13/duckdb:duckdb 221429070 220282238 1.01
tpch_q14/duckdb:duckdb 71084299 70492609 1.01
tpch_q15/duckdb:duckdb 77454867 77805548 1.00
tpch_q16/duckdb:duckdb 73155833 74067987 0.99
tpch_q17/duckdb:duckdb 84656430 84901443 1.00
tpch_q18/duckdb:duckdb 212763832 215758151 0.99
tpch_q19/duckdb:duckdb 116482511 115499837 1.01
tpch_q20/duckdb:duckdb 112083457 112055466 1.00
tpch_q21/duckdb:duckdb 299935346 296000396 1.01
tpch_q22/duckdb:duckdb 65155542 64948117 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +0.7% -0.7% +1.5% +10.0% ➖ noise
1 datafusion:vortex-compact +1.0% -0.7% +1.7% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +5.2% -0.7% +5.9% +10.0% ➖ noise
1 duckdb:duckdb +0.3% -0.7% +1.0% +10.0% ➖ noise
1 duckdb:vortex-compact +0.6% -0.7% +1.4% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +0.1% -0.7% +0.8% +10.0% ➖ noise
2 datafusion:arrow +0.5% -1.6% +2.2% +10.0% ➖ noise
2 datafusion:vortex-compact -0.3% -1.6% +1.4% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.6% -1.6% +1.1% +10.0% ➖ noise
2 duckdb:duckdb +2.3% -1.6% +4.0% +10.0% ➖ noise
2 duckdb:vortex-compact +39.9% -1.6% +42.3% +10.0% 🚨 regression
2 duckdb:vortex-file-compressed +33.2% -1.6% +35.5% +10.0% 🚨 regression
3 datafusion:arrow +0.6% +1.5% -0.9% +10.0% ➖ noise
3 datafusion:vortex-compact -0.1% +1.5% -1.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +0.5% +1.5% -1.0% +10.0% ➖ noise
3 duckdb:duckdb +0.3% +1.5% -1.3% +10.0% ➖ noise
3 duckdb:vortex-compact +15.4% +1.5% +13.6% +10.0% 🚨 regression
3 duckdb:vortex-file-compressed +13.7% +1.5% +12.0% +10.0% 🚨 regression
4 datafusion:arrow -0.0% +0.7% -0.7% +10.0% ➖ noise
4 datafusion:vortex-compact -0.5% +0.7% -1.2% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +0.9% +0.7% +0.2% +10.0% ➖ noise
4 duckdb:duckdb +1.5% +0.7% +0.7% +10.0% ➖ noise
4 duckdb:vortex-compact +5.8% +0.7% +5.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +11.8% +0.7% +11.0% +10.0% 🚨 regression
5 datafusion:arrow +1.9% +0.5% +1.4% +10.0% ➖ noise
5 datafusion:vortex-compact +1.2% +0.5% +0.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.2% +0.5% +1.7% +10.0% ➖ noise
5 duckdb:duckdb +0.3% +0.5% -0.2% +10.0% ➖ noise
5 duckdb:vortex-compact +24.9% +0.5% +24.3% +10.0% 🚨 regression
5 duckdb:vortex-file-compressed +19.7% +0.5% +19.1% +10.0% 🚨 regression
6 datafusion:arrow +1.3% -0.5% +1.8% +10.0% ➖ noise
6 datafusion:vortex-compact -1.2% -0.5% -0.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.4% -0.5% +2.0% +10.0% ➖ noise
6 duckdb:duckdb +3.2% -0.5% +3.7% +10.0% ➖ noise
6 duckdb:vortex-compact -32.2% -0.5% -31.8% +10.0% ✅ faster
6 duckdb:vortex-file-compressed -29.8% -0.5% -29.4% +11.0% ✅ faster
7 datafusion:arrow +1.2% -0.2% +1.4% +10.0% ➖ noise
7 datafusion:vortex-compact +1.4% -0.2% +1.6% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +1.6% -0.2% +1.8% +10.0% ➖ noise
7 duckdb:duckdb +1.1% -0.2% +1.3% +10.0% ➖ noise
7 duckdb:vortex-compact +3.9% -0.2% +4.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +12.6% -0.2% +12.8% +10.0% 🚨 regression
8 datafusion:arrow -1.0% -0.5% -0.5% +10.0% ➖ noise
8 datafusion:vortex-compact -0.0% -0.5% +0.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +2.6% -0.5% +3.1% +10.0% ➖ noise
8 duckdb:duckdb +0.1% -0.5% +0.6% +10.0% ➖ noise
8 duckdb:vortex-compact +47.4% -0.5% +48.1% +10.0% 🚨 regression
8 duckdb:vortex-file-compressed +35.7% -0.5% +36.4% +10.0% 🚨 regression
9 datafusion:arrow -0.1% -0.6% +0.5% +10.0% ➖ noise
9 datafusion:vortex-compact +0.1% -0.6% +0.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +2.3% -0.6% +3.0% +10.0% ➖ noise
9 duckdb:duckdb -0.4% -0.6% +0.2% +10.0% ➖ noise
9 duckdb:vortex-compact +26.4% -0.6% +27.2% +10.0% 🚨 regression
9 duckdb:vortex-file-compressed +28.4% -0.6% +29.2% +10.0% 🚨 regression
10 datafusion:arrow +2.6% +1.7% +0.9% +10.0% ➖ noise
10 datafusion:vortex-compact +1.1% +1.7% -0.6% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.1% +1.7% -0.6% +10.0% ➖ noise
10 duckdb:duckdb -1.3% +1.7% -3.0% +10.0% ➖ noise
10 duckdb:vortex-compact +31.3% +1.7% +29.1% +10.0% 🚨 regression
10 duckdb:vortex-file-compressed +36.3% +1.7% +34.1% +10.0% 🚨 regression
11 datafusion:arrow +0.3% +0.8% -0.4% +10.0% ➖ noise
11 datafusion:vortex-compact +1.8% +0.8% +1.0% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +1.0% +0.8% +0.2% +10.0% ➖ noise
11 duckdb:duckdb +1.7% +0.8% +0.9% +11.7% ➖ noise
11 duckdb:vortex-compact +2.0% +0.8% +1.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +7.1% +0.8% +6.3% +10.0% ➖ noise
12 datafusion:arrow +10.9% +1.4% +9.4% +37.1% ➖ noise
12 datafusion:vortex-compact -0.7% +1.4% -2.1% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -1.3% +1.4% -2.6% +10.0% ➖ noise
12 duckdb:duckdb -1.5% +1.4% -2.8% +10.0% ➖ noise
12 duckdb:vortex-compact +25.0% +1.4% +23.3% +10.0% 🚨 regression
12 duckdb:vortex-file-compressed +105.5% +1.4% +102.7% +10.0% 🚨 regression
13 datafusion:arrow -0.7% -0.9% +0.2% +10.0% ➖ noise
13 datafusion:vortex-compact +1.5% -0.9% +2.3% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.2% -0.9% +1.0% +10.0% ➖ noise
13 duckdb:duckdb +0.5% -0.9% +1.4% +10.0% ➖ noise
13 duckdb:vortex-compact +19.4% -0.9% +20.4% +10.0% 🚨 regression
13 duckdb:vortex-file-compressed +17.1% -0.9% +18.1% +10.0% 🚨 regression
14 datafusion:arrow +2.6% -0.9% +3.5% +10.0% ➖ noise
14 datafusion:vortex-compact +1.1% -0.9% +2.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +0.9% -0.9% +1.8% +10.0% ➖ noise
14 duckdb:duckdb +0.8% -0.9% +1.8% +10.0% ➖ noise
14 duckdb:vortex-compact -25.5% -0.9% -24.8% +10.0% ✅ faster
14 duckdb:vortex-file-compressed -14.2% -0.9% -13.5% +10.0% ✅ faster
15 datafusion:arrow +3.1% -0.8% +3.9% +10.0% ➖ noise
15 datafusion:vortex-compact +0.7% -0.8% +1.5% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.1% -0.8% +0.9% +10.0% ➖ noise
15 duckdb:duckdb -0.5% -0.8% +0.3% +10.0% ➖ noise
15 duckdb:vortex-compact -1.7% -0.8% -0.9% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -1.1% -0.8% -0.3% +10.0% ➖ noise
16 datafusion:arrow +1.7% -2.6% +4.4% +10.0% ➖ noise
16 datafusion:vortex-compact +3.7% -2.6% +6.5% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +0.2% -2.6% +2.9% +10.0% ➖ noise
16 duckdb:duckdb -1.2% -2.6% +1.4% +10.0% ➖ noise
16 duckdb:vortex-compact -3.3% -2.6% -0.7% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -0.6% -2.6% +2.1% +10.0% ➖ noise
17 datafusion:arrow +1.0% -0.3% +1.3% +10.0% ➖ noise
17 datafusion:vortex-compact +0.7% -0.3% +1.0% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.8% -0.3% +1.1% +10.0% ➖ noise
17 duckdb:duckdb -0.3% -0.3% +0.0% +10.0% ➖ noise
17 duckdb:vortex-compact +386.0% -0.3% +387.5% +10.0% 🚨 regression
17 duckdb:vortex-file-compressed +439.7% -0.3% +441.3% +10.0% 🚨 regression
18 datafusion:arrow +0.3% -0.4% +0.7% +10.0% ➖ noise
18 datafusion:vortex-compact +1.2% -0.4% +1.6% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +1.7% -0.4% +2.1% +10.0% ➖ noise
18 duckdb:duckdb -1.4% -0.4% -1.0% +10.0% ➖ noise
18 duckdb:vortex-compact -1.1% -0.4% -0.8% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +0.4% -0.4% +0.7% +10.0% ➖ noise
19 datafusion:arrow +1.3% -0.8% +2.1% +10.0% ➖ noise
19 datafusion:vortex-compact -3.1% -0.8% -2.4% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -5.8% -0.8% -5.1% +10.0% ➖ noise
19 duckdb:duckdb +0.9% -0.8% +1.7% +10.0% ➖ noise
19 duckdb:vortex-compact -15.5% -0.8% -14.8% +10.0% ✅ faster
19 duckdb:vortex-file-compressed -9.1% -0.8% -8.4% +10.0% ➖ noise
20 datafusion:arrow +1.4% +0.6% +0.7% +10.0% ➖ noise
20 datafusion:vortex-compact +0.3% +0.6% -0.4% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -1.0% +0.6% -1.6% +10.0% ➖ noise
20 duckdb:duckdb +0.0% +0.6% -0.6% +10.0% ➖ noise
20 duckdb:vortex-compact -1.6% +0.6% -2.2% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +2.3% +0.6% +1.6% +10.0% ➖ noise
21 datafusion:arrow +1.8% +0.0% +1.8% +10.0% ➖ noise
21 datafusion:vortex-compact +1.3% +0.0% +1.3% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +1.5% +0.0% +1.5% +10.0% ➖ noise
21 duckdb:duckdb +1.3% +0.0% +1.3% +10.0% ➖ noise
21 duckdb:vortex-compact +68.4% +0.0% +68.4% +10.0% 🚨 regression
21 duckdb:vortex-file-compressed +74.3% +0.0% +74.3% +10.0% 🚨 regression
22 datafusion:arrow +4.4% -0.1% +4.5% +10.0% ➖ noise
22 datafusion:vortex-compact +0.2% -0.1% +0.3% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +1.4% -0.1% +1.5% +10.0% ➖ noise
22 duckdb:duckdb +0.3% -0.1% +0.4% +10.0% ➖ noise
22 duckdb:vortex-compact -13.7% -0.1% -13.6% +10.0% ✅ faster
22 duckdb:vortex-file-compressed -8.7% -0.1% -8.6% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.4%
Vortex (geomean): 0.920x ➖
Parquet (geomean): 0.952x ➖
Shifts: Parquet (control) -4.8% · Median polish -6.1%


datafusion / vortex-file-compressed (0.869x ➖, 3↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 252398282 249719847 1.01
tpch_q02/datafusion:vortex-file-compressed 490719600 450171192 1.09
tpch_q03/datafusion:vortex-file-compressed 455471757 487372819 0.93
tpch_q04/datafusion:vortex-file-compressed 237152796 265041095 0.89
tpch_q05/datafusion:vortex-file-compressed 🚀 394653905 689347719 0.57
tpch_q06/datafusion:vortex-file-compressed 336181558 412795602 0.81
tpch_q07/datafusion:vortex-file-compressed 424596464 525081775 0.81
tpch_q08/datafusion:vortex-file-compressed 🚀 532033255 819130673 0.65
tpch_q09/datafusion:vortex-file-compressed 🚀 360231908 613355404 0.59
tpch_q10/datafusion:vortex-file-compressed 461576135 540221016 0.85
tpch_q11/datafusion:vortex-file-compressed 278586757 277461199 1.00
tpch_q12/datafusion:vortex-file-compressed 483188244 589139326 0.82
tpch_q13/datafusion:vortex-file-compressed 137040618 150422972 0.91
tpch_q14/datafusion:vortex-file-compressed 255742257 284912308 0.90
tpch_q15/datafusion:vortex-file-compressed 472757703 522142140 0.91
tpch_q16/datafusion:vortex-file-compressed 184937656 244934695 0.76
tpch_q17/datafusion:vortex-file-compressed 377456594 457733098 0.82
tpch_q18/datafusion:vortex-file-compressed 353323023 400982761 0.88
tpch_q19/datafusion:vortex-file-compressed 467250912 426817800 1.09
tpch_q20/datafusion:vortex-file-compressed 468897147 446241590 1.05
tpch_q21/datafusion:vortex-file-compressed 625389675 609485495 1.03
tpch_q22/datafusion:vortex-file-compressed 130262185 127729304 1.02
datafusion / vortex-compact (0.931x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 248272971 244742490 1.01
tpch_q02/datafusion:vortex-compact 518954711 423671166 1.22
tpch_q03/datafusion:vortex-compact 376681146 364064775 1.03
tpch_q04/datafusion:vortex-compact 204331881 290652811 0.70
tpch_q05/datafusion:vortex-compact 358948497 428170841 0.84
tpch_q06/datafusion:vortex-compact 318116324 424222829 0.75
tpch_q07/datafusion:vortex-compact 364966861 476807884 0.77
tpch_q08/datafusion:vortex-compact 509233273 501138735 1.02
tpch_q09/datafusion:vortex-compact 385674635 381700117 1.01
tpch_q10/datafusion:vortex-compact 443842548 424099196 1.05
tpch_q11/datafusion:vortex-compact 256296305 259017837 0.99
tpch_q12/datafusion:vortex-compact 427128188 433033657 0.99
tpch_q13/datafusion:vortex-compact 137074058 160302870 0.86
tpch_q14/datafusion:vortex-compact 264136816 272775130 0.97
tpch_q15/datafusion:vortex-compact 473106378 513298045 0.92
tpch_q16/datafusion:vortex-compact 182594778 209397032 0.87
tpch_q17/datafusion:vortex-compact 398420767 382501830 1.04
tpch_q18/datafusion:vortex-compact 303832039 358063743 0.85
tpch_q19/datafusion:vortex-compact 464688552 479600522 0.97
tpch_q20/datafusion:vortex-compact 424489992 464219360 0.91
tpch_q21/datafusion:vortex-compact 499230352 548854287 0.91
tpch_q22/datafusion:vortex-compact 107759366 113464820 0.95
datafusion / parquet (0.954x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 206700366 240107654 0.86
tpch_q02/datafusion:parquet 430341077 386989693 1.11
tpch_q03/datafusion:parquet 291566863 300481837 0.97
tpch_q04/datafusion:parquet 141821770 154433482 0.92
tpch_q05/datafusion:parquet 443934909 426798863 1.04
tpch_q06/datafusion:parquet 142358117 150571651 0.95
tpch_q07/datafusion:parquet 455293390 441234260 1.03
tpch_q08/datafusion:parquet 575608646 563919093 1.02
tpch_q09/datafusion:parquet 504736069 451806534 1.12
tpch_q10/datafusion:parquet 554221266 496021012 1.12
tpch_q11/datafusion:parquet 318442839 353370805 0.90
tpch_q12/datafusion:parquet 229697327 247648810 0.93
tpch_q13/datafusion:parquet 448565804 434211464 1.03
tpch_q14/datafusion:parquet 172787847 207018252 0.83
tpch_q15/datafusion:parquet 298674113 380186939 0.79
tpch_q16/datafusion:parquet 172552621 173000441 1.00
tpch_q17/datafusion:parquet 388574143 435966781 0.89
tpch_q18/datafusion:parquet 454587494 490302858 0.93
tpch_q19/datafusion:parquet 289450704 311596183 0.93
tpch_q20/datafusion:parquet 306858595 318123469 0.96
tpch_q21/datafusion:parquet 467494657 511630873 0.91
tpch_q22/datafusion:parquet 119052142 141061788 0.84
duckdb / vortex-file-compressed (0.943x ➖, 1↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 257444275 278883337 0.92
tpch_q02/duckdb:vortex-file-compressed 895544537 961761169 0.93
tpch_q03/duckdb:vortex-file-compressed 582270351 660660972 0.88
tpch_q04/duckdb:vortex-file-compressed 408489239 403550674 1.01
tpch_q05/duckdb:vortex-file-compressed 768823646 947841468 0.81
tpch_q06/duckdb:vortex-file-compressed 333687674 374813009 0.89
tpch_q07/duckdb:vortex-file-compressed 773262602 803361676 0.96
tpch_q08/duckdb:vortex-file-compressed 1061632114 992591220 1.07
tpch_q09/duckdb:vortex-file-compressed 904040456 859790470 1.05
tpch_q10/duckdb:vortex-file-compressed 761232809 747989757 1.02
tpch_q11/duckdb:vortex-file-compressed 508847590 517769331 0.98
tpch_q12/duckdb:vortex-file-compressed 633452491 490451277 1.29
tpch_q13/duckdb:vortex-file-compressed 406613155 462466015 0.88
tpch_q14/duckdb:vortex-file-compressed 🚀 349134353 500741995 0.70
tpch_q15/duckdb:vortex-file-compressed 330159241 303046160 1.09
tpch_q16/duckdb:vortex-file-compressed 343666165 390418817 0.88
tpch_q17/duckdb:vortex-file-compressed 509304452 697437904 0.73
tpch_q18/duckdb:vortex-file-compressed 564212985 547612732 1.03
tpch_q19/duckdb:vortex-file-compressed 503542882 450042897 1.12
tpch_q20/duckdb:vortex-file-compressed 734726712 812268922 0.90
tpch_q21/duckdb:vortex-file-compressed 1071937952 1081676706 0.99
tpch_q22/duckdb:vortex-file-compressed 311124338 384482492 0.81
duckdb / vortex-compact (0.937x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 296461161 271597797 1.09
tpch_q02/duckdb:vortex-compact 903862926 919699266 0.98
tpch_q03/duckdb:vortex-compact 493630255 631380252 0.78
tpch_q04/duckdb:vortex-compact 378572205 330611391 1.15
tpch_q05/duckdb:vortex-compact 758932324 850733118 0.89
tpch_q06/duckdb:vortex-compact 361692994 474945566 0.76
tpch_q07/duckdb:vortex-compact 804706228 765544491 1.05
tpch_q08/duckdb:vortex-compact 967971866 915751028 1.06
tpch_q09/duckdb:vortex-compact 869082106 894989795 0.97
tpch_q10/duckdb:vortex-compact 660076612 697986235 0.95
tpch_q11/duckdb:vortex-compact 524048088 512311184 1.02
tpch_q12/duckdb:vortex-compact 618571954 494771472 1.25
tpch_q13/duckdb:vortex-compact 375005522 463918277 0.81
tpch_q14/duckdb:vortex-compact 404150225 500885815 0.81
tpch_q15/duckdb:vortex-compact 278041966 281035416 0.99
tpch_q16/duckdb:vortex-compact 311926527 379565439 0.82
tpch_q17/duckdb:vortex-compact 527764232 622256863 0.85
tpch_q18/duckdb:vortex-compact 441585902 526919605 0.84
tpch_q19/duckdb:vortex-compact 455499434 422309546 1.08
tpch_q20/duckdb:vortex-compact 679396148 759219607 0.89
tpch_q21/duckdb:vortex-compact 1034682511 1081575380 0.96
tpch_q22/duckdb:vortex-compact 281916069 345746679 0.82
duckdb / parquet (0.950x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 424494116 484807737 0.88
tpch_q02/duckdb:parquet 1084048125 1119365740 0.97
tpch_q03/duckdb:parquet 1016847055 1070919846 0.95
tpch_q04/duckdb:parquet 636547777 717897839 0.89
tpch_q05/duckdb:parquet 1174909320 1177015622 1.00
tpch_q06/duckdb:parquet 407495804 408583590 1.00
tpch_q07/duckdb:parquet 1157134334 1183178474 0.98
tpch_q08/duckdb:parquet 1491291570 1539045323 0.97
tpch_q09/duckdb:parquet 1315791103 1383487084 0.95
tpch_q10/duckdb:parquet 1205182631 1310141651 0.92
tpch_q11/duckdb:parquet 704570860 805269849 0.87
tpch_q12/duckdb:parquet 693612125 700587703 0.99
tpch_q13/duckdb:parquet 898378760 879935084 1.02
tpch_q14/duckdb:parquet 622840860 697990827 0.89
tpch_q15/duckdb:parquet 501992267 552689342 0.91
tpch_q16/duckdb:parquet 632495456 694654305 0.91
tpch_q17/duckdb:parquet 700163000 755866673 0.93
tpch_q18/duckdb:parquet 846827988 859208756 0.99
tpch_q19/duckdb:parquet 737732970 746132896 0.99
tpch_q20/duckdb:parquet 1092914383 1150866009 0.95
tpch_q21/duckdb:parquet 1126044389 1106803465 1.02
tpch_q22/duckdb:parquet 560598324 583692821 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +1.4% -13.2% +16.8% +66.7% ➖ noise
1 datafusion:vortex-file-compressed +1.1% -13.2% +16.4% +64.5% ➖ noise
1 duckdb:vortex-compact +9.2% -13.2% +25.7% +39.5% ➖ noise
1 duckdb:vortex-file-compressed -7.7% -13.2% +6.3% +48.7% ➖ noise
2 datafusion:vortex-compact +22.5% +3.8% +18.0% +31.6% ➖ noise
2 datafusion:vortex-file-compressed +9.0% +3.8% +5.0% +42.0% ➖ noise
2 duckdb:vortex-compact -1.7% +3.8% -5.3% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -6.9% +3.8% -10.3% +30.0% ➖ noise
3 datafusion:vortex-compact +3.5% -4.0% +7.8% +48.2% ➖ noise
3 datafusion:vortex-file-compressed -6.5% -4.0% -2.6% +51.5% ➖ noise
3 duckdb:vortex-compact -21.8% -4.0% -18.5% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -11.9% -4.0% -8.2% +30.0% ➖ noise
4 datafusion:vortex-compact -29.7% -9.8% -22.1% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -10.5% -9.8% -0.8% +30.0% ➖ noise
4 duckdb:vortex-compact +14.5% -9.8% +26.9% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +1.2% -9.8% +12.2% +30.0% ➖ noise
5 datafusion:vortex-compact -16.2% +1.9% -17.7% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -42.7% +1.9% -43.8% +30.0% ✅ faster
5 duckdb:vortex-compact -10.8% +1.9% -12.5% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -18.9% +1.9% -20.4% +30.0% ➖ noise
6 datafusion:vortex-compact -25.0% -2.9% -22.8% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -18.6% -2.9% -16.1% +30.0% ➖ noise
6 duckdb:vortex-compact -23.8% -2.9% -21.6% +30.6% ➖ noise
6 duckdb:vortex-file-compressed -11.0% -2.9% -8.3% +30.0% ➖ noise
7 datafusion:vortex-compact -23.5% +0.5% -23.8% +30.0% ✅ faster
7 datafusion:vortex-file-compressed -19.1% +0.5% -19.5% +30.0% ➖ noise
7 duckdb:vortex-compact +5.1% +0.5% +4.6% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -3.7% +0.5% -4.2% +30.0% ➖ noise
8 datafusion:vortex-compact +1.6% -0.5% +2.2% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -35.0% -0.5% -34.7% +31.9% ✅ faster
8 duckdb:vortex-compact +5.7% -0.5% +6.3% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +7.0% -0.5% +7.5% +30.0% ➖ noise
9 datafusion:vortex-compact +1.0% +3.1% -2.0% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -41.3% +3.1% -43.0% +30.0% ✅ faster
9 duckdb:vortex-compact -2.9% +3.1% -5.8% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +5.1% +3.1% +2.0% +30.0% ➖ noise
10 datafusion:vortex-compact +4.7% +1.4% +3.2% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -14.6% +1.4% -15.7% +30.0% ➖ noise
10 duckdb:vortex-compact -5.4% +1.4% -6.7% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +1.8% +1.4% +0.4% +30.0% ➖ noise
11 datafusion:vortex-compact -1.1% -11.2% +11.4% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +0.4% -11.2% +13.1% +30.0% ➖ noise
11 duckdb:vortex-compact +2.3% -11.2% +15.2% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -1.7% -11.2% +10.7% +30.0% ➖ noise
12 datafusion:vortex-compact -1.4% -4.2% +2.9% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -18.0% -4.2% -14.4% +30.0% ➖ noise
12 duckdb:vortex-compact +25.0% -4.2% +30.5% +30.0% 🚨 regression
12 duckdb:vortex-file-compressed +29.2% -4.2% +34.8% +30.0% 🚨 regression
13 datafusion:vortex-compact -14.5% +2.7% -16.7% +36.8% ➖ noise
13 datafusion:vortex-file-compressed -8.9% +2.7% -11.3% +31.9% ➖ noise
13 duckdb:vortex-compact -19.2% +2.7% -21.3% +30.7% ➖ noise
13 duckdb:vortex-file-compressed -12.1% +2.7% -14.4% +30.0% ➖ noise
14 datafusion:vortex-compact -3.2% -13.7% +12.2% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -10.2% -13.7% +4.0% +30.0% ➖ noise
14 duckdb:vortex-compact -19.3% -13.7% -6.5% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -30.3% -13.7% -19.2% +30.0% ➖ noise
15 datafusion:vortex-compact -7.8% -15.5% +9.1% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -9.5% -15.5% +7.2% +30.0% ➖ noise
15 duckdb:vortex-compact -1.1% -15.5% +17.1% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +8.9% -15.5% +29.0% +33.4% ➖ noise
16 datafusion:vortex-compact -12.8% -4.7% -8.5% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -24.5% -4.7% -20.8% +30.0% ➖ noise
16 duckdb:vortex-compact -17.8% -4.7% -13.8% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -12.0% -4.7% -7.6% +30.0% ➖ noise
17 datafusion:vortex-compact +4.2% -9.1% +14.6% +33.0% ➖ noise
17 datafusion:vortex-file-compressed -17.5% -9.1% -9.2% +30.0% ➖ noise
17 duckdb:vortex-compact -15.2% -9.1% -6.7% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -27.0% -9.1% -19.6% +30.0% ➖ noise
18 datafusion:vortex-compact -15.1% -4.4% -11.2% +31.4% ➖ noise
18 datafusion:vortex-file-compressed -11.9% -4.4% -7.8% +30.0% ➖ noise
18 duckdb:vortex-compact -16.2% -4.4% -12.3% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +3.0% -4.4% +7.8% +30.0% ➖ noise
19 datafusion:vortex-compact -3.1% -4.2% +1.1% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +9.5% -4.2% +14.2% +30.0% ➖ noise
19 duckdb:vortex-compact +7.9% -4.2% +12.5% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +11.9% -4.2% +16.7% +30.0% ➖ noise
20 datafusion:vortex-compact -8.6% -4.3% -4.5% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +5.1% -4.3% +9.8% +30.0% ➖ noise
20 duckdb:vortex-compact -10.5% -4.3% -6.5% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -9.5% -4.3% -5.5% +30.0% ➖ noise
21 datafusion:vortex-compact -9.0% -3.6% -5.7% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +2.6% -3.6% +6.4% +30.0% ➖ noise
21 duckdb:vortex-compact -4.3% -3.6% -0.8% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -0.9% -3.6% +2.8% +30.0% ➖ noise
22 datafusion:vortex-compact -5.0% -10.0% +5.5% +30.0% ➖ noise
22 datafusion:vortex-file-compressed +2.0% -10.0% +13.3% +30.0% ➖ noise
22 duckdb:vortex-compact -18.5% -10.0% -9.4% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -19.1% -10.0% -10.1% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.5%
Vortex (geomean): 0.983x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.7%


duckdb / vortex-file-compressed (0.973x ➖, 1↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11587775 11273260 1.03
statpopgen_q01/duckdb:vortex-file-compressed 🚀 20280399 27873472 0.73
statpopgen_q02/duckdb:vortex-file-compressed 1377508984 1385316652 0.99
statpopgen_q03/duckdb:vortex-file-compressed 3140810760 3187771049 0.99
statpopgen_q04/duckdb:vortex-file-compressed 3146539170 3167296708 0.99
statpopgen_q05/duckdb:vortex-file-compressed 1472049552 1463503181 1.01
statpopgen_q06/duckdb:vortex-file-compressed 2127712789 2154656842 0.99
statpopgen_q07/duckdb:vortex-file-compressed 216153416 200347103 1.08
statpopgen_q08/duckdb:vortex-file-compressed 240856886 241594642 1.00
statpopgen_q09/duckdb:vortex-file-compressed 2892023315 3022492672 0.96
statpopgen_q10/duckdb:vortex-file-compressed 4715869087 4744606030 0.99
duckdb / vortex-compact (0.993x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11173805 11463403 0.97
statpopgen_q01/duckdb:vortex-compact 166564442 168429969 0.99
statpopgen_q02/duckdb:vortex-compact 1826173567 1840328315 0.99
statpopgen_q03/duckdb:vortex-compact 3530873741 3582325612 0.99
statpopgen_q04/duckdb:vortex-compact 3559088215 3558240928 1.00
statpopgen_q05/duckdb:vortex-compact 1873673669 1901623960 0.99
statpopgen_q06/duckdb:vortex-compact 2690691135 2714458368 0.99
statpopgen_q07/duckdb:vortex-compact 895304709 885443135 1.01
statpopgen_q08/duckdb:vortex-compact 923607023 918411753 1.01
statpopgen_q09/duckdb:vortex-compact 3335818878 3341486931 1.00
statpopgen_q10/duckdb:vortex-compact 5363127467 5403380024 0.99
duckdb / parquet (0.998x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 324425431 327627018 0.99
statpopgen_q01/duckdb:parquet 407551578 407389220 1.00
statpopgen_q02/duckdb:parquet 997544933 1002872465 0.99
statpopgen_q03/duckdb:parquet 1507545941 1520396339 0.99
statpopgen_q04/duckdb:parquet 1505475175 1520809575 0.99
statpopgen_q05/duckdb:parquet 1010399318 1004102067 1.01
statpopgen_q06/duckdb:parquet 1492544016 1496723322 1.00
statpopgen_q07/duckdb:parquet 1314287680 1300281025 1.01
statpopgen_q08/duckdb:parquet 1334174373 1308782958 1.02
statpopgen_q09/duckdb:parquet 1378742935 1389029871 0.99
statpopgen_q10/duckdb:parquet 2657703152 2697188308 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -2.5% -1.0% -1.6% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +2.8% -1.0% +3.8% +10.0% ➖ noise
1 duckdb:vortex-compact -1.1% +0.0% -1.1% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -27.2% +0.0% -27.3% +195.8% ➖ noise
2 duckdb:vortex-compact -0.8% -0.5% -0.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -0.6% -0.5% -0.0% +10.0% ➖ noise
3 duckdb:vortex-compact -1.4% -0.8% -0.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.5% -0.8% -0.6% +10.0% ➖ noise
4 duckdb:vortex-compact +0.0% -1.0% +1.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.7% -1.0% +0.4% +10.0% ➖ noise
5 duckdb:vortex-compact -1.5% +0.6% -2.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.6% +0.6% -0.0% +10.0% ➖ noise
6 duckdb:vortex-compact -0.9% -0.3% -0.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.3% -0.3% -1.0% +10.0% ➖ noise
7 duckdb:vortex-compact +1.1% +1.1% +0.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +7.9% +1.1% +6.7% +10.0% ➖ noise
8 duckdb:vortex-compact +0.6% +1.9% -1.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.3% +1.9% -2.2% +10.0% ➖ noise
9 duckdb:vortex-compact -0.2% -0.7% +0.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -4.3% -0.7% -3.6% +10.0% ➖ noise
10 duckdb:vortex-compact -0.7% -1.5% +0.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.6% -1.5% +0.9% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Vortex (geomean): 1.001x ➖
Parquet (geomean): 1.013x ➖
Shifts: Parquet (control) +1.3% · Median polish +2.1%


datafusion / vortex-file-compressed (1.026x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1677741 1682272 1.00
clickbench_q01/datafusion:vortex-file-compressed 19670427 18615658 1.06
clickbench_q02/datafusion:vortex-file-compressed 38018410 36570398 1.04
clickbench_q03/datafusion:vortex-file-compressed 44390374 42530427 1.04
clickbench_q04/datafusion:vortex-file-compressed 290825636 280396288 1.04
clickbench_q05/datafusion:vortex-file-compressed 312057812 294569918 1.06
clickbench_q06/datafusion:vortex-file-compressed 1637021 1673912 0.98
clickbench_q07/datafusion:vortex-file-compressed 22667431 21722520 1.04
clickbench_q08/datafusion:vortex-file-compressed 371553036 347866720 1.07
clickbench_q09/datafusion:vortex-file-compressed 548977534 546860812 1.00
clickbench_q10/datafusion:vortex-file-compressed 76214997 74643908 1.02
clickbench_q11/datafusion:vortex-file-compressed 86350807 83702296 1.03
clickbench_q12/datafusion:vortex-file-compressed 267022233 261777410 1.02
clickbench_q13/datafusion:vortex-file-compressed 416344560 402380101 1.03
clickbench_q14/datafusion:vortex-file-compressed 254235181 249552885 1.02
clickbench_q15/datafusion:vortex-file-compressed 340734686 318403875 1.07
clickbench_q16/datafusion:vortex-file-compressed 664231641 632459589 1.05
clickbench_q17/datafusion:vortex-file-compressed 643291994 630130337 1.02
clickbench_q18/datafusion:vortex-file-compressed 1364173416 1308676504 1.04
clickbench_q19/datafusion:vortex-file-compressed 37020887 35628444 1.04
clickbench_q20/datafusion:vortex-file-compressed 337756086 338722319 1.00
clickbench_q21/datafusion:vortex-file-compressed 370271971 362213945 1.02
clickbench_q22/datafusion:vortex-file-compressed 445609446 440402837 1.01
clickbench_q23/datafusion:vortex-file-compressed 641154944 640810385 1.00
clickbench_q24/datafusion:vortex-file-compressed 44758803 45233690 0.99
clickbench_q25/datafusion:vortex-file-compressed 73543862 68575648 1.07
clickbench_q26/datafusion:vortex-file-compressed 46786150 43830020 1.07
clickbench_q27/datafusion:vortex-file-compressed 705737601 731503473 0.96
clickbench_q28/datafusion:vortex-file-compressed 6728960673 6606476773 1.02
clickbench_q29/datafusion:vortex-file-compressed 229214298 233840872 0.98
clickbench_q30/datafusion:vortex-file-compressed 220308569 218871170 1.01
clickbench_q31/datafusion:vortex-file-compressed 257988856 249248826 1.04
clickbench_q32/datafusion:vortex-file-compressed 1132314653 1129722327 1.00
clickbench_q33/datafusion:vortex-file-compressed 1300517641 1269414844 1.02
clickbench_q34/datafusion:vortex-file-compressed 1290228542 1260763292 1.02
clickbench_q35/datafusion:vortex-file-compressed 465569791 456037059 1.02
clickbench_q36/datafusion:vortex-file-compressed 70103117 70483552 0.99
clickbench_q37/datafusion:vortex-file-compressed 35330071 34321861 1.03
clickbench_q38/datafusion:vortex-file-compressed 19379684 18325144 1.06
clickbench_q39/datafusion:vortex-file-compressed 134449311 129563930 1.04
clickbench_q40/datafusion:vortex-file-compressed 16144450 15769774 1.02
clickbench_q41/datafusion:vortex-file-compressed 14956688 14385573 1.04
clickbench_q42/datafusion:vortex-file-compressed 17326893 16628592 1.04
datafusion / parquet (1.019x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1529715 1533578 1.00
clickbench_q01/datafusion:parquet 18695487 19253707 0.97
clickbench_q02/datafusion:parquet 46205174 45990399 1.00
clickbench_q03/datafusion:parquet 37692096 37008556 1.02
clickbench_q04/datafusion:parquet 293017428 293327373 1.00
clickbench_q05/datafusion:parquet 355539442 340478729 1.04
clickbench_q06/datafusion:parquet 1539615 1546131 1.00
clickbench_q07/datafusion:parquet 21880961 21885725 1.00
clickbench_q08/datafusion:parquet 374226093 362953323 1.03
clickbench_q09/datafusion:parquet 624931927 610617326 1.02
clickbench_q10/datafusion:parquet 105317160 102940851 1.02
clickbench_q11/datafusion:parquet 131087109 128506280 1.02
clickbench_q12/datafusion:parquet 353541567 340250822 1.04
clickbench_q13/datafusion:parquet 487286908 481695617 1.01
clickbench_q14/datafusion:parquet 348479468 336449427 1.04
clickbench_q15/datafusion:parquet 340862319 338601604 1.01
clickbench_q16/datafusion:parquet 663319279 646665507 1.03
clickbench_q17/datafusion:parquet 654094065 629542447 1.04
clickbench_q18/datafusion:parquet 1312785559 1324305344 0.99
clickbench_q19/datafusion:parquet 29335616 29120930 1.01
clickbench_q20/datafusion:parquet 618045194 592464784 1.04
clickbench_q21/datafusion:parquet 672988109 647250284 1.04
clickbench_q22/datafusion:parquet 966307200 963305122 1.00
clickbench_q23/datafusion:parquet 3630721381 3590884273 1.01
clickbench_q24/datafusion:parquet 82233771 77196985 1.07
clickbench_q25/datafusion:parquet 134004251 130660589 1.03
clickbench_q26/datafusion:parquet 81796084 80735100 1.01
clickbench_q27/datafusion:parquet 1050526647 1042234317 1.01
clickbench_q28/datafusion:parquet 6672201578 6384641905 1.05
clickbench_q29/datafusion:parquet 237840864 246181861 0.97
clickbench_q30/datafusion:parquet 327750768 316018842 1.04
clickbench_q31/datafusion:parquet 363976955 354530857 1.03
clickbench_q32/datafusion:parquet 1208570882 1150814780 1.05
clickbench_q33/datafusion:parquet 1473112341 1436344850 1.03
clickbench_q34/datafusion:parquet 1473060011 1429754026 1.03
clickbench_q35/datafusion:parquet 459188170 449943912 1.02
clickbench_q36/datafusion:parquet 140474836 144962395 0.97
clickbench_q37/datafusion:parquet 56033529 56318339 0.99
clickbench_q38/datafusion:parquet 84348199 80558347 1.05
clickbench_q39/datafusion:parquet 264520803 254917090 1.04
clickbench_q40/datafusion:parquet 30369113 29400720 1.03
clickbench_q41/datafusion:parquet 28387507 27708834 1.02
clickbench_q42/datafusion:parquet 29885695 29158772 1.02
duckdb / vortex-file-compressed (0.976x ➖, 7↑ 3↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚨 6587017 5914475 1.11
clickbench_q01/duckdb:vortex-file-compressed 12598572 12815303 0.98
clickbench_q02/duckdb:vortex-file-compressed 26246283 24070821 1.09
clickbench_q03/duckdb:vortex-file-compressed 29618480 28853029 1.03
clickbench_q04/duckdb:vortex-file-compressed 181905473 180817391 1.01
clickbench_q05/duckdb:vortex-file-compressed 174544646 170113135 1.03
clickbench_q06/duckdb:vortex-file-compressed 20903508 20272691 1.03
clickbench_q07/duckdb:vortex-file-compressed 🚨 15692116 13725562 1.14
clickbench_q08/duckdb:vortex-file-compressed 258133184 256363182 1.01
clickbench_q09/duckdb:vortex-file-compressed 338692037 331011713 1.02
clickbench_q10/duckdb:vortex-file-compressed 66736350 64172097 1.04
clickbench_q11/duckdb:vortex-file-compressed 75921728 73981472 1.03
clickbench_q12/duckdb:vortex-file-compressed 189314316 184903875 1.02
clickbench_q13/duckdb:vortex-file-compressed 398362230 392853774 1.01
clickbench_q14/duckdb:vortex-file-compressed 224705024 220936654 1.02
clickbench_q15/duckdb:vortex-file-compressed 240232560 240889975 1.00
clickbench_q16/duckdb:vortex-file-compressed 585376844 569898435 1.03
clickbench_q17/duckdb:vortex-file-compressed 474722986 460008088 1.03
clickbench_q18/duckdb:vortex-file-compressed 983185813 958774632 1.03
clickbench_q19/duckdb:vortex-file-compressed 21160097 20344517 1.04
clickbench_q20/duckdb:vortex-file-compressed 323212019 336759604 0.96
clickbench_q21/duckdb:vortex-file-compressed 357700464 356756593 1.00
clickbench_q22/duckdb:vortex-file-compressed 524137253 547759263 0.96
clickbench_q23/duckdb:vortex-file-compressed 🚀 245425647 303659494 0.81
clickbench_q24/duckdb:vortex-file-compressed 🚨 39114336 34331198 1.14
clickbench_q25/duckdb:vortex-file-compressed 66746966 67892127 0.98
clickbench_q26/duckdb:vortex-file-compressed 49390107 45536233 1.08
clickbench_q27/duckdb:vortex-file-compressed 460092281 458036724 1.00
clickbench_q28/duckdb:vortex-file-compressed 2979216461 2957600454 1.01
clickbench_q29/duckdb:vortex-file-compressed 28257025 27016697 1.05
clickbench_q30/duckdb:vortex-file-compressed 187716924 179586456 1.05
clickbench_q31/duckdb:vortex-file-compressed 278453193 266254252 1.05
clickbench_q32/duckdb:vortex-file-compressed 1181335176 1117116068 1.06
clickbench_q33/duckdb:vortex-file-compressed 1126495043 1131092040 1.00
clickbench_q34/duckdb:vortex-file-compressed 1209275377 1188220480 1.02
clickbench_q35/duckdb:vortex-file-compressed 377867400 379463517 1.00
clickbench_q36/duckdb:vortex-file-compressed 🚀 24084659 28936983 0.83
clickbench_q37/duckdb:vortex-file-compressed 🚀 15591745 22069002 0.71
clickbench_q38/duckdb:vortex-file-compressed 🚀 17814461 23265516 0.77
clickbench_q39/duckdb:vortex-file-compressed 36954499 40387869 0.91
clickbench_q40/duckdb:vortex-file-compressed 🚀 15499608 22772479 0.68
clickbench_q41/duckdb:vortex-file-compressed 🚀 17066356 22015874 0.78
clickbench_q42/duckdb:vortex-file-compressed 🚀 17262227 23389210 0.74
duckdb / parquet (1.007x ➖, 0↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 25626862 27987513 0.92
clickbench_q01/duckdb:parquet 27708755 27216060 1.02
clickbench_q02/duckdb:parquet 48815090 49655533 0.98
clickbench_q03/duckdb:parquet 38280454 38037056 1.01
clickbench_q04/duckdb:parquet 201947749 200381535 1.01
clickbench_q05/duckdb:parquet 270894981 264646049 1.02
clickbench_q06/duckdb:parquet 45998734 45702719 1.01
clickbench_q07/duckdb:parquet 29171852 29438197 0.99
clickbench_q08/duckdb:parquet 267439925 263251362 1.02
clickbench_q09/duckdb:parquet 396234547 392722102 1.01
clickbench_q10/duckdb:parquet 79674961 80898488 0.98
clickbench_q11/duckdb:parquet 100831529 98094934 1.03
clickbench_q12/duckdb:parquet 290320113 292302868 0.99
clickbench_q13/duckdb:parquet 480983508 475448532 1.01
clickbench_q14/duckdb:parquet 320516764 328546358 0.98
clickbench_q15/duckdb:parquet 257437619 254777938 1.01
clickbench_q16/duckdb:parquet 645885825 639787673 1.01
clickbench_q17/duckdb:parquet 535875682 529256134 1.01
clickbench_q18/duckdb:parquet 1085509940 1062469878 1.02
clickbench_q19/duckdb:parquet 26399010 24987876 1.06
clickbench_q20/duckdb:parquet 426344330 420650775 1.01
clickbench_q21/duckdb:parquet 545361536 539992601 1.01
clickbench_q22/duckdb:parquet 930091997 928933542 1.00
clickbench_q23/duckdb:parquet 314009045 307529669 1.02
clickbench_q24/duckdb:parquet 66382302 69374525 0.96
clickbench_q25/duckdb:parquet 156536060 156105274 1.00
clickbench_q26/duckdb:parquet 51213960 50093242 1.02
clickbench_q27/duckdb:parquet 642393597 647124864 0.99
clickbench_q28/duckdb:parquet 4834360048 4819150514 1.00
clickbench_q29/duckdb:parquet 40879019 40121485 1.02
clickbench_q30/duckdb:parquet 304390103 302531887 1.01
clickbench_q31/duckdb:parquet 362690053 360910225 1.00
clickbench_q32/duckdb:parquet 1172921016 1145127304 1.02
clickbench_q33/duckdb:parquet 1241445654 1205118732 1.03
clickbench_q34/duckdb:parquet 1270893116 1260070285 1.01
clickbench_q35/duckdb:parquet 360716550 361891588 1.00
clickbench_q36/duckdb:parquet 46509058 47265849 0.98
clickbench_q37/duckdb:parquet 30604186 31120999 0.98
clickbench_q38/duckdb:parquet 35728585 33445028 1.07
clickbench_q39/duckdb:parquet 86997546 82806673 1.05
clickbench_q40/duckdb:parquet 17729930 17724080 1.00
clickbench_q41/duckdb:parquet 18383822 18243836 1.01
clickbench_q42/duckdb:parquet 22117910 21778866 1.02
duckdb / duckdb (1.033x ➖, 0↑ 3↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18301089 17788110 1.03
clickbench_q01/duckdb:duckdb 34441490 31869274 1.08
clickbench_q02/duckdb:duckdb 45914665 44204245 1.04
clickbench_q03/duckdb:duckdb 47863729 45758312 1.05
clickbench_q04/duckdb:duckdb 190010043 189261349 1.00
clickbench_q05/duckdb:duckdb 266954131 263976471 1.01
clickbench_q06/duckdb:duckdb 🚨 36724128 27931838 1.31
clickbench_q07/duckdb:duckdb 36936526 33972137 1.09
clickbench_q08/duckdb:duckdb 250397560 254557271 0.98
clickbench_q09/duckdb:duckdb 377264579 366968061 1.03
clickbench_q10/duckdb:duckdb 99789108 97514317 1.02
clickbench_q11/duckdb:duckdb 109280290 107042134 1.02
clickbench_q12/duckdb:duckdb 238044307 238934682 1.00
clickbench_q13/duckdb:duckdb 463329775 444671461 1.04
clickbench_q14/duckdb:duckdb 272119585 271810691 1.00
clickbench_q15/duckdb:duckdb 222144503 217977739 1.02
clickbench_q16/duckdb:duckdb 624975306 616870783 1.01
clickbench_q17/duckdb:duckdb 550441403 537921353 1.02
clickbench_q18/duckdb:duckdb 1170493885 1143433682 1.02
clickbench_q19/duckdb:duckdb 36520671 34169045 1.07
clickbench_q20/duckdb:duckdb 🚨 961957205 834914309 1.15
clickbench_q21/duckdb:duckdb 🚨 958836792 868062126 1.10
clickbench_q22/duckdb:duckdb 1048996319 996331839 1.05
clickbench_q23/duckdb:duckdb 260448455 254868827 1.02
clickbench_q24/duckdb:duckdb 61527587 61398949 1.00
clickbench_q25/duckdb:duckdb 142538929 141993021 1.00
clickbench_q26/duckdb:duckdb 60971353 60030507 1.02
clickbench_q27/duckdb:duckdb 926849631 901556110 1.03
clickbench_q28/duckdb:duckdb 4618285526 4647440137 0.99
clickbench_q29/duckdb:duckdb 49418331 47516493 1.04
clickbench_q30/duckdb:duckdb 260570124 260672088 1.00
clickbench_q31/duckdb:duckdb 434105811 427421518 1.02
clickbench_q32/duckdb:duckdb 1405461916 1494919524 0.94
clickbench_q33/duckdb:duckdb 1861251392 1959205297 0.95
clickbench_q34/duckdb:duckdb 1995215078 2047824771 0.97
clickbench_q35/duckdb:duckdb 284023974 272202684 1.04
clickbench_q36/duckdb:duckdb 43021774 41506784 1.04
clickbench_q37/duckdb:duckdb 33209739 31037611 1.07
clickbench_q38/duckdb:duckdb 31962581 30229022 1.06
clickbench_q39/duckdb:duckdb 65052936 67685243 0.96
clickbench_q40/duckdb:duckdb 33117585 31270310 1.06
clickbench_q41/duckdb:duckdb 31854812 29921065 1.06
clickbench_q42/duckdb:duckdb 32712600 30808218 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -0.3% -4.4% +4.4% +773.1% ➖ noise
0 duckdb:duckdb +2.9% -4.4% +7.7% +288.5% ➖ noise
0 duckdb:vortex-file-compressed +11.4% -4.4% +16.5% +483.3% ➖ noise
1 datafusion:vortex-file-compressed +5.7% -0.6% +6.3% +22.4% ➖ noise
1 duckdb:duckdb +8.1% -0.6% +8.7% +58.9% ➖ noise
1 duckdb:vortex-file-compressed -1.7% -0.6% -1.1% +25.7% ➖ noise
2 datafusion:vortex-file-compressed +4.0% -0.6% +4.6% +17.4% ➖ noise
2 duckdb:duckdb +3.9% -0.6% +4.5% +21.1% ➖ noise
2 duckdb:vortex-file-compressed +9.0% -0.6% +9.7% +11.5% ➖ noise
3 datafusion:vortex-file-compressed +4.4% +1.2% +3.1% +142.6% ➖ noise
3 duckdb:duckdb +4.6% +1.2% +3.3% +42.2% ➖ noise
3 duckdb:vortex-file-compressed +2.7% +1.2% +1.4% +67.0% ➖ noise
4 datafusion:vortex-file-compressed +3.7% +0.3% +3.4% +10.0% ➖ noise
4 duckdb:duckdb +0.4% +0.3% +0.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.6% +0.3% +0.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +5.9% +3.4% +2.5% +10.0% ➖ noise
5 duckdb:duckdb +1.1% +3.4% -2.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.6% +3.4% -0.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -2.2% +0.1% -2.3% +120.1% ➖ noise
6 duckdb:duckdb +31.5% +0.1% +31.3% +30.2% 🚨 regression
6 duckdb:vortex-file-compressed +3.1% +0.1% +3.0% +19.5% ➖ noise
7 datafusion:vortex-file-compressed +4.3% -0.5% +4.8% +12.6% ➖ noise
7 duckdb:duckdb +8.7% -0.5% +9.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +14.3% -0.5% +14.9% +10.4% 🚨 regression
8 datafusion:vortex-file-compressed +6.8% +2.3% +4.4% +10.0% ➖ noise
8 duckdb:duckdb -1.6% +2.3% -3.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.7% +2.3% -1.6% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +0.4% +1.6% -1.2% +10.0% ➖ noise
9 duckdb:duckdb +2.8% +1.6% +1.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +2.3% +1.6% +0.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +2.1% +0.4% +1.7% +10.0% ➖ noise
10 duckdb:duckdb +2.3% +0.4% +1.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +4.0% +0.4% +3.6% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +3.2% +2.4% +0.7% +10.0% ➖ noise
11 duckdb:duckdb +2.1% +2.4% -0.3% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +2.6% +2.4% +0.2% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +2.0% +1.6% +0.4% +10.0% ➖ noise
12 duckdb:duckdb -0.4% +1.6% -1.9% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +2.4% +1.6% +0.8% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +3.5% +1.2% +2.3% +10.0% ➖ noise
13 duckdb:duckdb +4.2% +1.2% +3.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +1.4% +1.2% +0.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +1.9% +0.5% +1.3% +10.0% ➖ noise
14 duckdb:duckdb +0.1% +0.5% -0.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +1.7% +0.5% +1.2% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +7.0% +0.9% +6.1% +10.0% ➖ noise
15 duckdb:duckdb +1.9% +0.9% +1.0% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.3% +0.9% -1.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +5.0% +1.8% +3.2% +10.0% ➖ noise
16 duckdb:duckdb +1.3% +1.8% -0.4% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +2.7% +1.8% +0.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +2.1% +2.6% -0.5% +10.0% ➖ noise
17 duckdb:duckdb +2.3% +2.6% -0.2% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +3.2% +2.6% +0.6% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +4.2% +0.6% +3.6% +10.0% ➖ noise
18 duckdb:duckdb +2.4% +0.6% +1.7% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +2.5% +0.6% +1.9% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +3.9% +3.2% +0.7% +25.9% ➖ noise
19 duckdb:duckdb +6.9% +3.2% +3.6% +12.2% ➖ noise
19 duckdb:vortex-file-compressed +4.0% +3.2% +0.8% +17.2% ➖ noise
20 datafusion:vortex-file-compressed -0.3% +2.8% -3.0% +209.3% ➖ noise
20 duckdb:duckdb +15.2% +2.8% +12.1% +30.6% ➖ noise
20 duckdb:vortex-file-compressed -4.0% +2.8% -6.7% +28.4% ➖ noise
21 datafusion:vortex-file-compressed +2.2% +2.5% -0.2% +10.0% ➖ noise
21 duckdb:duckdb +10.5% +2.5% +7.8% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +0.3% +2.5% -2.2% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +1.2% +0.2% +1.0% +15.9% ➖ noise
22 duckdb:duckdb +5.3% +0.2% +5.1% +17.3% ➖ noise
22 duckdb:vortex-file-compressed -4.3% +0.2% -4.5% +19.5% ➖ noise
23 datafusion:vortex-file-compressed +0.1% +1.6% -1.5% +45.8% ➖ noise
23 duckdb:duckdb +2.2% +1.6% +0.6% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -19.2% +1.6% -20.5% +10.0% ✅ faster
24 datafusion:vortex-file-compressed -1.0% +1.0% -2.0% +10.0% ➖ noise
24 duckdb:duckdb +0.2% +1.0% -0.7% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +13.9% +1.0% +12.8% +22.3% ➖ noise
25 datafusion:vortex-file-compressed +7.2% +1.4% +5.8% +10.0% ➖ noise
25 duckdb:duckdb +0.4% +1.4% -1.0% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -1.7% +1.4% -3.1% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +6.7% +1.8% +4.9% +13.1% ➖ noise
26 duckdb:duckdb +1.6% +1.8% -0.2% +12.3% ➖ noise
26 duckdb:vortex-file-compressed +8.5% +1.8% +6.6% +15.1% ➖ noise
27 datafusion:vortex-file-compressed -3.5% +0.0% -3.6% +10.0% ➖ noise
27 duckdb:duckdb +2.8% +0.0% +2.8% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +0.4% +0.0% +0.4% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +1.9% +2.4% -0.5% +10.0% ➖ noise
28 duckdb:duckdb -0.6% +2.4% -2.9% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.7% +2.4% -1.6% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -2.0% -0.8% -1.2% +10.0% ➖ noise
29 duckdb:duckdb +4.0% -0.8% +4.8% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +4.6% -0.8% +5.4% +30.7% ➖ noise
30 datafusion:vortex-file-compressed +0.7% +2.2% -1.5% +10.0% ➖ noise
30 duckdb:duckdb -0.0% +2.2% -2.1% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +4.5% +2.2% +2.3% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +3.5% +1.6% +1.9% +10.0% ➖ noise
31 duckdb:duckdb +1.6% +1.6% -0.0% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +4.6% +1.6% +3.0% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +0.2% +3.7% -3.4% +13.0% ➖ noise
32 duckdb:duckdb -6.0% +3.7% -9.4% +10.0% ✅ faster
32 duckdb:vortex-file-compressed +5.7% +3.7% +2.0% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +2.5% +2.8% -0.3% +10.0% ➖ noise
33 duckdb:duckdb -5.0% +2.8% -7.6% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -0.4% +2.8% -3.1% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +2.3% +1.9% +0.4% +10.0% ➖ noise
34 duckdb:duckdb -2.6% +1.9% -4.4% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +1.8% +1.9% -0.2% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +2.1% +0.9% +1.2% +10.0% ➖ noise
35 duckdb:duckdb +4.3% +0.9% +3.5% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -0.4% +0.9% -1.3% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -0.5% -2.4% +1.9% +10.0% ➖ noise
36 duckdb:duckdb +3.6% -2.4% +6.1% +12.0% ➖ noise
36 duckdb:vortex-file-compressed -16.8% -2.4% -14.8% +11.6% ✅ faster
37 datafusion:vortex-file-compressed +2.9% -1.1% +4.1% +10.0% ➖ noise
37 duckdb:duckdb +7.0% -1.1% +8.2% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -29.4% -1.1% -28.6% +11.4% ✅ faster
38 datafusion:vortex-file-compressed +5.8% +5.8% -0.0% +11.7% ➖ noise
38 duckdb:duckdb +5.7% +5.8% -0.0% +11.4% ➖ noise
38 duckdb:vortex-file-compressed -23.4% +5.8% -27.6% +13.8% ✅ faster
39 datafusion:vortex-file-compressed +3.8% +4.4% -0.6% +10.0% ➖ noise
39 duckdb:duckdb -3.9% +4.4% -8.0% +13.5% ➖ noise
39 duckdb:vortex-file-compressed -8.5% +4.4% -12.4% +11.7% ✅ faster
40 datafusion:vortex-file-compressed +2.4% +1.7% +0.7% +10.4% ➖ noise
40 duckdb:duckdb +5.9% +1.7% +4.2% +14.1% ➖ noise
40 duckdb:vortex-file-compressed -31.9% +1.7% -33.0% +10.0% ✅ faster
41 datafusion:vortex-file-compressed +4.0% +1.6% +2.3% +10.0% ➖ noise
41 duckdb:duckdb +6.5% +1.6% +4.8% +11.1% ➖ noise
41 duckdb:vortex-file-compressed -22.5% +1.6% -23.7% +15.5% ✅ faster
42 datafusion:vortex-file-compressed +4.2% +2.0% +2.1% +10.0% ➖ noise
42 duckdb:duckdb +6.2% +2.0% +4.1% +10.0% ➖ noise
42 duckdb:vortex-file-compressed -26.2% +2.0% -27.7% +10.4% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-H SF=10 on S3 failed! Check the workflow run for details.

Signed-off-by: Mikhail Kot <to@myrrc.dev>
@myrrc myrrc force-pushed the myrrc/duckdb-pushdown-expression branch from 75bbb15 to 7736c90 Compare May 11, 2026 13:44
@myrrc myrrc added action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels May 11, 2026
@github-actions github-actions Bot removed action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels May 11, 2026
@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@myrrc myrrc added action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels May 12, 2026
@github-actions github-actions Bot removed action/benchmark-sql Trigger SQL benchmarks to run on this PR action/benchmark Trigger full benchmarks to run on this PR labels May 12, 2026
@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.892x ✅
Parquet (geomean): 0.943x ➖


unknown / unknown (0.923x ➖, 16↑ 0↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 2019859 2695649 0.75
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1450560 1542383 0.94
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8319597653 8238725416 1.01
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8339739715 8214965002 1.02
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7519798 7854776 0.96
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 6517633 7538501 0.86
random-access/feature-vectors/uniform/lance-tokio-local-disk 5749649 5957859 0.97
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 6511780 6805859 0.96
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8386511181 8277938973 1.01
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8400826589 8368079416 1.00
random-access/feature-vectors/uniform/vortex-tokio-local-disk 12867820 13709995 0.94
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 12715136 13510489 0.94
random-access/lance-tokio-local-disk 746321 786990 0.95
random-access/lance-tokio-local-disk-footer 1300250 1395322 0.93
random-access/nested-lists/correlated/lance-tokio-local-disk 247754 259407 0.96
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 619967 672596 0.92
random-access/nested-lists/correlated/parquet-tokio-local-disk 129978580 132533290 0.98
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 129390421 132184748 0.98
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 552979 655508 0.84
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 557375 638157 0.87
random-access/nested-lists/uniform/lance-tokio-local-disk 1102063 1149860 0.96
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1478767 1568086 0.94
random-access/nested-lists/uniform/parquet-tokio-local-disk 129332981 132261233 0.98
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 129287859 131885018 0.98
random-access/nested-lists/uniform/vortex-tokio-local-disk 2077658 2178648 0.95
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2055717 2158106 0.95
random-access/nested-structs/correlated/lance-tokio-local-disk 393076 413118 0.95
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 589861 635486 0.93
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚀 20253862 23682235 0.86
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚀 20201578 23732919 0.85
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚀 716262 814358 0.88
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚀 722875 810454 0.89
random-access/nested-structs/uniform/lance-tokio-local-disk 2716300 2808015 0.97
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2935446 3042508 0.96
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚀 20085494 23763295 0.85
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚀 20104588 23649194 0.85
random-access/nested-structs/uniform/vortex-tokio-local-disk 1602379 1746711 0.92
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1611707 1751059 0.92
random-access/parquet-tokio-local-disk 164690702 175452722 0.94
random-access/parquet-tokio-local-disk-footer 164142784 174621918 0.94
random-access/taxi/correlated/lance-tokio-local-disk 932329 990884 0.94
random-access/taxi/correlated/lance-tokio-local-disk-footer 1562911 1689318 0.93
random-access/taxi/correlated/parquet-tokio-local-disk 246444634 261622122 0.94
random-access/taxi/correlated/parquet-tokio-local-disk-footer 246314713 262665740 0.94
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1526624 1962941 0.78
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1686019 1990541 0.85
random-access/taxi/uniform/lance-tokio-local-disk 9587888 9926745 0.97
random-access/taxi/uniform/lance-tokio-local-disk-footer 10281158 10637464 0.97
random-access/taxi/uniform/parquet-tokio-local-disk 261050629 278250858 0.94
random-access/taxi/uniform/parquet-tokio-local-disk-footer 261895400 278731295 0.94
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4380720 4917690 0.89
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4344513 4842216 0.90
random-access/vortex-tokio-local-disk 🚀 1157473 1348864 0.86
random-access/vortex-tokio-local-disk-footer 🚀 1171497 1355850 0.86

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.000x ➖
Parquet (geomean): 0.997x ➖


unknown / unknown (0.996x ➖, 1↑ 1↓)
name PR 7b2bcbe (ns) base 2ee2033 (ns) ratio (PR/base)
compress time/Arade 1193504580 1181909857 1.01
compress time/Bimbo 6901316280 7117784003 0.97
compress time/CMSprovider 2891104347 2929841566 0.99
compress time/Euro2016 443422114 446490647 0.99
compress time/Food 393201883 400620957 0.98
compress time/HashTags 823602120 858114144 0.96
compress time/TPC-H l_comment canonical 1337448774 1331098371 1.00
compress time/TPC-H l_comment chunked 1346142529 1368591407 0.98
compress time/taxi 734553071 752347098 0.98
compress time/wide table cols=100 chunks=1 rows=1000 12866115 12738052 1.01
compress time/wide table cols=100 chunks=50 rows=1000 🚨 13281860 11995985 1.11
compress time/wide table cols=1000 chunks=1 rows=1000 134388223 135376700 0.99
compress time/wide table cols=1000 chunks=50 rows=1000 132392540 130927304 1.01
compress time/wide table cols=10000 chunks=1 rows=1000 1518208553 1503538913 1.01
compress time/wide table cols=10000 chunks=50 rows=1000 1505213624 1488760211 1.01
decompress time/Arade 29732441 27844020 1.07
decompress time/Bimbo 88223658 89049070 0.99
decompress time/CMSprovider 83343318 83745402 1.00
decompress time/Euro2016 19584183 19888936 0.98
decompress time/Food 8524499 7761056 1.10
decompress time/HashTags 74248365 75638696 0.98
decompress time/TPC-H l_comment canonical 39912677 42520271 0.94
decompress time/TPC-H l_comment chunked 41742217 44905369 0.93
decompress time/taxi 15701722 16362592 0.96
decompress time/wide table cols=100 chunks=1 rows=1000 2734899 2815442 0.97
decompress time/wide table cols=100 chunks=50 rows=1000 2784274 2878858 0.97
decompress time/wide table cols=1000 chunks=1 rows=1000 25306159 25283685 1.00
decompress time/wide table cols=1000 chunks=50 rows=1000 25870143 25473691 1.02
decompress time/wide table cols=10000 chunks=1 rows=1000 274706058 296887816 0.93
decompress time/wide table cols=10000 chunks=50 rows=1000 🚀 272350097 302642584 0.90
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2660562222 2650549232 1.00
parquet_rs-zstd compress time/Bimbo 12924769929 13138204801 0.98
parquet_rs-zstd compress time/CMSprovider 7309446187 7388756970 0.99
parquet_rs-zstd compress time/Euro2016 1350715341 1392583276 0.97
parquet_rs-zstd compress time/Food 810475413 806092304 1.01
parquet_rs-zstd compress time/HashTags 2324498615 2312855919 1.01
parquet_rs-zstd compress time/TPC-H l_comment canonical 3271769696 3246691567 1.01
parquet_rs-zstd compress time/TPC-H l_comment chunked 3285886793 3327264565 0.99
parquet_rs-zstd compress time/taxi 1229747922 1241658295 0.99
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 7254952 7602143 0.95
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 7168516 6928987 1.03
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 79039666 79431967 1.00
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 79037857 81220465 0.97
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 805936013 803611973 1.00
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 788014746 810327803 0.97
parquet_rs-zstd decompress time/Arade 627071863 624064460 1.00
parquet_rs-zstd decompress time/Bimbo 1710346403 1717049145 1.00
parquet_rs-zstd decompress time/CMSprovider 1776692127 1759588255 1.01
parquet_rs-zstd decompress time/Euro2016 386056280 390987125 0.99
parquet_rs-zstd decompress time/Food 203768695 203537059 1.00
parquet_rs-zstd decompress time/HashTags 702182504 716203841 0.98
parquet_rs-zstd decompress time/TPC-H l_comment canonical 608726797 612552708 0.99
parquet_rs-zstd decompress time/TPC-H l_comment chunked 606500676 615383742 0.99
parquet_rs-zstd decompress time/taxi 251554146 250529058 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2968944 3214045 0.92
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 3039701 3061389 0.99
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 34595385 35043989 0.99
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 35465446 36548664 0.97
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 351464068 356707403 0.99
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 354786843 355174682 1.00
vortex-file-compressed size/Arade 145363796 145363796 1.00
vortex-file-compressed size/Bimbo 468763332 468763332 1.00
vortex-file-compressed size/CMSprovider 417907812 417907812 1.00
vortex-file-compressed size/Euro2016 163394924 163599156 1.00
vortex-file-compressed size/Food 41926936 41926936 1.00
vortex-file-compressed size/HashTags 195647828 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087360 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087360 179087360 1.00
vortex-file-compressed size/taxi 52363948 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.01
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.99
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.00
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.02
vortex:parquet-zstd ratio compress time/Food 0 0 0.98
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.95
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.00
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.00
vortex:parquet-zstd ratio compress time/taxi 0 0 0.99
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 1.06
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 1.07
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.04
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.04
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.06
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.99
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 0.99
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.00
vortex:parquet-zstd ratio decompress time/Food 0 0 1.10
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.00
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.94
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.94
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.94
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.90
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@myrrc myrrc force-pushed the myrrc/duckdb-pushdown-expression branch from 7b2bcbe to 734fac2 Compare May 13, 2026 10:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature ext/duckdb Relates to the DuckDB integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant