Skip to content

experiment: cache aligned alloc#7198

Closed
0ax1 wants to merge 1 commit intodevelopfrom
ad/experiment-overalign
Closed

experiment: cache aligned alloc#7198
0ax1 wants to merge 1 commit intodevelopfrom
ad/experiment-overalign

Conversation

@0ax1
Copy link
Copy Markdown
Contributor

@0ax1 0ax1 commented Mar 28, 2026

No description provided.

@0ax1
overalign
cd7cc32 
Signed-off-by: Alexander Droste <alexander.droste@protonmail.com>
@0ax1 0ax1 added do not merge Pull requests that are not intended to merge action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Mar 28, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 28, 2026
@0ax1 0ax1 changed the title experiment: overalign experiment: cache aligned alloc Mar 28, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 28, 2026 •
edited
Loading

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done cd7cc32 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 28, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.095x ➖

datafusion / vortex-file-compressed (1.095x ➖, 0↑ 5↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 139469316 135085384 1.03
polarsignals_q01/datafusion:vortex-file-compressed 422871048 393467164 1.07
polarsignals_q02/datafusion:vortex-file-compressed 24999927 24427202 1.02
polarsignals_q03/datafusion:vortex-file-compressed 🚨 439712984 391567489 1.12
polarsignals_q04/datafusion:vortex-file-compressed 🚨 13801869 11348953 1.22
polarsignals_q05/datafusion:vortex-file-compressed 🚨 18069505 16413794 1.10
polarsignals_q06/datafusion:vortex-file-compressed 20572884 19192799 1.07
polarsignals_q07/datafusion:vortex-file-compressed 15026965 14687881 1.02
polarsignals_q08/datafusion:vortex-file-compressed 🚨 547326764 476966659 1.15
polarsignals_q09/datafusion:vortex-file-compressed 🚨 12790443 11078980 1.15

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 28, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.5%
Vortex (geomean): 0.988x ➖
Parquet (geomean): 1.011x ➖
Shifts: Parquet (control) +1.1% · Median polish -1.6%

datafusion / vortex-file-compressed (0.970x ➖, 1↑ 0↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 49036201 49128742 1.00
tpch_q02/datafusion:vortex-file-compressed 33843001 34062628 0.99
tpch_q03/datafusion:vortex-file-compressed 26445931 27976831 0.95
tpch_q04/datafusion:vortex-file-compressed 18272464 18495015 0.99
tpch_q05/datafusion:vortex-file-compressed 56112221 55756127 1.01
tpch_q06/datafusion:vortex-file-compressed 9161663 9763909 0.94
tpch_q07/datafusion:vortex-file-compressed 63505201 64962657 0.98
tpch_q08/datafusion:vortex-file-compressed 44962105 47449181 0.95
tpch_q09/datafusion:vortex-file-compressed 57148417 56020944 1.02
tpch_q10/datafusion:vortex-file-compressed 47052077 48241695 0.98
tpch_q11/datafusion:vortex-file-compressed 17266611 18300831 0.94
tpch_q12/datafusion:vortex-file-compressed 22361974 23507402 0.95
tpch_q13/datafusion:vortex-file-compressed 27601482 28270285 0.98
tpch_q14/datafusion:vortex-file-compressed 16233204 16137120 1.01
tpch_q15/datafusion:vortex-file-compressed 25091603 25515461 0.98
tpch_q16/datafusion:vortex-file-compressed 25076413 25064181 1.00
tpch_q17/datafusion:vortex-file-compressed 63980994 68823301 0.93
tpch_q18/datafusion:vortex-file-compressed 79038919 81190634 0.97
tpch_q19/datafusion:vortex-file-compressed 28182873 27792951 1.01
tpch_q20/datafusion:vortex-file-compressed 33037471 34089524 0.97
tpch_q21/datafusion:vortex-file-compressed 73362763 78055763 0.94
tpch_q22/datafusion:vortex-file-compressed 🚀 15529689 17818757 0.87
datafusion / vortex-compact (0.970x ➖, 0↑ 0↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 56945467 58936209 0.97
tpch_q02/datafusion:vortex-compact 36810262 36919385 1.00
tpch_q03/datafusion:vortex-compact 31306730 32221439 0.97
tpch_q04/datafusion:vortex-compact 23032238 23683388 0.97
tpch_q05/datafusion:vortex-compact 56752920 58314645 0.97
tpch_q06/datafusion:vortex-compact 13371595 14808337 0.90
tpch_q07/datafusion:vortex-compact 69158103 72364410 0.96
tpch_q08/datafusion:vortex-compact 50108710 51796218 0.97
tpch_q09/datafusion:vortex-compact 61369549 61745492 0.99
tpch_q10/datafusion:vortex-compact 53884248 56038091 0.96
tpch_q11/datafusion:vortex-compact 19668877 20793980 0.95
tpch_q12/datafusion:vortex-compact 34463600 34435016 1.00
tpch_q13/datafusion:vortex-compact 35769173 37708172 0.95
tpch_q14/datafusion:vortex-compact 20230794 20883601 0.97
tpch_q15/datafusion:vortex-compact 33947816 34755641 0.98
tpch_q16/datafusion:vortex-compact 31663385 31702141 1.00
tpch_q17/datafusion:vortex-compact 71800749 69448381 1.03
tpch_q18/datafusion:vortex-compact 85506154 85879449 1.00
tpch_q19/datafusion:vortex-compact 40436891 43316890 0.93
tpch_q20/datafusion:vortex-compact 37438497 38847765 0.96
tpch_q21/datafusion:vortex-compact 87521217 90700081 0.96
tpch_q22/datafusion:vortex-compact 17076345 17946859 0.95
datafusion / parquet (1.014x ➖, 1↑ 3↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 134020838 137666630 0.97
tpch_q02/datafusion:parquet 69595408 71441769 0.97
tpch_q03/datafusion:parquet 🚨 79690561 68525791 1.16
tpch_q04/datafusion:parquet 48170398 48976724 0.98
tpch_q05/datafusion:parquet 104259599 103439379 1.01
tpch_q06/datafusion:parquet 🚨 44845348 33760595 1.33
tpch_q07/datafusion:parquet 112405897 114430788 0.98
tpch_q08/datafusion:parquet 103949495 98679698 1.05
tpch_q09/datafusion:parquet 140473442 134696567 1.04
tpch_q10/datafusion:parquet 119960916 121812674 0.98
tpch_q11/datafusion:parquet 47920759 48894158 0.98
tpch_q12/datafusion:parquet 🚀 81697451 95039432 0.86
tpch_q13/datafusion:parquet 205360094 208752058 0.98
tpch_q14/datafusion:parquet 47657310 52407255 0.91
tpch_q15/datafusion:parquet 68207198 64196966 1.06
tpch_q16/datafusion:parquet 51971296 50701376 1.03
tpch_q17/datafusion:parquet 132188076 140384703 0.94
tpch_q18/datafusion:parquet 168002519 166836964 1.01
tpch_q19/datafusion:parquet 🚨 94351488 71926523 1.31
tpch_q20/datafusion:parquet 75616792 78741846 0.96
tpch_q21/datafusion:parquet 146296899 151062485 0.97
tpch_q22/datafusion:parquet 33702416 36255195 0.93
datafusion / arrow (1.046x ➖, 0↑ 5↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 58634894 59861176 0.98
tpch_q02/datafusion:arrow 22937727 22865496 1.00
tpch_q03/datafusion:arrow 37601888 35475289 1.06
tpch_q04/datafusion:arrow 31767268 30219452 1.05
tpch_q05/datafusion:arrow 82673838 82307467 1.00
tpch_q06/datafusion:arrow 22261229 21554015 1.03
tpch_q07/datafusion:arrow 114270993 117226232 0.97
tpch_q08/datafusion:arrow 🚨 56039629 46708591 1.20
tpch_q09/datafusion:arrow 🚨 83447800 73453250 1.14
tpch_q10/datafusion:arrow 🚨 62181939 53511388 1.16
tpch_q11/datafusion:arrow 12509582 11745063 1.07
tpch_q12/datafusion:arrow 62246859 56770672 1.10
tpch_q13/datafusion:arrow 50106171 49955110 1.00
tpch_q14/datafusion:arrow 🚨 25916044 23165384 1.12
tpch_q15/datafusion:arrow 🚨 52064024 46254971 1.13
tpch_q16/datafusion:arrow 22057182 21293613 1.04
tpch_q17/datafusion:arrow 75034856 71989750 1.04
tpch_q18/datafusion:arrow 150023838 160783439 0.93
tpch_q19/datafusion:arrow 43191569 43636188 0.99
tpch_q20/datafusion:arrow 42800038 42385764 1.01
tpch_q21/datafusion:arrow 160697127 155835819 1.03
tpch_q22/datafusion:arrow 20246688 20377683 0.99
duckdb / vortex-file-compressed (1.030x ➖, 0↑ 3↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32376590 33940333 0.95
tpch_q02/duckdb:vortex-file-compressed 27660705 27409855 1.01
tpch_q03/duckdb:vortex-file-compressed 31555354 29743860 1.06
tpch_q04/duckdb:vortex-file-compressed 32209248 29999761 1.07
tpch_q05/duckdb:vortex-file-compressed 36994133 34191135 1.08
tpch_q06/duckdb:vortex-file-compressed 11033832 10646190 1.04
tpch_q07/duckdb:vortex-file-compressed 40044657 37515896 1.07
tpch_q08/duckdb:vortex-file-compressed 🚨 45661261 41072074 1.11
tpch_q09/duckdb:vortex-file-compressed 80765180 82295185 0.98
tpch_q10/duckdb:vortex-file-compressed 39046008 37868953 1.03
tpch_q11/duckdb:vortex-file-compressed 🚨 17709514 15668447 1.13
tpch_q12/duckdb:vortex-file-compressed 24670244 24462745 1.01
tpch_q13/duckdb:vortex-file-compressed 38647371 38040594 1.02
tpch_q14/duckdb:vortex-file-compressed 🚨 24084650 21825257 1.10
tpch_q15/duckdb:vortex-file-compressed 16691852 16362339 1.02
tpch_q16/duckdb:vortex-file-compressed 30411719 31621000 0.96
tpch_q17/duckdb:vortex-file-compressed 26198431 25804320 1.02
tpch_q18/duckdb:vortex-file-compressed 49087929 48728706 1.01
tpch_q19/duckdb:vortex-file-compressed 32620575 33639985 0.97
tpch_q20/duckdb:vortex-file-compressed 36523205 35689802 1.02
tpch_q21/duckdb:vortex-file-compressed 104780934 105012475 1.00
tpch_q22/duckdb:vortex-file-compressed 19755965 19332399 1.02
duckdb / vortex-compact (0.983x ➖, 0↑ 0↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39344470 40222110 0.98
tpch_q02/duckdb:vortex-compact 38706981 37205152 1.04
tpch_q03/duckdb:vortex-compact 32912609 34007564 0.97
tpch_q04/duckdb:vortex-compact 35122891 36740990 0.96
tpch_q05/duckdb:vortex-compact 40001591 38521154 1.04
tpch_q06/duckdb:vortex-compact 15582028 16077931 0.97
tpch_q07/duckdb:vortex-compact 42889551 43737722 0.98
tpch_q08/duckdb:vortex-compact 48761317 46733327 1.04
tpch_q09/duckdb:vortex-compact 86988013 92486331 0.94
tpch_q10/duckdb:vortex-compact 42064231 42537979 0.99
tpch_q11/duckdb:vortex-compact 21374064 21538106 0.99
tpch_q12/duckdb:vortex-compact 36257925 37779702 0.96
tpch_q13/duckdb:vortex-compact 46700893 48409760 0.96
tpch_q14/duckdb:vortex-compact 30405210 31314647 0.97
tpch_q15/duckdb:vortex-compact 20011451 19789429 1.01
tpch_q16/duckdb:vortex-compact 36058392 36708323 0.98
tpch_q17/duckdb:vortex-compact 31187781 31860747 0.98
tpch_q18/duckdb:vortex-compact 51134975 52220073 0.98
tpch_q19/duckdb:vortex-compact 37539035 38804583 0.97
tpch_q20/duckdb:vortex-compact 42400096 44346972 0.96
tpch_q21/duckdb:vortex-compact 113170411 114536493 0.99
tpch_q22/duckdb:vortex-compact 21119905 21363240 0.99
duckdb / parquet (1.008x ➖, 2↑ 5↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 104546417 109827430 0.95
tpch_q02/duckdb:parquet 39249869 40334438 0.97
tpch_q03/duckdb:parquet 70065128 69598786 1.01
tpch_q04/duckdb:parquet 47491717 48494246 0.98
tpch_q05/duckdb:parquet 68127742 67548329 1.01
tpch_q06/duckdb:parquet 🚨 27696241 20302036 1.36
tpch_q07/duckdb:parquet 🚨 81927650 70568250 1.16
tpch_q08/duckdb:parquet 82802119 81681429 1.01
tpch_q09/duckdb:parquet 🚨 153564268 135910790 1.13
tpch_q10/duckdb:parquet 125413492 127569248 0.98
tpch_q11/duckdb:parquet 21942881 23035375 0.95
tpch_q12/duckdb:parquet 🚨 50297907 45267242 1.11
tpch_q13/duckdb:parquet 262259405 272603957 0.96
tpch_q14/duckdb:parquet 🚨 60419062 50300694 1.20
tpch_q15/duckdb:parquet 24079771 24752890 0.97
tpch_q16/duckdb:parquet 54664869 54626601 1.00
tpch_q17/duckdb:parquet 56946209 57462108 0.99
tpch_q18/duckdb:parquet 118239606 117678931 1.00
tpch_q19/duckdb:parquet 🚀 68935111 82278356 0.84
tpch_q20/duckdb:parquet 🚀 64124651 82152958 0.78
tpch_q21/duckdb:parquet 165478488 174838143 0.95
tpch_q22/duckdb:parquet 51499858 51980797 0.99
duckdb / duckdb (0.980x ➖, 0↑ 0↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15980137 16430784 0.97
tpch_q02/duckdb:duckdb 12169471 12120762 1.00
tpch_q03/duckdb:duckdb 20104558 20576949 0.98
tpch_q04/duckdb:duckdb 19441373 20125085 0.97
tpch_q05/duckdb:duckdb 19173118 19762068 0.97
tpch_q06/duckdb:duckdb 5145897 5440843 0.95
tpch_q07/duckdb:duckdb 23322643 22099637 1.06
tpch_q08/duckdb:duckdb 21481663 21204811 1.01
tpch_q09/duckdb:duckdb 53334841 52696081 1.01
tpch_q10/duckdb:duckdb 42741310 46160015 0.93
tpch_q11/duckdb:duckdb 5690140 6046500 0.94
tpch_q12/duckdb:duckdb 13714526 13973337 0.98
tpch_q13/duckdb:duckdb 37932529 39165476 0.97
tpch_q14/duckdb:duckdb 16374866 17684984 0.93
tpch_q15/duckdb:duckdb 12534392 11811848 1.06
tpch_q16/duckdb:duckdb 23098237 23467591 0.98
tpch_q17/duckdb:duckdb 13194929 13725209 0.96
tpch_q18/duckdb:duckdb 38249447 38570594 0.99
tpch_q19/duckdb:duckdb 26893994 27905187 0.96
tpch_q20/duckdb:duckdb 22889017 22744217 1.01
tpch_q21/duckdb:duckdb 56291717 58882744 0.96
tpch_q22/duckdb:duckdb 25116409 25188131 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -2.0% -3.7% +1.8% +27.9% ➖ noise
1 datafusion:vortex-compact -3.4% -3.7% +0.4% +24.5% ➖ noise
1 datafusion:vortex-file-compressed -0.2% -3.7% +3.7% +28.1% ➖ noise
1 duckdb:duckdb -2.7% -3.7% +1.0% +24.1% ➖ noise
1 duckdb:vortex-compact -2.2% -3.7% +1.6% +23.4% ➖ noise
1 duckdb:vortex-file-compressed -4.6% -3.7% -0.9% +23.6% ➖ noise
2 datafusion:arrow +0.3% -2.6% +3.0% +23.4% ➖ noise
2 datafusion:vortex-compact -0.3% -2.6% +2.4% +23.4% ➖ noise
2 datafusion:vortex-file-compressed -0.6% -2.6% +2.0% +23.4% ➖ noise
2 duckdb:duckdb +0.4% -2.6% +3.1% +23.4% ➖ noise
2 duckdb:vortex-compact +4.0% -2.6% +6.9% +23.4% ➖ noise
2 duckdb:vortex-file-compressed +0.9% -2.6% +3.6% +23.4% ➖ noise
3 datafusion:arrow +6.0% +8.2% -2.0% +23.4% ➖ noise
3 datafusion:vortex-compact -2.8% +8.2% -10.2% +23.4% ➖ noise
3 datafusion:vortex-file-compressed -5.5% +8.2% -12.6% +23.4% ➖ noise
3 duckdb:duckdb -2.3% +8.2% -9.7% +23.4% ➖ noise
3 duckdb:vortex-compact -3.2% +8.2% -10.6% +23.4% ➖ noise
3 duckdb:vortex-file-compressed +6.1% +8.2% -1.9% +23.4% ➖ noise
4 datafusion:arrow +5.1% -1.9% +7.1% +23.4% ➖ noise
4 datafusion:vortex-compact -2.7% -1.9% -0.9% +23.4% ➖ noise
4 datafusion:vortex-file-compressed -1.2% -1.9% +0.7% +23.4% ➖ noise
4 duckdb:duckdb -3.4% -1.9% -1.6% +23.4% ➖ noise
4 duckdb:vortex-compact -4.4% -1.9% -2.6% +23.4% ➖ noise
4 duckdb:vortex-file-compressed +7.4% -1.9% +9.4% +23.4% ➖ noise
5 datafusion:arrow +0.4% +0.8% -0.4% +23.4% ➖ noise
5 datafusion:vortex-compact -2.7% +0.8% -3.5% +23.4% ➖ noise
5 datafusion:vortex-file-compressed +0.6% +0.8% -0.2% +23.4% ➖ noise
5 duckdb:duckdb -3.0% +0.8% -3.8% +23.4% ➖ noise
5 duckdb:vortex-compact +3.8% +0.8% +3.0% +23.4% ➖ noise
5 duckdb:vortex-file-compressed +8.2% +0.8% +7.3% +23.4% ➖ noise
6 datafusion:arrow +3.3% +34.6% -23.3% +23.4% ✅ faster
6 datafusion:vortex-compact -9.7% +34.6% -32.9% +23.4% ✅ faster
6 datafusion:vortex-file-compressed -6.2% +34.6% -30.3% +23.4% ✅ faster
6 duckdb:duckdb -5.4% +34.6% -29.7% +23.8% ✅ faster
6 duckdb:vortex-compact -3.1% +34.6% -28.0% +23.4% ✅ faster
6 duckdb:vortex-file-compressed +3.6% +34.6% -23.0% +23.4% ✅ faster
7 datafusion:arrow -2.5% +6.8% -8.7% +23.4% ➖ noise
7 datafusion:vortex-compact -4.4% +6.8% -10.5% +23.4% ➖ noise
7 datafusion:vortex-file-compressed -2.2% +6.8% -8.5% +23.4% ➖ noise
7 duckdb:duckdb +5.5% +6.8% -1.2% +23.4% ➖ noise
7 duckdb:vortex-compact -1.9% +6.8% -8.2% +23.4% ➖ noise
7 duckdb:vortex-file-compressed +6.7% +6.8% -0.0% +23.4% ➖ noise
8 datafusion:arrow +20.0% +3.3% +16.1% +23.4% ➖ noise
8 datafusion:vortex-compact -3.3% +3.3% -6.4% +23.4% ➖ noise
8 datafusion:vortex-file-compressed -5.2% +3.3% -8.3% +23.4% ➖ noise
8 duckdb:duckdb +1.3% +3.3% -2.0% +23.4% ➖ noise
8 duckdb:vortex-compact +4.3% +3.3% +1.0% +23.4% ➖ noise
8 duckdb:vortex-file-compressed +11.2% +3.3% +7.6% +23.4% ➖ noise
9 datafusion:arrow +13.6% +8.6% +4.7% +29.2% ➖ noise
9 datafusion:vortex-compact -0.6% +8.6% -8.4% +23.4% ➖ noise
9 datafusion:vortex-file-compressed +2.0% +8.6% -6.0% +23.4% ➖ noise
9 duckdb:duckdb +1.2% +8.6% -6.8% +23.4% ➖ noise
9 duckdb:vortex-compact -5.9% +8.6% -13.4% +23.4% ➖ noise
9 duckdb:vortex-file-compressed -1.9% +8.6% -9.6% +23.4% ➖ noise
10 datafusion:arrow +16.2% -1.6% +18.1% +23.4% ➖ noise
10 datafusion:vortex-compact -3.8% -1.6% -2.3% +23.4% ➖ noise
10 datafusion:vortex-file-compressed -2.5% -1.6% -0.9% +23.4% ➖ noise
10 duckdb:duckdb -7.4% -1.6% -5.9% +23.4% ➖ noise
10 duckdb:vortex-compact -1.1% -1.6% +0.5% +23.4% ➖ noise
10 duckdb:vortex-file-compressed +3.1% -1.6% +4.8% +23.4% ➖ noise
11 datafusion:arrow +6.5% -3.4% +10.2% +23.4% ➖ noise
11 datafusion:vortex-compact -5.4% -3.4% -2.1% +23.4% ➖ noise
11 datafusion:vortex-file-compressed -5.7% -3.4% -2.4% +23.4% ➖ noise
11 duckdb:duckdb -5.9% -3.4% -2.6% +23.4% ➖ noise
11 duckdb:vortex-compact -0.8% -3.4% +2.7% +23.4% ➖ noise
11 duckdb:vortex-file-compressed +13.0% -3.4% +17.0% +23.4% ➖ noise
12 datafusion:arrow +9.6% -2.3% +12.2% +23.4% ➖ noise
12 datafusion:vortex-compact +0.1% -2.3% +2.4% +23.4% ➖ noise
12 datafusion:vortex-file-compressed -4.9% -2.3% -2.7% +23.4% ➖ noise
12 duckdb:duckdb -1.9% -2.3% +0.4% +23.4% ➖ noise
12 duckdb:vortex-compact -4.0% -2.3% -1.8% +23.4% ➖ noise
12 duckdb:vortex-file-compressed +0.8% -2.3% +3.2% +23.4% ➖ noise
13 datafusion:arrow +0.3% -2.7% +3.1% +23.4% ➖ noise
13 datafusion:vortex-compact -5.1% -2.7% -2.5% +23.4% ➖ noise
13 datafusion:vortex-file-compressed -2.4% -2.7% +0.4% +23.4% ➖ noise
13 duckdb:duckdb -3.1% -2.7% -0.4% +23.4% ➖ noise
13 duckdb:vortex-compact -3.5% -2.7% -0.8% +23.4% ➖ noise
13 duckdb:vortex-file-compressed +1.6% -2.7% +4.4% +23.4% ➖ noise
14 datafusion:arrow +11.9% +4.5% +7.0% +23.4% ➖ noise
14 datafusion:vortex-compact -3.1% +4.5% -7.3% +23.4% ➖ noise
14 datafusion:vortex-file-compressed +0.6% +4.5% -3.7% +23.4% ➖ noise
14 duckdb:duckdb -7.4% +4.5% -11.4% +23.4% ➖ noise
14 duckdb:vortex-compact -2.9% +4.5% -7.1% +23.4% ➖ noise
14 duckdb:vortex-file-compressed +10.4% +4.5% +5.6% +23.4% ➖ noise
15 datafusion:arrow +12.6% +1.7% +10.7% +23.4% ➖ noise
15 datafusion:vortex-compact -2.3% +1.7% -3.9% +23.4% ➖ noise
15 datafusion:vortex-file-compressed -1.7% +1.7% -3.3% +23.4% ➖ noise
15 duckdb:duckdb +6.1% +1.7% +4.4% +23.4% ➖ noise
15 duckdb:vortex-compact +1.1% +1.7% -0.5% +23.4% ➖ noise
15 duckdb:vortex-file-compressed +2.0% +1.7% +0.3% +23.4% ➖ noise
16 datafusion:arrow +3.6% +1.3% +2.3% +23.4% ➖ noise
16 datafusion:vortex-compact -0.1% +1.3% -1.4% +23.4% ➖ noise
16 datafusion:vortex-file-compressed +0.0% +1.3% -1.2% +23.4% ➖ noise
16 duckdb:duckdb -1.6% +1.3% -2.8% +23.4% ➖ noise
16 duckdb:vortex-compact -1.8% +1.3% -3.0% +23.4% ➖ noise
16 duckdb:vortex-file-compressed -3.8% +1.3% -5.0% +23.4% ➖ noise
17 datafusion:arrow +4.2% -3.4% +7.9% +23.4% ➖ noise
17 datafusion:vortex-compact +3.4% -3.4% +7.0% +23.4% ➖ noise
17 datafusion:vortex-file-compressed -7.0% -3.4% -3.8% +23.4% ➖ noise
17 duckdb:duckdb -3.9% -3.4% -0.5% +23.4% ➖ noise
17 duckdb:vortex-compact -2.1% -3.4% +1.3% +23.4% ➖ noise
17 duckdb:vortex-file-compressed +1.5% -3.4% +5.1% +23.4% ➖ noise
18 datafusion:arrow -6.7% +0.6% -7.2% +23.4% ➖ noise
18 datafusion:vortex-compact -0.4% +0.6% -1.0% +23.4% ➖ noise
18 datafusion:vortex-file-compressed -2.7% +0.6% -3.2% +23.4% ➖ noise
18 duckdb:duckdb -0.8% +0.6% -1.4% +23.4% ➖ noise
18 duckdb:vortex-compact -2.1% +0.6% -2.6% +23.4% ➖ noise
18 duckdb:vortex-file-compressed +0.7% +0.6% +0.1% +23.4% ➖ noise
19 datafusion:arrow -1.0% +4.8% -5.6% +23.4% ➖ noise
19 datafusion:vortex-compact -6.6% +4.8% -11.0% +23.4% ➖ noise
19 datafusion:vortex-file-compressed +1.4% +4.8% -3.3% +23.4% ➖ noise
19 duckdb:duckdb -3.6% +4.8% -8.1% +24.2% ➖ noise
19 duckdb:vortex-compact -3.3% +4.8% -7.7% +23.4% ➖ noise
19 duckdb:vortex-file-compressed -3.0% +4.8% -7.5% +23.4% ➖ noise
20 datafusion:arrow +1.0% -13.4% +16.6% +23.4% ➖ noise
20 datafusion:vortex-compact -3.6% -13.4% +11.3% +23.4% ➖ noise
20 datafusion:vortex-file-compressed -3.1% -13.4% +11.9% +23.4% ➖ noise
20 duckdb:duckdb +0.6% -13.4% +16.2% +25.2% ➖ noise
20 duckdb:vortex-compact -4.4% -13.4% +10.4% +23.4% ➖ noise
20 duckdb:vortex-file-compressed +2.3% -13.4% +18.2% +23.4% ➖ noise
21 datafusion:arrow +3.1% -4.3% +7.7% +23.4% ➖ noise
21 datafusion:vortex-compact -3.5% -4.3% +0.8% +23.4% ➖ noise
21 datafusion:vortex-file-compressed -6.0% -4.3% -1.8% +23.4% ➖ noise
21 duckdb:duckdb -4.4% -4.3% -0.1% +23.4% ➖ noise
21 duckdb:vortex-compact -1.2% -4.3% +3.2% +23.4% ➖ noise
21 duckdb:vortex-file-compressed -0.2% -4.3% +4.2% +23.4% ➖ noise
22 datafusion:arrow -0.6% -4.0% +3.5% +23.4% ➖ noise
22 datafusion:vortex-compact -4.9% -4.0% -0.9% +23.4% ➖ noise
22 datafusion:vortex-file-compressed -12.8% -4.0% -9.2% +23.4% ➖ noise
22 duckdb:duckdb -0.3% -4.0% +3.9% +23.4% ➖ noise
22 duckdb:vortex-compact -1.1% -4.0% +3.0% +23.4% ➖ noise
22 duckdb:vortex-file-compressed +2.2% -4.0% +6.5% +23.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 28, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.3%
Vortex (geomean): 1.010x ➖
Parquet (geomean): 0.987x ➖
Shifts: Parquet (control) -1.3% · Median polish -0.4%

datafusion / vortex-file-compressed (1.003x ➖, 0↑ 2↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5733401 5798340 0.99
fineweb_q01/datafusion:vortex-file-compressed 25136269 26820340 0.94
fineweb_q02/datafusion:vortex-file-compressed 🚨 32280906 28744085 1.12
fineweb_q03/datafusion:vortex-file-compressed 87031265 79338662 1.10
fineweb_q04/datafusion:vortex-file-compressed 264303843 275480878 0.96
fineweb_q05/datafusion:vortex-file-compressed 246760802 262577447 0.94
fineweb_q06/datafusion:vortex-file-compressed 🚨 75848915 67228446 1.13
fineweb_q07/datafusion:vortex-file-compressed 70677306 72704297 0.97
fineweb_q08/datafusion:vortex-file-compressed 24010621 26371772 0.91
datafusion / vortex-compact (0.996x ➖, 1↑ 0↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5225582 4781360 1.09
fineweb_q01/datafusion:vortex-compact 164318153 165583955 0.99
fineweb_q02/datafusion:vortex-compact 168585047 165344524 1.02
fineweb_q03/datafusion:vortex-compact 1583438449 1464505158 1.08
fineweb_q04/datafusion:vortex-compact 1547659503 1611181073 0.96
fineweb_q05/datafusion:vortex-compact 1229371861 1252837323 0.98
fineweb_q06/datafusion:vortex-compact 701852479 699992448 1.00
fineweb_q07/datafusion:vortex-compact 732152022 745661815 0.98
fineweb_q08/datafusion:vortex-compact 🚀 22444861 25726789 0.87
datafusion / parquet (0.995x ➖, 0↑ 0↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6580892 6317142 1.04
fineweb_q01/datafusion:parquet 270473433 276632960 0.98
fineweb_q02/datafusion:parquet 272187380 280223689 0.97
fineweb_q03/datafusion:parquet 275785749 274196652 1.01
fineweb_q04/datafusion:parquet 289917656 286344343 1.01
fineweb_q05/datafusion:parquet 283279576 283260410 1.00
fineweb_q06/datafusion:parquet 273713804 286183606 0.96
fineweb_q07/datafusion:parquet 273261645 273358796 1.00
fineweb_q08/datafusion:parquet 267909774 270296975 0.99
duckdb / vortex-file-compressed (1.042x ➖, 0↑ 2↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3324931 3398303 0.98
fineweb_q01/duckdb:vortex-file-compressed 🚨 29407930 24737047 1.19
fineweb_q02/duckdb:vortex-file-compressed 30640196 28784075 1.06
fineweb_q03/duckdb:vortex-file-compressed 🚨 172621098 140758108 1.23
fineweb_q04/duckdb:vortex-file-compressed 226575619 239092991 0.95
fineweb_q05/duckdb:vortex-file-compressed 213866215 222985494 0.96
fineweb_q06/duckdb:vortex-file-compressed 67076693 64265673 1.04
fineweb_q07/duckdb:vortex-file-compressed 64905767 69341815 0.94
fineweb_q08/duckdb:vortex-file-compressed 28267257 26216553 1.08
duckdb / vortex-compact (0.997x ➖, 1↑ 1↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4489232 4412477 1.02
fineweb_q01/duckdb:vortex-compact 🚀 99363755 112086287 0.89
fineweb_q02/duckdb:vortex-compact 117301279 117753444 1.00
fineweb_q03/duckdb:vortex-compact 849314127 869302356 0.98
fineweb_q04/duckdb:vortex-compact 914512964 920177777 0.99
fineweb_q05/duckdb:vortex-compact 823983375 826880253 1.00
fineweb_q06/duckdb:vortex-compact 470490519 474268081 0.99
fineweb_q07/duckdb:vortex-compact 479911340 483719204 0.99
fineweb_q08/duckdb:vortex-compact 🚨 27120610 23771025 1.14
duckdb / parquet (0.979x ➖, 0↑ 0↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 35819586 35888514 1.00
fineweb_q01/duckdb:parquet 93019714 93752738 0.99
fineweb_q02/duckdb:parquet 95893090 98581786 0.97
fineweb_q03/duckdb:parquet 305053897 311790138 0.98
fineweb_q04/duckdb:parquet 436428208 441831561 0.99
fineweb_q05/duckdb:parquet 406324753 411670957 0.99
fineweb_q06/duckdb:parquet 197235702 201966247 0.98
fineweb_q07/duckdb:parquet 208265590 212698220 0.98
fineweb_q08/duckdb:parquet 56032960 59437661 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +9.3% +2.0% +7.2% +37.5% ➖ noise
0 datafusion:vortex-file-compressed -1.1% +2.0% -3.0% +53.4% ➖ noise
0 duckdb:vortex-compact +1.7% +2.0% -0.2% +43.4% ➖ noise
0 duckdb:vortex-file-compressed -2.2% +2.0% -4.0% +48.6% ➖ noise
1 datafusion:vortex-compact -0.8% -1.5% +0.8% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -6.3% -1.5% -4.8% +19.1% ➖ noise
1 duckdb:vortex-compact -11.4% -1.5% -10.0% +14.8% ➖ noise
1 duckdb:vortex-file-compressed +18.9% -1.5% +20.7% +45.4% ➖ noise
2 datafusion:vortex-compact +2.0% -2.8% +4.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +12.3% -2.8% +15.5% +19.7% ➖ noise
2 duckdb:vortex-compact -0.4% -2.8% +2.5% +16.1% ➖ noise
2 duckdb:vortex-file-compressed +6.4% -2.8% +9.5% +10.6% ➖ noise
3 datafusion:vortex-compact +8.1% -0.8% +9.0% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +9.7% -0.8% +10.6% +24.9% ➖ noise
3 duckdb:vortex-compact -2.3% -0.8% -1.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +22.6% -0.8% +23.6% +37.3% ➖ noise
4 datafusion:vortex-compact -3.9% +0.0% -3.9% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -4.1% +0.0% -4.1% +10.0% ➖ noise
4 duckdb:vortex-compact -0.6% +0.0% -0.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -5.2% +0.0% -5.2% +10.0% ➖ noise
5 datafusion:vortex-compact -1.9% -0.6% -1.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -6.0% -0.6% -5.4% +10.0% ➖ noise
5 duckdb:vortex-compact -0.4% -0.6% +0.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -4.1% -0.6% -3.5% +10.0% ➖ noise
6 datafusion:vortex-compact +0.3% -3.4% +3.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +12.8% -3.4% +16.7% +32.3% ➖ noise
6 duckdb:vortex-compact -0.8% -3.4% +2.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +4.4% -3.4% +8.0% +10.4% ➖ noise
7 datafusion:vortex-compact -1.8% -1.1% -0.8% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -2.8% -1.1% -1.7% +11.2% ➖ noise
7 duckdb:vortex-compact -0.8% -1.1% +0.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -6.4% -1.1% -5.4% +10.0% ➖ noise
8 datafusion:vortex-compact -12.8% -3.3% -9.7% +16.4% ➖ noise
8 datafusion:vortex-file-compressed -9.0% -3.3% -5.8% +27.1% ➖ noise
8 duckdb:vortex-compact +14.1% -3.3% +18.0% +16.0% 🚨 regression
8 duckdb:vortex-file-compressed +7.8% -3.3% +11.5% +15.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 28, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (medium confidence)
Attributed Vortex impact: +9.1%
Vortex (geomean): 1.197x ❌
Parquet (geomean): 1.059x ➖
Shifts: Parquet (control) +5.9% · Median polish +12.3%

datafusion / vortex-file-compressed (1.126x ❌, 0↑ 64↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 31583755 29077960 1.09
tpcds_q02/datafusion:vortex-file-compressed 🚨 64293304 55306465 1.16
tpcds_q03/datafusion:vortex-file-compressed 🚨 24591493 21774769 1.13
tpcds_q04/datafusion:vortex-file-compressed 🚨 356932965 307428778 1.16
tpcds_q05/datafusion:vortex-file-compressed 🚨 64404533 55763775 1.15
tpcds_q06/datafusion:vortex-file-compressed 🚨 62170421 54253942 1.15
tpcds_q07/datafusion:vortex-file-compressed 🚨 64196444 55639569 1.15
tpcds_q08/datafusion:vortex-file-compressed 42315469 40136998 1.05
tpcds_q09/datafusion:vortex-file-compressed 62883139 58599782 1.07
tpcds_q10/datafusion:vortex-file-compressed 🚨 54377275 47952286 1.13
tpcds_q11/datafusion:vortex-file-compressed 🚨 202855076 172036756 1.18
tpcds_q12/datafusion:vortex-file-compressed 🚨 27140390 23217195 1.17
tpcds_q13/datafusion:vortex-file-compressed 🚨 71244946 61017821 1.17
tpcds_q14/datafusion:vortex-file-compressed 🚨 239728716 209308406 1.15
tpcds_q15/datafusion:vortex-file-compressed 39673285 36748058 1.08
tpcds_q16/datafusion:vortex-file-compressed 31826783 29824445 1.07
tpcds_q17/datafusion:vortex-file-compressed 🚨 81099198 70309745 1.15
tpcds_q18/datafusion:vortex-file-compressed 89577569 82420777 1.09
tpcds_q19/datafusion:vortex-file-compressed 🚨 36276100 32346841 1.12
tpcds_q20/datafusion:vortex-file-compressed 🚨 30893171 26537335 1.16
tpcds_q21/datafusion:vortex-file-compressed 157586774 144347663 1.09
tpcds_q22/datafusion:vortex-file-compressed 🚨 69985076 60990451 1.15
tpcds_q23/datafusion:vortex-file-compressed 🚨 184837613 154335818 1.20
tpcds_q24/datafusion:vortex-file-compressed 🚨 136264203 117865445 1.16
tpcds_q25/datafusion:vortex-file-compressed 🚨 79846883 71158173 1.12
tpcds_q26/datafusion:vortex-file-compressed 🚨 45902640 38406031 1.20
tpcds_q27/datafusion:vortex-file-compressed 🚨 145719584 131204167 1.11
tpcds_q28/datafusion:vortex-file-compressed 🚨 57861539 52050690 1.11
tpcds_q29/datafusion:vortex-file-compressed 78684830 72862841 1.08
tpcds_q30/datafusion:vortex-file-compressed 37953672 34822325 1.09
tpcds_q31/datafusion:vortex-file-compressed 110193298 101457996 1.09
tpcds_q32/datafusion:vortex-file-compressed 23670444 23310938 1.02
tpcds_q33/datafusion:vortex-file-compressed 🚨 45841502 40687733 1.13
tpcds_q34/datafusion:vortex-file-compressed 🚨 39419630 34052533 1.16
tpcds_q35/datafusion:vortex-file-compressed 63903103 59152893 1.08
tpcds_q36/datafusion:vortex-file-compressed 🚨 91267678 80017322 1.14
tpcds_q37/datafusion:vortex-file-compressed 🚨 40432427 35669344 1.13
tpcds_q38/datafusion:vortex-file-compressed 🚨 61576900 55652993 1.11
tpcds_q39/datafusion:vortex-file-compressed 🚨 170818307 149285239 1.14
tpcds_q40/datafusion:vortex-file-compressed 🚨 60819462 54485844 1.12
tpcds_q41/datafusion:vortex-file-compressed 🚨 25818257 19978945 1.29
tpcds_q42/datafusion:vortex-file-compressed 22157835 20208613 1.10
tpcds_q43/datafusion:vortex-file-compressed 37413833 34246316 1.09
tpcds_q44/datafusion:vortex-file-compressed 47699239 45858672 1.04
tpcds_q45/datafusion:vortex-file-compressed 39237861 35929392 1.09
tpcds_q46/datafusion:vortex-file-compressed 🚨 58612559 49817890 1.18
tpcds_q47/datafusion:vortex-file-compressed 🚨 255688829 221374991 1.16
tpcds_q48/datafusion:vortex-file-compressed 🚨 54866929 49130232 1.12
tpcds_q49/datafusion:vortex-file-compressed 🚨 85566456 73258396 1.17
tpcds_q50/datafusion:vortex-file-compressed 🚨 54504699 48342724 1.13
tpcds_q51/datafusion:vortex-file-compressed 102395488 93505219 1.10
tpcds_q52/datafusion:vortex-file-compressed 🚨 22821150 20212983 1.13
tpcds_q53/datafusion:vortex-file-compressed 🚨 30383562 27250743 1.11
tpcds_q54/datafusion:vortex-file-compressed 50118178 46212830 1.08
tpcds_q55/datafusion:vortex-file-compressed 🚨 21740751 19460139 1.12
tpcds_q56/datafusion:vortex-file-compressed 46418386 42469798 1.09
tpcds_q57/datafusion:vortex-file-compressed 🚨 147475271 131951193 1.12
tpcds_q58/datafusion:vortex-file-compressed 🚨 84473944 71204535 1.19
tpcds_q59/datafusion:vortex-file-compressed 🚨 83335952 74467486 1.12
tpcds_q60/datafusion:vortex-file-compressed 🚨 46846924 40998086 1.14
tpcds_q61/datafusion:vortex-file-compressed 🚨 60451901 52267729 1.16
tpcds_q62/datafusion:vortex-file-compressed 🚨 37216633 32631570 1.14
tpcds_q63/datafusion:vortex-file-compressed 🚨 29581184 26319416 1.12
tpcds_q64/datafusion:vortex-file-compressed 🚨 560814848 476749258 1.18
tpcds_q65/datafusion:vortex-file-compressed 54239012 50732967 1.07
tpcds_q66/datafusion:vortex-file-compressed 99613361 95843161 1.04
tpcds_q67/datafusion:vortex-file-compressed 122111234 125000862 0.98
tpcds_q68/datafusion:vortex-file-compressed 46912497 47265491 0.99
tpcds_q69/datafusion:vortex-file-compressed 43377008 44328723 0.98
tpcds_q70/datafusion:vortex-file-compressed 120062570 112490028 1.07
tpcds_q71/datafusion:vortex-file-compressed 🚨 38239974 32145637 1.19
tpcds_q72/datafusion:vortex-file-compressed 2916381677 2703411002 1.08
tpcds_q73/datafusion:vortex-file-compressed 38840656 35959401 1.08
tpcds_q74/datafusion:vortex-file-compressed 🚨 142140419 120867445 1.18
tpcds_q75/datafusion:vortex-file-compressed 🚨 149187683 122778388 1.22
tpcds_q76/datafusion:vortex-file-compressed 🚨 45403738 35184327 1.29
tpcds_q77/datafusion:vortex-file-compressed 🚨 64451323 53893859 1.20
tpcds_q78/datafusion:vortex-file-compressed 🚨 158712439 133186753 1.19
tpcds_q79/datafusion:vortex-file-compressed 🚨 50439199 40443037 1.25
tpcds_q80/datafusion:vortex-file-compressed 🚨 138621856 119807480 1.16
tpcds_q81/datafusion:vortex-file-compressed 38262532 38738851 0.99
tpcds_q82/datafusion:vortex-file-compressed 🚨 46656207 37187382 1.25
tpcds_q83/datafusion:vortex-file-compressed 🚨 59057949 53278619 1.11
tpcds_q84/datafusion:vortex-file-compressed 17179467 17022576 1.01
tpcds_q85/datafusion:vortex-file-compressed 🚨 117135311 103030290 1.14
tpcds_q86/datafusion:vortex-file-compressed 19763839 19274740 1.03
tpcds_q87/datafusion:vortex-file-compressed 🚨 65502438 53645142 1.22
tpcds_q88/datafusion:vortex-file-compressed 82211588 78198285 1.05
tpcds_q89/datafusion:vortex-file-compressed 🚨 47183203 37960650 1.24
tpcds_q90/datafusion:vortex-file-compressed 🚨 21092498 18821745 1.12
tpcds_q91/datafusion:vortex-file-compressed 29051601 27839359 1.04
tpcds_q92/datafusion:vortex-file-compressed 19637145 19230615 1.02
tpcds_q93/datafusion:vortex-file-compressed 36218208 35456780 1.02
tpcds_q94/datafusion:vortex-file-compressed 🚨 28877599 24311794 1.19
tpcds_q95/datafusion:vortex-file-compressed 🚨 71478277 60699398 1.18
tpcds_q96/datafusion:vortex-file-compressed 18972400 17544359 1.08
tpcds_q97/datafusion:vortex-file-compressed 🚨 40847828 31690290 1.29
tpcds_q98/datafusion:vortex-file-compressed 🚨 43096994 33755877 1.28
tpcds_q99/datafusion:vortex-file-compressed 🚨 58329622 45755779 1.27
datafusion / vortex-compact (1.202x ❌, 0↑ 82↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚨 46365591 38030124 1.22
tpcds_q02/datafusion:vortex-compact 🚨 71644955 58395107 1.23
tpcds_q03/datafusion:vortex-compact 30056230 27855783 1.08
tpcds_q04/datafusion:vortex-compact 🚨 424895560 331192650 1.28
tpcds_q05/datafusion:vortex-compact 🚨 88197794 68707483 1.28
tpcds_q06/datafusion:vortex-compact 🚨 78730814 57747618 1.36
tpcds_q07/datafusion:vortex-compact 🚨 86151787 69220514 1.24
tpcds_q08/datafusion:vortex-compact 🚨 58011768 46842141 1.24
tpcds_q09/datafusion:vortex-compact 🚨 124631919 103615732 1.20
tpcds_q10/datafusion:vortex-compact 🚨 80098848 64603847 1.24
tpcds_q11/datafusion:vortex-compact 🚨 243786169 189691417 1.29
tpcds_q12/datafusion:vortex-compact 29353560 26729600 1.10
tpcds_q13/datafusion:vortex-compact 🚨 148853582 131191096 1.13
tpcds_q14/datafusion:vortex-compact 🚨 309269370 261895094 1.18
tpcds_q15/datafusion:vortex-compact 🚨 49526052 39408286 1.26
tpcds_q16/datafusion:vortex-compact 🚨 48755853 40457025 1.21
tpcds_q17/datafusion:vortex-compact 🚨 115642399 96230659 1.20
tpcds_q18/datafusion:vortex-compact 🚨 123383425 95385415 1.29
tpcds_q19/datafusion:vortex-compact 🚨 53028047 45528268 1.16
tpcds_q20/datafusion:vortex-compact 🚨 40644765 30401113 1.34
tpcds_q21/datafusion:vortex-compact 🚨 195732400 149242573 1.31
tpcds_q22/datafusion:vortex-compact 🚨 85397719 67732736 1.26
tpcds_q23/datafusion:vortex-compact 🚨 231029309 192193141 1.20
tpcds_q24/datafusion:vortex-compact 🚨 180785950 144967463 1.25
tpcds_q25/datafusion:vortex-compact 🚨 120500310 98167601 1.23
tpcds_q26/datafusion:vortex-compact 🚨 64520912 50118822 1.29
tpcds_q27/datafusion:vortex-compact 🚨 209745926 163387279 1.28
tpcds_q28/datafusion:vortex-compact 🚨 119546866 103651668 1.15
tpcds_q29/datafusion:vortex-compact 🚨 125952343 99659644 1.26
tpcds_q30/datafusion:vortex-compact 🚨 49331401 37890617 1.30
tpcds_q31/datafusion:vortex-compact 🚨 149715882 131348879 1.14
tpcds_q32/datafusion:vortex-compact 🚨 32617977 28248407 1.15
tpcds_q33/datafusion:vortex-compact 🚨 66183898 54841891 1.21
tpcds_q34/datafusion:vortex-compact 🚨 64792887 51672614 1.25
tpcds_q35/datafusion:vortex-compact 🚨 91154735 70886421 1.29
tpcds_q36/datafusion:vortex-compact 🚨 133918140 103156466 1.30
tpcds_q37/datafusion:vortex-compact 🚨 62647801 47707737 1.31
tpcds_q38/datafusion:vortex-compact 🚨 85462947 68509521 1.25
tpcds_q39/datafusion:vortex-compact 🚨 207787726 160414111 1.30
tpcds_q40/datafusion:vortex-compact 🚨 80658310 59495893 1.36
tpcds_q41/datafusion:vortex-compact 🚨 34075425 22359181 1.52
tpcds_q42/datafusion:vortex-compact 🚨 32091674 26883106 1.19
tpcds_q43/datafusion:vortex-compact 🚨 51424141 41186371 1.25
tpcds_q44/datafusion:vortex-compact 🚨 87941397 77976748 1.13
tpcds_q45/datafusion:vortex-compact 🚨 49154402 39102803 1.26
tpcds_q46/datafusion:vortex-compact 🚨 92934712 74028459 1.26
tpcds_q47/datafusion:vortex-compact 🚨 318626556 235931579 1.35
tpcds_q48/datafusion:vortex-compact 🚨 108678446 98119132 1.11
tpcds_q49/datafusion:vortex-compact 🚨 120461575 99604163 1.21
tpcds_q50/datafusion:vortex-compact 🚨 78431747 65249690 1.20
tpcds_q51/datafusion:vortex-compact 🚨 117282689 101807676 1.15
tpcds_q52/datafusion:vortex-compact 26045665 25435611 1.02
tpcds_q53/datafusion:vortex-compact 🚨 44045655 36836144 1.20
tpcds_q54/datafusion:vortex-compact 🚨 67160768 60803428 1.10
tpcds_q55/datafusion:vortex-compact 24912177 25222290 0.99
tpcds_q56/datafusion:vortex-compact 🚨 67987160 56959284 1.19
tpcds_q57/datafusion:vortex-compact 🚨 179779976 143896103 1.25
tpcds_q58/datafusion:vortex-compact 🚨 98364280 80508323 1.22
tpcds_q59/datafusion:vortex-compact 🚨 99244965 88430639 1.12
tpcds_q60/datafusion:vortex-compact 🚨 67220145 56640498 1.19
tpcds_q61/datafusion:vortex-compact 🚨 83391603 74915917 1.11
tpcds_q62/datafusion:vortex-compact 🚨 43838426 34968293 1.25
tpcds_q63/datafusion:vortex-compact 38517124 37489435 1.03
tpcds_q64/datafusion:vortex-compact 🚨 688475037 556253747 1.24
tpcds_q65/datafusion:vortex-compact 🚨 87874279 68089643 1.29
tpcds_q66/datafusion:vortex-compact 🚨 141637638 100659271 1.41
tpcds_q67/datafusion:vortex-compact 🚨 161771274 129578401 1.25
tpcds_q68/datafusion:vortex-compact 🚨 99298435 70258244 1.41
tpcds_q69/datafusion:vortex-compact 🚨 78974305 61420396 1.29
tpcds_q70/datafusion:vortex-compact 🚨 190589829 130595191 1.46
tpcds_q71/datafusion:vortex-compact 🚨 59043515 44889503 1.32
tpcds_q72/datafusion:vortex-compact 🚨 3867724579 2756113862 1.40
tpcds_q73/datafusion:vortex-compact 🚨 66952111 52188464 1.28
tpcds_q74/datafusion:vortex-compact 🚨 190900698 140456697 1.36
tpcds_q75/datafusion:vortex-compact 183254472 169029380 1.08
tpcds_q76/datafusion:vortex-compact 🚨 62953354 54458801 1.16
tpcds_q77/datafusion:vortex-compact 🚨 81735394 68139227 1.20
tpcds_q78/datafusion:vortex-compact 🚨 175220554 153552659 1.14
tpcds_q79/datafusion:vortex-compact 🚨 75409624 61600364 1.22
tpcds_q80/datafusion:vortex-compact 🚨 151435277 135641351 1.12
tpcds_q81/datafusion:vortex-compact 🚨 53514824 45397152 1.18
tpcds_q82/datafusion:vortex-compact 🚨 60187199 50094408 1.20
tpcds_q83/datafusion:vortex-compact 61057998 60756204 1.00
tpcds_q84/datafusion:vortex-compact 🚨 23413750 19564324 1.20
tpcds_q85/datafusion:vortex-compact 🚨 149823219 128311478 1.17
tpcds_q86/datafusion:vortex-compact 22480031 20779239 1.08
tpcds_q87/datafusion:vortex-compact 🚨 80545477 68336619 1.18
tpcds_q88/datafusion:vortex-compact 148870823 140590378 1.06
tpcds_q89/datafusion:vortex-compact 🚨 60661859 45818937 1.32
tpcds_q90/datafusion:vortex-compact 🚨 27826995 24861570 1.12
tpcds_q91/datafusion:vortex-compact 🚨 47298992 41718576 1.13
tpcds_q92/datafusion:vortex-compact 21780388 21934884 0.99
tpcds_q93/datafusion:vortex-compact 48758866 48698648 1.00
tpcds_q94/datafusion:vortex-compact 32916230 31555976 1.04
tpcds_q95/datafusion:vortex-compact 76352548 74759894 1.02
tpcds_q96/datafusion:vortex-compact 28126736 27516699 1.02
tpcds_q97/datafusion:vortex-compact 44212293 42599801 1.04
tpcds_q98/datafusion:vortex-compact 41742240 40155028 1.04
tpcds_q99/datafusion:vortex-compact 57919323 54029301 1.07
datafusion / parquet (1.117x ❌, 0↑ 61↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 🚨 42868908 38472176 1.11
tpcds_q02/datafusion:parquet 🚨 53762519 46236296 1.16
tpcds_q03/datafusion:parquet 16786067 16980959 0.99
tpcds_q04/datafusion:parquet 🚨 376288141 338161591 1.11
tpcds_q05/datafusion:parquet 🚨 65617104 55078856 1.19
tpcds_q06/datafusion:parquet 68039409 67032467 1.02
tpcds_q07/datafusion:parquet 🚨 106927038 92318902 1.16
tpcds_q08/datafusion:parquet 🚨 38052070 33687927 1.13
tpcds_q09/datafusion:parquet 🚨 68372335 58996906 1.16
tpcds_q10/datafusion:parquet 🚨 103812772 86665846 1.20
tpcds_q11/datafusion:parquet 🚨 225298932 186794915 1.21
tpcds_q12/datafusion:parquet 🚨 28035962 22552212 1.24
tpcds_q13/datafusion:parquet 97141491 92173432 1.05
tpcds_q14/datafusion:parquet 🚨 229530707 202224093 1.14
tpcds_q15/datafusion:parquet 29790138 27161864 1.10
tpcds_q16/datafusion:parquet 🚨 33125042 29525669 1.12
tpcds_q17/datafusion:parquet 🚨 79912188 72640197 1.10
tpcds_q18/datafusion:parquet 🚨 154013467 137090757 1.12
tpcds_q19/datafusion:parquet 🚨 32830029 29060936 1.13
tpcds_q20/datafusion:parquet 🚨 25759547 22118114 1.16
tpcds_q21/datafusion:parquet 🚨 26591363 22764665 1.17
tpcds_q22/datafusion:parquet 🚨 186067491 134550002 1.38
tpcds_q23/datafusion:parquet 🚨 207692645 173151276 1.20
tpcds_q24/datafusion:parquet 🚨 129081188 114226543 1.13
tpcds_q25/datafusion:parquet 🚨 86213142 74307543 1.16
tpcds_q26/datafusion:parquet 🚨 90076809 78065454 1.15
tpcds_q27/datafusion:parquet 🚨 196456592 170798802 1.15
tpcds_q28/datafusion:parquet 54521355 52134798 1.05
tpcds_q29/datafusion:parquet 🚨 86293725 77535215 1.11
tpcds_q30/datafusion:parquet 51774978 47949485 1.08
tpcds_q31/datafusion:parquet 🚨 89197535 80344372 1.11
tpcds_q32/datafusion:parquet 🚨 25987778 23212849 1.12
tpcds_q33/datafusion:parquet 🚨 41835067 36168679 1.16
tpcds_q34/datafusion:parquet 32318445 29595885 1.09
tpcds_q35/datafusion:parquet 🚨 108657652 87911973 1.24
tpcds_q36/datafusion:parquet 🚨 79971994 67116164 1.19
tpcds_q37/datafusion:parquet 🚨 28096078 24072936 1.17
tpcds_q38/datafusion:parquet 🚨 59578479 51878474 1.15
tpcds_q39/datafusion:parquet 🚨 108154974 89868364 1.20
tpcds_q40/datafusion:parquet 31110432 28575166 1.09
tpcds_q41/datafusion:parquet 🚨 23535724 17086108 1.38
tpcds_q42/datafusion:parquet 15654021 14414070 1.09
tpcds_q43/datafusion:parquet 🚨 22099583 19914850 1.11
tpcds_q44/datafusion:parquet 46711953 44424722 1.05
tpcds_q45/datafusion:parquet 🚨 38265272 34782734 1.10
tpcds_q46/datafusion:parquet 🚨 46580461 40513406 1.15
tpcds_q47/datafusion:parquet 🚨 157485880 141316013 1.11
tpcds_q48/datafusion:parquet 🚨 96415171 82425347 1.17
tpcds_q49/datafusion:parquet 🚨 80252963 68599262 1.17
tpcds_q50/datafusion:parquet 🚨 60276661 51340108 1.17
tpcds_q51/datafusion:parquet 🚨 106691603 93087062 1.15
tpcds_q52/datafusion:parquet 16298627 15046109 1.08
tpcds_q53/datafusion:parquet 🚨 24815500 22109413 1.12
tpcds_q54/datafusion:parquet 48827626 44903093 1.09
tpcds_q55/datafusion:parquet 15749036 14668750 1.07
tpcds_q56/datafusion:parquet 🚨 42448991 37060100 1.15
tpcds_q57/datafusion:parquet 🚨 127688633 111932278 1.14
tpcds_q58/datafusion:parquet 67200089 61539371 1.09
tpcds_q59/datafusion:parquet 66038700 61082379 1.08
tpcds_q60/datafusion:parquet 40894473 37419594 1.09
tpcds_q61/datafusion:parquet 56638928 54092339 1.05
tpcds_q62/datafusion:parquet 🚨 30681710 25277574 1.21
tpcds_q63/datafusion:parquet 24657872 22804218 1.08
tpcds_q64/datafusion:parquet 🚨 652710775 577792111 1.13
tpcds_q65/datafusion:parquet 🚨 54498283 46708115 1.17
tpcds_q66/datafusion:parquet 🚨 98882891 78445545 1.26
tpcds_q67/datafusion:parquet 🚨 187433905 160137110 1.17
tpcds_q68/datafusion:parquet 🚨 46173640 39592839 1.17
tpcds_q69/datafusion:parquet 🚨 91430117 80602767 1.13
tpcds_q70/datafusion:parquet 🚨 116034965 101511409 1.14
tpcds_q71/datafusion:parquet 🚨 29066447 26407391 1.10
tpcds_q72/datafusion:parquet 🚨 783118164 661738296 1.18
tpcds_q73/datafusion:parquet 🚨 32711163 28043318 1.17
tpcds_q74/datafusion:parquet 120604505 110227334 1.09
tpcds_q75/datafusion:parquet 🚨 137734861 120351603 1.14
tpcds_q76/datafusion:parquet 39399391 36536408 1.08
tpcds_q77/datafusion:parquet 54374014 50876581 1.07
tpcds_q78/datafusion:parquet 123871185 127000831 0.98
tpcds_q79/datafusion:parquet 32762823 32973218 0.99
tpcds_q80/datafusion:parquet 100124675 99237192 1.01
tpcds_q81/datafusion:parquet 41678228 42638945 0.98
tpcds_q82/datafusion:parquet 22821861 24376105 0.94
tpcds_q83/datafusion:parquet 55270276 50248327 1.10
tpcds_q84/datafusion:parquet 52302825 48251553 1.08
tpcds_q85/datafusion:parquet 185097707 177983366 1.04
tpcds_q86/datafusion:parquet 🚨 20785423 18042406 1.15
tpcds_q87/datafusion:parquet 🚨 58837466 53479167 1.10
tpcds_q88/datafusion:parquet 78396030 71723593 1.09
tpcds_q89/datafusion:parquet 🚨 29442937 25371405 1.16
tpcds_q90/datafusion:parquet 21760929 20530997 1.06
tpcds_q91/datafusion:parquet 76629541 72841349 1.05
tpcds_q92/datafusion:parquet 24436031 23576767 1.04
tpcds_q93/datafusion:parquet 38062057 37981828 1.00
tpcds_q94/datafusion:parquet 26476436 26072556 1.02
tpcds_q95/datafusion:parquet 75992878 71721162 1.06
tpcds_q96/datafusion:parquet 16947215 15457973 1.10
tpcds_q97/datafusion:parquet 🚨 39281653 35386584 1.11
tpcds_q98/datafusion:parquet 🚨 30180239 26936781 1.12
tpcds_q99/datafusion:parquet 30220068 29833277 1.01
duckdb / vortex-file-compressed (1.248x ❌, 0↑ 79↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 26364321 26244145 1.00
tpcds_q02/duckdb:vortex-file-compressed 88971086 85134089 1.05
tpcds_q03/duckdb:vortex-file-compressed 25379562 25389299 1.00
tpcds_q04/duckdb:vortex-file-compressed 106776694 107919718 0.99
tpcds_q05/duckdb:vortex-file-compressed 🚨 123602207 98017154 1.26
tpcds_q06/duckdb:vortex-file-compressed 🚨 49999391 37878106 1.32
tpcds_q07/duckdb:vortex-file-compressed 🚨 36266331 24695493 1.47
tpcds_q08/duckdb:vortex-file-compressed 🚨 34384307 24281880 1.42
tpcds_q09/duckdb:vortex-file-compressed 🚨 56528432 40401214 1.40
tpcds_q10/duckdb:vortex-file-compressed 🚨 53882083 36957541 1.46
tpcds_q11/duckdb:vortex-file-compressed 🚨 84237521 61083303 1.38
tpcds_q12/duckdb:vortex-file-compressed 🚨 20721086 14274605 1.45
tpcds_q13/duckdb:vortex-file-compressed 🚨 51008119 34366743 1.48
tpcds_q14/duckdb:vortex-file-compressed 🚨 261292902 193797528 1.35
tpcds_q15/duckdb:vortex-file-compressed 🚨 55785834 42049574 1.33
tpcds_q16/duckdb:vortex-file-compressed 🚨 38817647 31980457 1.21
tpcds_q17/duckdb:vortex-file-compressed 🚨 62476202 40580841 1.54
tpcds_q18/duckdb:vortex-file-compressed 🚨 72959074 46364431 1.57
tpcds_q19/duckdb:vortex-file-compressed 🚨 50838693 34968257 1.45
tpcds_q20/duckdb:vortex-file-compressed 17547888 17768585 0.99
tpcds_q21/duckdb:vortex-file-compressed 23282907 21444711 1.09
tpcds_q22/duckdb:vortex-file-compressed 🚨 172289626 113781376 1.51
tpcds_q23/duckdb:vortex-file-compressed 🚨 176985632 131966662 1.34
tpcds_q24/duckdb:vortex-file-compressed 🚨 85691742 59328057 1.44
tpcds_q25/duckdb:vortex-file-compressed 🚨 44205951 39364432 1.12
tpcds_q26/duckdb:vortex-file-compressed 🚨 56903062 41471492 1.37
tpcds_q27/duckdb:vortex-file-compressed 🚨 130495820 92608483 1.41
tpcds_q28/duckdb:vortex-file-compressed 🚨 42608210 37105770 1.15
tpcds_q29/duckdb:vortex-file-compressed 🚨 51479249 40094293 1.28
tpcds_q30/duckdb:vortex-file-compressed 🚨 41302115 29071860 1.42
tpcds_q31/duckdb:vortex-file-compressed 🚨 32530140 27333138 1.19
tpcds_q32/duckdb:vortex-file-compressed 🚨 24037658 17747535 1.35
tpcds_q33/duckdb:vortex-file-compressed 🚨 106427140 67908277 1.57
tpcds_q34/duckdb:vortex-file-compressed 🚨 27376441 21185567 1.29
tpcds_q35/duckdb:vortex-file-compressed 🚨 87950536 68982327 1.27
tpcds_q36/duckdb:vortex-file-compressed 🚨 34187367 27907450 1.23
tpcds_q37/duckdb:vortex-file-compressed 🚨 34801084 22669055 1.54
tpcds_q38/duckdb:vortex-file-compressed 🚨 47902754 38729510 1.24
tpcds_q39/duckdb:vortex-file-compressed 🚨 57542640 47063260 1.22
tpcds_q40/duckdb:vortex-file-compressed 🚨 32660766 25068331 1.30
tpcds_q41/duckdb:vortex-file-compressed 🚨 18632813 14630907 1.27
tpcds_q42/duckdb:vortex-file-compressed 🚨 17962985 12091610 1.49
tpcds_q43/duckdb:vortex-file-compressed 🚨 26838692 20839254 1.29
tpcds_q44/duckdb:vortex-file-compressed 🚨 26948121 24240926 1.11
tpcds_q45/duckdb:vortex-file-compressed 🚨 39394999 29464949 1.34
tpcds_q46/duckdb:vortex-file-compressed 🚨 65681658 51612179 1.27
tpcds_q47/duckdb:vortex-file-compressed 🚨 64122806 52825416 1.21
tpcds_q48/duckdb:vortex-file-compressed 🚨 45710487 33377904 1.37
tpcds_q49/duckdb:vortex-file-compressed 🚨 37679941 30938766 1.22
tpcds_q50/duckdb:vortex-file-compressed 🚨 50094380 37882155 1.32
tpcds_q51/duckdb:vortex-file-compressed 🚨 126838158 101106482 1.25
tpcds_q52/duckdb:vortex-file-compressed 🚨 15735897 12642181 1.24
tpcds_q53/duckdb:vortex-file-compressed 🚨 24245240 19063073 1.27
tpcds_q54/duckdb:vortex-file-compressed 🚨 69809718 53346036 1.31
tpcds_q55/duckdb:vortex-file-compressed 🚨 17158214 11371764 1.51
tpcds_q56/duckdb:vortex-file-compressed 🚨 105826014 71689393 1.48
tpcds_q57/duckdb:vortex-file-compressed 🚨 54957935 45787070 1.20
tpcds_q58/duckdb:vortex-file-compressed 🚨 41764637 33770305 1.24
tpcds_q59/duckdb:vortex-file-compressed 🚨 65169622 58214464 1.12
tpcds_q60/duckdb:vortex-file-compressed 🚨 106928110 74482601 1.44
tpcds_q61/duckdb:vortex-file-compressed 🚨 51581098 40235216 1.28
tpcds_q62/duckdb:vortex-file-compressed 🚨 22519409 18427774 1.22
tpcds_q63/duckdb:vortex-file-compressed 🚨 24178624 19186096 1.26
tpcds_q64/duckdb:vortex-file-compressed 🚨 111958400 82577015 1.36
tpcds_q65/duckdb:vortex-file-compressed 🚨 26482471 23386191 1.13
tpcds_q66/duckdb:vortex-file-compressed 🚨 77672570 62118244 1.25
tpcds_q67/duckdb:vortex-file-compressed 🚨 185349919 147361979 1.26
tpcds_q68/duckdb:vortex-file-compressed 🚨 53089694 41364479 1.28
tpcds_q69/duckdb:vortex-file-compressed 🚨 53341894 38849372 1.37
tpcds_q70/duckdb:vortex-file-compressed 🚨 32869891 24774855 1.33
tpcds_q71/duckdb:vortex-file-compressed 🚨 30692275 22334292 1.37
tpcds_q72/duckdb:vortex-file-compressed 🚨 198419381 179713052 1.10
tpcds_q73/duckdb:vortex-file-compressed 🚨 25378070 19959495 1.27
tpcds_q74/duckdb:vortex-file-compressed 🚨 62149511 52805698 1.18
tpcds_q75/duckdb:vortex-file-compressed 🚨 70638830 60215374 1.17
tpcds_q76/duckdb:vortex-file-compressed 🚨 92051605 67362666 1.37
tpcds_q77/duckdb:vortex-file-compressed 75861602 71620406 1.06
tpcds_q78/duckdb:vortex-file-compressed 82264814 79682097 1.03
tpcds_q79/duckdb:vortex-file-compressed 38007233 37782650 1.01
tpcds_q80/duckdb:vortex-file-compressed 99761628 94277377 1.06
tpcds_q81/duckdb:vortex-file-compressed 36543167 35295246 1.04
tpcds_q82/duckdb:vortex-file-compressed 25012185 26227378 0.95
tpcds_q83/duckdb:vortex-file-compressed 29626531 27693495 1.07
tpcds_q84/duckdb:vortex-file-compressed 18260408 17778281 1.03
tpcds_q85/duckdb:vortex-file-compressed 50300791 47431566 1.06
tpcds_q86/duckdb:vortex-file-compressed 18841840 18734617 1.01
tpcds_q87/duckdb:vortex-file-compressed 41480067 43043889 0.96
tpcds_q88/duckdb:vortex-file-compressed 36794425 37579898 0.98
tpcds_q89/duckdb:vortex-file-compressed 🚨 21281138 18462277 1.15
tpcds_q90/duckdb:vortex-file-compressed 🚨 17442836 15018306 1.16
tpcds_q91/duckdb:vortex-file-compressed 🚨 41739842 28101211 1.49
tpcds_q92/duckdb:vortex-file-compressed 🚨 20495537 15116669 1.36
tpcds_q93/duckdb:vortex-file-compressed 🚨 40917214 31735581 1.29
tpcds_q94/duckdb:vortex-file-compressed 🚨 29710746 25094295 1.18
tpcds_q95/duckdb:vortex-file-compressed 168184657 160351071 1.05
tpcds_q96/duckdb:vortex-file-compressed 🚨 16641096 12218734 1.36
tpcds_q97/duckdb:vortex-file-compressed 🚨 48368674 39718513 1.22
tpcds_q98/duckdb:vortex-file-compressed 🚨 24417551 18876039 1.29
tpcds_q99/duckdb:vortex-file-compressed 36457081 33144480 1.10
duckdb / vortex-compact (1.215x ❌, 0↑ 86↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚨 44559299 34872276 1.28
tpcds_q02/duckdb:vortex-compact 🚨 143225037 125937774 1.14
tpcds_q03/duckdb:vortex-compact 🚨 58363824 50242169 1.16
tpcds_q04/duckdb:vortex-compact 🚨 149932965 128816013 1.16
tpcds_q05/duckdb:vortex-compact 177444916 165970025 1.07
tpcds_q06/duckdb:vortex-compact 🚨 47727365 38827490 1.23
tpcds_q07/duckdb:vortex-compact 40123355 38080946 1.05
tpcds_q08/duckdb:vortex-compact 🚨 36740947 30403608 1.21
tpcds_q09/duckdb:vortex-compact 🚨 126305301 112840837 1.12
tpcds_q10/duckdb:vortex-compact 48368891 47354003 1.02
tpcds_q11/duckdb:vortex-compact 79919485 75752759 1.06
tpcds_q12/duckdb:vortex-compact 23025813 21850534 1.05
tpcds_q13/duckdb:vortex-compact 🚨 56264131 48521364 1.16
tpcds_q14/duckdb:vortex-compact 🚨 318821437 284772591 1.12
tpcds_q15/duckdb:vortex-compact 🚨 61865601 48256265 1.28
tpcds_q16/duckdb:vortex-compact 🚨 49822477 3970445 1.25
tpcds_q17/duckdb:vortex-compact 🚨 70222868 53111500 1.32
tpcds_q18/duckdb:vortex-compact 🚨 87213953 70338513 1.24
tpcds_q19/duckdb:vortex-compact 🚨 55254131 40911838 1.35
tpcds_q20/duckdb:vortex-compact 🚨 29724007 21427131 1.39
tpcds_q21/duckdb:vortex-compact 🚨 38238819 29564884 1.29
tpcds_q22/duckdb:vortex-compact 🚨 168841529 124255802 1.36
tpcds_q23/duckdb:vortex-compact 182741506 176317682 1.04
tpcds_q24/duckdb:vortex-compact 🚨 90764503 71162723 1.28
tpcds_q25/duckdb:vortex-compact 🚨 67251963 49240116 1.37
tpcds_q26/duckdb:vortex-compact 🚨 75165128 50085744 1.50
tpcds_q27/duckdb:vortex-compact 🚨 166387609 134924843 1.23
tpcds_q28/duckdb:vortex-compact 🚨 128756935 110360063 1.17
tpcds_q29/duckdb:vortex-compact 🚨 71725769 49646475 1.44
tpcds_q30/duckdb:vortex-compact 🚨 45036026 36459345 1.24
tpcds_q31/duckdb:vortex-compact 🚨 39116789 31925719 1.23
tpcds_q32/duckdb:vortex-compact 🚨 33597091 24086636 1.39
tpcds_q33/duckdb:vortex-compact 🚨 167823851 136837507 1.23
tpcds_q34/duckdb:vortex-compact 🚨 33335722 25189573 1.32
tpcds_q35/duckdb:vortex-compact 🚨 94146820 71368738 1.32
tpcds_q36/duckdb:vortex-compact 🚨 43781244 35852205 1.22
tpcds_q37/duckdb:vortex-compact 🚨 41606318 31292028 1.33
tpcds_q38/duckdb:vortex-compact 🚨 50514660 44344827 1.14
tpcds_q39/duckdb:vortex-compact 🚨 67916231 57583179 1.18
tpcds_q40/duckdb:vortex-compact 🚨 41989220 31981547 1.31
tpcds_q41/duckdb:vortex-compact 🚨 24409540 17979317 1.36
tpcds_q42/duckdb:vortex-compact 🚨 22309585 15850174 1.41
tpcds_q43/duckdb:vortex-compact 🚨 29745529 24449600 1.22
tpcds_q44/duckdb:vortex-compact 🚨 40250501 33509453 1.20
tpcds_q45/duckdb:vortex-compact 🚨 51271076 33601895 1.53
tpcds_q46/duckdb:vortex-compact 🚨 74251304 57788155 1.28
tpcds_q47/duckdb:vortex-compact 🚨 73497152 56617533 1.30
tpcds_q48/duckdb:vortex-compact 🚨 54212064 42040773 1.29
tpcds_q49/duckdb:vortex-compact 🚨 66582150 47926346 1.39
tpcds_q50/duckdb:vortex-compact 🚨 57754994 43179863 1.34
tpcds_q51/duckdb:vortex-compact 🚨 131721754 106240663 1.24
tpcds_q52/duckdb:vortex-compact 🚨 18638229 15881687 1.17
tpcds_q53/duckdb:vortex-compact 🚨 31292076 23232010 1.35
tpcds_q54/duckdb:vortex-compact 🚨 110928399 88863530 1.25
tpcds_q55/duckdb:vortex-compact 🚨 21162892 16062576 1.32
tpcds_q56/duckdb:vortex-compact 🚨 168380814 134328304 1.25
tpcds_q57/duckdb:vortex-compact 🚨 62675135 48403156 1.29
tpcds_q58/duckdb:vortex-compact 🚨 53678656 40863376 1.31
tpcds_q59/duckdb:vortex-compact 🚨 76306181 68246924 1.12
tpcds_q60/duckdb:vortex-compact 147978420 142618741 1.04
tpcds_q61/duckdb:vortex-compact 54017766 50124592 1.08
tpcds_q62/duckdb:vortex-compact 🚨 33181701 24046585 1.38
tpcds_q63/duckdb:vortex-compact 🚨 26934739 23106721 1.17
tpcds_q64/duckdb:vortex-compact 🚨 117553604 102483169 1.15
tpcds_q65/duckdb:vortex-compact 🚨 31623909 28205255 1.12
tpcds_q66/duckdb:vortex-compact 🚨 122479782 98764293 1.24
tpcds_q67/duckdb:vortex-compact 🚨 204077353 157138370 1.30
tpcds_q68/duckdb:vortex-compact 🚨 67742091 52298170 1.30
tpcds_q69/duckdb:vortex-compact 🚨 61701087 47928721 1.29
tpcds_q70/duckdb:vortex-compact 🚨 35537167 29995648 1.18
tpcds_q71/duckdb:vortex-compact 🚨 36212912 27500798 1.32
tpcds_q72/duckdb:vortex-compact 🚨 237695219 203296601 1.17
tpcds_q73/duckdb:vortex-compact 🚨 31001832 24686226 1.26
tpcds_q74/duckdb:vortex-compact 🚨 71810283 57760945 1.24
tpcds_q75/duckdb:vortex-compact 85635067 79697122 1.07
tpcds_q76/duckdb:vortex-compact 🚨 148583642 132990575 1.12
tpcds_q77/duckdb:vortex-compact 🚨 155559387 131189572 1.19
tpcds_q78/duckdb:vortex-compact 🚨 108129275 87871614 1.23
tpcds_q79/duckdb:vortex-compact 🚨 66303570 56630468 1.17
tpcds_q80/duckdb:vortex-compact 🚨 183357094 162987708 1.12
tpcds_q81/duckdb:vortex-compact 🚨 48444742 42530147 1.14
tpcds_q82/duckdb:vortex-compact 🚨 42400344 31866856 1.33
tpcds_q83/duckdb:vortex-compact 🚨 52138293 46856765 1.11
tpcds_q84/duckdb:vortex-compact 🚨 26167452 21902868 1.19
tpcds_q85/duckdb:vortex-compact 🚨 74569770 65420001 1.14
tpcds_q86/duckdb:vortex-compact 🚨 22464503 20279913 1.11
tpcds_q87/duckdb:vortex-compact 🚨 51195380 42146059 1.21
tpcds_q88/duckdb:vortex-compact 🚨 44279031 39830825 1.11
tpcds_q89/duckdb:vortex-compact 26299423 24028050 1.09
tpcds_q90/duckdb:vortex-compact 🚨 19898959 16861340 1.18
tpcds_q91/duckdb:vortex-compact 🚨 54591238 47677137 1.15
tpcds_q92/duckdb:vortex-compact 🚨 24889427 21623602 1.15
tpcds_q93/duckdb:vortex-compact 🚨 48575100 38423458 1.26
tpcds_q94/duckdb:vortex-compact 🚨 38976014 31563724 1.23
tpcds_q95/duckdb:vortex-compact 🚨 188860815 165117339 1.14
tpcds_q96/duckdb:vortex-compact 🚨 15564311 13822635 1.13
tpcds_q97/duckdb:vortex-compact 44200563 42565380 1.04
tpcds_q98/duckdb:vortex-compact 25342175 23568525 1.08
tpcds_q99/duckdb:vortex-compact 39537017 41213592 0.96
duckdb / parquet (1.004x ➖, 2↑ 1↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 🚀 46088717 54033778 0.85
tpcds_q02/duckdb:parquet 64194032 63172751 1.02
tpcds_q03/duckdb:parquet 12724563 12459448 1.02
tpcds_q04/duckdb:parquet 133170882 127779059 1.04
tpcds_q05/duckdb:parquet 74940290 72548226 1.03
tpcds_q06/duckdb:parquet 30836916 29882988 1.03
tpcds_q07/duckdb:parquet 24857196 24141413 1.03
tpcds_q08/duckdb:parquet 28974686 29698337 0.98
tpcds_q09/duckdb:parquet 40387952 39863148 1.01
tpcds_q10/duckdb:parquet 37878366 36526499 1.04
tpcds_q11/duckdb:parquet 86480158 88992172 0.97
tpcds_q12/duckdb:parquet 14402815 15203175 0.95
tpcds_q13/duckdb:parquet 34450839 35675941 0.97
tpcds_q14/duckdb:parquet 172854169 167758995 1.03
tpcds_q15/duckdb:parquet 31527091 30270152 1.04
tpcds_q16/duckdb:parquet 22444650 22044115 1.02
tpcds_q17/duckdb:parquet 38843805 38460674 1.01
tpcds_q18/duckdb:parquet 47117333 45003824 1.05
tpcds_q19/duckdb:parquet 29902674 29277770 1.02
tpcds_q20/duckdb:parquet 15358452 16142457 0.95
tpcds_q21/duckdb:parquet 11776413 12613395 0.93
tpcds_q22/duckdb:parquet 76835898 75230143 1.02
tpcds_q23/duckdb:parquet 122484776 114408436 1.07
tpcds_q24/duckdb:parquet 47180254 45806031 1.03
tpcds_q25/duckdb:parquet 34205865 33886583 1.01
tpcds_q26/duckdb:parquet 39181418 37634635 1.04
tpcds_q27/duckdb:parquet 90055165 90814250 0.99
tpcds_q28/duckdb:parquet 37255853 37059271 1.01
tpcds_q29/duckdb:parquet 36447941 36011121 1.01
tpcds_q30/duckdb:parquet 40209594 41887476 0.96
tpcds_q31/duckdb:parquet 22231983 24463955 0.91
tpcds_q32/duckdb:parquet 11055611 11158602 0.99
tpcds_q33/duckdb:parquet 75774183 73372201 1.03
tpcds_q34/duckdb:parquet 22357402 21619814 1.03
tpcds_q35/duckdb:parquet 60875190 60990206 1.00
tpcds_q36/duckdb:parquet 21442128 20856914 1.03
tpcds_q37/duckdb:parquet 14214244 13942509 1.02
tpcds_q38/duckdb:parquet 36445878 35748152 1.02
tpcds_q39/duckdb:parquet 33028472 33668869 0.98
tpcds_q40/duckdb:parquet 18207644 18712580 0.97
tpcds_q41/duckdb:parquet 7787699 7914645 0.98
tpcds_q42/duckdb:parquet 10646334 10588438 1.01
tpcds_q43/duckdb:parquet 16254824 16200647 1.00
tpcds_q44/duckdb:parquet 22129267 21933732 1.01
tpcds_q45/duckdb:parquet 28201872 30176505 0.93
tpcds_q46/duckdb:parquet 47029821 47056261 1.00
tpcds_q47/duckdb:parquet 48681694 46604281 1.04
tpcds_q48/duckdb:parquet 33149921 30705484 1.08
tpcds_q49/duckdb:parquet 24357225 25368156 0.96
tpcds_q50/duckdb:parquet 25379030 24702115 1.03
tpcds_q51/duckdb:parquet 95682819 97284316 0.98
tpcds_q52/duckdb:parquet 11365790 10938137 1.04
tpcds_q53/duckdb:parquet 17317471 16831157 1.03
tpcds_q54/duckdb:parquet 42213454 43096576 0.98
tpcds_q55/duckdb:parquet 11289256 10568370 1.07
tpcds_q56/duckdb:parquet 69276577 69091248 1.00
tpcds_q57/duckdb:parquet 35249153 34748491 1.01
tpcds_q58/duckdb:parquet 21872116 21795926 1.00
tpcds_q59/duckdb:parquet 36440499 36738275 0.99
tpcds_q60/duckdb:parquet 77494016 71772293 1.08
tpcds_q61/duckdb:parquet 32580289 32257204 1.01
tpcds_q62/duckdb:parquet 11907028 12216870 0.97
tpcds_q63/duckdb:parquet 15655213 15648717 1.00
tpcds_q64/duckdb:parquet 78162199 74642643 1.05
tpcds_q65/duckdb:parquet 21311574 20518588 1.04
tpcds_q66/duckdb:parquet 56220076 59522740 0.94
tpcds_q67/duckdb:parquet 144291444 136815353 1.05
tpcds_q68/duckdb:parquet 39000963 38172910 1.02
tpcds_q69/duckdb:parquet 39198093 38224864 1.03
tpcds_q70/duckdb:parquet 20228856 19686918 1.03
tpcds_q71/duckdb:parquet 🚨 20096728 18157451 1.11
tpcds_q72/duckdb:parquet 168981895 166970061 1.01
tpcds_q73/duckdb:parquet 18713124 19222387 0.97
tpcds_q74/duckdb:parquet 🚀 47964955 53555736 0.90
tpcds_q75/duckdb:parquet 52373899 53553953 0.98
tpcds_q76/duckdb:parquet 68176152 73410172 0.93
tpcds_q77/duckdb:parquet 67384609 61785643 1.09
tpcds_q78/duckdb:parquet 78331817 76556172 1.02
tpcds_q79/duckdb:parquet 29619879 28146919 1.05
tpcds_q80/duckdb:parquet 85931194 84667905 1.01
tpcds_q81/duckdb:parquet 48607693 47254621 1.03
tpcds_q82/duckdb:parquet 16043916 15352423 1.05
tpcds_q83/duckdb:parquet 17005434 16278793 1.04
tpcds_q84/duckdb:parquet 20340202 19400162 1.05
tpcds_q85/duckdb:parquet 42505932 41622682 1.02
tpcds_q86/duckdb:parquet 12483909 12415965 1.01
tpcds_q87/duckdb:parquet 38191858 37102569 1.03
tpcds_q88/duckdb:parquet 29954618 29387792 1.02
tpcds_q89/duckdb:parquet 17746444 18190420 0.98
tpcds_q90/duckdb:parquet 7445588 7943801 0.94
tpcds_q91/duckdb:parquet 22878032 23502657 0.97
tpcds_q92/duckdb:parquet 12299597 12169098 1.01
tpcds_q93/duckdb:parquet 32499340 30350273 1.07
tpcds_q94/duckdb:parquet 17576280 18481247 0.95
tpcds_q95/duckdb:parquet 134197737 142341732 0.94
tpcds_q96/duckdb:parquet 9292108 9578239 0.97
tpcds_q97/duckdb:parquet 34540980 36347737 0.95
tpcds_q98/duckdb:parquet 17980698 18557825 0.97
tpcds_q99/duckdb:parquet 19713680 20439018 0.96
duckdb / duckdb (1.007x ➖, 3↑ 4↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 21193950 19663669 1.08
tpcds_q02/duckdb:duckdb 20059619 19144440 1.05
tpcds_q03/duckdb:duckdb 8982980 8268974 1.09
tpcds_q04/duckdb:duckdb 165545745 165804388 1.00
tpcds_q05/duckdb:duckdb 18852206 18773984 1.00
tpcds_q06/duckdb:duckdb 24101228 22709644 1.06
tpcds_q07/duckdb:duckdb 38751910 38747754 1.00
tpcds_q08/duckdb:duckdb 119982172 122287362 0.98
tpcds_q09/duckdb:duckdb 19600331 19981479 0.98
tpcds_q10/duckdb:duckdb 23955384 23385349 1.02
tpcds_q11/duckdb:duckdb 143526466 142869432 1.00
tpcds_q12/duckdb:duckdb 11949216 11609332 1.03
tpcds_q13/duckdb:duckdb 23830100 24073394 0.99
tpcds_q14/duckdb:duckdb 96005786 94753696 1.01
tpcds_q15/duckdb:duckdb 25837427 25420477 1.02
tpcds_q16/duckdb:duckdb 18654142 18127457 1.03
tpcds_q17/duckdb:duckdb 23091130 22355478 1.03
tpcds_q18/duckdb:duckdb 45739306 45308696 1.01
tpcds_q19/duckdb:duckdb 17641111 16984758 1.04
tpcds_q20/duckdb:duckdb 12152751 12523112 0.97
tpcds_q21/duckdb:duckdb 7340514 6893918 1.06
tpcds_q22/duckdb:duckdb 65166491 65044850 1.00
tpcds_q23/duckdb:duckdb 81461228 79446946 1.03
tpcds_q24/duckdb:duckdb 24391320 24794088 0.98
tpcds_q25/duckdb:duckdb 16991971 17516503 0.97
tpcds_q26/duckdb:duckdb 🚀 22985078 27656564 0.83
tpcds_q27/duckdb:duckdb 37283114 40986742 0.91
tpcds_q28/duckdb:duckdb 21692772 21768095 1.00
tpcds_q29/duckdb:duckdb 19564476 20044494 0.98
tpcds_q30/duckdb:duckdb 29185938 30696977 0.95
tpcds_q31/duckdb:duckdb 19413887 20043299 0.97
tpcds_q32/duckdb:duckdb 7315618 7496615 0.98
tpcds_q33/duckdb:duckdb 🚀 12348401 13768028 0.90
tpcds_q34/duckdb:duckdb 15488551 14597337 1.06
tpcds_q35/duckdb:duckdb 33860353 33264219 1.02
tpcds_q36/duckdb:duckdb 74607334 73154219 1.02
tpcds_q37/duckdb:duckdb 8273454 7638685 1.08
tpcds_q38/duckdb:duckdb 29923377 30049483 1.00
tpcds_q39/duckdb:duckdb 🚨 30655837 26225861 1.17
tpcds_q40/duckdb:duckdb 13890363 14472968 0.96
tpcds_q41/duckdb:duckdb 8521870 8435179 1.01
tpcds_q42/duckdb:duckdb 🚨 6905013 5989587 1.15
tpcds_q43/duckdb:duckdb 11496773 11408818 1.01
tpcds_q44/duckdb:duckdb 13101499 12462794 1.05
tpcds_q45/duckdb:duckdb 18302897 17579700 1.04
tpcds_q46/duckdb:duckdb 37387722 37222135 1.00
tpcds_q47/duckdb:duckdb 42366838 42220255 1.00
tpcds_q48/duckdb:duckdb 22575594 21439892 1.05
tpcds_q49/duckdb:duckdb 16600116 16337780 1.02
tpcds_q50/duckdb:duckdb 14930512 14224454 1.05
tpcds_q51/duckdb:duckdb 95763637 92328743 1.04
tpcds_q52/duckdb:duckdb 7856709 7467578 1.05
tpcds_q53/duckdb:duckdb 11530368 12133771 0.95
tpcds_q54/duckdb:duckdb 17475492 16982063 1.03
tpcds_q55/duckdb:duckdb 6862002 7015817 0.98
tpcds_q56/duckdb:duckdb 14171602 13956338 1.02
tpcds_q57/duckdb:duckdb 🚀 30208750 33710086 0.90
tpcds_q58/duckdb:duckdb 12054954 13057341 0.92
tpcds_q59/duckdb:duckdb 34075661 35036105 0.97
tpcds_q60/duckdb:duckdb 14565519 14406083 1.01
tpcds_q61/duckdb:duckdb 14012547 14266463 0.98
tpcds_q62/duckdb:duckdb 9049175 9167833 0.99
tpcds_q63/duckdb:duckdb 11689556 11242768 1.04
tpcds_q64/duckdb:duckdb 55526645 54376645 1.02
tpcds_q65/duckdb:duckdb 36221568 33889595 1.07
tpcds_q66/duckdb:duckdb 25516823 25097370 1.02
tpcds_q67/duckdb:duckdb 139050251 130398039 1.07
tpcds_q68/duckdb:duckdb 26087312 25329132 1.03
tpcds_q69/duckdb:duckdb 24717679 24429288 1.01
tpcds_q70/duckdb:duckdb 14735690 14789819 1.00
tpcds_q71/duckdb:duckdb 13156518 12575180 1.05
tpcds_q72/duckdb:duckdb 41726339 42709977 0.98
tpcds_q73/duckdb:duckdb 11145544 10896209 1.02
tpcds_q74/duckdb:duckdb 99852014 100234014 1.00
tpcds_q75/duckdb:duckdb 41494606 43666246 0.95
tpcds_q76/duckdb:duckdb 🚨 13026527 11716580 1.11
tpcds_q77/duckdb:duckdb 11774953 11930214 0.99
tpcds_q78/duckdb:duckdb 60558119 65309734 0.93
tpcds_q79/duckdb:duckdb 17736685 18916534 0.94
tpcds_q80/duckdb:duckdb 27682022 28056802 0.99
tpcds_q81/duckdb:duckdb 36559632 38040404 0.96
tpcds_q82/duckdb:duckdb 8018345 8763351 0.91
tpcds_q83/duckdb:duckdb 8643810 9287183 0.93
tpcds_q84/duckdb:duckdb 13709631 14564409 0.94
tpcds_q85/duckdb:duckdb 24689640 22875575 1.08
tpcds_q86/duckdb:duckdb 10385078 11003283 0.94
tpcds_q87/duckdb:duckdb 34589805 37388580 0.93
tpcds_q88/duckdb:duckdb 24547423 24367421 1.01
tpcds_q89/duckdb:duckdb 13606619 13446555 1.01
tpcds_q90/duckdb:duckdb 6250759 5756666 1.09
tpcds_q91/duckdb:duckdb 12869743 13289189 0.97
tpcds_q92/duckdb:duckdb 9221130 8855447 1.04
tpcds_q93/duckdb:duckdb 23992895 23299145 1.03
tpcds_q94/duckdb:duckdb 13200295 13151393 1.00
tpcds_q95/duckdb:duckdb 134224523 129640167 1.04
tpcds_q96/duckdb:duckdb 4702901 4530975 1.04
tpcds_q97/duckdb:duckdb 30827851 29985971 1.03
tpcds_q98/duckdb:duckdb 14362618 13534820 1.06
tpcds_q99/duckdb:duckdb 🚨 18011901 16104369 1.12
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +21.9% -2.5% +25.1% +10.0% 🚨 regression
1 datafusion:vortex-file-compressed +8.6% -2.5% +11.4% +11.8% ➖ noise
1 duckdb:duckdb +7.8% -2.5% +10.6% +12.0% ➖ noise
1 duckdb:vortex-compact +27.8% -2.5% +31.1% +15.4% 🚨 regression
1 duckdb:vortex-file-compressed +0.5% -2.5% +3.0% +10.8% ➖ noise
2 datafusion:vortex-compact +22.7% +8.7% +12.9% +11.5% 🚨 regression
2 datafusion:vortex-file-compressed +16.2% +8.7% +6.9% +10.7% ➖ noise
2 duckdb:duckdb +4.8% +8.7% -3.6% +14.3% ➖ noise
2 duckdb:vortex-compact +13.7% +8.7% +4.6% +10.4% ➖ noise
2 duckdb:vortex-file-compressed +4.5% +8.7% -3.9% +10.0% ➖ noise
3 datafusion:vortex-compact +7.9% +0.5% +7.4% +12.3% ➖ noise
3 datafusion:vortex-file-compressed +12.9% +0.5% +12.4% +12.0% 🚨 regression
3 duckdb:duckdb +8.6% +0.5% +8.1% +13.9% ➖ noise
3 duckdb:vortex-compact +16.2% +0.5% +15.6% +15.3% 🚨 regression
3 duckdb:vortex-file-compressed -0.0% +0.5% -0.5% +12.9% ➖ noise
4 datafusion:vortex-compact +28.3% +7.7% +19.1% +10.0% 🚨 regression
4 datafusion:vortex-file-compressed +16.1% +7.7% +7.8% +10.0% ➖ noise
4 duckdb:duckdb -0.2% +7.7% -7.3% +10.0% ➖ noise
4 duckdb:vortex-compact +16.4% +7.7% +8.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.1% +7.7% -8.1% +10.0% ➖ noise
5 datafusion:vortex-compact +28.4% +10.9% +15.7% +21.4% ➖ noise
5 datafusion:vortex-file-compressed +15.5% +10.9% +4.1% +10.4% ➖ noise
5 duckdb:duckdb +0.4% +10.9% -9.5% +16.4% ➖ noise
5 duckdb:vortex-compact +6.9% +10.9% -3.6% +17.8% ➖ noise
5 duckdb:vortex-file-compressed +26.1% +10.9% +13.7% +24.0% ➖ noise
6 datafusion:vortex-compact +36.3% +2.3% +33.2% +14.7% 🚨 regression
6 datafusion:vortex-file-compressed +14.6% +2.3% +12.0% +10.0% 🚨 regression
6 duckdb:duckdb +6.1% +2.3% +3.7% +18.9% ➖ noise
6 duckdb:vortex-compact +22.9% +2.3% +20.1% +10.0% 🚨 regression
6 duckdb:vortex-file-compressed +32.0% +2.3% +29.0% +11.9% 🚨 regression
7 datafusion:vortex-compact +24.5% +9.2% +14.0% +15.8% ➖ noise
7 datafusion:vortex-file-compressed +15.4% +9.2% +5.7% +10.0% ➖ noise
7 duckdb:duckdb +0.0% +9.2% -8.4% +16.6% ➖ noise
7 duckdb:vortex-compact +5.4% +9.2% -3.5% +11.8% ➖ noise
7 duckdb:vortex-file-compressed +46.9% +9.2% +34.5% +14.6% 🚨 regression
8 datafusion:vortex-compact +23.8% +5.0% +18.0% +10.0% 🚨 regression
8 datafusion:vortex-file-compressed +5.4% +5.0% +0.4% +10.0% ➖ noise
8 duckdb:duckdb -1.9% +5.0% -6.5% +10.0% ➖ noise
8 duckdb:vortex-compact +20.8% +5.0% +15.1% +12.9% 🚨 regression
8 duckdb:vortex-file-compressed +41.6% +5.0% +34.9% +10.0% 🚨 regression
9 datafusion:vortex-compact +20.3% +8.4% +11.0% +10.0% 🚨 regression
9 datafusion:vortex-file-compressed +7.3% +8.4% -1.0% +10.0% ➖ noise
9 duckdb:duckdb -1.9% +8.4% -9.5% +10.0% ✅ faster
9 duckdb:vortex-compact +11.9% +8.4% +3.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +39.9% +8.4% +29.1% +17.0% 🚨 regression
10 datafusion:vortex-compact +24.0% +11.5% +11.2% +10.2% 🚨 regression
10 datafusion:vortex-file-compressed +13.4% +11.5% +1.7% +13.2% ➖ noise
10 duckdb:duckdb +2.4% +11.5% -8.1% +10.0% ➖ noise
10 duckdb:vortex-compact +2.1% +11.5% -8.4% +13.9% ➖ noise
10 duckdb:vortex-file-compressed +45.8% +11.5% +30.8% +13.5% 🚨 regression
11 datafusion:vortex-compact +28.5% +8.3% +18.7% +10.0% 🚨 regression
11 datafusion:vortex-file-compressed +17.9% +8.3% +8.9% +10.0% ➖ noise
11 duckdb:duckdb +0.5% +8.3% -7.2% +10.0% ➖ noise
11 duckdb:vortex-compact +5.5% +8.3% -2.6% +14.2% ➖ noise
11 duckdb:vortex-file-compressed +37.9% +8.3% +27.4% +10.0% 🚨 regression
12 datafusion:vortex-compact +9.8% +8.5% +1.2% +19.2% ➖ noise
12 datafusion:vortex-file-compressed +16.9% +8.5% +7.7% +12.3% ➖ noise
12 duckdb:duckdb +2.9% +8.5% -5.2% +11.8% ➖ noise
12 duckdb:vortex-compact +5.4% +8.5% -2.9% +16.1% ➖ noise
12 duckdb:vortex-file-compressed +45.2% +8.5% +33.8% +24.2% 🚨 regression
13 datafusion:vortex-compact +13.5% +0.9% +12.5% +10.1% 🚨 regression
13 datafusion:vortex-file-compressed +16.8% +0.9% +15.7% +10.0% 🚨 regression
13 duckdb:duckdb -1.0% +0.9% -1.9% +10.0% ➖ noise
13 duckdb:vortex-compact +16.0% +0.9% +14.9% +10.0% 🚨 regression
13 duckdb:vortex-file-compressed +48.4% +0.9% +47.1% +21.3% 🚨 regression
14 datafusion:vortex-compact +18.1% +8.1% +9.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +14.5% +8.1% +5.9% +10.0% ➖ noise
14 duckdb:duckdb +1.3% +8.1% -6.3% +10.0% ➖ noise
14 duckdb:vortex-compact +12.0% +8.1% +3.5% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +34.8% +8.1% +24.7% +10.0% 🚨 regression
15 datafusion:vortex-compact +25.7% +6.9% +17.6% +18.5% ➖ noise
15 datafusion:vortex-file-compressed +8.0% +6.9% +1.0% +17.2% ➖ noise
15 duckdb:duckdb +1.6% +6.9% -4.9% +13.8% ➖ noise
15 duckdb:vortex-compact +28.2% +6.9% +20.0% +10.8% 🚨 regression
15 duckdb:vortex-file-compressed +32.7% +6.9% +24.1% +12.9% 🚨 regression
16 datafusion:vortex-compact +20.5% +6.9% +12.8% +10.0% 🚨 regression
16 datafusion:vortex-file-compressed +6.7% +6.9% -0.2% +10.0% ➖ noise
16 duckdb:duckdb +2.9% +6.9% -3.7% +14.3% ➖ noise
16 duckdb:vortex-compact +25.5% +6.9% +17.4% +11.6% 🚨 regression
16 duckdb:vortex-file-compressed +21.4% +6.9% +13.6% +17.9% ➖ noise
17 datafusion:vortex-compact +20.2% +5.4% +14.0% +10.0% 🚨 regression
17 datafusion:vortex-file-compressed +15.3% +5.4% +9.4% +10.0% ➖ noise
17 duckdb:duckdb +3.3% +5.4% -2.0% +10.0% ➖ noise
17 duckdb:vortex-compact +32.2% +5.4% +25.4% +10.0% 🚨 regression
17 duckdb:vortex-file-compressed +54.0% +5.4% +46.1% +20.2% 🚨 regression
18 datafusion:vortex-compact +29.4% +8.5% +19.3% +10.1% 🚨 regression
18 datafusion:vortex-file-compressed +8.7% +8.5% +0.2% +10.0% ➖ noise
18 duckdb:duckdb +1.0% +8.5% -6.9% +10.0% ➖ noise
18 duckdb:vortex-compact +24.0% +8.5% +14.3% +14.0% 🚨 regression
18 duckdb:vortex-file-compressed +57.4% +8.5% +45.1% +10.0% 🚨 regression
19 datafusion:vortex-compact +16.5% +7.4% +8.4% +12.8% ➖ noise
19 datafusion:vortex-file-compressed +12.1% +7.4% +4.4% +10.0% ➖ noise
19 duckdb:duckdb +3.9% +7.4% -3.3% +10.3% ➖ noise
19 duckdb:vortex-compact +35.1% +7.4% +25.7% +11.1% 🚨 regression
19 duckdb:vortex-file-compressed +45.4% +7.4% +35.3% +16.2% 🚨 regression
20 datafusion:vortex-compact +33.7% +5.3% +27.0% +10.0% 🚨 regression
20 datafusion:vortex-file-compressed +16.4% +5.3% +10.6% +10.0% 🚨 regression
20 duckdb:duckdb -3.0% +5.3% -7.8% +11.5% ➖ noise
20 duckdb:vortex-compact +38.7% +5.3% +31.8% +12.4% 🚨 regression
20 duckdb:vortex-file-compressed -1.2% +5.3% -6.2% +14.0% ➖ noise
21 datafusion:vortex-compact +31.2% +4.4% +25.6% +10.0% 🚨 regression
21 datafusion:vortex-file-compressed +9.2% +4.4% +4.5% +10.0% ➖ noise
21 duckdb:duckdb +6.5% +4.4% +2.0% +26.3% ➖ noise
21 duckdb:vortex-compact +29.3% +4.4% +23.9% +15.7% 🚨 regression
21 duckdb:vortex-file-compressed +8.6% +4.4% +4.0% +10.0% ➖ noise
22 datafusion:vortex-compact +26.1% +18.8% +6.1% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +14.7% +18.8% -3.4% +10.8% ➖ noise
22 duckdb:duckdb +0.2% +18.8% -15.7% +11.2% ✅ faster
22 duckdb:vortex-compact +35.9% +18.8% +14.3% +11.2% 🚨 regression
22 duckdb:vortex-file-compressed +51.4% +18.8% +27.4% +21.2% 🚨 regression
23 datafusion:vortex-compact +20.2% +13.3% +6.1% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +19.8% +13.3% +5.7% +10.0% ➖ noise
23 duckdb:duckdb +2.5% +13.3% -9.5% +15.0% ➖ noise
23 duckdb:vortex-compact +3.6% +13.3% -8.5% +11.1% ➖ noise
23 duckdb:vortex-file-compressed +34.1% +13.3% +18.3% +10.1% 🚨 regression
24 datafusion:vortex-compact +24.7% +7.9% +15.6% +10.0% 🚨 regression
24 datafusion:vortex-file-compressed +15.6% +7.9% +7.2% +10.0% ➖ noise
24 duckdb:duckdb -1.6% +7.9% -8.8% +10.0% ➖ noise
24 duckdb:vortex-compact +27.5% +7.9% +18.2% +10.0% 🚨 regression
24 duckdb:vortex-file-compressed +44.4% +7.9% +33.9% +10.0% 🚨 regression
25 datafusion:vortex-compact +22.7% +8.2% +13.4% +10.0% 🚨 regression
25 datafusion:vortex-file-compressed +12.2% +8.2% +3.7% +10.0% ➖ noise
25 duckdb:duckdb -3.0% +8.2% -10.4% +10.6% ✅ faster
25 duckdb:vortex-compact +36.6% +8.2% +26.2% +16.7% 🚨 regression
25 duckdb:vortex-file-compressed +12.3% +8.2% +3.8% +19.3% ➖ noise
26 datafusion:vortex-compact +28.7% +9.6% +17.5% +11.4% 🚨 regression
26 datafusion:vortex-file-compressed +19.5% +9.6% +9.0% +11.0% ➖ noise
26 duckdb:duckdb -16.9% +9.6% -24.2% +17.7% ✅ faster
26 duckdb:vortex-compact +50.1% +9.6% +36.9% +18.2% 🚨 regression
26 duckdb:vortex-file-compressed +37.2% +9.6% +25.2% +20.4% 🚨 regression
27 datafusion:vortex-compact +28.4% +6.8% +20.2% +10.0% 🚨 regression
27 datafusion:vortex-file-compressed +11.1% +6.8% +4.0% +10.0% ➖ noise
27 duckdb:duckdb -9.0% +6.8% -14.8% +18.1% ➖ noise
27 duckdb:vortex-compact +23.3% +6.8% +15.5% +10.0% 🚨 regression
27 duckdb:vortex-file-compressed +40.9% +6.8% +31.9% +10.0% 🚨 regression
28 datafusion:vortex-compact +15.3% +2.5% +12.5% +10.0% 🚨 regression
28 datafusion:vortex-file-compressed +11.2% +2.5% +8.4% +12.3% ➖ noise
28 duckdb:duckdb -0.3% +2.5% -2.8% +10.0% ➖ noise
28 duckdb:vortex-compact +16.7% +2.5% +13.8% +10.0% 🚨 regression
28 duckdb:vortex-file-compressed +14.8% +2.5% +12.0% +17.2% ➖ noise
29 datafusion:vortex-compact +26.4% +6.1% +19.1% +10.0% 🚨 regression
29 datafusion:vortex-file-compressed +8.0% +6.1% +1.7% +10.6% ➖ noise
29 duckdb:duckdb -2.4% +6.1% -8.0% +11.2% ➖ noise
29 duckdb:vortex-compact +44.5% +6.1% +36.1% +10.0% 🚨 regression
29 duckdb:vortex-file-compressed +28.4% +6.1% +21.0% +25.0% ➖ noise
30 datafusion:vortex-compact +30.2% +1.8% +27.9% +10.0% 🚨 regression
30 datafusion:vortex-file-compressed +9.0% +1.8% +7.1% +10.0% ➖ noise
30 duckdb:duckdb -4.9% +1.8% -6.6% +10.0% ➖ noise
30 duckdb:vortex-compact +23.5% +1.8% +21.3% +10.0% 🚨 regression
30 duckdb:vortex-file-compressed +42.1% +1.8% +39.5% +10.0% 🚨 regression
31 datafusion:vortex-compact +14.0% +0.4% +13.5% +10.0% 🚨 regression
31 datafusion:vortex-file-compressed +8.6% +0.4% +8.1% +10.0% ➖ noise
31 duckdb:duckdb -3.1% +0.4% -3.6% +10.0% ➖ noise
31 duckdb:vortex-compact +22.5% +0.4% +22.0% +15.1% 🚨 regression
31 duckdb:vortex-file-compressed +19.0% +0.4% +18.5% +12.9% 🚨 regression
32 datafusion:vortex-compact +15.5% +5.3% +9.6% +12.5% ➖ noise
32 datafusion:vortex-file-compressed +1.5% +5.3% -3.6% +16.8% ➖ noise
32 duckdb:duckdb -2.4% +5.3% -7.3% +17.2% ➖ noise
32 duckdb:vortex-compact +39.5% +5.3% +32.4% +26.9% 🚨 regression
32 duckdb:vortex-file-compressed +35.4% +5.3% +28.6% +14.0% 🚨 regression
33 datafusion:vortex-compact +20.7% +9.3% +10.4% +13.4% ➖ noise
33 datafusion:vortex-file-compressed +12.7% +9.3% +3.1% +10.0% ➖ noise
33 duckdb:duckdb -10.3% +9.3% -17.9% +15.8% ✅ faster
33 duckdb:vortex-compact +22.6% +9.3% +12.2% +10.0% 🚨 regression
33 duckdb:vortex-file-compressed +56.7% +9.3% +43.4% +22.2% 🚨 regression
34 datafusion:vortex-compact +25.4% +6.3% +18.0% +15.7% 🚨 regression
34 datafusion:vortex-file-compressed +15.8% +6.3% +8.9% +11.8% ➖ noise
34 duckdb:duckdb +6.1% +6.3% -0.2% +10.8% ➖ noise
34 duckdb:vortex-compact +32.3% +6.3% +24.5% +10.0% 🚨 regression
34 duckdb:vortex-file-compressed +29.2% +6.3% +21.6% +10.3% 🚨 regression
35 datafusion:vortex-compact +28.6% +11.1% +15.8% +10.0% 🚨 regression
35 datafusion:vortex-file-compressed +8.0% +11.1% -2.7% +10.0% ➖ noise
35 duckdb:duckdb +1.8% +11.1% -8.4% +16.7% ➖ noise
35 duckdb:vortex-compact +31.9% +11.1% +18.8% +12.6% 🚨 regression
35 duckdb:vortex-file-compressed +27.5% +11.1% +14.8% +10.0% 🚨 regression
36 datafusion:vortex-compact +29.8% +10.7% +17.3% +10.0% 🚨 regression
36 datafusion:vortex-file-compressed +14.1% +10.7% +3.1% +10.0% ➖ noise
36 duckdb:duckdb +2.0% +10.7% -7.9% +10.0% ➖ noise
36 duckdb:vortex-compact +22.1% +10.7% +10.3% +10.4% ➖ noise
36 duckdb:vortex-file-compressed +22.5% +10.7% +10.7% +10.0% 🚨 regression
37 datafusion:vortex-compact +31.3% +9.1% +20.4% +16.4% 🚨 regression
37 datafusion:vortex-file-compressed +13.4% +9.1% +3.9% +11.0% ➖ noise
37 duckdb:duckdb +8.3% +9.1% -0.7% +12.4% ➖ noise
37 duckdb:vortex-compact +33.0% +9.1% +21.9% +14.5% 🚨 regression
37 duckdb:vortex-file-compressed +53.5% +9.1% +40.7% +16.9% 🚨 regression
38 datafusion:vortex-compact +24.7% +8.2% +15.3% +10.0% 🚨 regression
38 datafusion:vortex-file-compressed +10.6% +8.2% +2.3% +10.0% ➖ noise
38 duckdb:duckdb -0.4% +8.2% -8.0% +10.0% ➖ noise
38 duckdb:vortex-compact +13.9% +8.2% +5.3% +11.8% ➖ noise
38 duckdb:vortex-file-compressed +23.7% +8.2% +14.3% +11.6% 🚨 regression
39 datafusion:vortex-compact +29.5% +8.7% +19.2% +11.6% 🚨 regression
39 datafusion:vortex-file-compressed +14.4% +8.7% +5.3% +10.7% ➖ noise
39 duckdb:duckdb +16.9% +8.7% +7.6% +13.0% ➖ noise
39 duckdb:vortex-compact +17.9% +8.7% +8.5% +26.2% ➖ noise
39 duckdb:vortex-file-compressed +22.3% +8.7% +12.5% +20.0% ➖ noise
40 datafusion:vortex-compact +35.6% +2.9% +31.7% +20.2% 🚨 regression
40 datafusion:vortex-file-compressed +11.6% +2.9% +8.5% +11.0% ➖ noise
40 duckdb:duckdb -4.0% +2.9% -6.8% +10.7% ➖ noise
40 duckdb:vortex-compact +31.3% +2.9% +27.6% +11.1% 🚨 regression
40 duckdb:vortex-file-compressed +30.3% +2.9% +26.6% +15.5% 🚨 regression
41 datafusion:vortex-compact +52.4% +16.4% +30.9% +14.0% 🚨 regression
41 datafusion:vortex-file-compressed +29.2% +16.4% +11.0% +10.0% 🚨 regression
41 duckdb:duckdb +1.0% +16.4% -13.2% +10.0% ✅ faster
41 duckdb:vortex-compact +35.8% +16.4% +16.6% +17.8% ➖ noise
41 duckdb:vortex-file-compressed +27.4% +16.4% +9.4% +10.1% ➖ noise
42 datafusion:vortex-compact +19.4% +4.5% +14.2% +10.0% 🚨 regression
42 datafusion:vortex-file-compressed +9.6% +4.5% +4.9% +10.0% ➖ noise
42 duckdb:duckdb +15.3% +4.5% +10.3% +14.1% ➖ noise
42 duckdb:vortex-compact +40.8% +4.5% +34.7% +14.1% 🚨 regression
42 duckdb:vortex-file-compressed +48.6% +4.5% +42.2% +11.8% 🚨 regression
43 datafusion:vortex-compact +24.9% +5.5% +18.3% +10.0% 🚨 regression
43 datafusion:vortex-file-compressed +9.2% +5.5% +3.5% +10.0% ➖ noise
43 duckdb:duckdb +0.8% +5.5% -4.5% +10.0% ➖ noise
43 duckdb:vortex-compact +21.7% +5.5% +15.3% +10.0% 🚨 regression
43 duckdb:vortex-file-compressed +28.8% +5.5% +22.1% +10.0% 🚨 regression
44 datafusion:vortex-compact +12.8% +3.0% +9.5% +10.0% ➖ noise
44 datafusion:vortex-file-compressed +4.0% +3.0% +1.0% +10.0% ➖ noise
44 duckdb:duckdb +5.1% +3.0% +2.1% +18.4% ➖ noise
44 duckdb:vortex-compact +20.1% +3.0% +16.6% +13.4% 🚨 regression
44 duckdb:vortex-file-compressed +11.2% +3.0% +7.9% +18.8% ➖ noise
45 datafusion:vortex-compact +25.7% +1.4% +24.0% +14.0% 🚨 regression
45 datafusion:vortex-file-compressed +9.2% +1.4% +7.7% +10.0% ➖ noise
45 duckdb:duckdb +4.1% +1.4% +2.7% +16.6% ➖ noise
45 duckdb:vortex-compact +52.6% +1.4% +50.5% +18.3% 🚨 regression
45 duckdb:vortex-file-compressed +33.7% +1.4% +31.9% +21.8% 🚨 regression
46 datafusion:vortex-compact +25.5% +7.2% +17.1% +10.0% 🚨 regression
46 datafusion:vortex-file-compressed +17.7% +7.2% +9.8% +10.0% ➖ noise
46 duckdb:duckdb +0.4% +7.2% -6.3% +11.4% ➖ noise
46 duckdb:vortex-compact +28.5% +7.2% +19.9% +12.1% 🚨 regression
46 duckdb:vortex-file-compressed +27.3% +7.2% +18.7% +10.0% 🚨 regression
47 datafusion:vortex-compact +35.1% +7.9% +25.2% +11.6% 🚨 regression
47 datafusion:vortex-file-compressed +15.5% +7.9% +7.1% +10.0% ➖ noise
47 duckdb:duckdb +0.3% +7.9% -7.0% +10.6% ➖ noise
47 duckdb:vortex-compact +29.8% +7.9% +20.3% +10.0% 🚨 regression
47 duckdb:vortex-file-compressed +21.4% +7.9% +12.5% +11.1% 🚨 regression
48 datafusion:vortex-compact +10.8% +12.4% -1.4% +10.0% ➖ noise
48 datafusion:vortex-file-compressed +11.7% +12.4% -0.6% +10.0% ➖ noise
48 duckdb:duckdb +5.3% +12.4% -6.3% +10.0% ➖ noise
48 duckdb:vortex-compact +29.0% +12.4% +14.7% +10.0% 🚨 regression
48 duckdb:vortex-file-compressed +36.9% +12.4% +21.9% +24.0% ➖ noise
49 datafusion:vortex-compact +20.9% +6.0% +14.1% +16.3% ➖ noise
49 datafusion:vortex-file-compressed +16.8% +6.0% +10.2% +10.0% 🚨 regression
49 duckdb:duckdb +1.6% +6.0% -4.1% +16.8% ➖ noise
49 duckdb:vortex-compact +38.9% +6.0% +31.1% +13.4% 🚨 regression
49 duckdb:vortex-file-compressed +21.8% +6.0% +14.9% +18.8% ➖ noise
50 datafusion:vortex-compact +20.2% +9.8% +9.4% +11.3% ➖ noise
50 datafusion:vortex-file-compressed +12.7% +9.8% +2.7% +10.0% ➖ noise
50 duckdb:duckdb +5.0% +9.8% -4.4% +12.6% ➖ noise
50 duckdb:vortex-compact +33.8% +9.8% +21.8% +10.0% 🚨 regression
50 duckdb:vortex-file-compressed +32.2% +9.8% +20.4% +10.5% 🚨 regression
51 datafusion:vortex-compact +15.2% +6.2% +8.5% +14.0% ➖ noise
51 datafusion:vortex-file-compressed +9.5% +6.2% +3.1% +10.0% ➖ noise
51 duckdb:duckdb +3.7% +6.2% -2.3% +18.2% ➖ noise
51 duckdb:vortex-compact +24.0% +6.2% +16.8% +16.9% ➖ noise
51 duckdb:vortex-file-compressed +25.5% +6.2% +18.2% +27.1% ➖ noise
52 datafusion:vortex-compact +2.4% +6.1% -3.5% +12.9% ➖ noise
52 datafusion:vortex-file-compressed +12.9% +6.1% +6.4% +17.4% ➖ noise
52 duckdb:duckdb +5.2% +6.1% -0.8% +18.8% ➖ noise
52 duckdb:vortex-compact +17.4% +6.1% +10.6% +31.6% ➖ noise
52 duckdb:vortex-file-compressed +24.5% +6.1% +17.3% +18.6% ➖ noise
53 datafusion:vortex-compact +19.6% +7.5% +11.3% +11.2% 🚨 regression
53 datafusion:vortex-file-compressed +11.5% +7.5% +3.8% +10.0% ➖ noise
53 duckdb:duckdb -5.0% +7.5% -11.6% +11.8% ✅ faster
53 duckdb:vortex-compact +34.7% +7.5% +25.3% +11.1% 🚨 regression
53 duckdb:vortex-file-compressed +27.2% +7.5% +18.4% +10.6% 🚨 regression
54 datafusion:vortex-compact +10.5% +3.2% +7.0% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +8.5% +3.2% +5.1% +10.0% ➖ noise
54 duckdb:duckdb +2.9% +3.2% -0.3% +10.0% ➖ noise
54 duckdb:vortex-compact +24.8% +3.2% +21.0% +10.0% 🚨 regression
54 duckdb:vortex-file-compressed +30.9% +3.2% +26.8% +10.0% 🚨 regression
55 datafusion:vortex-compact -1.2% +7.1% -7.8% +17.0% ➖ noise
55 datafusion:vortex-file-compressed +11.7% +7.1% +4.3% +15.9% ➖ noise
55 duckdb:duckdb -2.2% +7.1% -8.7% +15.7% ➖ noise
55 duckdb:vortex-compact +31.8% +7.1% +23.0% +16.9% 🚨 regression
55 duckdb:vortex-file-compressed +50.9% +7.1% +40.9% +17.1% 🚨 regression
56 datafusion:vortex-compact +19.4% +7.2% +11.4% +10.0% 🚨 regression
56 datafusion:vortex-file-compressed +9.3% +7.2% +2.0% +11.4% ➖ noise
56 duckdb:duckdb +1.5% +7.2% -5.2% +11.8% ➖ noise
56 duckdb:vortex-compact +25.4% +7.2% +17.0% +13.0% 🚨 regression
56 duckdb:vortex-file-compressed +47.6% +7.2% +37.7% +10.0% 🚨 regression
57 datafusion:vortex-compact +24.9% +7.6% +16.1% +16.7% ➖ noise
57 datafusion:vortex-file-compressed +11.8% +7.6% +3.9% +11.2% ➖ noise
57 duckdb:duckdb -10.4% +7.6% -16.7% +17.2% ✅ faster
57 duckdb:vortex-compact +29.5% +7.6% +20.4% +10.0% 🚨 regression
57 duckdb:vortex-file-compressed +20.0% +7.6% +11.6% +12.4% ➖ noise
58 datafusion:vortex-compact +22.2% +4.7% +16.7% +14.4% 🚨 regression
58 datafusion:vortex-file-compressed +18.6% +4.7% +13.3% +10.0% 🚨 regression
58 duckdb:duckdb -7.7% +4.7% -11.8% +13.8% ➖ noise
58 duckdb:vortex-compact +31.4% +4.7% +25.5% +23.1% 🚨 regression
58 duckdb:vortex-file-compressed +23.7% +4.7% +18.1% +18.0% 🚨 regression
59 datafusion:vortex-compact +12.2% +3.6% +8.4% +15.7% ➖ noise
59 datafusion:vortex-file-compressed +11.9% +3.6% +8.1% +10.0% ➖ noise
59 duckdb:duckdb -2.7% +3.6% -6.1% +10.0% ➖ noise
59 duckdb:vortex-compact +11.8% +3.6% +8.0% +10.0% ➖ noise
59 duckdb:vortex-file-compressed +11.9% +3.6% +8.1% +10.0% ➖ noise
60 datafusion:vortex-compact +18.7% +8.6% +9.3% +10.0% ➖ noise
60 datafusion:vortex-file-compressed +14.3% +8.6% +5.2% +10.0% ➖ noise
60 duckdb:duckdb +1.1% +8.6% -6.9% +12.5% ➖ noise
60 duckdb:vortex-compact +3.8% +8.6% -4.5% +10.0% ➖ noise
60 duckdb:vortex-file-compressed +43.6% +8.6% +32.2% +23.6% 🚨 regression
61 datafusion:vortex-compact +11.3% +2.8% +8.2% +11.8% ➖ noise
61 datafusion:vortex-file-compressed +15.7% +2.8% +12.5% +10.0% 🚨 regression
61 duckdb:duckdb -1.8% +2.8% -4.5% +11.6% ➖ noise
61 duckdb:vortex-compact +7.8% +2.8% +4.8% +14.9% ➖ noise
61 duckdb:vortex-file-compressed +28.2% +2.8% +24.7% +14.9% 🚨 regression
62 datafusion:vortex-compact +25.4% +8.8% +15.3% +12.7% 🚨 regression
62 datafusion:vortex-file-compressed +14.1% +8.8% +4.9% +11.9% ➖ noise
62 duckdb:duckdb -1.3% +8.8% -9.2% +10.8% ➖ noise
62 duckdb:vortex-compact +38.0% +8.8% +26.9% +33.7% ➖ noise
62 duckdb:vortex-file-compressed +22.2% +8.8% +12.4% +24.9% ➖ noise
63 datafusion:vortex-compact +2.7% +4.0% -1.2% +12.1% ➖ noise
63 datafusion:vortex-file-compressed +12.4% +4.0% +8.1% +10.0% ➖ noise
63 duckdb:duckdb +4.0% +4.0% -0.0% +12.7% ➖ noise
63 duckdb:vortex-compact +16.6% +4.0% +12.1% +10.0% 🚨 regression
63 duckdb:vortex-file-compressed +26.0% +4.0% +21.2% +10.0% 🚨 regression
64 datafusion:vortex-compact +23.8% +8.8% +13.8% +10.0% 🚨 regression
64 datafusion:vortex-file-compressed +17.6% +8.8% +8.2% +10.0% ➖ noise
64 duckdb:duckdb +2.1% +8.8% -6.1% +10.0% ➖ noise
64 duckdb:vortex-compact +14.7% +8.8% +5.5% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +35.6% +8.8% +24.7% +10.0% 🚨 regression
65 datafusion:vortex-compact +29.1% +10.1% +17.2% +10.0% 🚨 regression
65 datafusion:vortex-file-compressed +6.9% +10.1% -2.9% +11.8% ➖ noise
65 duckdb:duckdb +6.9% +10.1% -2.9% +14.8% ➖ noise
65 duckdb:vortex-compact +12.1% +10.1% +1.8% +13.9% ➖ noise
65 duckdb:vortex-file-compressed +13.2% +10.1% +2.9% +11.1% ➖ noise
66 datafusion:vortex-compact +40.7% +9.1% +29.0% +18.2% 🚨 regression
66 datafusion:vortex-file-compressed +3.9% +9.1% -4.7% +10.0% ➖ noise
66 duckdb:duckdb +1.7% +9.1% -6.8% +10.0% ➖ noise
66 duckdb:vortex-compact +24.0% +9.1% +13.7% +11.0% 🚨 regression
66 duckdb:vortex-file-compressed +25.0% +9.1% +14.6% +15.0% ➖ noise
67 datafusion:vortex-compact +24.8% +11.1% +12.4% +17.3% ➖ noise
67 datafusion:vortex-file-compressed -2.3% +11.1% -12.1% +10.0% ✅ faster
67 duckdb:duckdb +6.6% +11.1% -4.0% +10.0% ➖ noise
67 duckdb:vortex-compact +29.9% +11.1% +16.9% +10.0% 🚨 regression
67 duckdb:vortex-file-compressed +25.8% +11.1% +13.2% +10.9% 🚨 regression
68 datafusion:vortex-compact +41.3% +9.2% +29.5% +10.0% 🚨 regression
68 datafusion:vortex-file-compressed -0.7% +9.2% -9.1% +10.0% ➖ noise
68 duckdb:duckdb +3.0% +9.2% -5.6% +10.0% ➖ noise
68 duckdb:vortex-compact +29.5% +9.2% +18.7% +10.0% 🚨 regression
68 duckdb:vortex-file-compressed +28.3% +9.2% +17.6% +10.0% 🚨 regression
69 datafusion:vortex-compact +28.6% +7.9% +19.2% +10.0% 🚨 regression
69 datafusion:vortex-file-compressed -2.1% +7.9% -9.3% +10.0% ✅ faster
69 duckdb:duckdb +1.2% +7.9% -6.2% +10.0% ➖ noise
69 duckdb:vortex-compact +28.7% +7.9% +19.4% +10.0% 🚨 regression
69 duckdb:vortex-file-compressed +37.3% +7.9% +27.3% +10.0% 🚨 regression
70 datafusion:vortex-compact +45.9% +8.4% +34.7% +10.0% 🚨 regression
70 datafusion:vortex-file-compressed +6.7% +8.4% -1.5% +10.2% ➖ noise
70 duckdb:duckdb -0.4% +8.4% -8.1% +13.1% ➖ noise
70 duckdb:vortex-compact +18.5% +8.4% +9.3% +10.0% ➖ noise
70 duckdb:vortex-file-compressed +32.7% +8.4% +22.4% +10.0% 🚨 regression
71 datafusion:vortex-compact +31.5% +10.4% +19.2% +10.9% 🚨 regression
71 datafusion:vortex-file-compressed +19.0% +10.4% +7.8% +10.9% ➖ noise
71 duckdb:duckdb +4.6% +10.4% -5.2% +15.4% ➖ noise
71 duckdb:vortex-compact +31.7% +10.4% +19.3% +11.2% 🚨 regression
71 duckdb:vortex-file-compressed +37.4% +10.4% +24.5% +21.7% 🚨 regression
72 datafusion:vortex-compact +40.3% +9.4% +28.2% +10.0% 🚨 regression
72 datafusion:vortex-file-compressed +7.9% +9.4% -1.4% +11.8% ➖ noise
72 duckdb:duckdb -2.3% +9.4% -10.7% +10.0% ✅ faster
72 duckdb:vortex-compact +16.9% +9.4% +6.8% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +10.4% +9.4% +0.9% +10.0% ➖ noise
73 datafusion:vortex-compact +28.3% +6.6% +20.4% +25.6% ➖ noise
73 datafusion:vortex-file-compressed +8.0% +6.6% +1.4% +19.3% ➖ noise
73 duckdb:duckdb +2.3% +6.6% -4.0% +14.4% ➖ noise
73 duckdb:vortex-compact +25.6% +6.6% +17.9% +10.0% 🚨 regression
73 duckdb:vortex-file-compressed +27.1% +6.6% +19.3% +14.7% 🚨 regression
74 datafusion:vortex-compact +35.9% -1.0% +37.3% +10.1% 🚨 regression
74 datafusion:vortex-file-compressed +17.6% -1.0% +18.8% +10.0% 🚨 regression
74 duckdb:duckdb -0.4% -1.0% +0.6% +10.0% ➖ noise
74 duckdb:vortex-compact +24.3% -1.0% +25.6% +10.0% 🚨 regression
74 duckdb:vortex-file-compressed +17.7% -1.0% +18.9% +16.9% 🚨 regression
75 datafusion:vortex-compact +8.4% +5.8% +2.5% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +21.5% +5.8% +14.9% +10.0% 🚨 regression
75 duckdb:duckdb -5.0% +5.8% -10.2% +11.6% ➖ noise
75 duckdb:vortex-compact +7.5% +5.8% +1.6% +10.0% ➖ noise
75 duckdb:vortex-file-compressed +17.3% +5.8% +10.9% +14.1% ➖ noise
76 datafusion:vortex-compact +15.6% +0.1% +15.5% +14.2% 🚨 regression
76 datafusion:vortex-file-compressed +29.0% +0.1% +29.0% +10.5% 🚨 regression
76 duckdb:duckdb +11.2% +0.1% +11.1% +19.8% ➖ noise
76 duckdb:vortex-compact +11.7% +0.1% +11.6% +16.1% ➖ noise
76 duckdb:vortex-file-compressed +36.7% +0.1% +36.6% +25.9% 🚨 regression
77 datafusion:vortex-compact +20.0% +8.0% +11.1% +10.0% 🚨 regression
77 datafusion:vortex-file-compressed +19.6% +8.0% +10.8% +11.6% ➖ noise
77 duckdb:duckdb -1.3% +8.0% -8.6% +13.4% ➖ noise
77 duckdb:vortex-compact +18.6% +8.0% +9.8% +10.0% ➖ noise
77 duckdb:vortex-file-compressed +5.9% +8.0% -1.9% +11.4% ➖ noise
78 datafusion:vortex-compact +14.1% -0.1% +14.2% +10.5% 🚨 regression
78 datafusion:vortex-file-compressed +19.2% -0.1% +19.3% +10.6% 🚨 regression
78 duckdb:duckdb -7.3% -0.1% -7.2% +10.0% ➖ noise
78 duckdb:vortex-compact +23.1% -0.1% +23.2% +10.0% 🚨 regression
78 duckdb:vortex-file-compressed +3.2% -0.1% +3.3% +10.0% ➖ noise
79 datafusion:vortex-compact +22.4% +2.3% +19.7% +10.0% 🚨 regression
79 datafusion:vortex-file-compressed +24.7% +2.3% +22.0% +10.1% 🚨 regression
79 duckdb:duckdb -6.2% +2.3% -8.3% +12.5% ➖ noise
79 duckdb:vortex-compact +17.1% +2.3% +14.5% +10.0% 🚨 regression
79 duckdb:vortex-file-compressed +0.6% +2.3% -1.6% +11.2% ➖ noise
80 datafusion:vortex-compact +11.6% +1.2% +10.3% +14.4% ➖ noise
80 datafusion:vortex-file-compressed +15.7% +1.2% +14.3% +10.2% 🚨 regression
80 duckdb:duckdb -1.3% +1.2% -2.5% +13.7% ➖ noise
80 duckdb:vortex-compact +12.5% +1.2% +11.2% +10.3% 🚨 regression
80 duckdb:vortex-file-compressed +5.8% +1.2% +4.6% +10.0% ➖ noise
81 datafusion:vortex-compact +17.9% +0.3% +17.6% +11.5% 🚨 regression
81 datafusion:vortex-file-compressed -1.2% +0.3% -1.5% +15.2% ➖ noise
81 duckdb:duckdb -3.9% +0.3% -4.2% +10.0% ➖ noise
81 duckdb:vortex-compact +13.9% +0.3% +13.6% +12.9% 🚨 regression
81 duckdb:vortex-file-compressed +3.5% +0.3% +3.3% +10.9% ➖ noise
82 datafusion:vortex-compact +20.1% -1.1% +21.5% +13.5% 🚨 regression
82 datafusion:vortex-file-compressed +25.5% -1.1% +26.8% +11.7% 🚨 regression
82 duckdb:duckdb -8.5% -1.1% -7.5% +17.6% ➖ noise
82 duckdb:vortex-compact +33.1% -1.1% +34.5% +23.7% 🚨 regression
82 duckdb:vortex-file-compressed -4.6% -1.1% -3.6% +16.5% ➖ noise
83 datafusion:vortex-compact +0.5% +7.2% -6.2% +10.2% ➖ noise
83 datafusion:vortex-file-compressed +10.8% +7.2% +3.4% +13.7% ➖ noise
83 duckdb:duckdb -6.9% +7.2% -13.2% +12.2% ✅ faster
83 duckdb:vortex-compact +11.3% +7.2% +3.8% +10.0% ➖ noise
83 duckdb:vortex-file-compressed +7.0% +7.2% -0.2% +13.9% ➖ noise
84 datafusion:vortex-compact +19.7% +6.6% +12.3% +13.2% ➖ noise
84 datafusion:vortex-file-compressed +0.9% +6.6% -5.3% +19.4% ➖ noise
84 duckdb:duckdb -5.9% +6.6% -11.7% +11.3% ✅ faster
84 duckdb:vortex-compact +19.5% +6.6% +12.1% +21.5% ➖ noise
84 duckdb:vortex-file-compressed +2.7% +6.6% -3.7% +10.0% ➖ noise
85 datafusion:vortex-compact +16.8% +3.1% +13.3% +10.0% 🚨 regression
85 datafusion:vortex-file-compressed +13.7% +3.1% +10.3% +12.8% ➖ noise
85 duckdb:duckdb +7.9% +3.1% +4.7% +10.0% ➖ noise
85 duckdb:vortex-compact +14.0% +3.1% +10.6% +10.0% 🚨 regression
85 duckdb:vortex-file-compressed +6.0% +3.1% +2.9% +10.0% ➖ noise
86 datafusion:vortex-compact +8.2% +7.6% +0.5% +17.8% ➖ noise
86 datafusion:vortex-file-compressed +2.5% +7.6% -4.7% +20.5% ➖ noise
86 duckdb:duckdb -5.6% +7.6% -12.3% +21.0% ➖ noise
86 duckdb:vortex-compact +10.8% +7.6% +2.9% +25.2% ➖ noise
86 duckdb:vortex-file-compressed +0.6% +7.6% -6.6% +17.7% ➖ noise
87 datafusion:vortex-compact +17.9% +6.4% +10.8% +10.0% 🚨 regression
87 datafusion:vortex-file-compressed +22.1% +6.4% +14.7% +13.3% 🚨 regression
87 duckdb:duckdb -7.5% +6.4% -13.1% +20.1% ➖ noise
87 duckdb:vortex-compact +21.5% +6.4% +14.1% +10.0% 🚨 regression
87 duckdb:vortex-file-compressed -3.6% +6.4% -9.4% +10.6% ➖ noise
88 datafusion:vortex-compact +5.9% +5.6% +0.3% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +5.1% +5.6% -0.4% +10.0% ➖ noise
88 duckdb:duckdb +0.7% +5.6% -4.6% +10.0% ➖ noise
88 duckdb:vortex-compact +11.2% +5.6% +5.3% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -2.1% +5.6% -7.2% +10.0% ➖ noise
89 datafusion:vortex-compact +32.4% +6.4% +24.4% +11.9% 🚨 regression
89 datafusion:vortex-file-compressed +24.3% +6.4% +16.8% +10.2% 🚨 regression
89 duckdb:duckdb +1.2% +6.4% -4.9% +10.9% ➖ noise
89 duckdb:vortex-compact +9.5% +6.4% +2.9% +12.9% ➖ noise
89 duckdb:vortex-file-compressed +15.3% +6.4% +8.3% +13.6% ➖ noise
90 datafusion:vortex-compact +11.9% -0.3% +12.3% +10.0% 🚨 regression
90 datafusion:vortex-file-compressed +12.1% -0.3% +12.4% +14.0% ➖ noise
90 duckdb:duckdb +8.6% -0.3% +8.9% +10.0% ➖ noise
90 duckdb:vortex-compact +18.0% -0.3% +18.4% +10.0% 🚨 regression
90 duckdb:vortex-file-compressed +16.1% -0.3% +16.5% +10.0% 🚨 regression
91 datafusion:vortex-compact +13.4% +1.2% +12.0% +10.0% 🚨 regression
91 datafusion:vortex-file-compressed +4.4% +1.2% +3.1% +10.0% ➖ noise
91 duckdb:duckdb -3.2% +1.2% -4.3% +10.0% ➖ noise
91 duckdb:vortex-compact +14.5% +1.2% +13.1% +10.0% 🚨 regression
91 duckdb:vortex-file-compressed +48.5% +1.2% +46.8% +15.2% 🚨 regression
92 datafusion:vortex-compact -0.7% +2.4% -3.0% +10.0% ➖ noise
92 datafusion:vortex-file-compressed +2.1% +2.4% -0.2% +14.6% ➖ noise
92 duckdb:duckdb +4.1% +2.4% +1.7% +10.0% ➖ noise
92 duckdb:vortex-compact +15.1% +2.4% +12.5% +11.0% 🚨 regression
92 duckdb:vortex-file-compressed +35.6% +2.4% +32.5% +10.0% 🚨 regression
93 datafusion:vortex-compact +0.1% +3.6% -3.3% +10.0% ➖ noise
93 datafusion:vortex-file-compressed +2.1% +3.6% -1.4% +16.9% ➖ noise
93 duckdb:duckdb +3.0% +3.6% -0.6% +14.6% ➖ noise
93 duckdb:vortex-compact +26.4% +3.6% +22.0% +10.1% 🚨 regression
93 duckdb:vortex-file-compressed +28.9% +3.6% +24.5% +17.9% 🚨 regression
94 datafusion:vortex-compact +4.3% -1.7% +6.1% +10.2% ➖ noise
94 datafusion:vortex-file-compressed +18.8% -1.7% +20.9% +13.5% 🚨 regression
94 duckdb:duckdb +0.4% -1.7% +2.1% +11.4% ➖ noise
94 duckdb:vortex-compact +23.5% -1.7% +25.7% +10.9% 🚨 regression
94 duckdb:vortex-file-compressed +18.4% -1.7% +20.5% +16.9% 🚨 regression
95 datafusion:vortex-compact +2.1% -0.1% +2.2% +11.4% ➖ noise
95 datafusion:vortex-file-compressed +17.8% -0.1% +17.8% +12.1% 🚨 regression
95 duckdb:duckdb +3.5% -0.1% +3.6% +17.2% ➖ noise
95 duckdb:vortex-compact +14.4% -0.1% +14.4% +13.8% 🚨 regression
95 duckdb:vortex-file-compressed +4.9% -0.1% +4.9% +19.5% ➖ noise
96 datafusion:vortex-compact +2.2% +3.1% -0.9% +10.0% ➖ noise
96 datafusion:vortex-file-compressed +8.1% +3.1% +4.9% +24.2% ➖ noise
96 duckdb:duckdb +3.8% +3.1% +0.6% +16.1% ➖ noise
96 duckdb:vortex-compact +12.6% +3.1% +9.2% +10.0% ➖ noise
96 duckdb:vortex-file-compressed +36.2% +3.1% +32.1% +11.9% 🚨 regression
97 datafusion:vortex-compact +3.8% +2.7% +1.0% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +28.9% +2.7% +25.5% +16.2% 🚨 regression
97 duckdb:duckdb +2.8% +2.7% +0.1% +10.0% ➖ noise
97 duckdb:vortex-compact +3.8% +2.7% +1.1% +14.1% ➖ noise
97 duckdb:vortex-file-compressed +21.8% +2.7% +18.6% +11.2% 🚨 regression
98 datafusion:vortex-compact +4.0% +4.2% -0.2% +10.0% ➖ noise
98 datafusion:vortex-file-compressed +27.7% +4.2% +22.5% +21.9% 🚨 regression
98 duckdb:duckdb +6.1% +4.2% +1.8% +14.5% ➖ noise
98 duckdb:vortex-compact +7.5% +4.2% +3.2% +10.0% ➖ noise
98 duckdb:vortex-file-compressed +29.4% +4.2% +24.2% +18.5% 🚨 regression
99 datafusion:vortex-compact +7.2% -1.2% +8.5% +15.3% ➖ noise
99 datafusion:vortex-file-compressed +27.5% -1.2% +29.0% +24.0% 🚨 regression
99 duckdb:duckdb +11.8% -1.2% +13.2% +26.1% ➖ noise
99 duckdb:vortex-compact -4.1% -1.2% -2.9% +26.0% ➖ noise
99 duckdb:vortex-file-compressed +10.0% -1.2% +11.3% +14.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 28, 2026

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-H SF=10 on NVME failed! Check the workflow run for details.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 28, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.2%
Vortex (geomean): 0.981x ➖
Parquet (geomean): 0.970x ➖
Shifts: Parquet (control) -3.0% · Median polish -1.6%

duckdb / vortex-file-compressed (0.974x ➖, 1↑ 2↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10950526 11257966 0.97
statpopgen_q01/duckdb:vortex-file-compressed 🚀 18977045 27378302 0.69
statpopgen_q02/duckdb:vortex-file-compressed 1297326465 1336059900 0.97
statpopgen_q03/duckdb:vortex-file-compressed 3029346693 3079695353 0.98
statpopgen_q04/duckdb:vortex-file-compressed 3039569289 3135239689 0.97
statpopgen_q05/duckdb:vortex-file-compressed 1390638755 1410731616 0.99
statpopgen_q06/duckdb:vortex-file-compressed 2063668599 2094996625 0.99
statpopgen_q07/duckdb:vortex-file-compressed 🚨 236147858 208801664 1.13
statpopgen_q08/duckdb:vortex-file-compressed 🚨 249631303 221144186 1.13
statpopgen_q09/duckdb:vortex-file-compressed 2786776785 2830928373 0.98
statpopgen_q10/duckdb:vortex-file-compressed 4595876652 4683859854 0.98
duckdb / vortex-compact (0.989x ➖, 0↑ 0↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10874449 11152287 0.98
statpopgen_q01/duckdb:vortex-compact 165999147 170159661 0.98
statpopgen_q02/duckdb:vortex-compact 1812810336 1826118200 0.99
statpopgen_q03/duckdb:vortex-compact 3486726339 3526268856 0.99
statpopgen_q04/duckdb:vortex-compact 3500578286 3582256571 0.98
statpopgen_q05/duckdb:vortex-compact 1836443430 1867274960 0.98
statpopgen_q06/duckdb:vortex-compact 2663252130 2725489977 0.98
statpopgen_q07/duckdb:vortex-compact 983560094 969493949 1.01
statpopgen_q08/duckdb:vortex-compact 1014764649 1008080520 1.01
statpopgen_q09/duckdb:vortex-compact 3311481119 3350029940 0.99
statpopgen_q10/duckdb:vortex-compact 5415295050 5432367688 1.00
duckdb / parquet (0.970x ➖, 0↑ 0↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 305719186 321329080 0.95
statpopgen_q01/duckdb:parquet 390920374 405298006 0.96
statpopgen_q02/duckdb:parquet 983105071 1020360928 0.96
statpopgen_q03/duckdb:parquet 1492662423 1516631694 0.98
statpopgen_q04/duckdb:parquet 1483438638 1532960028 0.97
statpopgen_q05/duckdb:parquet 998255970 1013188947 0.99
statpopgen_q06/duckdb:parquet 1487854749 1510023953 0.99
statpopgen_q07/duckdb:parquet 1867021693 1925826457 0.97
statpopgen_q08/duckdb:parquet 1869345523 1932265256 0.97
statpopgen_q09/duckdb:parquet 1350567023 1405697530 0.96
statpopgen_q10/duckdb:parquet 2647880988 2728096661 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -2.5% -4.9% +2.5% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -2.7% -4.9% +2.2% +10.0% ➖ noise
1 duckdb:vortex-compact -2.4% -3.5% +1.1% +27.2% ➖ noise
1 duckdb:vortex-file-compressed -30.7% -3.5% -28.1% +255.8% ➖ noise
2 duckdb:vortex-compact -0.7% -3.7% +3.0% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -2.9% -3.7% +0.8% +10.0% ➖ noise
3 duckdb:vortex-compact -1.1% -1.6% +0.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.6% -1.6% -0.1% +10.0% ➖ noise
4 duckdb:vortex-compact -2.3% -3.2% +1.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -3.1% -3.2% +0.2% +10.0% ➖ noise
5 duckdb:vortex-compact -1.7% -1.5% -0.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.4% -1.5% +0.1% +10.0% ➖ noise
6 duckdb:vortex-compact -2.3% -1.5% -0.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.5% -1.5% -0.0% +10.0% ➖ noise
7 duckdb:vortex-compact +1.5% -3.1% +4.6% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +13.1% -3.1% +16.7% +10.0% 🚨 regression
8 duckdb:vortex-compact +0.7% -3.3% +4.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +12.9% -3.3% +16.7% +10.0% 🚨 regression
9 duckdb:vortex-compact -1.2% -3.9% +2.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.6% -3.9% +2.5% +10.0% ➖ noise
10 duckdb:vortex-compact -0.3% -2.9% +2.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.9% -2.9% +1.1% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 28, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.0%
Vortex (geomean): 0.893x ➖
Parquet (geomean): 0.893x ➖
Shifts: Parquet (control) -10.7% · Median polish -6.1%

datafusion / vortex-file-compressed (0.685x ✅, 11↑ 0↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 180130957 207238764 0.87
tpch_q02/datafusion:vortex-file-compressed 418525640 435651159 0.96
tpch_q03/datafusion:vortex-file-compressed 330413036 420262373 0.79
tpch_q04/datafusion:vortex-file-compressed 203759560 221454408 0.92
tpch_q05/datafusion:vortex-file-compressed 377144242 478977309 0.79
tpch_q06/datafusion:vortex-file-compressed 🚀 222887540 439573166 0.51
tpch_q07/datafusion:vortex-file-compressed 🚀 330844124 904905383 0.37
tpch_q08/datafusion:vortex-file-compressed 🚀 500404757 754287606 0.66
tpch_q09/datafusion:vortex-file-compressed 396750648 556275391 0.71
tpch_q10/datafusion:vortex-file-compressed 🚀 409536163 755233356 0.54
tpch_q11/datafusion:vortex-file-compressed 🚀 272459496 517976280 0.53
tpch_q12/datafusion:vortex-file-compressed 🚀 332304192 525924515 0.63
tpch_q13/datafusion:vortex-file-compressed 🚀 214579944 339053859 0.63
tpch_q14/datafusion:vortex-file-compressed 🚀 164753290 257853177 0.64
tpch_q15/datafusion:vortex-file-compressed 327366106 406022855 0.81
tpch_q16/datafusion:vortex-file-compressed 190371243 243973195 0.78
tpch_q17/datafusion:vortex-file-compressed 301883378 370223190 0.82
tpch_q18/datafusion:vortex-file-compressed 314837197 422115369 0.75
tpch_q19/datafusion:vortex-file-compressed 🚀 324879822 477580707 0.68
tpch_q20/datafusion:vortex-file-compressed 349616855 413857170 0.84
tpch_q21/datafusion:vortex-file-compressed 🚀 452431562 668933505 0.68
tpch_q22/datafusion:vortex-file-compressed 🚀 187151606 352477237 0.53
datafusion / vortex-compact (0.980x ➖, 1↑ 2↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 239565340 331487055 0.72
tpch_q02/datafusion:vortex-compact 385885423 424809323 0.91
tpch_q03/datafusion:vortex-compact 298872191 310048154 0.96
tpch_q04/datafusion:vortex-compact 221651451 190806205 1.16
tpch_q05/datafusion:vortex-compact 348179310 338445991 1.03
tpch_q06/datafusion:vortex-compact 317605160 282714221 1.12
tpch_q07/datafusion:vortex-compact 411610733 577062649 0.71
tpch_q08/datafusion:vortex-compact 508968940 612069334 0.83
tpch_q09/datafusion:vortex-compact 394977569 389446386 1.01
tpch_q10/datafusion:vortex-compact 🚀 402611863 720567902 0.56
tpch_q11/datafusion:vortex-compact 247288029 258943337 0.95
tpch_q12/datafusion:vortex-compact 🚨 860018327 409347414 2.10
tpch_q13/datafusion:vortex-compact 212524947 212129749 1.00
tpch_q14/datafusion:vortex-compact 🚨 393173241 260748901 1.51
tpch_q15/datafusion:vortex-compact 455385014 472380591 0.96
tpch_q16/datafusion:vortex-compact 173019758 191610607 0.90
tpch_q17/datafusion:vortex-compact 325061401 330865579 0.98
tpch_q18/datafusion:vortex-compact 292042633 289931533 1.01
tpch_q19/datafusion:vortex-compact 392398572 346159336 1.13
tpch_q20/datafusion:vortex-compact 424653659 541921924 0.78
tpch_q21/datafusion:vortex-compact 488932617 474881014 1.03
tpch_q22/datafusion:vortex-compact 118139119 125873603 0.94
datafusion / parquet (0.887x ➖, 1↑ 0↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 228149346 212500944 1.07
tpch_q02/datafusion:parquet 400259537 500559077 0.80
tpch_q03/datafusion:parquet 300227758 327481126 0.92
tpch_q04/datafusion:parquet 139189081 153958464 0.90
tpch_q05/datafusion:parquet 481283892 537871083 0.89
tpch_q06/datafusion:parquet 133946017 144502912 0.93
tpch_q07/datafusion:parquet 464887865 470657022 0.99
tpch_q08/datafusion:parquet 561976253 667802299 0.84
tpch_q09/datafusion:parquet 491809908 544473454 0.90
tpch_q10/datafusion:parquet 506736144 540950386 0.94
tpch_q11/datafusion:parquet 350698615 423646526 0.83
tpch_q12/datafusion:parquet 233819221 243728667 0.96
tpch_q13/datafusion:parquet 444277343 436495240 1.02
tpch_q14/datafusion:parquet 169692359 214501938 0.79
tpch_q15/datafusion:parquet 287748740 315887404 0.91
tpch_q16/datafusion:parquet 167305922 176054132 0.95
tpch_q17/datafusion:parquet 353664618 378653863 0.93
tpch_q18/datafusion:parquet 432021098 488169410 0.88
tpch_q19/datafusion:parquet 🚀 302970307 456506875 0.66
tpch_q20/datafusion:parquet 305020637 434704429 0.70
tpch_q21/datafusion:parquet 503898099 595113975 0.85
tpch_q22/datafusion:parquet 108418977 112822522 0.96
duckdb / vortex-file-compressed (0.962x ➖, 0↑ 0↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 232913336 243840503 0.96
tpch_q02/duckdb:vortex-file-compressed 863748580 820904652 1.05
tpch_q03/duckdb:vortex-file-compressed 533869264 544312699 0.98
tpch_q04/duckdb:vortex-file-compressed 347725879 342272093 1.02
tpch_q05/duckdb:vortex-file-compressed 855521836 869979995 0.98
tpch_q06/duckdb:vortex-file-compressed 360234919 415735222 0.87
tpch_q07/duckdb:vortex-file-compressed 738959089 698823034 1.06
tpch_q08/duckdb:vortex-file-compressed 861462869 997026784 0.86
tpch_q09/duckdb:vortex-file-compressed 860492712 849380520 1.01
tpch_q10/duckdb:vortex-file-compressed 670962337 736931752 0.91
tpch_q11/duckdb:vortex-file-compressed 500947770 466872503 1.07
tpch_q12/duckdb:vortex-file-compressed 449413418 499067014 0.90
tpch_q13/duckdb:vortex-file-compressed 459737541 480283079 0.96
tpch_q14/duckdb:vortex-file-compressed 446841068 543206720 0.82
tpch_q15/duckdb:vortex-file-compressed 276762655 264841780 1.05
tpch_q16/duckdb:vortex-file-compressed 318931807 349604930 0.91
tpch_q17/duckdb:vortex-file-compressed 564338389 664352347 0.85
tpch_q18/duckdb:vortex-file-compressed 503702955 472905324 1.07
tpch_q19/duckdb:vortex-file-compressed 470978326 480072244 0.98
tpch_q20/duckdb:vortex-file-compressed 708075625 789493217 0.90
tpch_q21/duckdb:vortex-file-compressed 982953368 1000949809 0.98
tpch_q22/duckdb:vortex-file-compressed 347661053 328875851 1.06
duckdb / vortex-compact (0.984x ➖, 0↑ 0↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 272269585 302126881 0.90
tpch_q02/duckdb:vortex-compact 817553046 818863314 1.00
tpch_q03/duckdb:vortex-compact 525861443 420976071 1.25
tpch_q04/duckdb:vortex-compact 349183334 343227991 1.02
tpch_q05/duckdb:vortex-compact 748111176 731199417 1.02
tpch_q06/duckdb:vortex-compact 393336249 389513614 1.01
tpch_q07/duckdb:vortex-compact 624415328 651608781 0.96
tpch_q08/duckdb:vortex-compact 754525194 839156275 0.90
tpch_q09/duckdb:vortex-compact 832980349 849017911 0.98
tpch_q10/duckdb:vortex-compact 661729877 633247518 1.04
tpch_q11/duckdb:vortex-compact 461464739 494688010 0.93
tpch_q12/duckdb:vortex-compact 417177088 409807209 1.02
tpch_q13/duckdb:vortex-compact 426993052 472389975 0.90
tpch_q14/duckdb:vortex-compact 418780048 538597849 0.78
tpch_q15/duckdb:vortex-compact 277776763 283575522 0.98
tpch_q16/duckdb:vortex-compact 321551403 314471160 1.02
tpch_q17/duckdb:vortex-compact 568520790 548849387 1.04
tpch_q18/duckdb:vortex-compact 465626406 450811289 1.03
tpch_q19/duckdb:vortex-compact 422370053 413634926 1.02
tpch_q20/duckdb:vortex-compact 728449747 722384016 1.01
tpch_q21/duckdb:vortex-compact 939899384 943307889 1.00
tpch_q22/duckdb:vortex-compact 328484687 356375970 0.92
duckdb / parquet (0.899x ➖, 1↑ 0↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 466622048 493089476 0.95
tpch_q02/duckdb:parquet 1374535957 1318734630 1.04
tpch_q03/duckdb:parquet 975132767 1219691921 0.80
tpch_q04/duckdb:parquet 567120516 556370429 1.02
tpch_q05/duckdb:parquet 1442327844 1819449379 0.79
tpch_q06/duckdb:parquet 386154479 392814274 0.98
tpch_q07/duckdb:parquet 1162643603 1258096352 0.92
tpch_q08/duckdb:parquet 1663216300 1775283851 0.94
tpch_q09/duckdb:parquet 1388512635 1371427029 1.01
tpch_q10/duckdb:parquet 1239022457 1623034424 0.76
tpch_q11/duckdb:parquet 814915527 892122797 0.91
tpch_q12/duckdb:parquet 582936708 753471438 0.77
tpch_q13/duckdb:parquet 875654911 935614531 0.94
tpch_q14/duckdb:parquet 624518312 665646421 0.94
tpch_q15/duckdb:parquet 505465886 569484541 0.89
tpch_q16/duckdb:parquet 525054212 535339830 0.98
tpch_q17/duckdb:parquet 712594982 789072758 0.90
tpch_q18/duckdb:parquet 842828417 824526558 1.02
tpch_q19/duckdb:parquet 780681664 900916747 0.87
tpch_q20/duckdb:parquet 🚀 974948421 1450235558 0.67
tpch_q21/duckdb:parquet 1040848020 1184143981 0.88
tpch_q22/duckdb:parquet 450480027 503279984 0.90
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -27.7% +0.8% -28.3% +133.8% ➖ noise
1 datafusion:vortex-file-compressed -13.1% +0.8% -13.8% +126.1% ➖ noise
1 duckdb:vortex-compact -9.9% +0.8% -10.6% +54.9% ➖ noise
1 duckdb:vortex-file-compressed -4.5% +0.8% -5.2% +48.0% ➖ noise
2 datafusion:vortex-compact -9.2% -8.7% -0.5% +51.0% ➖ noise
2 datafusion:vortex-file-compressed -3.9% -8.7% +5.2% +37.0% ➖ noise
2 duckdb:vortex-compact -0.2% -8.7% +9.4% +30.9% ➖ noise
2 duckdb:vortex-file-compressed +5.2% -8.7% +15.3% +30.0% ➖ noise
3 datafusion:vortex-compact -3.6% -14.4% +12.6% +60.5% ➖ noise
3 datafusion:vortex-file-compressed -21.4% -14.4% -8.2% +53.1% ➖ noise
3 duckdb:vortex-compact +24.9% -14.4% +45.9% +30.0% 🚨 regression
3 duckdb:vortex-file-compressed -1.9% -14.4% +14.6% +52.8% ➖ noise
4 datafusion:vortex-compact +16.2% -4.0% +21.0% +41.8% ➖ noise
4 datafusion:vortex-file-compressed -8.0% -4.0% -4.2% +30.0% ➖ noise
4 duckdb:vortex-compact +1.7% -4.0% +6.0% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +1.6% -4.0% +5.8% +30.0% ➖ noise
5 datafusion:vortex-compact +2.9% -15.8% +22.1% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -21.3% -15.8% -6.5% +45.0% ➖ noise
5 duckdb:vortex-compact +2.3% -15.8% +21.5% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -1.7% -15.8% +16.8% +33.4% ➖ noise
6 datafusion:vortex-compact +12.3% -4.5% +17.7% +33.9% ➖ noise
6 datafusion:vortex-file-compressed -49.3% -4.5% -46.9% +37.6% ✅ faster
6 duckdb:vortex-compact +1.0% -4.5% +5.8% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -13.3% -4.5% -9.2% +38.7% ➖ noise
7 datafusion:vortex-compact -28.7% -4.5% -25.3% +30.0% ✅ faster
7 datafusion:vortex-file-compressed -63.4% -4.5% -61.7% +30.0% ✅ faster
7 duckdb:vortex-compact -4.2% -4.5% +0.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +5.7% -4.5% +10.7% +30.0% ➖ noise
8 datafusion:vortex-compact -16.8% -11.2% -6.3% +78.9% ➖ noise
8 datafusion:vortex-file-compressed -33.7% -11.2% -25.3% +37.8% ➖ noise
8 duckdb:vortex-compact -10.1% -11.2% +1.3% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -13.6% -11.2% -2.7% +30.0% ➖ noise
9 datafusion:vortex-compact +1.4% -4.4% +6.1% +33.2% ➖ noise
9 datafusion:vortex-file-compressed -28.7% -4.4% -25.4% +31.8% ✅ faster
9 duckdb:vortex-compact -1.9% -4.4% +2.6% +34.4% ➖ noise
9 duckdb:vortex-file-compressed +1.3% -4.4% +5.9% +30.0% ➖ noise
10 datafusion:vortex-compact -44.1% -15.4% -33.9% +30.7% ✅ faster
10 datafusion:vortex-file-compressed -45.8% -15.4% -35.9% +35.0% ✅ faster
10 duckdb:vortex-compact +4.5% -15.4% +23.6% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -9.0% -15.4% +7.7% +30.0% ➖ noise
11 datafusion:vortex-compact -4.5% -13.0% +9.8% +49.1% ➖ noise
11 datafusion:vortex-file-compressed -47.4% -13.0% -39.5% +40.1% ✅ faster
11 duckdb:vortex-compact -6.7% -13.0% +7.3% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +7.3% -13.0% +23.4% +30.0% ➖ noise
12 datafusion:vortex-compact +110.1% -13.8% +143.9% +44.9% 🚨 regression
12 datafusion:vortex-file-compressed -36.8% -13.8% -26.7% +36.4% ➖ noise
12 duckdb:vortex-compact +1.8% -13.8% +18.2% +30.8% ➖ noise
12 duckdb:vortex-file-compressed -9.9% -13.8% +4.5% +30.0% ➖ noise
13 datafusion:vortex-compact +0.2% -2.4% +2.6% +85.8% ➖ noise
13 datafusion:vortex-file-compressed -36.7% -2.4% -35.2% +45.9% ✅ faster
13 duckdb:vortex-compact -9.6% -2.4% -7.4% +30.0% ➖ noise
13 duckdb:vortex-file-compressed -4.3% -2.4% -1.9% +42.6% ➖ noise
14 datafusion:vortex-compact +50.8% -13.8% +75.0% +38.6% 🚨 regression
14 datafusion:vortex-file-compressed -36.1% -13.8% -25.8% +46.5% ➖ noise
14 duckdb:vortex-compact -22.2% -13.8% -9.7% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -17.7% -13.8% -4.5% +30.0% ➖ noise
15 datafusion:vortex-compact -3.6% -10.1% +7.2% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -19.4% -10.1% -10.3% +30.0% ➖ noise
15 duckdb:vortex-compact -2.0% -10.1% +8.9% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +4.5% -10.1% +16.2% +61.2% ➖ noise
16 datafusion:vortex-compact -9.7% -3.5% -6.5% +30.5% ➖ noise
16 datafusion:vortex-file-compressed -22.0% -3.5% -19.2% +30.0% ➖ noise
16 duckdb:vortex-compact +2.3% -3.5% +5.9% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -8.8% -3.5% -5.5% +30.0% ➖ noise
17 datafusion:vortex-compact -1.8% -8.2% +7.0% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -18.5% -8.2% -11.2% +30.0% ➖ noise
17 duckdb:vortex-compact +3.6% -8.2% +12.8% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -15.1% -8.2% -7.5% +30.0% ➖ noise
18 datafusion:vortex-compact +0.7% -4.9% +5.9% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -25.4% -4.9% -21.6% +30.0% ➖ noise
18 duckdb:vortex-compact +3.3% -4.9% +8.6% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +6.5% -4.9% +12.0% +30.0% ➖ noise
19 datafusion:vortex-compact +13.4% -24.2% +49.5% +30.0% 🚨 regression
19 datafusion:vortex-file-compressed -32.0% -24.2% -10.3% +30.0% ➖ noise
19 duckdb:vortex-compact +2.1% -24.2% +34.6% +30.0% 🚨 regression
19 duckdb:vortex-file-compressed -1.9% -24.2% +29.4% +39.5% ➖ noise
20 datafusion:vortex-compact -21.6% -31.3% +14.1% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -15.5% -31.3% +23.0% +30.0% ➖ noise
20 duckdb:vortex-compact +0.8% -31.3% +46.8% +30.0% 🚨 regression
20 duckdb:vortex-file-compressed -10.3% -31.3% +30.6% +30.0% 🚨 regression
21 datafusion:vortex-compact +3.0% -13.7% +19.3% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -32.4% -13.7% -21.6% +30.0% ➖ noise
21 duckdb:vortex-compact -0.4% -13.7% +15.5% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -1.8% -13.7% +13.8% +30.0% ➖ noise
22 datafusion:vortex-compact -6.1% -7.3% +1.2% +31.2% ➖ noise
22 datafusion:vortex-file-compressed -46.9% -7.3% -42.8% +30.0% ✅ faster
22 duckdb:vortex-compact -7.8% -7.3% -0.6% +38.9% ➖ noise
22 duckdb:vortex-file-compressed +5.7% -7.3% +14.0% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 28, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +10.0%
Vortex (geomean): 0.972x ➖
Parquet (geomean): 0.883x ➖
Shifts: Parquet (control) -11.7% · Median polish -3.6%

datafusion / vortex-file-compressed (0.866x ➖, 1↑ 0↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 35982408 58411101 0.62
fineweb_q01/datafusion:vortex-file-compressed 480846971 561172156 0.86
fineweb_q02/datafusion:vortex-file-compressed 493749169 535445756 0.92
fineweb_q03/datafusion:vortex-file-compressed 1338223655 1418753535 0.94
fineweb_q04/datafusion:vortex-file-compressed 1373741442 1418777328 0.97
fineweb_q05/datafusion:vortex-file-compressed 1344868598 1386374118 0.97
fineweb_q06/datafusion:vortex-file-compressed 1471899651 1810871985 0.81
fineweb_q07/datafusion:vortex-file-compressed 1330308498 1444489724 0.92
fineweb_q08/datafusion:vortex-file-compressed 553216418 653975311 0.85
datafusion / vortex-compact (0.990x ➖, 0↑ 0↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 34226614 31959547 1.07
fineweb_q01/datafusion:vortex-compact 533755820 580072432 0.92
fineweb_q02/datafusion:vortex-compact 655911005 673383187 0.97
fineweb_q03/datafusion:vortex-compact 1817919437 1845634650 0.98
fineweb_q04/datafusion:vortex-compact 2247204051 2174299229 1.03
fineweb_q05/datafusion:vortex-compact 1706640177 1680536192 1.02
fineweb_q06/datafusion:vortex-compact 1426777953 1433982692 0.99
fineweb_q07/datafusion:vortex-compact 1357155688 1463491214 0.93
fineweb_q08/datafusion:vortex-compact 397779572 398119085 1.00
datafusion / parquet (0.865x ➖, 0↑ 0↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1041449429 1158383164 0.90
fineweb_q01/datafusion:parquet 1692343583 1960818053 0.86
fineweb_q02/datafusion:parquet 1676275714 2211646762 0.76
fineweb_q03/datafusion:parquet 1721658381 1918299848 0.90
fineweb_q04/datafusion:parquet 1745291489 2021968421 0.86
fineweb_q05/datafusion:parquet 1730747100 1923319497 0.90
fineweb_q06/datafusion:parquet 1749840421 1920311017 0.91
fineweb_q07/datafusion:parquet 1727364371 1898705586 0.91
fineweb_q08/datafusion:parquet 1704759867 2130270159 0.80
duckdb / vortex-file-compressed (1.023x ➖, 0↑ 0↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 106662703 87076673 1.22
fineweb_q01/duckdb:vortex-file-compressed 555860924 613097010 0.91
fineweb_q02/duckdb:vortex-file-compressed 432398460 450045313 0.96
fineweb_q03/duckdb:vortex-file-compressed 1477276835 1438932998 1.03
fineweb_q04/duckdb:vortex-file-compressed 1544779485 1450783495 1.06
fineweb_q05/duckdb:vortex-file-compressed 1458179960 1418870380 1.03
fineweb_q06/duckdb:vortex-file-compressed 1625738248 1598674435 1.02
fineweb_q07/duckdb:vortex-file-compressed 1444069228 1439629485 1.00
fineweb_q08/duckdb:vortex-file-compressed 599972183 599546600 1.00
duckdb / vortex-compact (1.018x ➖, 0↑ 1↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 95648114 73481000 1.30
fineweb_q01/duckdb:vortex-compact 531413129 555227703 0.96
fineweb_q02/duckdb:vortex-compact 540020087 662198976 0.82
fineweb_q03/duckdb:vortex-compact 1669751297 1624954773 1.03
fineweb_q04/duckdb:vortex-compact 1728491883 1613192628 1.07
fineweb_q05/duckdb:vortex-compact 1483985982 1382058203 1.07
fineweb_q06/duckdb:vortex-compact 1413095145 1400506617 1.01
fineweb_q07/duckdb:vortex-compact 1330668970 1290177031 1.03
fineweb_q08/duckdb:vortex-compact 482419360 513307457 0.94
duckdb / parquet (0.901x ➖, 0↑ 0↓)
name PR cd7cc32 (ns) base 60847b0 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1044821329 1203241884 0.87
fineweb_q01/duckdb:parquet 1612991510 1742153192 0.93
fineweb_q02/duckdb:parquet 1565441455 1706151089 0.92
fineweb_q03/duckdb:parquet 3888574409 4441615538 0.88
fineweb_q04/duckdb:parquet 1780503636 1856931686 0.96
fineweb_q05/duckdb:parquet 2544563770 3076161614 0.83
fineweb_q06/duckdb:parquet 3268515857 3495509231 0.94
fineweb_q07/duckdb:parquet 3779576015 3971792600 0.95
fineweb_q08/duckdb:parquet 1054638252 1222945226 0.86
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +7.1% -11.6% +21.2% +138.3% ➖ noise
0 datafusion:vortex-file-compressed -38.4% -11.6% -30.3% +126.5% ➖ noise
0 duckdb:vortex-compact +30.2% -11.6% +47.3% +30.8% 🚨 regression
0 duckdb:vortex-file-compressed +22.5% -11.6% +38.6% +30.0% 🚨 regression
1 datafusion:vortex-compact -8.0% -10.6% +2.9% +51.0% ➖ noise
1 datafusion:vortex-file-compressed -14.3% -10.6% -4.1% +58.8% ➖ noise
1 duckdb:vortex-compact -4.3% -10.6% +7.1% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -9.3% -10.6% +1.4% +30.0% ➖ noise
2 datafusion:vortex-compact -2.6% -16.6% +16.8% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -7.8% -16.6% +10.6% +44.2% ➖ noise
2 duckdb:vortex-compact -18.5% -16.6% -2.2% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -3.9% -16.6% +15.2% +30.0% ➖ noise
3 datafusion:vortex-compact -1.5% -11.4% +11.1% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -5.7% -11.4% +6.4% +30.0% ➖ noise
3 duckdb:vortex-compact +2.8% -11.4% +15.9% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +2.7% -11.4% +15.8% +30.0% ➖ noise
4 datafusion:vortex-compact +3.4% -9.0% +13.6% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -3.2% -9.0% +6.4% +30.0% ➖ noise
4 duckdb:vortex-compact +7.1% -9.0% +17.8% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +6.5% -9.0% +17.0% +30.0% ➖ noise
5 datafusion:vortex-compact +1.6% -13.7% +17.7% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -3.0% -13.7% +12.4% +30.0% ➖ noise
5 duckdb:vortex-compact +7.4% -13.7% +24.5% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +2.8% -13.7% +19.1% +30.0% ➖ noise
6 datafusion:vortex-compact -0.5% -7.7% +7.8% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -18.7% -7.7% -11.9% +30.0% ➖ noise
6 duckdb:vortex-compact +0.9% -7.7% +9.3% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +1.7% -7.7% +10.2% +30.0% ➖ noise
7 datafusion:vortex-compact -7.3% -7.0% -0.3% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -7.9% -7.0% -1.0% +30.0% ➖ noise
7 duckdb:vortex-compact +3.1% -7.0% +10.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +0.3% -7.0% +7.8% +30.0% ➖ noise
8 datafusion:vortex-compact -0.1% -16.9% +20.3% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -15.4% -16.9% +1.8% +30.0% ➖ noise
8 duckdb:vortex-compact -6.0% -16.9% +13.1% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +0.1% -16.9% +20.5% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 28, 2026

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark Clickbench on NVME failed! Check the workflow run for details.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 28, 2026

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-H SF=10 on S3 failed! Check the workflow run for details.

@0ax1 0ax1 closed this Mar 28, 2026
@0ax1 0ax1 deleted the ad/experiment-overalign branch March 28, 2026 14:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

do not merge Pull requests that are not intended to merge

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@0ax1