Skip to content

Change default segment size#7453

Draft
mprammer wants to merge 1 commit intodevelopfrom
mp/resize-segment-3
Draft

Change default segment size#7453
mprammer wants to merge 1 commit intodevelopfrom
mp/resize-segment-3

Conversation

@mprammer
Copy link
Copy Markdown

Summary

Changes the default segment size. PR for testing.

Testing

N/A

Signed-off-by: Martin Prammer <martin@spiraldb.com>
@mprammer mprammer requested a review from gatesn April 15, 2026 19:05
@mprammer mprammer added the action/benchmark Trigger full benchmarks to run on this PR label Apr 15, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 15, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 8622793 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.167x ❌


datafusion / vortex-file-compressed (1.167x ❌, 0↑ 7↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 123918712 123836664 1.00
polarsignals_q01/datafusion:vortex-file-compressed 🚨 451339588 371420246 1.22
polarsignals_q02/datafusion:vortex-file-compressed 25903301 24590176 1.05
polarsignals_q03/datafusion:vortex-file-compressed 🚨 466380773 365755096 1.28
polarsignals_q04/datafusion:vortex-file-compressed 🚨 15258751 11405335 1.34
polarsignals_q05/datafusion:vortex-file-compressed 🚨 20644048 16383909 1.26
polarsignals_q06/datafusion:vortex-file-compressed 🚨 22960316 19289469 1.19
polarsignals_q07/datafusion:vortex-file-compressed 🚨 18536893 14403220 1.29
polarsignals_q08/datafusion:vortex-file-compressed 🚨 517053920 442423701 1.17
polarsignals_q09/datafusion:vortex-file-compressed 12061654 12658430 0.95

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

File Size Changes (1 files changed, +0.1% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 689.06 MB 689.45 MB +398.55 KB +0.1%

Totals:

  • vortex-file-compressed: 689.06 MB → 689.45 MB (+0.1%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -5.3%
Vortex (geomean): 0.944x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -1.2%


datafusion / vortex-file-compressed (0.951x ➖, 2↑ 1↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 4783169 5499087 0.87
fineweb_q01/datafusion:vortex-file-compressed 🚨 29369440 26316843 1.12
fineweb_q02/datafusion:vortex-file-compressed 30425161 32098125 0.95
fineweb_q03/datafusion:vortex-file-compressed 🚀 76012907 95804345 0.79
fineweb_q04/datafusion:vortex-file-compressed 253826431 257295931 0.99
fineweb_q05/datafusion:vortex-file-compressed 219916089 235413104 0.93
fineweb_q06/datafusion:vortex-file-compressed 72114241 70747725 1.02
fineweb_q07/datafusion:vortex-file-compressed 69220926 71806657 0.96
fineweb_q08/datafusion:vortex-file-compressed 26734097 27663290 0.97
datafusion / vortex-compact (0.927x ➖, 2↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 4950001 4816728 1.03
fineweb_q01/datafusion:vortex-compact 159842381 165699590 0.96
fineweb_q02/datafusion:vortex-compact 161564589 164605463 0.98
fineweb_q03/datafusion:vortex-compact 1347064709 1451614938 0.93
fineweb_q04/datafusion:vortex-compact 1422972668 1550876441 0.92
fineweb_q05/datafusion:vortex-compact 1153089653 1246873042 0.92
fineweb_q06/datafusion:vortex-compact 648094512 700935884 0.92
fineweb_q07/datafusion:vortex-compact 🚀 678484902 792461589 0.86
fineweb_q08/datafusion:vortex-compact 🚀 21165696 25477404 0.83
datafusion / parquet (0.997x ➖, 0↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6554433 6571120 1.00
fineweb_q01/datafusion:parquet 282914535 288681894 0.98
fineweb_q02/datafusion:parquet 279878090 285215358 0.98
fineweb_q03/datafusion:parquet 286994273 280063415 1.02
fineweb_q04/datafusion:parquet 298463017 294645028 1.01
fineweb_q05/datafusion:parquet 296603847 289316897 1.03
fineweb_q06/datafusion:parquet 287021323 300582084 0.95
fineweb_q07/datafusion:parquet 281160746 280375112 1.00
fineweb_q08/datafusion:parquet 278134075 280082821 0.99
duckdb / vortex-file-compressed (0.970x ➖, 1↑ 1↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 2408911 3387446 0.71
fineweb_q01/duckdb:vortex-file-compressed 🚨 29274700 26440809 1.11
fineweb_q02/duckdb:vortex-file-compressed 26667024 26332065 1.01
fineweb_q03/duckdb:vortex-file-compressed 161433665 156148170 1.03
fineweb_q04/duckdb:vortex-file-compressed 231511576 235904017 0.98
fineweb_q05/duckdb:vortex-file-compressed 217764972 225116230 0.97
fineweb_q06/duckdb:vortex-file-compressed 63533451 67945707 0.94
fineweb_q07/duckdb:vortex-file-compressed 67417379 67577252 1.00
fineweb_q08/duckdb:vortex-file-compressed 25875471 24790269 1.04
duckdb / vortex-compact (0.928x ➖, 1↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀 2456406 3994289 0.61
fineweb_q01/duckdb:vortex-compact 101702515 100317081 1.01
fineweb_q02/duckdb:vortex-compact 112827339 113204237 1.00
fineweb_q03/duckdb:vortex-compact 851433835 867815044 0.98
fineweb_q04/duckdb:vortex-compact 907365399 906356560 1.00
fineweb_q05/duckdb:vortex-compact 816986736 864921456 0.94
fineweb_q06/duckdb:vortex-compact 459847913 479163220 0.96
fineweb_q07/duckdb:vortex-compact 473460452 471382258 1.00
fineweb_q08/duckdb:vortex-compact 22097439 24084458 0.92
duckdb / parquet (0.997x ➖, 0↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 36706255 37450887 0.98
fineweb_q01/duckdb:parquet 92073760 91270180 1.01
fineweb_q02/duckdb:parquet 98929948 99234453 1.00
fineweb_q03/duckdb:parquet 309968740 309591404 1.00
fineweb_q04/duckdb:parquet 439119081 436411165 1.01
fineweb_q05/duckdb:parquet 410085206 413561106 0.99
fineweb_q06/duckdb:parquet 198487201 200375106 0.99
fineweb_q07/duckdb:parquet 210363101 210034390 1.00
fineweb_q08/duckdb:parquet 57020345 57263084 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +2.8% -1.1% +3.9% +43.6% ➖ noise
0 datafusion:vortex-file-compressed -13.0% -1.1% -12.0% +74.6% ➖ noise
0 duckdb:vortex-compact -38.5% -1.1% -37.8% +35.3% ✅ faster
0 duckdb:vortex-file-compressed -28.9% -1.1% -28.1% +52.3% ➖ noise
1 datafusion:vortex-compact -3.5% -0.6% -3.0% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +11.6% -0.6% +12.2% +13.2% ➖ noise
1 duckdb:vortex-compact +1.4% -0.6% +2.0% +19.8% ➖ noise
1 duckdb:vortex-file-compressed +10.7% -0.6% +11.4% +43.4% ➖ noise
2 datafusion:vortex-compact -1.8% -1.1% -0.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -5.2% -1.1% -4.2% +24.3% ➖ noise
2 duckdb:vortex-compact -0.3% -1.1% +0.8% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +1.3% -1.1% +2.4% +10.0% ➖ noise
3 datafusion:vortex-compact -7.2% +1.3% -8.4% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -20.7% +1.3% -21.7% +31.7% ➖ noise
3 duckdb:vortex-compact -1.9% +1.3% -3.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +3.4% +1.3% +2.1% +28.0% ➖ noise
4 datafusion:vortex-compact -8.2% +1.0% -9.1% +10.0% ✅ faster
4 datafusion:vortex-file-compressed -1.3% +1.0% -2.3% +10.0% ➖ noise
4 duckdb:vortex-compact +0.1% +1.0% -0.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.9% +1.0% -2.8% +10.0% ➖ noise
5 datafusion:vortex-compact -7.5% +0.8% -8.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -6.6% +0.8% -7.3% +10.0% ➖ noise
5 duckdb:vortex-compact -5.5% +0.8% -6.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -3.3% +0.8% -4.1% +10.0% ➖ noise
6 datafusion:vortex-compact -7.5% -2.7% -4.9% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.9% -2.7% +4.8% +16.2% ➖ noise
6 duckdb:vortex-compact -4.0% -2.7% -1.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -6.5% -2.7% -3.9% +14.0% ➖ noise
7 datafusion:vortex-compact -14.4% +0.2% -14.6% +10.0% ✅ faster
7 datafusion:vortex-file-compressed -3.6% +0.2% -3.8% +15.4% ➖ noise
7 duckdb:vortex-compact +0.4% +0.2% +0.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.2% +0.2% -0.5% +11.5% ➖ noise
8 datafusion:vortex-compact -16.9% -0.6% -16.5% +23.6% ➖ noise
8 datafusion:vortex-file-compressed -3.4% -0.6% -2.8% +30.9% ➖ noise
8 duckdb:vortex-compact -8.3% -0.6% -7.7% +17.3% ➖ noise
8 duckdb:vortex-file-compressed +4.4% -0.6% +5.0% +13.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

File Size Changes (2 files changed, +0.0% overall, 2↑ 0↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.79 GB 1.79 GB +204.77 KB +0.0%
sample.vortex 1.0 vortex-compact 1.23 GB 1.23 GB +87.18 KB +0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (+0.0%)
  • vortex-file-compressed: 1.79 GB → 1.79 GB (+0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.5%
Vortex (geomean): 1.090x ➖
Parquet (geomean): 1.023x ➖
Shifts: Parquet (control) +2.3% · Median polish +1.2%


datafusion / vortex-file-compressed (1.193x ❌, 0↑ 11↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 56202572 48463064 1.16
tpch_q02/datafusion:vortex-file-compressed 35044803 32615581 1.07
tpch_q03/datafusion:vortex-file-compressed 🚨 31897842 27458299 1.16
tpch_q04/datafusion:vortex-file-compressed 🚨 25755765 19218861 1.34
tpch_q05/datafusion:vortex-file-compressed 57666040 53884694 1.07
tpch_q06/datafusion:vortex-file-compressed 🚨 20343706 10948296 1.86
tpch_q07/datafusion:vortex-file-compressed 🚨 72230676 64085145 1.13
tpch_q08/datafusion:vortex-file-compressed 50530730 46024064 1.10
tpch_q09/datafusion:vortex-file-compressed 59442845 56134736 1.06
tpch_q10/datafusion:vortex-file-compressed 52284559 47561454 1.10
tpch_q11/datafusion:vortex-file-compressed 🚨 20201159 17979916 1.12
tpch_q12/datafusion:vortex-file-compressed 🚨 40245884 25285559 1.59
tpch_q13/datafusion:vortex-file-compressed 28426370 27512478 1.03
tpch_q14/datafusion:vortex-file-compressed 🚨 23825751 16342576 1.46
tpch_q15/datafusion:vortex-file-compressed 🚨 36373590 25504290 1.43
tpch_q16/datafusion:vortex-file-compressed 25167483 24507542 1.03
tpch_q17/datafusion:vortex-file-compressed 68720148 63815634 1.08
tpch_q18/datafusion:vortex-file-compressed 85322153 78835075 1.08
tpch_q19/datafusion:vortex-file-compressed 🚨 36590918 23845004 1.53
tpch_q20/datafusion:vortex-file-compressed 🚨 37184652 32966061 1.13
tpch_q21/datafusion:vortex-file-compressed 82817307 76440929 1.08
tpch_q22/datafusion:vortex-file-compressed 16545390 16362146 1.01
datafusion / vortex-compact (1.147x ❌, 1↑ 11↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 72973916 57945557 1.26
tpch_q02/datafusion:vortex-compact 36051294 36997865 0.97
tpch_q03/datafusion:vortex-compact 🚨 34297414 30384236 1.13
tpch_q04/datafusion:vortex-compact 🚨 31561157 22729060 1.39
tpch_q05/datafusion:vortex-compact 58936684 56566419 1.04
tpch_q06/datafusion:vortex-compact 🚨 22525353 13937013 1.62
tpch_q07/datafusion:vortex-compact 74893514 70838848 1.06
tpch_q08/datafusion:vortex-compact 53079826 49572412 1.07
tpch_q09/datafusion:vortex-compact 64001664 61755305 1.04
tpch_q10/datafusion:vortex-compact 🚨 62056524 52837729 1.17
tpch_q11/datafusion:vortex-compact 20303222 19908219 1.02
tpch_q12/datafusion:vortex-compact 🚨 50393512 34344702 1.47
tpch_q13/datafusion:vortex-compact 38698752 35807789 1.08
tpch_q14/datafusion:vortex-compact 🚨 26174856 20461146 1.28
tpch_q15/datafusion:vortex-compact 🚨 43874733 34496435 1.27
tpch_q16/datafusion:vortex-compact 🚀 26728314 29708259 0.90
tpch_q17/datafusion:vortex-compact 72722457 66950949 1.09
tpch_q18/datafusion:vortex-compact 🚨 92169586 83180237 1.11
tpch_q19/datafusion:vortex-compact 🚨 42777736 34331213 1.25
tpch_q20/datafusion:vortex-compact 🚨 42735654 37811247 1.13
tpch_q21/datafusion:vortex-compact 94339344 86073186 1.10
tpch_q22/datafusion:vortex-compact 17686038 16831629 1.05
datafusion / parquet (1.052x ➖, 0↑ 4↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 136433040 114615825 1.19
tpch_q02/datafusion:parquet 70337145 69983827 1.01
tpch_q03/datafusion:parquet 🚨 82776129 73232547 1.13
tpch_q04/datafusion:parquet 51393927 48737089 1.05
tpch_q05/datafusion:parquet 109974052 103345900 1.06
tpch_q06/datafusion:parquet 43928606 44102415 1.00
tpch_q07/datafusion:parquet 121766748 113601790 1.07
tpch_q08/datafusion:parquet 108714926 102812643 1.06
tpch_q09/datafusion:parquet 🚨 146582442 132183845 1.11
tpch_q10/datafusion:parquet 131683038 120415344 1.09
tpch_q11/datafusion:parquet 51251832 48946696 1.05
tpch_q12/datafusion:parquet 88539684 86634263 1.02
tpch_q13/datafusion:parquet 215061812 203372457 1.06
tpch_q14/datafusion:parquet 46694122 51287524 0.91
tpch_q15/datafusion:parquet 🚨 72946495 66019224 1.10
tpch_q16/datafusion:parquet 53088958 50409301 1.05
tpch_q17/datafusion:parquet 142298272 134413115 1.06
tpch_q18/datafusion:parquet 166507687 164765247 1.01
tpch_q19/datafusion:parquet 77649636 71702806 1.08
tpch_q20/datafusion:parquet 79389653 76956093 1.03
tpch_q21/datafusion:parquet 154273904 147032628 1.05
tpch_q22/datafusion:parquet 35529761 36123749 0.98
datafusion / arrow (0.995x ➖, 0↑ 1↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 52562864 54766590 0.96
tpch_q02/datafusion:arrow 21473698 21341400 1.01
tpch_q03/datafusion:arrow 31672193 32767529 0.97
tpch_q04/datafusion:arrow 26042598 27015314 0.96
tpch_q05/datafusion:arrow 76308265 75295483 1.01
tpch_q06/datafusion:arrow 🚨 21263326 18951050 1.12
tpch_q07/datafusion:arrow 109975824 109138071 1.01
tpch_q08/datafusion:arrow 42401999 43593003 0.97
tpch_q09/datafusion:arrow 67024317 68711583 0.98
tpch_q10/datafusion:arrow 50731232 51185766 0.99
tpch_q11/datafusion:arrow 11318651 11616688 0.97
tpch_q12/datafusion:arrow 53595929 59388338 0.90
tpch_q13/datafusion:arrow 49111945 48494588 1.01
tpch_q14/datafusion:arrow 22377250 22082535 1.01
tpch_q15/datafusion:arrow 44519517 42965619 1.04
tpch_q16/datafusion:arrow 20737787 21203446 0.98
tpch_q17/datafusion:arrow 69097273 69217735 1.00
tpch_q18/datafusion:arrow 142474468 141127927 1.01
tpch_q19/datafusion:arrow 37443223 37569161 1.00
tpch_q20/datafusion:arrow 37026236 37479834 0.99
tpch_q21/datafusion:arrow 152410465 149716963 1.02
tpch_q22/datafusion:arrow 20095268 20261716 0.99
duckdb / vortex-file-compressed (1.041x ➖, 1↑ 5↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31871202 33361207 0.96
tpch_q02/duckdb:vortex-file-compressed 26219174 27771887 0.94
tpch_q03/duckdb:vortex-file-compressed 31809362 30375105 1.05
tpch_q04/duckdb:vortex-file-compressed 29633769 31131528 0.95
tpch_q05/duckdb:vortex-file-compressed 35064697 34497453 1.02
tpch_q06/duckdb:vortex-file-compressed 🚨 19679908 10954751 1.80
tpch_q07/duckdb:vortex-file-compressed 39086046 38160004 1.02
tpch_q08/duckdb:vortex-file-compressed 40163878 42387319 0.95
tpch_q09/duckdb:vortex-file-compressed 76357232 81177480 0.94
tpch_q10/duckdb:vortex-file-compressed 🚨 42701089 37577779 1.14
tpch_q11/duckdb:vortex-file-compressed 🚀 14364519 16564231 0.87
tpch_q12/duckdb:vortex-file-compressed 🚨 32584364 23695807 1.38
tpch_q13/duckdb:vortex-file-compressed 37115945 37113741 1.00
tpch_q14/duckdb:vortex-file-compressed 🚨 25912143 22655008 1.14
tpch_q15/duckdb:vortex-file-compressed 17080599 15748857 1.08
tpch_q16/duckdb:vortex-file-compressed 28756243 31036508 0.93
tpch_q17/duckdb:vortex-file-compressed 🚨 28659611 25483239 1.12
tpch_q18/duckdb:vortex-file-compressed 51457807 52048472 0.99
tpch_q19/duckdb:vortex-file-compressed 29632491 30653277 0.97
tpch_q20/duckdb:vortex-file-compressed 36142211 33996875 1.06
tpch_q21/duckdb:vortex-file-compressed 106432766 107886876 0.99
tpch_q22/duckdb:vortex-file-compressed 17268155 18831951 0.92
duckdb / vortex-compact (0.990x ➖, 4↑ 4↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 51060159 39542596 1.29
tpch_q02/duckdb:vortex-compact 🚀 29576391 38146737 0.78
tpch_q03/duckdb:vortex-compact 32981845 32445598 1.02
tpch_q04/duckdb:vortex-compact 33681101 34108266 0.99
tpch_q05/duckdb:vortex-compact 39556485 38061707 1.04
tpch_q06/duckdb:vortex-compact 🚨 22739187 14461173 1.57
tpch_q07/duckdb:vortex-compact 45903651 43421703 1.06
tpch_q08/duckdb:vortex-compact 44380458 45904040 0.97
tpch_q09/duckdb:vortex-compact 83915847 90605583 0.93
tpch_q10/duckdb:vortex-compact 🚨 47047333 40846569 1.15
tpch_q11/duckdb:vortex-compact 🚀 14440805 21375827 0.68
tpch_q12/duckdb:vortex-compact 🚨 44324559 36083391 1.23
tpch_q13/duckdb:vortex-compact 44022623 45638459 0.96
tpch_q14/duckdb:vortex-compact 30967679 33943358 0.91
tpch_q15/duckdb:vortex-compact 21363880 20436891 1.05
tpch_q16/duckdb:vortex-compact 🚀 29716508 38024874 0.78
tpch_q17/duckdb:vortex-compact 33186854 30745408 1.08
tpch_q18/duckdb:vortex-compact 50100746 54082224 0.93
tpch_q19/duckdb:vortex-compact 🚀 32709055 40541487 0.81
tpch_q20/duckdb:vortex-compact 42399456 45025173 0.94
tpch_q21/duckdb:vortex-compact 119880378 110817418 1.08
tpch_q22/duckdb:vortex-compact 19036291 20887954 0.91
duckdb / parquet (0.995x ➖, 2↑ 2↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 76998540 76250902 1.01
tpch_q02/duckdb:parquet 39128848 39020907 1.00
tpch_q03/duckdb:parquet 69410434 68717189 1.01
tpch_q04/duckdb:parquet 🚨 56647542 47411736 1.19
tpch_q05/duckdb:parquet 67918706 65489304 1.04
tpch_q06/duckdb:parquet 27786009 27301342 1.02
tpch_q07/duckdb:parquet 🚀 68119470 81627654 0.83
tpch_q08/duckdb:parquet 81829907 82328270 0.99
tpch_q09/duckdb:parquet 149227942 152914347 0.98
tpch_q10/duckdb:parquet 🚀 126127178 143565558 0.88
tpch_q11/duckdb:parquet 22633182 23211266 0.98
tpch_q12/duckdb:parquet 45569546 50231226 0.91
tpch_q13/duckdb:parquet 264428826 265696385 1.00
tpch_q14/duckdb:parquet 48910057 48803436 1.00
tpch_q15/duckdb:parquet 🚨 28003247 24486145 1.14
tpch_q16/duckdb:parquet 55821079 56986263 0.98
tpch_q17/duckdb:parquet 52341764 57080679 0.92
tpch_q18/duckdb:parquet 115580963 117525465 0.98
tpch_q19/duckdb:parquet 74460975 69088645 1.08
tpch_q20/duckdb:parquet 64488884 63493325 1.02
tpch_q21/duckdb:parquet 182276657 179372695 1.02
tpch_q22/duckdb:parquet 51591756 52537297 0.98
duckdb / duckdb (1.003x ➖, 0↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15851406 15965128 0.99
tpch_q02/duckdb:duckdb 12434534 12366007 1.01
tpch_q03/duckdb:duckdb 18977804 19396591 0.98
tpch_q04/duckdb:duckdb 19344251 19052127 1.02
tpch_q05/duckdb:duckdb 19761594 20138520 0.98
tpch_q06/duckdb:duckdb 5266680 5326396 0.99
tpch_q07/duckdb:duckdb 21784309 21741821 1.00
tpch_q08/duckdb:duckdb 20907302 20628043 1.01
tpch_q09/duckdb:duckdb 52308174 54316986 0.96
tpch_q10/duckdb:duckdb 43270252 41949523 1.03
tpch_q11/duckdb:duckdb 5898660 5579580 1.06
tpch_q12/duckdb:duckdb 14032166 14081799 1.00
tpch_q13/duckdb:duckdb 37483899 37179778 1.01
tpch_q14/duckdb:duckdb 17518407 15991152 1.10
tpch_q15/duckdb:duckdb 11844263 11828872 1.00
tpch_q16/duckdb:duckdb 24361842 23457774 1.04
tpch_q17/duckdb:duckdb 13697312 13938402 0.98
tpch_q18/duckdb:duckdb 38273825 38210881 1.00
tpch_q19/duckdb:duckdb 25771663 28121276 0.92
tpch_q20/duckdb:duckdb 22200725 22567907 0.98
tpch_q21/duckdb:duckdb 56464279 55719847 1.01
tpch_q22/duckdb:duckdb 24031291 23904627 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -4.0% +9.6% -12.5% +18.3% ➖ noise
1 datafusion:vortex-compact +25.9% +9.6% +14.9% +16.7% ➖ noise
1 datafusion:vortex-file-compressed +16.0% +9.6% +5.8% +17.4% ➖ noise
1 duckdb:duckdb -0.7% +9.6% -9.4% +16.4% ➖ noise
1 duckdb:vortex-compact +29.1% +9.6% +17.8% +16.5% 🚨 regression
1 duckdb:vortex-file-compressed -4.5% +9.6% -12.9% +17.1% ➖ noise
2 datafusion:arrow +0.6% +0.4% +0.2% +13.3% ➖ noise
2 datafusion:vortex-compact -2.6% +0.4% -2.9% +13.3% ➖ noise
2 datafusion:vortex-file-compressed +7.4% +0.4% +7.0% +13.3% ➖ noise
2 duckdb:duckdb +0.6% +0.4% +0.2% +13.3% ➖ noise
2 duckdb:vortex-compact -22.5% +0.4% -22.8% +13.3% ✅ faster
2 duckdb:vortex-file-compressed -5.6% +0.4% -6.0% +13.3% ➖ noise
3 datafusion:arrow -3.3% +6.9% -9.5% +13.3% ➖ noise
3 datafusion:vortex-compact +12.9% +6.9% +5.6% +13.3% ➖ noise
3 datafusion:vortex-file-compressed +16.2% +6.9% +8.7% +13.3% ➖ noise
3 duckdb:duckdb -2.2% +6.9% -8.4% +14.7% ➖ noise
3 duckdb:vortex-compact +1.7% +6.9% -4.9% +13.3% ➖ noise
3 duckdb:vortex-file-compressed +4.7% +6.9% -2.0% +13.3% ➖ noise
4 datafusion:arrow -3.6% +12.2% -14.1% +13.3% ✅ faster
4 datafusion:vortex-compact +38.9% +12.2% +23.7% +13.3% 🚨 regression
4 datafusion:vortex-file-compressed +34.0% +12.2% +19.4% +13.3% 🚨 regression
4 duckdb:duckdb +1.5% +12.2% -9.5% +13.3% ➖ noise
4 duckdb:vortex-compact -1.3% +12.2% -12.0% +13.3% ✅ faster
4 duckdb:vortex-file-compressed -4.8% +12.2% -15.2% +13.3% ✅ faster
5 datafusion:arrow +1.3% +5.1% -3.5% +13.3% ➖ noise
5 datafusion:vortex-compact +4.2% +5.1% -0.8% +13.3% ➖ noise
5 datafusion:vortex-file-compressed +7.0% +5.1% +1.9% +13.3% ➖ noise
5 duckdb:duckdb -1.9% +5.1% -6.6% +13.3% ➖ noise
5 duckdb:vortex-compact +3.9% +5.1% -1.1% +13.3% ➖ noise
5 duckdb:vortex-file-compressed +1.6% +5.1% -3.2% +13.3% ➖ noise
6 datafusion:arrow +12.2% +0.7% +11.4% +14.6% ➖ noise
6 datafusion:vortex-compact +61.6% +0.7% +60.5% +14.9% 🚨 regression
6 datafusion:vortex-file-compressed +85.8% +0.7% +84.6% +14.9% 🚨 regression
6 duckdb:duckdb -1.1% +0.7% -1.8% +17.0% ➖ noise
6 duckdb:vortex-compact +57.2% +0.7% +56.2% +14.5% 🚨 regression
6 duckdb:vortex-file-compressed +79.6% +0.7% +78.4% +18.0% 🚨 regression
7 datafusion:arrow +0.8% -5.4% +6.5% +13.3% ➖ noise
7 datafusion:vortex-compact +5.7% -5.4% +11.8% +13.3% ➖ noise
7 datafusion:vortex-file-compressed +12.7% -5.4% +19.2% +13.3% 🚨 regression
7 duckdb:duckdb +0.2% -5.4% +5.9% +13.3% ➖ noise
7 duckdb:vortex-compact +5.7% -5.4% +11.8% +13.3% ➖ noise
7 duckdb:vortex-file-compressed +2.4% -5.4% +8.3% +13.3% ➖ noise
8 datafusion:arrow -2.7% +2.5% -5.1% +13.3% ➖ noise
8 datafusion:vortex-compact +7.1% +2.5% +4.4% +13.3% ➖ noise
8 datafusion:vortex-file-compressed +9.8% +2.5% +7.1% +13.3% ➖ noise
8 duckdb:duckdb +1.4% +2.5% -1.1% +13.3% ➖ noise
8 duckdb:vortex-compact -3.3% +2.5% -5.7% +13.3% ➖ noise
8 duckdb:vortex-file-compressed -5.2% +2.5% -7.6% +13.3% ➖ noise
9 datafusion:arrow -2.5% +4.0% -6.2% +13.3% ➖ noise
9 datafusion:vortex-compact +3.6% +4.0% -0.4% +13.3% ➖ noise
9 datafusion:vortex-file-compressed +5.9% +4.0% +1.8% +13.3% ➖ noise
9 duckdb:duckdb -3.7% +4.0% -7.4% +13.3% ➖ noise
9 duckdb:vortex-compact -7.4% +4.0% -11.0% +13.3% ➖ noise
9 duckdb:vortex-file-compressed -5.9% +4.0% -9.6% +13.3% ➖ noise
10 datafusion:arrow -0.9% -2.0% +1.1% +13.3% ➖ noise
10 datafusion:vortex-compact +17.4% -2.0% +19.8% +13.3% 🚨 regression
10 datafusion:vortex-file-compressed +9.9% -2.0% +12.2% +13.3% ➖ noise
10 duckdb:duckdb +3.1% -2.0% +5.2% +13.3% ➖ noise
10 duckdb:vortex-compact +15.2% -2.0% +17.5% +13.3% 🚨 regression
10 duckdb:vortex-file-compressed +13.6% -2.0% +15.9% +13.3% 🚨 regression
11 datafusion:arrow -2.6% +1.0% -3.6% +13.3% ➖ noise
11 datafusion:vortex-compact +2.0% +1.0% +0.9% +13.3% ➖ noise
11 datafusion:vortex-file-compressed +12.4% +1.0% +11.2% +13.3% ➖ noise
11 duckdb:duckdb +5.7% +1.0% +4.6% +13.3% ➖ noise
11 duckdb:vortex-compact -32.4% +1.0% -33.1% +13.3% ✅ faster
11 duckdb:vortex-file-compressed -13.3% +1.0% -14.2% +13.3% ✅ faster
12 datafusion:arrow -9.8% -3.7% -6.3% +13.3% ➖ noise
12 datafusion:vortex-compact +46.7% -3.7% +52.4% +13.3% 🚨 regression
12 datafusion:vortex-file-compressed +59.2% -3.7% +65.3% +13.3% 🚨 regression
12 duckdb:duckdb -0.4% -3.7% +3.5% +13.3% ➖ noise
12 duckdb:vortex-compact +22.8% -3.7% +27.6% +13.3% 🚨 regression
12 duckdb:vortex-file-compressed +37.5% -3.7% +42.8% +13.3% 🚨 regression
13 datafusion:arrow +1.3% +2.6% -1.3% +13.3% ➖ noise
13 datafusion:vortex-compact +8.1% +2.6% +5.3% +13.3% ➖ noise
13 datafusion:vortex-file-compressed +3.3% +2.6% +0.7% +13.3% ➖ noise
13 duckdb:duckdb +0.8% +2.6% -1.7% +13.3% ➖ noise
13 duckdb:vortex-compact -3.5% +2.6% -6.0% +13.3% ➖ noise
13 duckdb:vortex-file-compressed +0.0% +2.6% -2.5% +13.3% ➖ noise
14 datafusion:arrow +1.3% -4.5% +6.1% +13.3% ➖ noise
14 datafusion:vortex-compact +27.9% -4.5% +33.9% +13.3% 🚨 regression
14 datafusion:vortex-file-compressed +45.8% -4.5% +52.6% +13.3% 🚨 regression
14 duckdb:duckdb +9.6% -4.5% +14.7% +16.4% ➖ noise
14 duckdb:vortex-compact -8.8% -4.5% -4.5% +13.3% ➖ noise
14 duckdb:vortex-file-compressed +14.4% -4.5% +19.7% +13.3% 🚨 regression
15 datafusion:arrow +3.6% +12.4% -7.8% +13.3% ➖ noise
15 datafusion:vortex-compact +27.2% +12.4% +13.1% +13.3% ➖ noise
15 datafusion:vortex-file-compressed +42.6% +12.4% +26.9% +13.3% 🚨 regression
15 duckdb:duckdb +0.1% +12.4% -10.9% +13.4% ➖ noise
15 duckdb:vortex-compact +4.5% +12.4% -7.0% +14.8% ➖ noise
15 duckdb:vortex-file-compressed +8.5% +12.4% -3.5% +13.3% ➖ noise
16 datafusion:arrow -2.2% +1.6% -3.7% +13.3% ➖ noise
16 datafusion:vortex-compact -10.0% +1.6% -11.4% +13.3% ➖ noise
16 datafusion:vortex-file-compressed +2.7% +1.6% +1.1% +13.3% ➖ noise
16 duckdb:duckdb +3.9% +1.6% +2.2% +13.3% ➖ noise
16 duckdb:vortex-compact -21.8% +1.6% -23.1% +13.3% ✅ faster
16 duckdb:vortex-file-compressed -7.3% +1.6% -8.8% +13.3% ➖ noise
17 datafusion:arrow -0.2% -1.5% +1.3% +13.3% ➖ noise
17 datafusion:vortex-compact +8.6% -1.5% +10.2% +13.3% ➖ noise
17 datafusion:vortex-file-compressed +7.7% -1.5% +9.3% +13.3% ➖ noise
17 duckdb:duckdb -1.7% -1.5% -0.3% +13.3% ➖ noise
17 duckdb:vortex-compact +7.9% -1.5% +9.6% +13.3% ➖ noise
17 duckdb:vortex-file-compressed +12.5% -1.5% +14.1% +13.3% 🚨 regression
18 datafusion:arrow +1.0% -0.3% +1.3% +13.3% ➖ noise
18 datafusion:vortex-compact +10.8% -0.3% +11.1% +13.3% ➖ noise
18 datafusion:vortex-file-compressed +8.2% -0.3% +8.6% +13.3% ➖ noise
18 duckdb:duckdb +0.2% -0.3% +0.5% +13.3% ➖ noise
18 duckdb:vortex-compact -7.4% -0.3% -7.1% +13.3% ➖ noise
18 duckdb:vortex-file-compressed -1.1% -0.3% -0.8% +13.3% ➖ noise
19 datafusion:arrow -0.3% +8.0% -7.7% +13.3% ➖ noise
19 datafusion:vortex-compact +24.6% +8.0% +15.3% +13.3% 🚨 regression
19 datafusion:vortex-file-compressed +53.5% +8.0% +42.0% +13.3% 🚨 regression
19 duckdb:duckdb -8.4% +8.0% -15.2% +14.7% ✅ faster
19 duckdb:vortex-compact -19.3% +8.0% -25.3% +14.5% ✅ faster
19 duckdb:vortex-file-compressed -3.3% +8.0% -10.5% +15.6% ➖ noise
20 datafusion:arrow -1.2% +2.4% -3.5% +13.3% ➖ noise
20 datafusion:vortex-compact +13.0% +2.4% +10.4% +13.3% ➖ noise
20 datafusion:vortex-file-compressed +12.8% +2.4% +10.2% +13.3% ➖ noise
20 duckdb:duckdb -1.6% +2.4% -3.9% +13.3% ➖ noise
20 duckdb:vortex-compact -5.8% +2.4% -8.0% +13.3% ➖ noise
20 duckdb:vortex-file-compressed +6.3% +2.4% +3.9% +13.3% ➖ noise
21 datafusion:arrow +1.8% +3.3% -1.4% +13.3% ➖ noise
21 datafusion:vortex-compact +9.6% +3.3% +6.1% +13.3% ➖ noise
21 datafusion:vortex-file-compressed +8.3% +3.3% +4.9% +13.3% ➖ noise
21 duckdb:duckdb +1.3% +3.3% -1.9% +13.3% ➖ noise
21 duckdb:vortex-compact +8.2% +3.3% +4.8% +13.3% ➖ noise
21 duckdb:vortex-file-compressed -1.3% +3.3% -4.5% +13.3% ➖ noise
22 datafusion:arrow -0.8% -1.7% +0.9% +13.3% ➖ noise
22 datafusion:vortex-compact +5.1% -1.7% +6.9% +13.3% ➖ noise
22 datafusion:vortex-file-compressed +1.1% -1.7% +2.9% +13.3% ➖ noise
22 duckdb:duckdb +0.5% -1.7% +2.3% +13.3% ➖ noise
22 duckdb:vortex-compact -8.9% -1.7% -7.3% +13.3% ➖ noise
22 duckdb:vortex-file-compressed -8.3% -1.7% -6.7% +13.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

File Size Changes (12 files changed, +0.9% overall, 11↑ 1↓)
File Scale Format Base HEAD Change %
partsupp_0.vortex 1.0 vortex-file-compressed 35.90 MB 36.95 MB +1.06 MB +2.9%
lineitem_1.vortex 1.0 vortex-file-compressed 84.72 MB 86.19 MB +1.47 MB +1.7%
lineitem_0.vortex 1.0 vortex-file-compressed 85.24 MB 86.18 MB +968.29 KB +1.1%
lineitem_1.vortex 1.0 vortex-compact 62.89 MB 63.33 MB +455.14 KB +0.7%
lineitem_0.vortex 1.0 vortex-compact 62.86 MB 63.29 MB +440.59 KB +0.7%
partsupp_0.vortex 1.0 vortex-compact 25.21 MB 25.37 MB +169.11 KB +0.7%
part_0.vortex 1.0 vortex-compact 3.62 MB 3.63 MB +10.78 KB +0.3%
orders_0.vortex 1.0 vortex-compact 31.68 MB 31.75 MB +76.70 KB +0.2%
part_0.vortex 1.0 vortex-file-compressed 5.42 MB 5.43 MB +9.32 KB +0.2%
customer_0.vortex 1.0 vortex-compact 7.42 MB 7.42 MB +4.62 KB +0.1%
customer_0.vortex 1.0 vortex-file-compressed 10.48 MB 10.48 MB +6.05 KB +0.1%
orders_0.vortex 1.0 vortex-file-compressed 43.36 MB 42.93 MB 447.66 KB -1.0%

Totals:

  • vortex-compact: 194.43 MB → 195.56 MB (+0.6%)
  • vortex-file-compressed: 266.07 MB → 269.13 MB (+1.1%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (medium confidence)
Attributed Vortex impact: +6.7%
Vortex (geomean): 1.072x ➖
Parquet (geomean): 0.991x ➖
Shifts: Parquet (control) -0.9% · Median polish +2.1%


datafusion / vortex-file-compressed (1.051x ➖, 0↑ 21↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 27217578 29988636 0.91
tpcds_q02/datafusion:vortex-file-compressed 52518041 53122378 0.99
tpcds_q03/datafusion:vortex-file-compressed 22236520 21575563 1.03
tpcds_q04/datafusion:vortex-file-compressed 308161428 296849371 1.04
tpcds_q05/datafusion:vortex-file-compressed 56373129 59281163 0.95
tpcds_q06/datafusion:vortex-file-compressed 52400765 55620064 0.94
tpcds_q07/datafusion:vortex-file-compressed 62904623 58086609 1.08
tpcds_q08/datafusion:vortex-file-compressed 37313820 38500525 0.97
tpcds_q09/datafusion:vortex-file-compressed 🚨 86165353 60638796 1.42
tpcds_q10/datafusion:vortex-file-compressed 45928682 44581916 1.03
tpcds_q11/datafusion:vortex-file-compressed 174065350 175777917 0.99
tpcds_q12/datafusion:vortex-file-compressed 22851643 24039679 0.95
tpcds_q13/datafusion:vortex-file-compressed 🚨 72016670 57585119 1.25
tpcds_q14/datafusion:vortex-file-compressed 220325349 202315240 1.09
tpcds_q15/datafusion:vortex-file-compressed 36247035 39322782 0.92
tpcds_q16/datafusion:vortex-file-compressed 31644438 30569720 1.04
tpcds_q17/datafusion:vortex-file-compressed 72880961 70487496 1.03
tpcds_q18/datafusion:vortex-file-compressed 89585214 86052118 1.04
tpcds_q19/datafusion:vortex-file-compressed 32261046 30894298 1.04
tpcds_q20/datafusion:vortex-file-compressed 27405629 27371136 1.00
tpcds_q21/datafusion:vortex-file-compressed 141452906 153257210 0.92
tpcds_q22/datafusion:vortex-file-compressed 64571135 61530507 1.05
tpcds_q23/datafusion:vortex-file-compressed 162526468 148852214 1.09
tpcds_q24/datafusion:vortex-file-compressed 117243531 111991872 1.05
tpcds_q25/datafusion:vortex-file-compressed 74342000 68023651 1.09
tpcds_q26/datafusion:vortex-file-compressed 🚨 46172021 37872623 1.22
tpcds_q27/datafusion:vortex-file-compressed 🚨 141482123 121524532 1.16
tpcds_q28/datafusion:vortex-file-compressed 🚨 76266619 52682216 1.45
tpcds_q29/datafusion:vortex-file-compressed 72206580 69437449 1.04
tpcds_q30/datafusion:vortex-file-compressed 29708446 32597991 0.91
tpcds_q31/datafusion:vortex-file-compressed 99028534 94142643 1.05
tpcds_q32/datafusion:vortex-file-compressed 🚨 23903103 21495180 1.11
tpcds_q33/datafusion:vortex-file-compressed 41885371 38666966 1.08
tpcds_q34/datafusion:vortex-file-compressed 30899509 30367495 1.02
tpcds_q35/datafusion:vortex-file-compressed 54217009 55175183 0.98
tpcds_q36/datafusion:vortex-file-compressed 81307848 74860449 1.09
tpcds_q37/datafusion:vortex-file-compressed 🚨 42809991 35357418 1.21
tpcds_q38/datafusion:vortex-file-compressed 52291332 51099821 1.02
tpcds_q39/datafusion:vortex-file-compressed 143841653 149186883 0.96
tpcds_q40/datafusion:vortex-file-compressed 52649793 53982182 0.98
tpcds_q41/datafusion:vortex-file-compressed 19270618 19190899 1.00
tpcds_q42/datafusion:vortex-file-compressed 20011014 18858632 1.06
tpcds_q43/datafusion:vortex-file-compressed 33872793 31363943 1.08
tpcds_q44/datafusion:vortex-file-compressed 🚨 53120485 40843512 1.30
tpcds_q45/datafusion:vortex-file-compressed 34722373 35477133 0.98
tpcds_q46/datafusion:vortex-file-compressed 49446637 50640766 0.98
tpcds_q47/datafusion:vortex-file-compressed 210892854 210720276 1.00
tpcds_q48/datafusion:vortex-file-compressed 🚨 60841240 46687061 1.30
tpcds_q49/datafusion:vortex-file-compressed 🚨 82052180 72748345 1.13
tpcds_q50/datafusion:vortex-file-compressed 49892536 46551538 1.07
tpcds_q51/datafusion:vortex-file-compressed 91584169 91895277 1.00
tpcds_q52/datafusion:vortex-file-compressed 🚨 21222569 18781951 1.13
tpcds_q53/datafusion:vortex-file-compressed 26543117 26847275 0.99
tpcds_q54/datafusion:vortex-file-compressed 46962788 45618655 1.03
tpcds_q55/datafusion:vortex-file-compressed 20226648 19071674 1.06
tpcds_q56/datafusion:vortex-file-compressed 42635042 40399195 1.06
tpcds_q57/datafusion:vortex-file-compressed 130067366 133140743 0.98
tpcds_q58/datafusion:vortex-file-compressed 75140939 73020505 1.03
tpcds_q59/datafusion:vortex-file-compressed 75191893 72830462 1.03
tpcds_q60/datafusion:vortex-file-compressed 43141015 41710112 1.03
tpcds_q61/datafusion:vortex-file-compressed 54513533 50566461 1.08
tpcds_q62/datafusion:vortex-file-compressed 31313935 32678154 0.96
tpcds_q63/datafusion:vortex-file-compressed 26221611 26378435 0.99
tpcds_q64/datafusion:vortex-file-compressed 481548112 480172637 1.00
tpcds_q65/datafusion:vortex-file-compressed 50745684 48231749 1.05
tpcds_q66/datafusion:vortex-file-compressed 96748336 93949059 1.03
tpcds_q67/datafusion:vortex-file-compressed 119398120 120306397 0.99
tpcds_q68/datafusion:vortex-file-compressed 50273647 46209883 1.09
tpcds_q69/datafusion:vortex-file-compressed 42995170 44014997 0.98
tpcds_q70/datafusion:vortex-file-compressed 111608477 111471576 1.00
tpcds_q71/datafusion:vortex-file-compressed 🚨 35433697 31699119 1.12
tpcds_q72/datafusion:vortex-file-compressed 2570477218 2637128502 0.97
tpcds_q73/datafusion:vortex-file-compressed 32100514 33156496 0.97
tpcds_q74/datafusion:vortex-file-compressed 122860957 114353609 1.07
tpcds_q75/datafusion:vortex-file-compressed 129904711 120866896 1.07
tpcds_q76/datafusion:vortex-file-compressed 🚨 41756500 33139545 1.26
tpcds_q77/datafusion:vortex-file-compressed 52789989 51818840 1.02
tpcds_q78/datafusion:vortex-file-compressed 🚨 137140875 124407474 1.10
tpcds_q79/datafusion:vortex-file-compressed 39616849 38171482 1.04
tpcds_q80/datafusion:vortex-file-compressed 118109841 115017542 1.03
tpcds_q81/datafusion:vortex-file-compressed 33750696 37448218 0.90
tpcds_q82/datafusion:vortex-file-compressed 🚨 44631532 34744137 1.28
tpcds_q83/datafusion:vortex-file-compressed 50648683 50764634 1.00
tpcds_q84/datafusion:vortex-file-compressed 15663390 15834571 0.99
tpcds_q85/datafusion:vortex-file-compressed 🚨 112114157 101888073 1.10
tpcds_q86/datafusion:vortex-file-compressed 18680832 19027502 0.98
tpcds_q87/datafusion:vortex-file-compressed 52266629 52880072 0.99
tpcds_q88/datafusion:vortex-file-compressed 🚨 75897252 68378184 1.11
tpcds_q89/datafusion:vortex-file-compressed 🚨 40245370 35557542 1.13
tpcds_q90/datafusion:vortex-file-compressed 🚨 19827422 17906760 1.11
tpcds_q91/datafusion:vortex-file-compressed 26063942 25660252 1.02
tpcds_q92/datafusion:vortex-file-compressed 20587264 20315620 1.01
tpcds_q93/datafusion:vortex-file-compressed 🚨 39136873 33783337 1.16
tpcds_q94/datafusion:vortex-file-compressed 26955208 25367216 1.06
tpcds_q95/datafusion:vortex-file-compressed 65303406 61689972 1.06
tpcds_q96/datafusion:vortex-file-compressed 17068835 15556117 1.10
tpcds_q97/datafusion:vortex-file-compressed 🚨 34140701 30709026 1.11
tpcds_q98/datafusion:vortex-file-compressed 34836596 32296954 1.08
tpcds_q99/datafusion:vortex-file-compressed 45384937 45868713 0.99
datafusion / vortex-compact (1.173x ❌, 4↑ 69↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚀 26497573 35648244 0.74
tpcds_q02/datafusion:vortex-compact 60931933 61214661 1.00
tpcds_q03/datafusion:vortex-compact 🚨 36583553 25762291 1.42
tpcds_q04/datafusion:vortex-compact 361549673 331640696 1.09
tpcds_q05/datafusion:vortex-compact 🚨 76716864 64054445 1.20
tpcds_q06/datafusion:vortex-compact 🚨 68218277 58595132 1.16
tpcds_q07/datafusion:vortex-compact 🚨 86689004 63972027 1.36
tpcds_q08/datafusion:vortex-compact 🚨 51429825 44137274 1.17
tpcds_q09/datafusion:vortex-compact 🚨 99100040 73218784 1.35
tpcds_q10/datafusion:vortex-compact 🚨 76502012 66146144 1.16
tpcds_q11/datafusion:vortex-compact 🚨 216905263 189879305 1.14
tpcds_q12/datafusion:vortex-compact 28363278 27551399 1.03
tpcds_q13/datafusion:vortex-compact 🚨 167520138 120017075 1.40
tpcds_q14/datafusion:vortex-compact 🚨 319916364 254804297 1.26
tpcds_q15/datafusion:vortex-compact 38489244 38612559 1.00
tpcds_q16/datafusion:vortex-compact 40006910 38781277 1.03
tpcds_q17/datafusion:vortex-compact 🚨 109219331 93027751 1.17
tpcds_q18/datafusion:vortex-compact 🚨 102105313 88460955 1.15
tpcds_q19/datafusion:vortex-compact 🚨 62194125 44366366 1.40
tpcds_q20/datafusion:vortex-compact 30261770 29634160 1.02
tpcds_q21/datafusion:vortex-compact 150122264 145288681 1.03
tpcds_q22/datafusion:vortex-compact 70742100 65004667 1.09
tpcds_q23/datafusion:vortex-compact 🚨 237447176 183020660 1.30
tpcds_q24/datafusion:vortex-compact 🚨 160733019 137199543 1.17
tpcds_q25/datafusion:vortex-compact 🚨 116970316 96322325 1.21
tpcds_q26/datafusion:vortex-compact 🚨 56979170 48635586 1.17
tpcds_q27/datafusion:vortex-compact 🚨 237233151 160769855 1.48
tpcds_q28/datafusion:vortex-compact 🚨 107043030 87254446 1.23
tpcds_q29/datafusion:vortex-compact 🚨 108244727 95395956 1.13
tpcds_q30/datafusion:vortex-compact 🚀 30961142 35762865 0.87
tpcds_q31/datafusion:vortex-compact 🚨 170003736 135894924 1.25
tpcds_q32/datafusion:vortex-compact 27291899 27117664 1.01
tpcds_q33/datafusion:vortex-compact 🚨 69375235 56127611 1.24
tpcds_q34/datafusion:vortex-compact 🚨 62828348 50041843 1.26
tpcds_q35/datafusion:vortex-compact 🚨 78690117 71252927 1.10
tpcds_q36/datafusion:vortex-compact 🚨 148988751 101295679 1.47
tpcds_q37/datafusion:vortex-compact 52090515 47766004 1.09
tpcds_q38/datafusion:vortex-compact 76730161 69815901 1.10
tpcds_q39/datafusion:vortex-compact 🚨 162875823 144370283 1.13
tpcds_q40/datafusion:vortex-compact 57355170 59348013 0.97
tpcds_q41/datafusion:vortex-compact 20830468 20427127 1.02
tpcds_q42/datafusion:vortex-compact 🚨 33117283 24198564 1.37
tpcds_q43/datafusion:vortex-compact 🚨 47584483 38514257 1.24
tpcds_q44/datafusion:vortex-compact 🚨 133487181 75068240 1.78
tpcds_q45/datafusion:vortex-compact 41266194 38837308 1.06
tpcds_q46/datafusion:vortex-compact 🚨 92016530 73180761 1.26
tpcds_q47/datafusion:vortex-compact 🚨 281439846 234950532 1.20
tpcds_q48/datafusion:vortex-compact 🚨 132180277 88088548 1.50
tpcds_q49/datafusion:vortex-compact 🚨 107870348 88936027 1.21
tpcds_q50/datafusion:vortex-compact 🚨 80176269 63500163 1.26
tpcds_q51/datafusion:vortex-compact 🚨 110242138 99393397 1.11
tpcds_q52/datafusion:vortex-compact 🚨 34366964 25795125 1.33
tpcds_q53/datafusion:vortex-compact 🚨 50588430 35821621 1.41
tpcds_q54/datafusion:vortex-compact 🚨 71601111 60894762 1.18
tpcds_q55/datafusion:vortex-compact 🚨 34225908 24543906 1.39
tpcds_q56/datafusion:vortex-compact 🚨 70309130 56301177 1.25
tpcds_q57/datafusion:vortex-compact 147212452 141098432 1.04
tpcds_q58/datafusion:vortex-compact 🚨 94396829 78529280 1.20
tpcds_q59/datafusion:vortex-compact 🚨 106481400 85575177 1.24
tpcds_q60/datafusion:vortex-compact 🚨 71213533 57965677 1.23
tpcds_q61/datafusion:vortex-compact 🚨 111434525 75937128 1.47
tpcds_q62/datafusion:vortex-compact 36196094 34487595 1.05
tpcds_q63/datafusion:vortex-compact 🚨 51417067 37019283 1.39
tpcds_q64/datafusion:vortex-compact 585634942 542897317 1.08
tpcds_q65/datafusion:vortex-compact 🚨 100797291 72085427 1.40
tpcds_q66/datafusion:vortex-compact 101477352 97639719 1.04
tpcds_q67/datafusion:vortex-compact 🚨 147132313 124586375 1.18
tpcds_q68/datafusion:vortex-compact 🚨 93159627 71785844 1.30
tpcds_q69/datafusion:vortex-compact 🚨 73207880 61971947 1.18
tpcds_q70/datafusion:vortex-compact 🚨 139664802 125980855 1.11
tpcds_q71/datafusion:vortex-compact 🚨 62015984 47157888 1.32
tpcds_q72/datafusion:vortex-compact 2602093728 2599667983 1.00
tpcds_q73/datafusion:vortex-compact 🚨 63874591 49988886 1.28
tpcds_q74/datafusion:vortex-compact 🚨 163254210 138025749 1.18
tpcds_q75/datafusion:vortex-compact 🚨 188918831 163760047 1.15
tpcds_q76/datafusion:vortex-compact 🚨 71513965 52119038 1.37
tpcds_q77/datafusion:vortex-compact 73000335 68679016 1.06
tpcds_q78/datafusion:vortex-compact 🚨 171793566 149321759 1.15
tpcds_q79/datafusion:vortex-compact 🚨 82673599 62808376 1.32
tpcds_q80/datafusion:vortex-compact 🚨 155697466 133919866 1.16
tpcds_q81/datafusion:vortex-compact 🚀 34933662 43072853 0.81
tpcds_q82/datafusion:vortex-compact 🚨 53772024 47982247 1.12
tpcds_q83/datafusion:vortex-compact 55113045 57719704 0.95
tpcds_q84/datafusion:vortex-compact 🚀 15932058 19458215 0.82
tpcds_q85/datafusion:vortex-compact 🚨 145472691 125911455 1.16
tpcds_q86/datafusion:vortex-compact 🚨 24786102 22422346 1.11
tpcds_q87/datafusion:vortex-compact 76134515 69297085 1.10
tpcds_q88/datafusion:vortex-compact 🚨 221981228 139781410 1.59
tpcds_q89/datafusion:vortex-compact 🚨 62726589 46184646 1.36
tpcds_q90/datafusion:vortex-compact 23934093 24233554 0.99
tpcds_q91/datafusion:vortex-compact 🚨 44172745 39814056 1.11
tpcds_q92/datafusion:vortex-compact 🚨 29960316 25471922 1.18
tpcds_q93/datafusion:vortex-compact 🚨 52802000 45668810 1.16
tpcds_q94/datafusion:vortex-compact 30993764 31812378 0.97
tpcds_q95/datafusion:vortex-compact 75568638 69450970 1.09
tpcds_q96/datafusion:vortex-compact 🚨 35702517 27346265 1.31
tpcds_q97/datafusion:vortex-compact 🚨 51831138 43887077 1.18
tpcds_q98/datafusion:vortex-compact 🚨 48151556 39527114 1.22
tpcds_q99/datafusion:vortex-compact 52229195 49927379 1.05
datafusion / parquet (0.989x ➖, 2↑ 1↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 36428441 38479985 0.95
tpcds_q02/datafusion:parquet 45606225 46554574 0.98
tpcds_q03/datafusion:parquet 14767860 15434591 0.96
tpcds_q04/datafusion:parquet 319682164 317061080 1.01
tpcds_q05/datafusion:parquet 50921319 53111136 0.96
tpcds_q06/datafusion:parquet 65267982 65234917 1.00
tpcds_q07/datafusion:parquet 86326622 86352803 1.00
tpcds_q08/datafusion:parquet 32903216 31764432 1.04
tpcds_q09/datafusion:parquet 59986859 56446048 1.06
tpcds_q10/datafusion:parquet 81763842 81544821 1.00
tpcds_q11/datafusion:parquet 186068517 180783782 1.03
tpcds_q12/datafusion:parquet 23147811 24310346 0.95
tpcds_q13/datafusion:parquet 86915725 87500142 0.99
tpcds_q14/datafusion:parquet 189416079 196597274 0.96
tpcds_q15/datafusion:parquet 26350160 28193949 0.93
tpcds_q16/datafusion:parquet 27216049 28378096 0.96
tpcds_q17/datafusion:parquet 69946577 70495599 0.99
tpcds_q18/datafusion:parquet 130127753 130696397 1.00
tpcds_q19/datafusion:parquet 26906541 27640895 0.97
tpcds_q20/datafusion:parquet 20424046 20491919 1.00
tpcds_q21/datafusion:parquet 21630940 22784807 0.95
tpcds_q22/datafusion:parquet 🚀 133431296 150719568 0.89
tpcds_q23/datafusion:parquet 157597245 158852385 0.99
tpcds_q24/datafusion:parquet 103872486 104544568 0.99
tpcds_q25/datafusion:parquet 69973493 72822815 0.96
tpcds_q26/datafusion:parquet 73642294 74157132 0.99
tpcds_q27/datafusion:parquet 159467679 163578410 0.97
tpcds_q28/datafusion:parquet 47293567 49476083 0.96
tpcds_q29/datafusion:parquet 72372572 73659982 0.98
tpcds_q30/datafusion:parquet 46181882 43002895 1.07
tpcds_q31/datafusion:parquet 73916054 75653614 0.98
tpcds_q32/datafusion:parquet 22859958 22490823 1.02
tpcds_q33/datafusion:parquet 35247746 36742653 0.96
tpcds_q34/datafusion:parquet 27465249 27053990 1.02
tpcds_q35/datafusion:parquet 81561213 83211052 0.98
tpcds_q36/datafusion:parquet 62560776 64907940 0.96
tpcds_q37/datafusion:parquet 22945838 22625500 1.01
tpcds_q38/datafusion:parquet 49102705 51397158 0.96
tpcds_q39/datafusion:parquet 82691775 82430240 1.00
tpcds_q40/datafusion:parquet 26818864 27073915 0.99
tpcds_q41/datafusion:parquet 16216249 16495880 0.98
tpcds_q42/datafusion:parquet 13814130 14361484 0.96
tpcds_q43/datafusion:parquet 18840792 18801026 1.00
tpcds_q44/datafusion:parquet 40088301 41382047 0.97
tpcds_q45/datafusion:parquet 32259935 32341618 1.00
tpcds_q46/datafusion:parquet 38894427 38459322 1.01
tpcds_q47/datafusion:parquet 136393534 134048578 1.02
tpcds_q48/datafusion:parquet 78922498 79659333 0.99
tpcds_q49/datafusion:parquet 65119539 65721206 0.99
tpcds_q50/datafusion:parquet 47357802 48241437 0.98
tpcds_q51/datafusion:parquet 89192009 88626141 1.01
tpcds_q52/datafusion:parquet 14475505 14756941 0.98
tpcds_q53/datafusion:parquet 21899530 21493503 1.02
tpcds_q54/datafusion:parquet 42086398 42732100 0.98
tpcds_q55/datafusion:parquet 13643125 14232805 0.96
tpcds_q56/datafusion:parquet 35377161 35209995 1.00
tpcds_q57/datafusion:parquet 112843252 105494016 1.07
tpcds_q58/datafusion:parquet 57871220 57233534 1.01
tpcds_q59/datafusion:parquet 58265141 58340835 1.00
tpcds_q60/datafusion:parquet 35086415 36367317 0.96
tpcds_q61/datafusion:parquet 49920548 50810017 0.98
tpcds_q62/datafusion:parquet 28753299 27587948 1.04
tpcds_q63/datafusion:parquet 21430262 22567861 0.95
tpcds_q64/datafusion:parquet 553673787 556178489 1.00
tpcds_q65/datafusion:parquet 43786938 45972862 0.95
tpcds_q66/datafusion:parquet 76694622 77572480 0.99
tpcds_q67/datafusion:parquet 149065214 149308941 1.00
tpcds_q68/datafusion:parquet 40174783 39950795 1.01
tpcds_q69/datafusion:parquet 77664625 79345900 0.98
tpcds_q70/datafusion:parquet 96399450 96833255 1.00
tpcds_q71/datafusion:parquet 26851697 26839906 1.00
tpcds_q72/datafusion:parquet 622566568 637428475 0.98
tpcds_q73/datafusion:parquet 26243135 26964700 0.97
tpcds_q74/datafusion:parquet 102646455 104270105 0.98
tpcds_q75/datafusion:parquet 114229205 118956699 0.96
tpcds_q76/datafusion:parquet 34674440 35822935 0.97
tpcds_q77/datafusion:parquet 50268437 49026305 1.03
tpcds_q78/datafusion:parquet 122589006 125887579 0.97
tpcds_q79/datafusion:parquet 32738417 31482064 1.04
tpcds_q80/datafusion:parquet 93053132 93698799 0.99
tpcds_q81/datafusion:parquet 40849719 42723787 0.96
tpcds_q82/datafusion:parquet 23090749 23365698 0.99
tpcds_q83/datafusion:parquet 46510005 47821337 0.97
tpcds_q84/datafusion:parquet 48297097 48687375 0.99
tpcds_q85/datafusion:parquet 169390669 169691792 1.00
tpcds_q86/datafusion:parquet 17008973 16385764 1.04
tpcds_q87/datafusion:parquet 51827002 50757717 1.02
tpcds_q88/datafusion:parquet 68407694 68486991 1.00
tpcds_q89/datafusion:parquet 24185117 25170893 0.96
tpcds_q90/datafusion:parquet 18677910 17949114 1.04
tpcds_q91/datafusion:parquet 69961864 71287237 0.98
tpcds_q92/datafusion:parquet 21263166 22697392 0.94
tpcds_q93/datafusion:parquet 35199854 34969746 1.01
tpcds_q94/datafusion:parquet 26007315 24931061 1.04
tpcds_q95/datafusion:parquet 68208463 67701000 1.01
tpcds_q96/datafusion:parquet 🚨 15390665 13673194 1.13
tpcds_q97/datafusion:parquet 33653975 33073471 1.02
tpcds_q98/datafusion:parquet 25568772 26208077 0.98
tpcds_q99/datafusion:parquet 🚀 28039149 31725960 0.88
duckdb / vortex-file-compressed (0.990x ➖, 30↑ 26↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 🚀 21287188 26196826 0.81
tpcds_q02/duckdb:vortex-file-compressed 🚀 70012427 82646098 0.85
tpcds_q03/duckdb:vortex-file-compressed 🚨 37467466 30804525 1.22
tpcds_q04/duckdb:vortex-file-compressed 115638999 107198399 1.08
tpcds_q05/duckdb:vortex-file-compressed 101271469 101897696 0.99
tpcds_q06/duckdb:vortex-file-compressed 33981856 34687716 0.98
tpcds_q07/duckdb:vortex-file-compressed 🚨 27315574 23264513 1.17
tpcds_q08/duckdb:vortex-file-compressed 🚀 22659564 26408771 0.86
tpcds_q09/duckdb:vortex-file-compressed 🚨 48516103 38827232 1.25
tpcds_q10/duckdb:vortex-file-compressed 38756427 36527845 1.06
tpcds_q11/duckdb:vortex-file-compressed 67727867 64814500 1.04
tpcds_q12/duckdb:vortex-file-compressed 13899242 14326050 0.97
tpcds_q13/duckdb:vortex-file-compressed 33594603 30661016 1.10
tpcds_q14/duckdb:vortex-file-compressed 🚨 231079186 192533575 1.20
tpcds_q15/duckdb:vortex-file-compressed 🚀 24673141 39459676 0.63
tpcds_q16/duckdb:vortex-file-compressed 🚀 26040400 29122675 0.89
tpcds_q17/duckdb:vortex-file-compressed 🚀 32636872 37178353 0.88
tpcds_q18/duckdb:vortex-file-compressed 46742466 44829688 1.04
tpcds_q19/duckdb:vortex-file-compressed 🚀 27113377 33136058 0.82
tpcds_q20/duckdb:vortex-file-compressed 15253413 15940879 0.96
tpcds_q21/duckdb:vortex-file-compressed 🚨 27355841 19153333 1.43
tpcds_q22/duckdb:vortex-file-compressed 🚀 87548774 103137632 0.85
tpcds_q23/duckdb:vortex-file-compressed 🚨 148858786 119600403 1.24
tpcds_q24/duckdb:vortex-file-compressed 🚀 46368710 54111822 0.86
tpcds_q25/duckdb:vortex-file-compressed 32917670 35899958 0.92
tpcds_q26/duckdb:vortex-file-compressed 38780100 39862138 0.97
tpcds_q27/duckdb:vortex-file-compressed 93530386 85154472 1.10
tpcds_q28/duckdb:vortex-file-compressed 🚨 51788256 39104945 1.32
tpcds_q29/duckdb:vortex-file-compressed 🚀 31475475 35372053 0.89
tpcds_q30/duckdb:vortex-file-compressed 26765715 29250788 0.92
tpcds_q31/duckdb:vortex-file-compressed 27510307 26283125 1.05
tpcds_q32/duckdb:vortex-file-compressed 16830113 16878813 1.00
tpcds_q33/duckdb:vortex-file-compressed 🚨 78226951 61335001 1.28
tpcds_q34/duckdb:vortex-file-compressed 19835334 18801359 1.05
tpcds_q35/duckdb:vortex-file-compressed 57672372 63571544 0.91
tpcds_q36/duckdb:vortex-file-compressed 25567999 27394507 0.93
tpcds_q37/duckdb:vortex-file-compressed 🚨 27580403 22199836 1.24
tpcds_q38/duckdb:vortex-file-compressed 🚀 32418184 37073548 0.87
tpcds_q39/duckdb:vortex-file-compressed 🚀 38458304 45056872 0.85
tpcds_q40/duckdb:vortex-file-compressed 🚀 19620047 22993476 0.85
tpcds_q41/duckdb:vortex-file-compressed 14319835 13798522 1.04
tpcds_q42/duckdb:vortex-file-compressed 🚨 13173725 11772183 1.12
tpcds_q43/duckdb:vortex-file-compressed 🚀 19436727 29630980 0.66
tpcds_q44/duckdb:vortex-file-compressed 🚨 26673142 22557124 1.18
tpcds_q45/duckdb:vortex-file-compressed 🚀 20244873 28112291 0.72
tpcds_q46/duckdb:vortex-file-compressed 🚀 41321508 47186899 0.88
tpcds_q47/duckdb:vortex-file-compressed 46902038 48968007 0.96
tpcds_q48/duckdb:vortex-file-compressed 30077448 28935969 1.04
tpcds_q49/duckdb:vortex-file-compressed 🚨 37144461 30118848 1.23
tpcds_q50/duckdb:vortex-file-compressed 36256873 34879273 1.04
tpcds_q51/duckdb:vortex-file-compressed 104297004 109718079 0.95
tpcds_q52/duckdb:vortex-file-compressed 🚨 13926497 12285208 1.13
tpcds_q53/duckdb:vortex-file-compressed 🚨 18535442 16792823 1.10
tpcds_q54/duckdb:vortex-file-compressed 🚨 59599726 47049412 1.27
tpcds_q55/duckdb:vortex-file-compressed 🚨 13164110 11758504 1.12
tpcds_q56/duckdb:vortex-file-compressed 🚨 77740968 62067324 1.25
tpcds_q57/duckdb:vortex-file-compressed 🚀 32979094 44403743 0.74
tpcds_q58/duckdb:vortex-file-compressed 🚨 39014690 35075279 1.11
tpcds_q59/duckdb:vortex-file-compressed 🚀 48569600 80059912 0.61
tpcds_q60/duckdb:vortex-file-compressed 🚨 80414705 64504331 1.25
tpcds_q61/duckdb:vortex-file-compressed 38729700 36284070 1.07
tpcds_q62/duckdb:vortex-file-compressed 🚀 14840674 17868345 0.83
tpcds_q63/duckdb:vortex-file-compressed 18017249 16944388 1.06
tpcds_q64/duckdb:vortex-file-compressed 🚨 99770982 80957564 1.23
tpcds_q65/duckdb:vortex-file-compressed 22709721 22790706 1.00
tpcds_q66/duckdb:vortex-file-compressed 56656385 57786727 0.98
tpcds_q67/duckdb:vortex-file-compressed 152219617 143854769 1.06
tpcds_q68/duckdb:vortex-file-compressed 38967968 41624805 0.94
tpcds_q69/duckdb:vortex-file-compressed 39337661 37161807 1.06
tpcds_q70/duckdb:vortex-file-compressed 25387791 27310298 0.93
tpcds_q71/duckdb:vortex-file-compressed 🚨 23424926 19627586 1.19
tpcds_q72/duckdb:vortex-file-compressed 🚀 137945507 174540024 0.79
tpcds_q73/duckdb:vortex-file-compressed 21170432 19638321 1.08
tpcds_q74/duckdb:vortex-file-compressed 56890101 53358410 1.07
tpcds_q75/duckdb:vortex-file-compressed 60334395 60472416 1.00
tpcds_q76/duckdb:vortex-file-compressed 🚨 96848463 64270514 1.51
tpcds_q77/duckdb:vortex-file-compressed 🚨 88255787 65187944 1.35
tpcds_q78/duckdb:vortex-file-compressed 71816697 76249274 0.94
tpcds_q79/duckdb:vortex-file-compressed 36799824 34317930 1.07
tpcds_q80/duckdb:vortex-file-compressed 🚨 99315707 86703258 1.15
tpcds_q81/duckdb:vortex-file-compressed 🚀 27198550 33864112 0.80
tpcds_q82/duckdb:vortex-file-compressed 🚨 29482466 21750977 1.36
tpcds_q83/duckdb:vortex-file-compressed 31790080 30754235 1.03
tpcds_q84/duckdb:vortex-file-compressed 16321232 17890355 0.91
tpcds_q85/duckdb:vortex-file-compressed 🚀 38312357 47064502 0.81
tpcds_q86/duckdb:vortex-file-compressed 🚀 14706504 16794705 0.88
tpcds_q87/duckdb:vortex-file-compressed 🚀 33398454 39916119 0.84
tpcds_q88/duckdb:vortex-file-compressed 34649309 33942224 1.02
tpcds_q89/duckdb:vortex-file-compressed 18281259 16993387 1.08
tpcds_q90/duckdb:vortex-file-compressed 🚀 11731958 13525926 0.87
tpcds_q91/duckdb:vortex-file-compressed 🚀 23738815 29433300 0.81
tpcds_q92/duckdb:vortex-file-compressed 🚀 12968551 14514552 0.89
tpcds_q93/duckdb:vortex-file-compressed 🚀 25547739 29552812 0.86
tpcds_q94/duckdb:vortex-file-compressed 21469576 21160439 1.01
tpcds_q95/duckdb:vortex-file-compressed 🚀 93334124 146966300 0.64
tpcds_q96/duckdb:vortex-file-compressed 🚨 12006085 10534926 1.14
tpcds_q97/duckdb:vortex-file-compressed 37765522 38003415 0.99
tpcds_q98/duckdb:vortex-file-compressed 18713224 17623575 1.06
tpcds_q99/duckdb:vortex-file-compressed 🚀 18318382 31953110 0.57
duckdb / vortex-compact (1.085x ➖, 24↑ 51↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚀 24126795 31964050 0.75
tpcds_q02/duckdb:vortex-compact 🚀 102406780 117009783 0.88
tpcds_q03/duckdb:vortex-compact 🚨 75924947 57569096 1.32
tpcds_q04/duckdb:vortex-compact 🚨 148415448 124854532 1.19
tpcds_q05/duckdb:vortex-compact 🚨 185463443 155421579 1.19
tpcds_q06/duckdb:vortex-compact 🚨 44982368 37780915 1.19
tpcds_q07/duckdb:vortex-compact 🚨 48438427 35573440 1.36
tpcds_q08/duckdb:vortex-compact 32987186 35090544 0.94
tpcds_q09/duckdb:vortex-compact 🚨 65433494 58855393 1.11
tpcds_q10/duckdb:vortex-compact 🚨 59074055 47628132 1.24
tpcds_q11/duckdb:vortex-compact 🚨 94483424 74288150 1.27
tpcds_q12/duckdb:vortex-compact 🚀 17151021 19056903 0.90
tpcds_q13/duckdb:vortex-compact 🚨 63182994 49164612 1.29
tpcds_q14/duckdb:vortex-compact 🚨 336263494 263173091 1.28
tpcds_q15/duckdb:vortex-compact 🚀 26142003 44761221 0.58
tpcds_q16/duckdb:vortex-compact 🚀 29386046 35104390 0.84
tpcds_q17/duckdb:vortex-compact 🚨 53570165 47557474 1.13
tpcds_q18/duckdb:vortex-compact 56146629 57602329 0.97
tpcds_q19/duckdb:vortex-compact 🚨 45088057 40059626 1.13
tpcds_q20/duckdb:vortex-compact 🚀 17776280 20496894 0.87
tpcds_q21/duckdb:vortex-compact 🚨 32450500 28210275 1.15
tpcds_q22/duckdb:vortex-compact 🚀 88300200 111392644 0.79
tpcds_q23/duckdb:vortex-compact 🚨 182746512 163652422 1.12
tpcds_q24/duckdb:vortex-compact 🚨 84006017 68182474 1.23
tpcds_q25/duckdb:vortex-compact 53705465 48848269 1.10
tpcds_q26/duckdb:vortex-compact 48263537 48502192 1.00
tpcds_q27/duckdb:vortex-compact 🚨 148068904 127467890 1.16
tpcds_q28/duckdb:vortex-compact 92107450 84095890 1.10
tpcds_q29/duckdb:vortex-compact 52503618 48676012 1.08
tpcds_q30/duckdb:vortex-compact 🚀 29271799 33790382 0.87
tpcds_q31/duckdb:vortex-compact 🚨 39929017 31164432 1.28
tpcds_q32/duckdb:vortex-compact 🚀 18367732 23630050 0.78
tpcds_q33/duckdb:vortex-compact 137805630 128115848 1.08
tpcds_q34/duckdb:vortex-compact 🚨 39870455 26736525 1.49
tpcds_q35/duckdb:vortex-compact 71745142 70044901 1.02
tpcds_q36/duckdb:vortex-compact 🚨 43624288 35854321 1.22
tpcds_q37/duckdb:vortex-compact 31570679 31365588 1.01
tpcds_q38/duckdb:vortex-compact 🚨 47551581 41304950 1.15
tpcds_q39/duckdb:vortex-compact 🚀 40905480 52716479 0.78
tpcds_q40/duckdb:vortex-compact 🚀 22932785 29613229 0.77
tpcds_q41/duckdb:vortex-compact 16718829 17138258 0.98
tpcds_q42/duckdb:vortex-compact 🚨 22245220 16304241 1.36
tpcds_q43/duckdb:vortex-compact 🚀 27973761 37558536 0.74
tpcds_q44/duckdb:vortex-compact 🚨 51203367 32155509 1.59
tpcds_q45/duckdb:vortex-compact 🚀 23820313 32182781 0.74
tpcds_q46/duckdb:vortex-compact 62136432 57582100 1.08
tpcds_q47/duckdb:vortex-compact 🚨 66652584 57284900 1.16
tpcds_q48/duckdb:vortex-compact 🚨 55032131 40517481 1.36
tpcds_q49/duckdb:vortex-compact 🚨 54108424 43026105 1.26
tpcds_q50/duckdb:vortex-compact 🚨 84673554 48877309 1.73
tpcds_q51/duckdb:vortex-compact 🚨 114719956 103090218 1.11
tpcds_q52/duckdb:vortex-compact 🚨 23349790 16418315 1.42
tpcds_q53/duckdb:vortex-compact 🚨 35418643 24385293 1.45
tpcds_q54/duckdb:vortex-compact 🚨 88527947 76881636 1.15
tpcds_q55/duckdb:vortex-compact 🚨 23365056 16291823 1.43
tpcds_q56/duckdb:vortex-compact 🚨 139394046 122169123 1.14
tpcds_q57/duckdb:vortex-compact 🚀 34461936 47465818 0.73
tpcds_q58/duckdb:vortex-compact 🚨 66849563 41840279 1.60
tpcds_q59/duckdb:vortex-compact 🚀 73855891 102366782 0.72
tpcds_q60/duckdb:vortex-compact 140436600 128595935 1.09
tpcds_q61/duckdb:vortex-compact 🚨 78950449 53334985 1.48
tpcds_q62/duckdb:vortex-compact 🚀 18177266 20507561 0.89
tpcds_q63/duckdb:vortex-compact 🚨 35749801 24747987 1.44
tpcds_q64/duckdb:vortex-compact 🚨 127298801 102149776 1.25
tpcds_q65/duckdb:vortex-compact 🚨 41262394 30978787 1.33
tpcds_q66/duckdb:vortex-compact 91626466 90148673 1.02
tpcds_q67/duckdb:vortex-compact 🚨 167846979 150058545 1.12
tpcds_q68/duckdb:vortex-compact 🚨 65214544 51206844 1.27
tpcds_q69/duckdb:vortex-compact 🚨 58226825 47639579 1.22
tpcds_q70/duckdb:vortex-compact 34629229 34175080 1.01
tpcds_q71/duckdb:vortex-compact 🚨 36896633 25422555 1.45
tpcds_q72/duckdb:vortex-compact 🚀 150202046 194343049 0.77
tpcds_q73/duckdb:vortex-compact 🚨 40230783 25683542 1.57
tpcds_q74/duckdb:vortex-compact 🚨 81236817 59785033 1.36
tpcds_q75/duckdb:vortex-compact 76154741 70920588 1.07
tpcds_q76/duckdb:vortex-compact 🚨 177470164 127499299 1.39
tpcds_q77/duckdb:vortex-compact 🚨 143775864 119725965 1.20
tpcds_q78/duckdb:vortex-compact 88318050 82366054 1.07
tpcds_q79/duckdb:vortex-compact 🚨 98546691 58310971 1.69
tpcds_q80/duckdb:vortex-compact 153816319 156880337 0.98
tpcds_q81/duckdb:vortex-compact 🚀 29946435 39078018 0.77
tpcds_q82/duckdb:vortex-compact 32347108 30858903 1.05
tpcds_q83/duckdb:vortex-compact 🚀 35107808 45545761 0.77
tpcds_q84/duckdb:vortex-compact 🚀 19533581 22295853 0.88
tpcds_q85/duckdb:vortex-compact 🚀 51762563 60330290 0.86
tpcds_q86/duckdb:vortex-compact 🚀 18461996 20814489 0.89
tpcds_q87/duckdb:vortex-compact 47658995 45193074 1.05
tpcds_q88/duckdb:vortex-compact 🚨 57901173 39578331 1.46
tpcds_q89/duckdb:vortex-compact 🚨 35716335 24213441 1.48
tpcds_q90/duckdb:vortex-compact 14236952 15471570 0.92
tpcds_q91/duckdb:vortex-compact 45593939 45951699 0.99
tpcds_q92/duckdb:vortex-compact 20065009 19519772 1.03
tpcds_q93/duckdb:vortex-compact 30125381 31942489 0.94
tpcds_q94/duckdb:vortex-compact 22917001 24701241 0.93
tpcds_q95/duckdb:vortex-compact 🚀 96010099 133680247 0.72
tpcds_q96/duckdb:vortex-compact 🚨 21557337 13065897 1.65
tpcds_q97/duckdb:vortex-compact 🚨 48016666 39104933 1.23
tpcds_q98/duckdb:vortex-compact 🚨 28003622 24954060 1.12
tpcds_q99/duckdb:vortex-compact 🚀 19994445 34305073 0.58
duckdb / parquet (0.993x ➖, 0↑ 1↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 44714853 44513678 1.00
tpcds_q02/duckdb:parquet 56987219 59571692 0.96
tpcds_q03/duckdb:parquet 12050405 11645405 1.03
tpcds_q04/duckdb:parquet 125777453 125971662 1.00
tpcds_q05/duckdb:parquet 73625206 74566621 0.99
tpcds_q06/duckdb:parquet 28596452 29331266 0.97
tpcds_q07/duckdb:parquet 22811775 23119557 0.99
tpcds_q08/duckdb:parquet 27969208 28340090 0.99
tpcds_q09/duckdb:parquet 39618325 39545882 1.00
tpcds_q10/duckdb:parquet 33733649 35408018 0.95
tpcds_q11/duckdb:parquet 87843796 89891594 0.98
tpcds_q12/duckdb:parquet 14319950 14505299 0.99
tpcds_q13/duckdb:parquet 35192894 33700669 1.04
tpcds_q14/duckdb:parquet 165454807 163358361 1.01
tpcds_q15/duckdb:parquet 29584511 28899711 1.02
tpcds_q16/duckdb:parquet 21145186 21042856 1.00
tpcds_q17/duckdb:parquet 37494625 37997589 0.99
tpcds_q18/duckdb:parquet 45510819 46472237 0.98
tpcds_q19/duckdb:parquet 29618638 29169397 1.02
tpcds_q20/duckdb:parquet 15430707 15306394 1.01
tpcds_q21/duckdb:parquet 11330622 10897173 1.04
tpcds_q22/duckdb:parquet 67271123 64753691 1.04
tpcds_q23/duckdb:parquet 115297335 121090427 0.95
tpcds_q24/duckdb:parquet 44900836 46047602 0.98
tpcds_q25/duckdb:parquet 33323105 31779461 1.05
tpcds_q26/duckdb:parquet 37482860 37033791 1.01
tpcds_q27/duckdb:parquet 87568063 89132393 0.98
tpcds_q28/duckdb:parquet 36987568 37348146 0.99
tpcds_q29/duckdb:parquet 35245419 35570750 0.99
tpcds_q30/duckdb:parquet 36310052 39693454 0.91
tpcds_q31/duckdb:parquet 22473905 21943718 1.02
tpcds_q32/duckdb:parquet 10877125 11848434 0.92
tpcds_q33/duckdb:parquet 72140131 70332350 1.03
tpcds_q34/duckdb:parquet 20324161 21250364 0.96
tpcds_q35/duckdb:parquet 59636531 61416808 0.97
tpcds_q36/duckdb:parquet 20004449 20505323 0.98
tpcds_q37/duckdb:parquet 13235399 13366832 0.99
tpcds_q38/duckdb:parquet 34349767 33756017 1.02
tpcds_q39/duckdb:parquet 31721727 33158382 0.96
tpcds_q40/duckdb:parquet 17776817 17384117 1.02
tpcds_q41/duckdb:parquet 7460473 7575238 0.98
tpcds_q42/duckdb:parquet 9584624 10410909 0.92
tpcds_q43/duckdb:parquet 15395046 15457856 1.00
tpcds_q44/duckdb:parquet 21728425 21124602 1.03
tpcds_q45/duckdb:parquet 27392470 26999466 1.01
tpcds_q46/duckdb:parquet 44689115 47211591 0.95
tpcds_q47/duckdb:parquet 45611743 46303437 0.99
tpcds_q48/duckdb:parquet 30016830 31907184 0.94
tpcds_q49/duckdb:parquet 23961521 24897733 0.96
tpcds_q50/duckdb:parquet 23999580 25118959 0.96
tpcds_q51/duckdb:parquet 93604310 95247692 0.98
tpcds_q52/duckdb:parquet 11025868 10856477 1.02
tpcds_q53/duckdb:parquet 16305379 16391295 0.99
tpcds_q54/duckdb:parquet 41364855 40260463 1.03
tpcds_q55/duckdb:parquet 10565773 10734750 0.98
tpcds_q56/duckdb:parquet 68406431 68098687 1.00
tpcds_q57/duckdb:parquet 34674131 34634987 1.00
tpcds_q58/duckdb:parquet 20984276 21141007 0.99
tpcds_q59/duckdb:parquet 36107090 36531171 0.99
tpcds_q60/duckdb:parquet 71477298 79028199 0.90
tpcds_q61/duckdb:parquet 30934467 29389172 1.05
tpcds_q62/duckdb:parquet 11379210 11221930 1.01
tpcds_q63/duckdb:parquet 15123334 15434614 0.98
tpcds_q64/duckdb:parquet 73935297 74847846 0.99
tpcds_q65/duckdb:parquet 20316516 21453195 0.95
tpcds_q66/duckdb:parquet 59054990 56992946 1.04
tpcds_q67/duckdb:parquet 134757437 135674904 0.99
tpcds_q68/duckdb:parquet 37539361 37689589 1.00
tpcds_q69/duckdb:parquet 36932019 38172073 0.97
tpcds_q70/duckdb:parquet 19531978 19723796 0.99
tpcds_q71/duckdb:parquet 18986075 18914590 1.00
tpcds_q72/duckdb:parquet 164705556 164369646 1.00
tpcds_q73/duckdb:parquet 17854747 18082762 0.99
tpcds_q74/duckdb:parquet 50765619 50048908 1.01
tpcds_q75/duckdb:parquet 52445694 53596708 0.98
tpcds_q76/duckdb:parquet 69134560 70125951 0.99
tpcds_q77/duckdb:parquet 60893187 63130350 0.96
tpcds_q78/duckdb:parquet 73070284 75298298 0.97
tpcds_q79/duckdb:parquet 28092337 27372542 1.03
tpcds_q80/duckdb:parquet 82367226 87608645 0.94
tpcds_q81/duckdb:parquet 47091176 47295379 1.00
tpcds_q82/duckdb:parquet 15074106 15929017 0.95
tpcds_q83/duckdb:parquet 16185314 15970868 1.01
tpcds_q84/duckdb:parquet 19575217 19866755 0.99
tpcds_q85/duckdb:parquet 39143492 38945559 1.01
tpcds_q86/duckdb:parquet 12327401 12180430 1.01
tpcds_q87/duckdb:parquet 37203836 37798203 0.98
tpcds_q88/duckdb:parquet 28595784 29005993 0.99
tpcds_q89/duckdb:parquet 17367641 17233987 1.01
tpcds_q90/duckdb:parquet 8029019 7449832 1.08
tpcds_q91/duckdb:parquet 23955820 23255389 1.03
tpcds_q92/duckdb:parquet 11943023 11454383 1.04
tpcds_q93/duckdb:parquet 30820603 30723610 1.00
tpcds_q94/duckdb:parquet 16423358 15865318 1.04
tpcds_q95/duckdb:parquet 🚨 142779581 119439661 1.20
tpcds_q96/duckdb:parquet 9097664 9148912 0.99
tpcds_q97/duckdb:parquet 34507880 36460000 0.95
tpcds_q98/duckdb:parquet 18308065 18285596 1.00
tpcds_q99/duckdb:parquet 19603218 20833924 0.94
duckdb / duckdb (1.000x ➖, 1↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 19988834 20747708 0.96
tpcds_q02/duckdb:duckdb 18349267 17913996 1.02
tpcds_q03/duckdb:duckdb 8308678 7926810 1.05
tpcds_q04/duckdb:duckdb 158305470 159496485 0.99
tpcds_q05/duckdb:duckdb 17252008 18325316 0.94
tpcds_q06/duckdb:duckdb 22520748 22495382 1.00
tpcds_q07/duckdb:duckdb 39116680 37150574 1.05
tpcds_q08/duckdb:duckdb 119845873 120190188 1.00
tpcds_q09/duckdb:duckdb 19444261 19631269 0.99
tpcds_q10/duckdb:duckdb 23240611 23437921 0.99
tpcds_q11/duckdb:duckdb 136777030 136084115 1.01
tpcds_q12/duckdb:duckdb 12033810 11053649 1.09
tpcds_q13/duckdb:duckdb 24728724 23479217 1.05
tpcds_q14/duckdb:duckdb 93313972 96063655 0.97
tpcds_q15/duckdb:duckdb 23478746 24088578 0.97
tpcds_q16/duckdb:duckdb 18148509 17227079 1.05
tpcds_q17/duckdb:duckdb 20871149 21544990 0.97
tpcds_q18/duckdb:duckdb 42610527 43780406 0.97
tpcds_q19/duckdb:duckdb 16694171 15989829 1.04
tpcds_q20/duckdb:duckdb 11912486 11819403 1.01
tpcds_q21/duckdb:duckdb 6828974 6466780 1.06
tpcds_q22/duckdb:duckdb 61870377 61089376 1.01
tpcds_q23/duckdb:duckdb 🚀 71815696 80044677 0.90
tpcds_q24/duckdb:duckdb 24382509 24201477 1.01
tpcds_q25/duckdb:duckdb 16475857 16524871 1.00
tpcds_q26/duckdb:duckdb 25405247 27088111 0.94
tpcds_q27/duckdb:duckdb 40166306 40709975 0.99
tpcds_q28/duckdb:duckdb 21204160 21067272 1.01
tpcds_q29/duckdb:duckdb 20228966 20255439 1.00
tpcds_q30/duckdb:duckdb 25818495 26649195 0.97
tpcds_q31/duckdb:duckdb 19436012 19856513 0.98
tpcds_q32/duckdb:duckdb 6826414 6718269 1.02
tpcds_q33/duckdb:duckdb 12938167 12471641 1.04
tpcds_q34/duckdb:duckdb 14259186 15262842 0.93
tpcds_q35/duckdb:duckdb 31525650 31609542 1.00
tpcds_q36/duckdb:duckdb 66188085 69171863 0.96
tpcds_q37/duckdb:duckdb 7257317 7203928 1.01
tpcds_q38/duckdb:duckdb 30114071 30300518 0.99
tpcds_q39/duckdb:duckdb 25528630 25405378 1.00
tpcds_q40/duckdb:duckdb 13811120 13941607 0.99
tpcds_q41/duckdb:duckdb 8112479 8402021 0.97
tpcds_q42/duckdb:duckdb 6286164 6349768 0.99
tpcds_q43/duckdb:duckdb 11198684 10876260 1.03
tpcds_q44/duckdb:duckdb 13372070 13413260 1.00
tpcds_q45/duckdb:duckdb 17485491 17204008 1.02
tpcds_q46/duckdb:duckdb 37194541 35654223 1.04
tpcds_q47/duckdb:duckdb 39952882 40763344 0.98
tpcds_q48/duckdb:duckdb 22453599 22513343 1.00
tpcds_q49/duckdb:duckdb 15479383 16333533 0.95
tpcds_q50/duckdb:duckdb 13897396 13790456 1.01
tpcds_q51/duckdb:duckdb 92199628 89746493 1.03
tpcds_q52/duckdb:duckdb 6912230 6921817 1.00
tpcds_q53/duckdb:duckdb 11557050 11772361 0.98
tpcds_q54/duckdb:duckdb 16716011 16275787 1.03
tpcds_q55/duckdb:duckdb 6908328 6717449 1.03
tpcds_q56/duckdb:duckdb 13566957 13113609 1.03
tpcds_q57/duckdb:duckdb 30921252 31319874 0.99
tpcds_q58/duckdb:duckdb 12834121 12080188 1.06
tpcds_q59/duckdb:duckdb 33806236 34914306 0.97
tpcds_q60/duckdb:duckdb 14773793 15035311 0.98
tpcds_q61/duckdb:duckdb 13875163 14204592 0.98
tpcds_q62/duckdb:duckdb 9153089 8944910 1.02
tpcds_q63/duckdb:duckdb 10936092 10942410 1.00
tpcds_q64/duckdb:duckdb 55206984 53585423 1.03
tpcds_q65/duckdb:duckdb 33660551 32372233 1.04
tpcds_q66/duckdb:duckdb 23332106 25118163 0.93
tpcds_q67/duckdb:duckdb 128258607 130902232 0.98
tpcds_q68/duckdb:duckdb 24934847 24719169 1.01
tpcds_q69/duckdb:duckdb 23787481 22916521 1.04
tpcds_q70/duckdb:duckdb 14183472 14096467 1.01
tpcds_q71/duckdb:duckdb 11902066 12779984 0.93
tpcds_q72/duckdb:duckdb 42061985 41981332 1.00
tpcds_q73/duckdb:duckdb 10493019 10095600 1.04
tpcds_q74/duckdb:duckdb 96421197 95156561 1.01
tpcds_q75/duckdb:duckdb 41071722 41826686 0.98
tpcds_q76/duckdb:duckdb 11357012 11807724 0.96
tpcds_q77/duckdb:duckdb 11651795 11100325 1.05
tpcds_q78/duckdb:duckdb 63593231 63028687 1.01
tpcds_q79/duckdb:duckdb 17114810 17372374 0.99
tpcds_q80/duckdb:duckdb 29144620 28033810 1.04
tpcds_q81/duckdb:duckdb 37524508 36495171 1.03
tpcds_q82/duckdb:duckdb 7881032 7953213 0.99
tpcds_q83/duckdb:duckdb 9198188 8785846 1.05
tpcds_q84/duckdb:duckdb 13330236 14112324 0.94
tpcds_q85/duckdb:duckdb 24940041 22830357 1.09
tpcds_q86/duckdb:duckdb 10719374 11415114 0.94
tpcds_q87/duckdb:duckdb 33095532 32331632 1.02
tpcds_q88/duckdb:duckdb 24168525 23887797 1.01
tpcds_q89/duckdb:duckdb 13207503 13861986 0.95
tpcds_q90/duckdb:duckdb 5319760 5533292 0.96
tpcds_q91/duckdb:duckdb 12277107 12638488 0.97
tpcds_q92/duckdb:duckdb 8693894 9258737 0.94
tpcds_q93/duckdb:duckdb 21818217 20583868 1.06
tpcds_q94/duckdb:duckdb 12609179 12609100 1.00
tpcds_q95/duckdb:duckdb 130344664 126944648 1.03
tpcds_q96/duckdb:duckdb 4384815 4476605 0.98
tpcds_q97/duckdb:duckdb 29623930 29916218 0.99
tpcds_q98/duckdb:duckdb 13986716 13566685 1.03
tpcds_q99/duckdb:duckdb 15536146 15815576 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -25.7% -2.5% -23.8% +10.6% ✅ faster
1 datafusion:vortex-file-compressed -9.2% -2.5% -6.9% +12.6% ➖ noise
1 duckdb:duckdb -3.7% -2.5% -1.2% +14.3% ➖ noise
1 duckdb:vortex-compact -24.5% -2.5% -22.6% +14.2% ✅ faster
1 duckdb:vortex-file-compressed -18.7% -2.5% -16.7% +12.0% ✅ faster
2 datafusion:vortex-compact -0.5% -3.2% +2.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -1.1% -3.2% +2.1% +10.8% ➖ noise
2 duckdb:duckdb +2.4% -3.2% +5.8% +10.1% ➖ noise
2 duckdb:vortex-compact -12.5% -3.2% -9.6% +10.0% ✅ faster
2 duckdb:vortex-file-compressed -15.3% -3.2% -12.5% +10.9% ✅ faster
3 datafusion:vortex-compact +42.0% -0.5% +42.7% +12.0% 🚨 regression
3 datafusion:vortex-file-compressed +3.1% -0.5% +3.6% +10.3% ➖ noise
3 duckdb:duckdb +4.8% -0.5% +5.3% +17.6% ➖ noise
3 duckdb:vortex-compact +31.9% -0.5% +32.5% +10.0% 🚨 regression
3 duckdb:vortex-file-compressed +21.6% -0.5% +22.2% +10.0% 🚨 regression
4 datafusion:vortex-compact +9.0% +0.3% +8.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +3.8% +0.3% +3.5% +10.0% ➖ noise
4 duckdb:duckdb -0.7% +0.3% -1.1% +14.2% ➖ noise
4 duckdb:vortex-compact +18.9% +0.3% +18.5% +10.0% 🚨 regression
4 duckdb:vortex-file-compressed +7.9% +0.3% +7.5% +10.0% ➖ noise
5 datafusion:vortex-compact +19.8% -2.7% +23.1% +10.0% 🚨 regression
5 datafusion:vortex-file-compressed -4.9% -2.7% -2.3% +10.0% ➖ noise
5 duckdb:duckdb -5.9% -2.7% -3.2% +11.9% ➖ noise
5 duckdb:vortex-compact +19.3% -2.7% +22.6% +10.0% 🚨 regression
5 duckdb:vortex-file-compressed -0.6% -2.7% +2.1% +12.9% ➖ noise
6 datafusion:vortex-compact +16.4% -1.2% +17.9% +10.0% 🚨 regression
6 datafusion:vortex-file-compressed -5.8% -1.2% -4.6% +10.0% ➖ noise
6 duckdb:duckdb +0.1% -1.2% +1.4% +13.4% ➖ noise
6 duckdb:vortex-compact +19.1% -1.2% +20.6% +10.0% 🚨 regression
6 duckdb:vortex-file-compressed -2.0% -1.2% -0.8% +10.0% ➖ noise
7 datafusion:vortex-compact +35.5% -0.7% +36.4% +10.0% 🚨 regression
7 datafusion:vortex-file-compressed +8.3% -0.7% +9.0% +10.0% ➖ noise
7 duckdb:duckdb +5.3% -0.7% +6.0% +21.8% ➖ noise
7 duckdb:vortex-compact +36.2% -0.7% +37.1% +10.0% 🚨 regression
7 duckdb:vortex-file-compressed +17.4% -0.7% +18.2% +11.3% 🚨 regression
8 datafusion:vortex-compact +16.5% +1.1% +15.2% +10.0% 🚨 regression
8 datafusion:vortex-file-compressed -3.1% +1.1% -4.1% +10.0% ➖ noise
8 duckdb:duckdb -0.3% +1.1% -1.4% +10.0% ➖ noise
8 duckdb:vortex-compact -6.0% +1.1% -7.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -14.2% +1.1% -15.1% +24.8% ➖ noise
9 datafusion:vortex-compact +35.3% +3.2% +31.2% +10.0% 🚨 regression
9 datafusion:vortex-file-compressed +42.1% +3.2% +37.7% +10.0% 🚨 regression
9 duckdb:duckdb -1.0% +3.2% -4.0% +10.0% ➖ noise
9 duckdb:vortex-compact +11.2% +3.2% +7.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +25.0% +3.2% +21.1% +10.0% 🚨 regression
10 datafusion:vortex-compact +15.7% -2.3% +18.3% +10.0% 🚨 regression
10 datafusion:vortex-file-compressed +3.0% -2.3% +5.4% +10.0% ➖ noise
10 duckdb:duckdb -0.8% -2.3% +1.5% +10.0% ➖ noise
10 duckdb:vortex-compact +24.0% -2.3% +26.9% +10.0% 🚨 regression
10 duckdb:vortex-file-compressed +6.1% -2.3% +8.6% +10.0% ➖ noise
11 datafusion:vortex-compact +14.2% +0.3% +13.9% +10.0% 🚨 regression
11 datafusion:vortex-file-compressed -1.0% +0.3% -1.3% +10.0% ➖ noise
11 duckdb:duckdb +0.5% +0.3% +0.2% +10.0% ➖ noise
11 duckdb:vortex-compact +27.2% +0.3% +26.8% +10.0% 🚨 regression
11 duckdb:vortex-file-compressed +4.5% +0.3% +4.2% +10.6% ➖ noise
12 datafusion:vortex-compact +2.9% -3.0% +6.2% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -4.9% -3.0% -2.0% +10.0% ➖ noise
12 duckdb:duckdb +8.9% -3.0% +12.3% +11.9% 🚨 regression
12 duckdb:vortex-compact -10.0% -3.0% -7.2% +13.2% ➖ noise
12 duckdb:vortex-file-compressed -3.0% -3.0% +0.1% +11.1% ➖ noise
13 datafusion:vortex-compact +39.6% +1.8% +37.0% +10.0% 🚨 regression
13 datafusion:vortex-file-compressed +25.1% +1.8% +22.8% +10.0% 🚨 regression
13 duckdb:duckdb +5.3% +1.8% +3.4% +17.9% ➖ noise
13 duckdb:vortex-compact +28.5% +1.8% +26.2% +10.0% 🚨 regression
13 duckdb:vortex-file-compressed +9.6% +1.8% +7.6% +10.3% ➖ noise
14 datafusion:vortex-compact +25.6% -1.2% +27.1% +10.0% 🚨 regression
14 datafusion:vortex-file-compressed +8.9% -1.2% +10.2% +10.1% 🚨 regression
14 duckdb:duckdb -2.9% -1.2% -1.7% +10.0% ➖ noise
14 duckdb:vortex-compact +27.8% -1.2% +29.3% +11.0% 🚨 regression
14 duckdb:vortex-file-compressed +20.0% -1.2% +21.5% +10.0% 🚨 regression
15 datafusion:vortex-compact -0.3% -2.2% +1.9% +10.4% ➖ noise
15 datafusion:vortex-file-compressed -7.8% -2.2% -5.8% +10.0% ➖ noise
15 duckdb:duckdb -2.5% -2.2% -0.4% +10.3% ➖ noise
15 duckdb:vortex-compact -41.6% -2.2% -40.3% +10.0% ✅ faster
15 duckdb:vortex-file-compressed -37.5% -2.2% -36.1% +17.0% ✅ faster
16 datafusion:vortex-compact +3.2% -1.8% +5.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +3.5% -1.8% +5.4% +10.0% ➖ noise
16 duckdb:duckdb +5.3% -1.8% +7.3% +20.8% ➖ noise
16 duckdb:vortex-compact -16.3% -1.8% -14.7% +17.4% ➖ noise
16 duckdb:vortex-file-compressed -10.6% -1.8% -8.9% +12.7% ➖ noise
17 datafusion:vortex-compact +17.4% -1.1% +18.7% +10.0% 🚨 regression
17 datafusion:vortex-file-compressed +3.4% -1.1% +4.5% +13.2% ➖ noise
17 duckdb:duckdb -3.1% -1.1% -2.1% +10.0% ➖ noise
17 duckdb:vortex-compact +12.6% -1.1% +13.8% +10.0% 🚨 regression
17 duckdb:vortex-file-compressed -12.2% -1.1% -11.3% +10.0% ✅ faster
18 datafusion:vortex-compact +15.4% -1.3% +16.9% +10.0% 🚨 regression
18 datafusion:vortex-file-compressed +4.1% -1.3% +5.4% +10.8% ➖ noise
18 duckdb:duckdb -2.7% -1.3% -1.4% +10.5% ➖ noise
18 duckdb:vortex-compact -2.5% -1.3% -1.3% +11.2% ➖ noise
18 duckdb:vortex-file-compressed +4.3% -1.3% +5.6% +10.0% ➖ noise
19 datafusion:vortex-compact +40.2% -0.6% +41.0% +10.0% 🚨 regression
19 datafusion:vortex-file-compressed +4.4% -0.6% +5.0% +10.0% ➖ noise
19 duckdb:duckdb +4.4% -0.6% +5.0% +10.7% ➖ noise
19 duckdb:vortex-compact +12.6% -0.6% +13.2% +10.0% 🚨 regression
19 duckdb:vortex-file-compressed -18.2% -0.6% -17.7% +11.2% ✅ faster
20 datafusion:vortex-compact +2.1% +0.2% +1.9% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +0.1% +0.2% -0.1% +21.2% ➖ noise
20 duckdb:duckdb +0.8% +0.2% +0.5% +10.4% ➖ noise
20 duckdb:vortex-compact -13.3% +0.2% -13.5% +12.9% ✅ faster
20 duckdb:vortex-file-compressed -4.3% +0.2% -4.5% +10.4% ➖ noise
21 datafusion:vortex-compact +3.3% -0.6% +4.0% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -7.7% -0.6% -7.1% +11.7% ➖ noise
21 duckdb:duckdb +5.6% -0.6% +6.3% +20.5% ➖ noise
21 duckdb:vortex-compact +15.0% -0.6% +15.8% +13.1% 🚨 regression
21 duckdb:vortex-file-compressed +42.8% -0.6% +43.8% +16.8% 🚨 regression
22 datafusion:vortex-compact +8.8% -4.1% +13.5% +12.7% 🚨 regression
22 datafusion:vortex-file-compressed +4.9% -4.1% +9.4% +25.0% ➖ noise
22 duckdb:duckdb +1.3% -4.1% +5.6% +13.6% ➖ noise
22 duckdb:vortex-compact -20.7% -4.1% -17.3% +12.3% ✅ faster
22 duckdb:vortex-file-compressed -15.1% -4.1% -11.5% +12.5% ✅ faster
23 datafusion:vortex-compact +29.7% -2.8% +33.5% +10.0% 🚨 regression
23 datafusion:vortex-file-compressed +9.2% -2.8% +12.3% +10.0% 🚨 regression
23 duckdb:duckdb -10.3% -2.8% -7.7% +17.2% ➖ noise
23 duckdb:vortex-compact +11.7% -2.8% +14.9% +10.0% 🚨 regression
23 duckdb:vortex-file-compressed +24.5% -2.8% +28.1% +10.0% 🚨 regression
24 datafusion:vortex-compact +17.2% -1.6% +19.0% +10.0% 🚨 regression
24 datafusion:vortex-file-compressed +4.7% -1.6% +6.4% +10.0% ➖ noise
24 duckdb:duckdb +0.7% -1.6% +2.4% +10.0% ➖ noise
24 duckdb:vortex-compact +23.2% -1.6% +25.2% +10.0% 🚨 regression
24 duckdb:vortex-file-compressed -14.3% -1.6% -12.9% +11.1% ✅ faster
25 datafusion:vortex-compact +21.4% +0.4% +21.0% +10.0% 🚨 regression
25 datafusion:vortex-file-compressed +9.3% +0.4% +8.9% +10.0% ➖ noise
25 duckdb:duckdb -0.3% +0.4% -0.7% +16.7% ➖ noise
25 duckdb:vortex-compact +9.9% +0.4% +9.5% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -8.3% +0.4% -8.7% +13.5% ➖ noise
26 datafusion:vortex-compact +17.2% +0.3% +16.9% +10.0% 🚨 regression
26 datafusion:vortex-file-compressed +21.9% +0.3% +21.6% +10.0% 🚨 regression
26 duckdb:duckdb -6.2% +0.3% -6.5% +11.6% ➖ noise
26 duckdb:vortex-compact -0.5% +0.3% -0.7% +11.6% ➖ noise
26 duckdb:vortex-file-compressed -2.7% +0.3% -3.0% +10.1% ➖ noise
27 datafusion:vortex-compact +47.6% -2.1% +50.8% +10.0% 🚨 regression
27 datafusion:vortex-file-compressed +16.4% -2.1% +19.0% +10.0% 🚨 regression
27 duckdb:duckdb -1.3% -2.1% +0.8% +20.3% ➖ noise
27 duckdb:vortex-compact +16.2% -2.1% +18.7% +10.0% 🚨 regression
27 duckdb:vortex-file-compressed +9.8% -2.1% +12.2% +10.0% 🚨 regression
28 datafusion:vortex-compact +22.7% -2.7% +26.1% +10.0% 🚨 regression
28 datafusion:vortex-file-compressed +44.8% -2.7% +48.8% +10.0% 🚨 regression
28 duckdb:duckdb +0.6% -2.7% +3.4% +10.0% ➖ noise
28 duckdb:vortex-compact +9.5% -2.7% +12.6% +10.0% 🚨 regression
28 duckdb:vortex-file-compressed +32.4% -2.7% +36.1% +10.0% 🚨 regression
29 datafusion:vortex-compact +13.5% -1.3% +15.0% +10.0% 🚨 regression
29 datafusion:vortex-file-compressed +4.0% -1.3% +5.4% +10.0% ➖ noise
29 duckdb:duckdb -0.1% -1.3% +1.2% +10.0% ➖ noise
29 duckdb:vortex-compact +7.9% -1.3% +9.3% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -11.0% -1.3% -9.8% +10.0% ✅ faster
30 datafusion:vortex-compact -13.4% -0.9% -12.7% +10.0% ✅ faster
30 datafusion:vortex-file-compressed -8.9% -0.9% -8.1% +12.1% ➖ noise
30 duckdb:duckdb -3.1% -0.9% -2.3% +12.9% ➖ noise
30 duckdb:vortex-compact -13.4% -0.9% -12.6% +10.0% ✅ faster
30 duckdb:vortex-file-compressed -8.5% -0.9% -7.7% +10.0% ➖ noise
31 datafusion:vortex-compact +25.1% +0.0% +25.1% +10.0% 🚨 regression
31 datafusion:vortex-file-compressed +5.2% +0.0% +5.2% +10.9% ➖ noise
31 duckdb:duckdb -2.1% +0.0% -2.1% +16.7% ➖ noise
31 duckdb:vortex-compact +28.1% +0.0% +28.1% +11.5% 🚨 regression
31 duckdb:vortex-file-compressed +4.7% +0.0% +4.6% +14.6% ➖ noise
32 datafusion:vortex-compact +0.6% -3.4% +4.2% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +11.2% -3.4% +15.1% +10.0% 🚨 regression
32 duckdb:duckdb +1.6% -3.4% +5.2% +18.6% ➖ noise
32 duckdb:vortex-compact -22.3% -3.4% -19.5% +10.0% ✅ faster
32 duckdb:vortex-file-compressed -0.3% -3.4% +3.2% +10.0% ➖ noise
33 datafusion:vortex-compact +23.6% -0.8% +24.6% +10.0% 🚨 regression
33 datafusion:vortex-file-compressed +8.3% -0.8% +9.2% +10.0% ➖ noise
33 duckdb:duckdb +3.7% -0.8% +4.6% +12.9% ➖ noise
33 duckdb:vortex-compact +7.6% -0.8% +8.4% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +27.5% -0.8% +28.6% +10.0% 🚨 regression
34 datafusion:vortex-compact +25.6% -1.5% +27.4% +10.0% 🚨 regression
34 datafusion:vortex-file-compressed +1.8% -1.5% +3.3% +10.0% ➖ noise
34 duckdb:duckdb -6.6% -1.5% -5.2% +15.2% ➖ noise
34 duckdb:vortex-compact +49.1% -1.5% +51.3% +10.0% 🚨 regression
34 duckdb:vortex-file-compressed +5.5% -1.5% +7.1% +10.0% ➖ noise
35 datafusion:vortex-compact +10.4% -2.4% +13.2% +10.0% 🚨 regression
35 datafusion:vortex-file-compressed -1.7% -2.4% +0.7% +10.0% ➖ noise
35 duckdb:duckdb -0.3% -2.4% +2.2% +12.4% ➖ noise
35 duckdb:vortex-compact +2.4% -2.4% +5.0% +12.5% ➖ noise
35 duckdb:vortex-file-compressed -9.3% -2.4% -7.0% +10.9% ➖ noise
36 datafusion:vortex-compact +47.1% -3.0% +51.7% +10.0% 🚨 regression
36 datafusion:vortex-file-compressed +8.6% -3.0% +12.0% +10.0% 🚨 regression
36 duckdb:duckdb -4.3% -3.0% -1.3% +10.7% ➖ noise
36 duckdb:vortex-compact +21.7% -3.0% +25.5% +10.0% 🚨 regression
36 duckdb:vortex-file-compressed -6.7% -3.0% -3.7% +10.9% ➖ noise
37 datafusion:vortex-compact +9.1% +0.2% +8.8% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +21.1% +0.2% +20.8% +10.0% 🚨 regression
37 duckdb:duckdb +0.7% +0.2% +0.5% +16.0% ➖ noise
37 duckdb:vortex-compact +0.7% +0.2% +0.4% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +24.2% +0.2% +24.0% +17.4% 🚨 regression
38 datafusion:vortex-compact +9.9% -1.4% +11.5% +10.0% 🚨 regression
38 datafusion:vortex-file-compressed +2.3% -1.4% +3.8% +10.0% ➖ noise
38 duckdb:duckdb -0.6% -1.4% +0.8% +14.7% ➖ noise
38 duckdb:vortex-compact +15.1% -1.4% +16.8% +11.4% 🚨 regression
38 duckdb:vortex-file-compressed -12.6% -1.4% -11.3% +10.9% ✅ faster
39 datafusion:vortex-compact +12.8% -2.0% +15.2% +13.1% 🚨 regression
39 datafusion:vortex-file-compressed -3.6% -2.0% -1.6% +12.6% ➖ noise
39 duckdb:duckdb +0.5% -2.0% +2.6% +18.6% ➖ noise
39 duckdb:vortex-compact -22.4% -2.0% -20.8% +16.6% ✅ faster
39 duckdb:vortex-file-compressed -14.6% -2.0% -12.9% +16.1% ➖ noise
40 datafusion:vortex-compact -3.4% +0.6% -4.0% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -2.5% +0.6% -3.1% +10.0% ➖ noise
40 duckdb:duckdb -0.9% +0.6% -1.6% +18.1% ➖ noise
40 duckdb:vortex-compact -22.6% +0.6% -23.1% +10.0% ✅ faster
40 duckdb:vortex-file-compressed -14.7% +0.6% -15.2% +20.1% ➖ noise
41 datafusion:vortex-compact +2.0% -1.6% +3.6% +11.4% ➖ noise
41 datafusion:vortex-file-compressed +0.4% -1.6% +2.1% +11.4% ➖ noise
41 duckdb:duckdb -3.4% -1.6% -1.9% +10.0% ➖ noise
41 duckdb:vortex-compact -2.4% -1.6% -0.9% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +3.8% -1.6% +5.5% +10.0% ➖ noise
42 datafusion:vortex-compact +36.9% -5.9% +45.4% +11.3% 🚨 regression
42 datafusion:vortex-file-compressed +6.1% -5.9% +12.8% +16.6% ➖ noise
42 duckdb:duckdb -1.0% -5.9% +5.2% +14.9% ➖ noise
42 duckdb:vortex-compact +36.4% -5.9% +45.0% +14.8% 🚨 regression
42 duckdb:vortex-file-compressed +11.9% -5.9% +18.9% +16.7% 🚨 regression
43 datafusion:vortex-compact +23.6% -0.1% +23.7% +10.0% 🚨 regression
43 datafusion:vortex-file-compressed +8.0% -0.1% +8.1% +10.0% ➖ noise
43 duckdb:duckdb +3.0% -0.1% +3.1% +21.9% ➖ noise
43 duckdb:vortex-compact -25.5% -0.1% -25.4% +25.5% ✅ faster
43 duckdb:vortex-file-compressed -34.4% -0.1% -34.3% +10.0% ✅ faster
44 datafusion:vortex-compact +77.8% -0.2% +78.1% +10.0% 🚨 regression
44 datafusion:vortex-file-compressed +30.1% -0.2% +30.3% +10.0% 🚨 regression
44 duckdb:duckdb -0.3% -0.2% -0.1% +10.0% ➖ noise
44 duckdb:vortex-compact +59.2% -0.2% +59.5% +10.0% 🚨 regression
44 duckdb:vortex-file-compressed +18.2% -0.2% +18.5% +10.7% 🚨 regression
45 datafusion:vortex-compact +6.3% +0.6% +5.6% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -2.1% +0.6% -2.7% +10.0% ➖ noise
45 duckdb:duckdb +1.6% +0.6% +1.0% +17.2% ➖ noise
45 duckdb:vortex-compact -26.0% +0.6% -26.4% +10.0% ✅ faster
45 duckdb:vortex-file-compressed -28.0% +0.6% -28.4% +14.7% ✅ faster
46 datafusion:vortex-compact +25.7% -2.2% +28.5% +10.0% 🚨 regression
46 datafusion:vortex-file-compressed -2.4% -2.2% -0.2% +10.0% ➖ noise
46 duckdb:duckdb +4.3% -2.2% +6.6% +10.0% ➖ noise
46 duckdb:vortex-compact +7.9% -2.2% +10.3% +10.0% 🚨 regression
46 duckdb:vortex-file-compressed -12.4% -2.2% -10.5% +10.0% ✅ faster
47 datafusion:vortex-compact +19.8% +0.1% +19.6% +10.0% 🚨 regression
47 datafusion:vortex-file-compressed +0.1% +0.1% -0.0% +10.0% ➖ noise
47 duckdb:duckdb -2.0% +0.1% -2.1% +10.0% ➖ noise
47 duckdb:vortex-compact +16.4% +0.1% +16.2% +10.0% 🚨 regression
47 duckdb:vortex-file-compressed -4.2% +0.1% -4.3% +10.6% ➖ noise
48 datafusion:vortex-compact +50.1% -3.5% +55.4% +10.0% 🚨 regression
48 datafusion:vortex-file-compressed +30.3% -3.5% +35.0% +10.0% 🚨 regression
48 duckdb:duckdb -0.3% -3.5% +3.3% +10.6% ➖ noise
48 duckdb:vortex-compact +35.8% -3.5% +40.7% +10.0% 🚨 regression
48 duckdb:vortex-file-compressed +3.9% -3.5% +7.7% +10.0% ➖ noise
49 datafusion:vortex-compact +21.3% -2.3% +24.2% +10.0% 🚨 regression
49 datafusion:vortex-file-compressed +12.8% -2.3% +15.5% +10.0% 🚨 regression
49 duckdb:duckdb -5.2% -2.3% -3.0% +13.1% ➖ noise
49 duckdb:vortex-compact +25.8% -2.3% +28.8% +11.4% 🚨 regression
49 duckdb:vortex-file-compressed +23.3% -2.3% +26.3% +16.5% 🚨 regression
50 datafusion:vortex-compact +26.3% -3.2% +30.4% +10.0% 🚨 regression
50 datafusion:vortex-file-compressed +7.2% -3.2% +10.7% +10.0% 🚨 regression
50 duckdb:duckdb +0.8% -3.2% +4.1% +11.7% ➖ noise
50 duckdb:vortex-compact +73.2% -3.2% +78.9% +10.0% 🚨 regression
50 duckdb:vortex-file-compressed +3.9% -3.2% +7.3% +10.0% ➖ noise
51 datafusion:vortex-compact +10.9% -0.6% +11.5% +10.0% 🚨 regression
51 datafusion:vortex-file-compressed -0.3% -0.6% +0.2% +10.0% ➖ noise
51 duckdb:duckdb +2.7% -0.6% +3.3% +16.8% ➖ noise
51 duckdb:vortex-compact +11.3% -0.6% +11.9% +14.3% ➖ noise
51 duckdb:vortex-file-compressed -4.9% -0.6% -4.4% +33.2% ➖ noise
52 datafusion:vortex-compact +33.2% -0.2% +33.5% +10.9% 🚨 regression
52 datafusion:vortex-file-compressed +13.0% -0.2% +13.2% +11.2% 🚨 regression
52 duckdb:duckdb -0.1% -0.2% +0.1% +17.1% ➖ noise
52 duckdb:vortex-compact +42.2% -0.2% +42.5% +12.4% 🚨 regression
52 duckdb:vortex-file-compressed +13.4% -0.2% +13.6% +20.4% ➖ noise
53 datafusion:vortex-compact +41.2% +0.7% +40.3% +10.0% 🚨 regression
53 datafusion:vortex-file-compressed -1.1% +0.7% -1.8% +11.8% ➖ noise
53 duckdb:duckdb -1.8% +0.7% -2.5% +10.4% ➖ noise
53 duckdb:vortex-compact +45.2% +0.7% +44.3% +10.0% 🚨 regression
53 duckdb:vortex-file-compressed +10.4% +0.7% +9.6% +11.6% ➖ noise
54 datafusion:vortex-compact +17.6% +0.6% +16.9% +10.0% 🚨 regression
54 datafusion:vortex-file-compressed +2.9% +0.6% +2.3% +13.4% ➖ noise
54 duckdb:duckdb +2.7% +0.6% +2.1% +12.8% ➖ noise
54 duckdb:vortex-compact +15.1% +0.6% +14.5% +10.0% 🚨 regression
54 duckdb:vortex-file-compressed +26.7% +0.6% +25.9% +13.0% 🚨 regression
55 datafusion:vortex-compact +39.4% -2.9% +43.6% +10.0% 🚨 regression
55 datafusion:vortex-file-compressed +6.1% -2.9% +9.2% +11.9% ➖ noise
55 duckdb:duckdb +2.8% -2.9% +5.9% +15.4% ➖ noise
55 duckdb:vortex-compact +43.4% -2.9% +47.6% +15.5% 🚨 regression
55 duckdb:vortex-file-compressed +12.0% -2.9% +15.3% +12.9% 🚨 regression
56 datafusion:vortex-compact +24.9% +0.5% +24.3% +10.0% 🚨 regression
56 datafusion:vortex-file-compressed +5.5% +0.5% +5.0% +10.0% ➖ noise
56 duckdb:duckdb +3.5% +0.5% +3.0% +12.6% ➖ noise
56 duckdb:vortex-compact +14.1% +0.5% +13.6% +10.0% 🚨 regression
56 duckdb:vortex-file-compressed +25.3% +0.5% +24.7% +10.0% 🚨 regression
57 datafusion:vortex-compact +4.3% +3.5% +0.8% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -2.3% +3.5% -5.6% +10.0% ➖ noise
57 duckdb:duckdb -1.3% +3.5% -4.6% +10.0% ➖ noise
57 duckdb:vortex-compact -27.4% +3.5% -29.8% +18.9% ✅ faster
57 duckdb:vortex-file-compressed -25.7% +3.5% -28.2% +11.6% ✅ faster
58 datafusion:vortex-compact +20.2% +0.2% +20.0% +10.0% 🚨 regression
58 datafusion:vortex-file-compressed +2.9% +0.2% +2.7% +10.0% ➖ noise
58 duckdb:duckdb +6.2% +0.2% +6.0% +11.5% ➖ noise
58 duckdb:vortex-compact +59.8% +0.2% +59.5% +15.3% 🚨 regression
58 duckdb:vortex-file-compressed +11.2% +0.2% +11.0% +12.5% ➖ noise
59 datafusion:vortex-compact +24.4% -0.6% +25.2% +10.0% 🚨 regression
59 datafusion:vortex-file-compressed +3.2% -0.6% +3.9% +10.0% ➖ noise
59 duckdb:duckdb -3.2% -0.6% -2.5% +10.0% ➖ noise
59 duckdb:vortex-compact -27.9% -0.6% -27.4% +10.0% ✅ faster
59 duckdb:vortex-file-compressed -39.3% -0.6% -38.9% +10.0% ✅ faster
60 datafusion:vortex-compact +22.9% -6.6% +31.5% +10.0% 🚨 regression
60 datafusion:vortex-file-compressed +3.4% -6.6% +10.7% +10.7% 🚨 regression
60 duckdb:duckdb -1.7% -6.6% +5.2% +10.5% ➖ noise
60 duckdb:vortex-compact +9.2% -6.6% +16.9% +10.0% 🚨 regression
60 duckdb:vortex-file-compressed +24.7% -6.6% +33.5% +12.3% 🚨 regression
61 datafusion:vortex-compact +46.7% +1.7% +44.3% +10.2% 🚨 regression
61 datafusion:vortex-file-compressed +7.8% +1.7% +6.0% +10.0% ➖ noise
61 duckdb:duckdb -2.3% +1.7% -3.9% +11.2% ➖ noise
61 duckdb:vortex-compact +48.0% +1.7% +45.6% +10.0% 🚨 regression
61 duckdb:vortex-file-compressed +6.7% +1.7% +5.0% +13.5% ➖ noise
62 datafusion:vortex-compact +5.0% +2.8% +2.1% +11.7% ➖ noise
62 datafusion:vortex-file-compressed -4.2% +2.8% -6.8% +12.7% ➖ noise
62 duckdb:duckdb +2.3% +2.8% -0.5% +25.2% ➖ noise
62 duckdb:vortex-compact -11.4% +2.8% -13.8% +15.1% ✅ faster
62 duckdb:vortex-file-compressed -16.9% +2.8% -19.2% +17.5% ✅ faster
63 datafusion:vortex-compact +38.9% -3.5% +44.0% +10.0% 🚨 regression
63 datafusion:vortex-file-compressed -0.6% -3.5% +3.1% +10.1% ➖ noise
63 duckdb:duckdb -0.1% -3.5% +3.6% +10.6% ➖ noise
63 duckdb:vortex-compact +44.5% -3.5% +49.8% +10.1% 🚨 regression
63 duckdb:vortex-file-compressed +6.3% -3.5% +10.2% +10.0% 🚨 regression
64 datafusion:vortex-compact +7.9% -0.8% +8.8% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +0.3% -0.8% +1.1% +10.0% ➖ noise
64 duckdb:duckdb +3.0% -0.8% +3.9% +10.0% ➖ noise
64 duckdb:vortex-compact +24.6% -0.8% +25.7% +10.0% 🚨 regression
64 duckdb:vortex-file-compressed +23.2% -0.8% +24.3% +10.0% 🚨 regression
65 datafusion:vortex-compact +39.8% -5.0% +47.2% +11.7% 🚨 regression
65 datafusion:vortex-file-compressed +5.2% -5.0% +10.8% +14.0% ➖ noise
65 duckdb:duckdb +4.0% -5.0% +9.5% +19.8% ➖ noise
65 duckdb:vortex-compact +33.2% -5.0% +40.2% +11.4% 🚨 regression
65 duckdb:vortex-file-compressed -0.4% -5.0% +4.9% +15.6% ➖ noise
66 datafusion:vortex-compact +3.9% +1.2% +2.7% +10.5% ➖ noise
66 datafusion:vortex-file-compressed +3.0% +1.2% +1.7% +12.2% ➖ noise
66 duckdb:duckdb -7.1% +1.2% -8.2% +13.2% ➖ noise
66 duckdb:vortex-compact +1.6% +1.2% +0.4% +10.0% ➖ noise
66 duckdb:vortex-file-compressed -2.0% +1.2% -3.1% +17.6% ➖ noise
67 datafusion:vortex-compact +18.1% -0.4% +18.6% +10.0% 🚨 regression
67 datafusion:vortex-file-compressed -0.8% -0.4% -0.3% +10.0% ➖ noise
67 duckdb:duckdb -2.0% -0.4% -1.6% +10.0% ➖ noise
67 duckdb:vortex-compact +11.9% -0.4% +12.3% +10.0% 🚨 regression
67 duckdb:vortex-file-compressed +5.8% -0.4% +6.3% +10.0% ➖ noise
68 datafusion:vortex-compact +29.8% +0.1% +29.7% +10.0% 🚨 regression
68 datafusion:vortex-file-compressed +8.8% +0.1% +8.7% +13.4% ➖ noise
68 duckdb:duckdb +0.9% +0.1% +0.8% +10.0% ➖ noise
68 duckdb:vortex-compact +27.4% +0.1% +27.3% +10.0% 🚨 regression
68 duckdb:vortex-file-compressed -6.4% +0.1% -6.5% +10.0% ➖ noise
69 datafusion:vortex-compact +18.1% -2.7% +21.4% +10.0% 🚨 regression
69 datafusion:vortex-file-compressed -2.3% -2.7% +0.4% +10.0% ➖ noise
69 duckdb:duckdb +3.8% -2.7% +6.7% +10.0% ➖ noise
69 duckdb:vortex-compact +22.2% -2.7% +25.6% +10.0% 🚨 regression
69 duckdb:vortex-file-compressed +5.9% -2.7% +8.8% +10.0% ➖ noise
70 datafusion:vortex-compact +10.9% -0.7% +11.7% +10.0% 🚨 regression
70 datafusion:vortex-file-compressed +0.1% -0.7% +0.8% +10.0% ➖ noise
70 duckdb:duckdb +0.6% -0.7% +1.3% +13.6% ➖ noise
70 duckdb:vortex-compact +1.3% -0.7% +2.1% +10.0% ➖ noise
70 duckdb:vortex-file-compressed -7.0% -0.7% -6.4% +11.5% ➖ noise
71 datafusion:vortex-compact +31.5% +0.2% +31.2% +11.0% 🚨 regression
71 datafusion:vortex-file-compressed +11.8% +0.2% +11.5% +13.0% ➖ noise
71 duckdb:duckdb -6.9% +0.2% -7.1% +15.7% ➖ noise
71 duckdb:vortex-compact +45.1% +0.2% +44.8% +12.1% 🚨 regression
71 duckdb:vortex-file-compressed +19.3% +0.2% +19.1% +17.0% 🚨 regression
72 datafusion:vortex-compact +0.1% -1.1% +1.2% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -2.5% -1.1% -1.5% +10.0% ➖ noise
72 duckdb:duckdb +0.2% -1.1% +1.3% +10.8% ➖ noise
72 duckdb:vortex-compact -22.7% -1.1% -21.9% +10.0% ✅ faster
72 duckdb:vortex-file-compressed -21.0% -1.1% -20.1% +10.0% ✅ faster
73 datafusion:vortex-compact +27.8% -2.0% +30.3% +16.9% 🚨 regression
73 datafusion:vortex-file-compressed -3.2% -2.0% -1.2% +22.1% ➖ noise
73 duckdb:duckdb +3.9% -2.0% +6.0% +15.1% ➖ noise
73 duckdb:vortex-compact +56.6% -2.0% +59.8% +11.3% 🚨 regression
73 duckdb:vortex-file-compressed +7.8% -2.0% +10.0% +12.8% ➖ noise
74 datafusion:vortex-compact +18.3% -0.1% +18.4% +10.0% 🚨 regression
74 datafusion:vortex-file-compressed +7.4% -0.1% +7.5% +10.0% ➖ noise
74 duckdb:duckdb +1.3% -0.1% +1.4% +10.0% ➖ noise
74 duckdb:vortex-compact +35.9% -0.1% +36.0% +10.9% 🚨 regression
74 duckdb:vortex-file-compressed +6.6% -0.1% +6.7% +12.4% ➖ noise
75 datafusion:vortex-compact +15.4% -3.1% +19.0% +10.0% 🚨 regression
75 datafusion:vortex-file-compressed +7.5% -3.1% +10.9% +10.0% 🚨 regression
75 duckdb:duckdb -1.8% -3.1% +1.3% +10.0% ➖ noise
75 duckdb:vortex-compact +7.4% -3.1% +10.8% +10.0% 🚨 regression
75 duckdb:vortex-file-compressed -0.2% -3.1% +2.9% +10.0% ➖ noise
76 datafusion:vortex-compact +37.2% -2.3% +40.5% +10.0% 🚨 regression
76 datafusion:vortex-file-compressed +26.0% -2.3% +29.0% +10.0% 🚨 regression
76 duckdb:duckdb -3.8% -2.3% -1.5% +15.5% ➖ noise
76 duckdb:vortex-compact +39.2% -2.3% +42.5% +10.0% 🚨 regression
76 duckdb:vortex-file-compressed +50.7% -2.3% +54.3% +25.2% 🚨 regression
77 datafusion:vortex-compact +6.3% -0.6% +6.9% +10.0% ➖ noise
77 datafusion:vortex-file-compressed +1.9% -0.6% +2.4% +10.0% ➖ noise
77 duckdb:duckdb +5.0% -0.6% +5.6% +12.9% ➖ noise
77 duckdb:vortex-compact +20.1% -0.6% +20.8% +10.0% 🚨 regression
77 duckdb:vortex-file-compressed +35.4% -0.6% +36.1% +11.2% 🚨 regression
78 datafusion:vortex-compact +15.0% -2.8% +18.4% +10.0% 🚨 regression
78 datafusion:vortex-file-compressed +10.2% -2.8% +13.4% +10.0% 🚨 regression
78 duckdb:duckdb +0.9% -2.8% +3.8% +10.0% ➖ noise
78 duckdb:vortex-compact +7.2% -2.8% +10.3% +10.0% 🚨 regression
78 duckdb:vortex-file-compressed -5.8% -2.8% -3.1% +10.0% ➖ noise
79 datafusion:vortex-compact +31.6% +3.3% +27.4% +10.0% 🚨 regression
79 datafusion:vortex-file-compressed +3.8% +3.3% +0.5% +10.0% ➖ noise
79 duckdb:duckdb -1.5% +3.3% -4.6% +10.6% ➖ noise
79 duckdb:vortex-compact +69.0% +3.3% +63.6% +10.0% 🚨 regression
79 duckdb:vortex-file-compressed +7.2% +3.3% +3.8% +10.0% ➖ noise
80 datafusion:vortex-compact +16.3% -3.4% +20.3% +10.0% 🚨 regression
80 datafusion:vortex-file-compressed +2.7% -3.4% +6.3% +10.0% ➖ noise
80 duckdb:duckdb +4.0% -3.4% +7.6% +17.5% ➖ noise
80 duckdb:vortex-compact -2.0% -3.4% +1.5% +10.0% ➖ noise
80 duckdb:vortex-file-compressed +14.5% -3.4% +18.5% +10.0% 🚨 regression
81 datafusion:vortex-compact -18.9% -2.4% -16.9% +10.2% ✅ faster
81 datafusion:vortex-file-compressed -9.9% -2.4% -7.6% +12.0% ➖ noise
81 duckdb:duckdb +2.8% -2.4% +5.4% +10.0% ➖ noise
81 duckdb:vortex-compact -23.4% -2.4% -21.5% +25.8% ✅ faster
81 duckdb:vortex-file-compressed -19.7% -2.4% -17.7% +10.0% ✅ faster
82 datafusion:vortex-compact +12.1% -3.3% +15.9% +10.0% 🚨 regression
82 datafusion:vortex-file-compressed +28.5% -3.3% +32.8% +10.0% 🚨 regression
82 duckdb:duckdb -0.9% -3.3% +2.5% +16.1% ➖ noise
82 duckdb:vortex-compact +4.8% -3.3% +8.4% +13.8% ➖ noise
82 duckdb:vortex-file-compressed +35.5% -3.3% +40.2% +16.9% 🚨 regression
83 datafusion:vortex-compact -4.5% -0.7% -3.8% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -0.2% -0.7% +0.5% +10.0% ➖ noise
83 duckdb:duckdb +4.7% -0.7% +5.5% +13.9% ➖ noise
83 duckdb:vortex-compact -22.9% -0.7% -22.4% +12.1% ✅ faster
83 duckdb:vortex-file-compressed +3.4% -0.7% +4.1% +10.0% ➖ noise
84 datafusion:vortex-compact -18.1% -1.1% -17.2% +11.6% ✅ faster
84 datafusion:vortex-file-compressed -1.1% -1.1% +0.1% +10.0% ➖ noise
84 duckdb:duckdb -5.5% -1.1% -4.5% +11.6% ➖ noise
84 duckdb:vortex-compact -12.4% -1.1% -11.4% +10.3% ✅ faster
84 duckdb:vortex-file-compressed -8.8% -1.1% -7.7% +11.0% ➖ noise
85 datafusion:vortex-compact +15.5% +0.2% +15.3% +10.0% 🚨 regression
85 datafusion:vortex-file-compressed +10.0% +0.2% +9.9% +10.0% ➖ noise
85 duckdb:duckdb +9.2% +0.2% +9.1% +12.3% ➖ noise
85 duckdb:vortex-compact -14.2% +0.2% -14.3% +10.0% ✅ faster
85 duckdb:vortex-file-compressed -18.6% +0.2% -18.7% +10.9% ✅ faster
86 datafusion:vortex-compact +10.5% +2.5% +7.8% +10.0% ➖ noise
86 datafusion:vortex-file-compressed -1.8% +2.5% -4.2% +10.0% ➖ noise
86 duckdb:duckdb -6.1% +2.5% -8.4% +17.9% ➖ noise
86 duckdb:vortex-compact -11.3% +2.5% -13.5% +16.3% ➖ noise
86 duckdb:vortex-file-compressed -12.4% +2.5% -14.6% +15.5% ✅ faster
87 datafusion:vortex-compact +9.9% +0.3% +9.6% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -1.2% +0.3% -1.4% +10.0% ➖ noise
87 duckdb:duckdb +2.4% +0.3% +2.1% +11.1% ➖ noise
87 duckdb:vortex-compact +5.5% +0.3% +5.2% +12.5% ➖ noise
87 duckdb:vortex-file-compressed -16.3% +0.3% -16.5% +12.1% ✅ faster
88 datafusion:vortex-compact +58.8% -0.8% +60.0% +10.0% 🚨 regression
88 datafusion:vortex-file-compressed +11.0% -0.8% +11.9% +10.0% 🚨 regression
88 duckdb:duckdb +1.2% -0.8% +2.0% +10.0% ➖ noise
88 duckdb:vortex-compact +46.3% -0.8% +47.4% +10.0% 🚨 regression
88 duckdb:vortex-file-compressed +2.1% -0.8% +2.9% +10.0% ➖ noise
89 datafusion:vortex-compact +35.8% -1.6% +38.0% +10.0% 🚨 regression
89 datafusion:vortex-file-compressed +13.2% -1.6% +15.0% +10.0% 🚨 regression
89 duckdb:duckdb -4.7% -1.6% -3.2% +11.9% ➖ noise
89 duckdb:vortex-compact +47.5% -1.6% +49.9% +10.0% 🚨 regression
89 duckdb:vortex-file-compressed +7.6% -1.6% +9.3% +11.7% ➖ noise
90 datafusion:vortex-compact -1.2% +5.9% -6.7% +10.0% ➖ noise
90 datafusion:vortex-file-compressed +10.7% +5.9% +4.6% +10.0% ➖ noise
90 duckdb:duckdb -3.9% +5.9% -9.2% +15.3% ➖ noise
90 duckdb:vortex-compact -8.0% +5.9% -13.1% +10.4% ✅ faster
90 duckdb:vortex-file-compressed -13.3% +5.9% -18.1% +11.8% ✅ faster
91 datafusion:vortex-compact +10.9% +0.5% +10.3% +10.0% 🚨 regression
91 datafusion:vortex-file-compressed +1.6% +0.5% +1.0% +10.0% ➖ noise
91 duckdb:duckdb -2.9% +0.5% -3.4% +10.0% ➖ noise
91 duckdb:vortex-compact -0.8% +0.5% -1.3% +10.0% ➖ noise
91 duckdb:vortex-file-compressed -19.3% +0.5% -19.8% +10.0% ✅ faster
92 datafusion:vortex-compact +17.6% -1.2% +19.0% +10.0% 🚨 regression
92 datafusion:vortex-file-compressed +1.3% -1.2% +2.5% +10.0% ➖ noise
92 duckdb:duckdb -6.1% -1.2% -5.0% +12.7% ➖ noise
92 duckdb:vortex-compact +2.8% -1.2% +4.0% +12.2% ➖ noise
92 duckdb:vortex-file-compressed -10.7% -1.2% -9.6% +15.6% ➖ noise
93 datafusion:vortex-compact +15.6% +0.5% +15.1% +10.0% 🚨 regression
93 datafusion:vortex-file-compressed +15.8% +0.5% +15.3% +10.0% 🚨 regression
93 duckdb:duckdb +6.0% +0.5% +5.5% +10.4% ➖ noise
93 duckdb:vortex-compact -5.7% +0.5% -6.1% +11.5% ➖ noise
93 duckdb:vortex-file-compressed -13.6% +0.5% -14.0% +10.0% ✅ faster
94 datafusion:vortex-compact -2.6% +3.9% -6.2% +10.0% ➖ noise
94 datafusion:vortex-file-compressed +6.3% +3.9% +2.3% +10.0% ➖ noise
94 duckdb:duckdb +0.0% +3.9% -3.8% +13.7% ➖ noise
94 duckdb:vortex-compact -7.2% +3.9% -10.7% +12.0% ✅ faster
94 duckdb:vortex-file-compressed +1.5% +3.9% -2.4% +10.3% ➖ noise
95 datafusion:vortex-compact +8.8% +9.7% -0.9% +10.0% ➖ noise
95 datafusion:vortex-file-compressed +5.9% +9.7% -3.5% +10.0% ➖ noise
95 duckdb:duckdb +2.7% +9.7% -6.4% +24.0% ➖ noise
95 duckdb:vortex-compact -28.2% +9.7% -34.6% +15.1% ✅ faster
95 duckdb:vortex-file-compressed -36.5% +9.7% -42.1% +13.2% ✅ faster
96 datafusion:vortex-compact +30.6% +5.8% +23.4% +10.0% 🚨 regression
96 datafusion:vortex-file-compressed +9.7% +5.8% +3.7% +11.1% ➖ noise
96 duckdb:duckdb -2.1% +5.8% -7.4% +18.0% ➖ noise
96 duckdb:vortex-compact +65.0% +5.8% +55.9% +11.7% 🚨 regression
96 duckdb:vortex-file-compressed +14.0% +5.8% +7.7% +15.2% ➖ noise
97 datafusion:vortex-compact +18.1% -1.9% +20.3% +10.0% 🚨 regression
97 datafusion:vortex-file-compressed +11.2% -1.9% +13.3% +10.0% 🚨 regression
97 duckdb:duckdb -1.0% -1.9% +0.9% +14.4% ➖ noise
97 duckdb:vortex-compact +22.8% -1.9% +25.1% +13.1% 🚨 regression
97 duckdb:vortex-file-compressed -0.6% -1.9% +1.3% +13.7% ➖ noise
98 datafusion:vortex-compact +21.8% -1.2% +23.3% +10.0% 🚨 regression
98 datafusion:vortex-file-compressed +7.9% -1.2% +9.1% +10.0% ➖ noise
98 duckdb:duckdb +3.1% -1.2% +4.3% +11.7% ➖ noise
98 duckdb:vortex-compact +12.2% -1.2% +13.5% +10.0% 🚨 regression
98 duckdb:vortex-file-compressed +6.2% -1.2% +7.4% +10.9% ➖ noise
99 datafusion:vortex-compact +4.6% -8.8% +14.7% +12.0% 🚨 regression
99 datafusion:vortex-file-compressed -1.1% -8.8% +8.5% +15.3% ➖ noise
99 duckdb:duckdb -1.8% -8.8% +7.7% +12.0% ➖ noise
99 duckdb:vortex-compact -41.7% -8.8% -36.1% +22.4% ✅ faster
99 duckdb:vortex-file-compressed -42.7% -8.8% -37.1% +14.1% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

File Size Changes (28 files changed, +0.9% overall, 21↑ 7↓)
File Scale Format Base HEAD Change %
customer_demographics.vortex 1.0 vortex-file-compressed 1.47 MB 1.81 MB +350.45 KB +23.3%
time_dim.vortex 1.0 vortex-compact 85.30 KB 98.88 KB +13.58 KB +15.9%
customer_demographics.vortex 1.0 vortex-compact 623.93 KB 706.25 KB +82.32 KB +13.2%
date_dim.vortex 1.0 vortex-compact 130.84 KB 141.53 KB +10.69 KB +8.2%
date_dim.vortex 1.0 vortex-file-compressed 1.01 MB 1.07 MB +69.33 KB +6.7%
inventory.vortex 1.0 vortex-compact 15.95 MB 16.50 MB +570.71 KB +3.5%
web_sales.vortex 1.0 vortex-compact 29.26 MB 29.86 MB +607.80 KB +2.0%
inventory.vortex 1.0 vortex-file-compressed 36.56 MB 37.15 MB +601.58 KB +1.6%
item.vortex 1.0 vortex-compact 975.02 KB 990.61 KB +15.59 KB +1.6%
web_sales.vortex 1.0 vortex-file-compressed 33.58 MB 34.06 MB +494.05 KB +1.4%
item.vortex 1.0 vortex-file-compressed 1.72 MB 1.75 MB +24.47 KB +1.4%
store_sales.vortex 1.0 vortex-compact 77.67 MB 78.64 MB +994.45 KB +1.3%
catalog_sales.vortex 1.0 vortex-compact 59.15 MB 59.69 MB +559.19 KB +0.9%
web_returns.vortex 1.0 vortex-compact 2.97 MB 2.99 MB +25.26 KB +0.8%
store_returns.vortex 1.0 vortex-compact 9.28 MB 9.35 MB +76.58 KB +0.8%
customer.vortex 1.0 vortex-compact 3.27 MB 3.29 MB +18.65 KB +0.6%
catalog_returns.vortex 1.0 vortex-compact 5.98 MB 6.01 MB +28.70 KB +0.5%
customer_address.vortex 1.0 vortex-compact 546.29 KB 547.94 KB +1.65 KB +0.3%
store_sales.vortex 1.0 vortex-file-compressed 96.78 MB 97.05 MB +279.78 KB +0.3%
catalog_page.vortex 1.0 vortex-file-compressed 601.56 KB 603.02 KB +1.45 KB +0.2%
catalog_page.vortex 1.0 vortex-compact 354.04 KB 354.23 KB +192 B +0.1%
web_returns.vortex 1.0 vortex-file-compressed 3.46 MB 3.46 MB 1.98 KB -0.1%
catalog_sales.vortex 1.0 vortex-file-compressed 69.41 MB 69.29 MB 121.83 KB -0.2%
customer.vortex 1.0 vortex-file-compressed 4.49 MB 4.48 MB 9.59 KB -0.2%
store_returns.vortex 1.0 vortex-file-compressed 11.10 MB 11.07 MB 37.48 KB -0.3%
catalog_returns.vortex 1.0 vortex-file-compressed 7.28 MB 7.20 MB 89.22 KB -1.2%
customer_address.vortex 1.0 vortex-file-compressed 992.07 KB 980.09 KB 11.98 KB -1.2%
time_dim.vortex 1.0 vortex-file-compressed 673.29 KB 645.93 KB 27.36 KB -4.1%

Totals:

  • vortex-compact: 206.62 MB → 209.56 MB (+1.4%)
  • vortex-file-compressed: 269.55 MB → 271.03 MB (+0.6%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +11.0%
Vortex (geomean): 1.145x ➖
Parquet (geomean): 1.031x ➖
Shifts: Parquet (control) +3.1% · Median polish +2.6%


datafusion / vortex-file-compressed (1.489x ❌, 0↑ 6↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 64122380 37630210 1.70
fineweb_q01/datafusion:vortex-file-compressed 🚨 712292388 490713877 1.45
fineweb_q02/datafusion:vortex-file-compressed 🚨 617417992 446633079 1.38
fineweb_q03/datafusion:vortex-file-compressed 1420059828 1380621016 1.03
fineweb_q04/datafusion:vortex-file-compressed 1698911677 1360698639 1.25
fineweb_q05/datafusion:vortex-file-compressed 🚨 2030485248 1341155188 1.51
fineweb_q06/datafusion:vortex-file-compressed 1736443150 1455480076 1.19
fineweb_q07/datafusion:vortex-file-compressed 🚨 1906112959 1322894129 1.44
fineweb_q08/datafusion:vortex-file-compressed 🚨 1651253492 525161289 3.14
datafusion / vortex-compact (1.092x ➖, 0↑ 2↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 62540620 38785068 1.61
fineweb_q01/datafusion:vortex-compact 🚨 737531633 522675272 1.41
fineweb_q02/datafusion:vortex-compact 685953375 626097096 1.10
fineweb_q03/datafusion:vortex-compact 1757160908 1875760321 0.94
fineweb_q04/datafusion:vortex-compact 2131151782 2274928883 0.94
fineweb_q05/datafusion:vortex-compact 1607087690 1726614352 0.93
fineweb_q06/datafusion:vortex-compact 1434872085 1409066538 1.02
fineweb_q07/datafusion:vortex-compact 1301183329 1313091528 0.99
fineweb_q08/datafusion:vortex-compact 426558408 395467638 1.08
datafusion / parquet (1.038x ➖, 0↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1222689106 1021928320 1.20
fineweb_q01/datafusion:parquet 1834132168 1988131736 0.92
fineweb_q02/datafusion:parquet 1904323240 2161310820 0.88
fineweb_q03/datafusion:parquet 1848906695 1737987212 1.06
fineweb_q04/datafusion:parquet 1923056262 1762211000 1.09
fineweb_q05/datafusion:parquet 1855345510 1776514235 1.04
fineweb_q06/datafusion:parquet 1948694005 1873834627 1.04
fineweb_q07/datafusion:parquet 2089887718 1906287748 1.10
fineweb_q08/datafusion:parquet 1802278210 1731825690 1.04
duckdb / vortex-file-compressed (1.052x ➖, 0↑ 2↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 79440135 88503854 0.90
fineweb_q01/duckdb:vortex-file-compressed 🚨 736535918 564565594 1.30
fineweb_q02/duckdb:vortex-file-compressed 🚨 581929969 438739301 1.33
fineweb_q03/duckdb:vortex-file-compressed 1600886374 1564257016 1.02
fineweb_q04/duckdb:vortex-file-compressed 1569541636 1658170825 0.95
fineweb_q05/duckdb:vortex-file-compressed 1444189984 1667535089 0.87
fineweb_q06/duckdb:vortex-file-compressed 1835980602 1699410737 1.08
fineweb_q07/duckdb:vortex-file-compressed 1526522523 1493541993 1.02
fineweb_q08/duckdb:vortex-file-compressed 694533610 634677859 1.09
duckdb / vortex-compact (1.005x ➖, 0↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 84367680 79736490 1.06
fineweb_q01/duckdb:vortex-compact 578153247 540750905 1.07
fineweb_q02/duckdb:vortex-compact 538539574 541245238 1.00
fineweb_q03/duckdb:vortex-compact 1648819700 1715183347 0.96
fineweb_q04/duckdb:vortex-compact 1707943336 1847461929 0.92
fineweb_q05/duckdb:vortex-compact 1490732585 1596033010 0.93
fineweb_q06/duckdb:vortex-compact 1656244814 1557973411 1.06
fineweb_q07/duckdb:vortex-compact 1363112527 1418922386 0.96
fineweb_q08/duckdb:vortex-compact 501372242 458239043 1.09
duckdb / parquet (1.024x ➖, 0↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1152620481 1178247040 0.98
fineweb_q01/duckdb:parquet 1716094872 1630545816 1.05
fineweb_q02/duckdb:parquet 1669073580 1621306869 1.03
fineweb_q03/duckdb:parquet 4199620102 4066682841 1.03
fineweb_q04/duckdb:parquet 1894989292 1900652804 1.00
fineweb_q05/duckdb:parquet 2992500995 2723440873 1.10
fineweb_q06/duckdb:parquet 3564583781 3539138732 1.01
fineweb_q07/duckdb:parquet 4130760257 3988981977 1.04
fineweb_q08/duckdb:parquet 1102277648 1110921971 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +61.2% +8.2% +49.0% +262.0% ➖ noise
0 datafusion:vortex-file-compressed +70.4% +8.2% +57.5% +175.2% ➖ noise
0 duckdb:vortex-compact +5.8% +8.2% -2.2% +57.4% ➖ noise
0 duckdb:vortex-file-compressed -10.2% +8.2% -17.0% +48.0% ➖ noise
1 datafusion:vortex-compact +41.1% -1.5% +43.2% +68.2% ➖ noise
1 datafusion:vortex-file-compressed +45.2% -1.5% +47.3% +83.9% ➖ noise
1 duckdb:vortex-compact +6.9% -1.5% +8.5% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +30.5% -1.5% +32.4% +30.0% 🚨 regression
2 datafusion:vortex-compact +9.6% -4.8% +15.0% +30.0% ➖ noise
2 datafusion:vortex-file-compressed +38.2% -4.8% +45.1% +39.6% 🚨 regression
2 duckdb:vortex-compact -0.5% -4.8% +4.5% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +32.6% -4.8% +39.3% +30.0% 🚨 regression
3 datafusion:vortex-compact -6.3% +4.8% -10.6% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +2.9% +4.8% -1.9% +30.0% ➖ noise
3 duckdb:vortex-compact -3.9% +4.8% -8.3% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +2.3% +4.8% -2.4% +30.0% ➖ noise
4 datafusion:vortex-compact -6.3% +4.3% -10.2% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +24.9% +4.3% +19.7% +49.5% ➖ noise
4 duckdb:vortex-compact -7.6% +4.3% -11.4% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -5.3% +4.3% -9.3% +30.0% ➖ noise
5 datafusion:vortex-compact -6.9% +7.1% -13.1% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +51.4% +7.1% +41.3% +56.7% ➖ noise
5 duckdb:vortex-compact -6.6% +7.1% -12.8% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -13.4% +7.1% -19.2% +30.0% ➖ noise
6 datafusion:vortex-compact +1.8% +2.3% -0.5% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +19.3% +2.3% +16.6% +149.1% ➖ noise
6 duckdb:vortex-compact +6.3% +2.3% +3.9% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +8.0% +2.3% +5.6% +30.0% ➖ noise
7 datafusion:vortex-compact -0.9% +6.5% -7.0% +34.1% ➖ noise
7 datafusion:vortex-file-compressed +44.1% +6.5% +35.2% +96.4% ➖ noise
7 duckdb:vortex-compact -3.9% +6.5% -9.8% +34.2% ➖ noise
7 duckdb:vortex-file-compressed +2.2% +6.5% -4.1% +34.1% ➖ noise
8 datafusion:vortex-compact +7.9% +1.6% +6.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +214.4% +1.6% +209.4% +92.6% 🚨 regression
8 duckdb:vortex-compact +9.4% +1.6% +7.7% +33.8% ➖ noise
8 duckdb:vortex-file-compressed +9.4% +1.6% +7.7% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 1.792x ❌
Parquet (geomean): 1.002x ➖


unknown / unknown (1.210x ❌, 4↑ 11↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 3047299 2580322 1.18
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1277521 1285468 0.99
random-access/feature-vectors/correlated/parquet-tokio-local-disk 11776038935 11270783953 1.04
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11342449860 11173990391 1.02
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚨 69995273 9358591 7.48
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚨 66949840 7551741 8.87
random-access/feature-vectors/uniform/lance-tokio-local-disk 1446951 1496365 0.97
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2332634 2379132 0.98
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11141258189 11164346140 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11088384059 11189701282 0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚨 68964387 15345123 4.49
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚨 68965395 15464865 4.46
random-access/lance-tokio-local-disk 735216 746639 0.98
random-access/lance-tokio-local-disk-footer 1320623 1346753 0.98
random-access/nested-lists/correlated/lance-tokio-local-disk 265266 260884 1.02
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 678566 694624 0.98
random-access/nested-lists/correlated/parquet-tokio-local-disk 132958657 138703247 0.96
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 132437328 138626969 0.96
random-access/nested-lists/correlated/vortex-tokio-local-disk 704652 724062 0.97
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 774067 743155 1.04
random-access/nested-lists/uniform/lance-tokio-local-disk 1142714 1188176 0.96
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1601579 1653604 0.97
random-access/nested-lists/uniform/parquet-tokio-local-disk 134799016 138693088 0.97
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 132740629 138822631 0.96
random-access/nested-lists/uniform/vortex-tokio-local-disk 2569767 2505107 1.03
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2622914 2652476 0.99
random-access/nested-structs/correlated/lance-tokio-local-disk 427036 434581 0.98
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 629734 642297 0.98
random-access/nested-structs/correlated/parquet-tokio-local-disk 27143138 25578766 1.06
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 27174142 25642294 1.06
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚨 1598486 922411 1.73
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚨 1760889 931471 1.89
random-access/nested-structs/uniform/lance-tokio-local-disk 2756976 2874740 0.96
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3002010 3104769 0.97
random-access/nested-structs/uniform/parquet-tokio-local-disk 26214890 26131543 1.00
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 27270091 26138048 1.04
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚨 3688616 1904865 1.94
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 🚨 3978129 1856809 2.14
random-access/parquet-tokio-local-disk 182520670 186481902 0.98
random-access/parquet-tokio-local-disk-footer 182177525 184138483 0.99
random-access/taxi/correlated/lance-tokio-local-disk 952888 982342 0.97
random-access/taxi/correlated/lance-tokio-local-disk-footer 1624045 1660268 0.98
random-access/taxi/correlated/parquet-tokio-local-disk 268132666 269687751 0.99
random-access/taxi/correlated/parquet-tokio-local-disk-footer 270373418 266356364 1.02
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 2308148 2856351 0.81
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 2416357 3022653 0.80
random-access/taxi/uniform/lance-tokio-local-disk 8466739 8640084 0.98
random-access/taxi/uniform/lance-tokio-local-disk-footer 9058287 9374200 0.97
random-access/taxi/uniform/parquet-tokio-local-disk 286461582 284266627 1.01
random-access/taxi/uniform/parquet-tokio-local-disk-footer 287423795 285395259 1.01
random-access/taxi/uniform/vortex-tokio-local-disk 🚨 12145866 5831718 2.08
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚨 11385052 5830814 1.95
random-access/vortex-tokio-local-disk 🚀 1697227 2007749 0.85
random-access/vortex-tokio-local-disk-footer 🚀 1759208 1999314 0.88

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.8%
Vortex (geomean): 0.971x ➖
Parquet (geomean): 0.989x ➖
Shifts: Parquet (control) -1.1% · Median polish -1.5%


duckdb / vortex-file-compressed (0.981x ➖, 0↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10846900 10916627 0.99
statpopgen_q01/duckdb:vortex-file-compressed 45403993 46660979 0.97
statpopgen_q02/duckdb:vortex-file-compressed 1294752871 1320698010 0.98
statpopgen_q03/duckdb:vortex-file-compressed 2994470037 3101988019 0.97
statpopgen_q04/duckdb:vortex-file-compressed 3047024999 3046118618 1.00
statpopgen_q05/duckdb:vortex-file-compressed 1395334960 1372874588 1.02
statpopgen_q06/duckdb:vortex-file-compressed 2100780591 2057604097 1.02
statpopgen_q07/duckdb:vortex-file-compressed 316041194 337537209 0.94
statpopgen_q08/duckdb:vortex-file-compressed 335090012 364093338 0.92
statpopgen_q09/duckdb:vortex-file-compressed 2867643174 2871288846 1.00
statpopgen_q10/duckdb:vortex-file-compressed 4601822889 4622295667 1.00
duckdb / vortex-compact (0.961x ➖, 2↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11158008 10744867 1.04
statpopgen_q01/duckdb:vortex-compact 165798079 172010423 0.96
statpopgen_q02/duckdb:vortex-compact 1810045370 1805820506 1.00
statpopgen_q03/duckdb:vortex-compact 3494561814 3461356611 1.01
statpopgen_q04/duckdb:vortex-compact 3519911442 3495731995 1.01
statpopgen_q05/duckdb:vortex-compact 1773130509 1808046134 0.98
statpopgen_q06/duckdb:vortex-compact 2660032181 2672504921 1.00
statpopgen_q07/duckdb:vortex-compact 🚀 738446890 927886292 0.80
statpopgen_q08/duckdb:vortex-compact 🚀 758078313 953852757 0.79
statpopgen_q09/duckdb:vortex-compact 3370502158 3325253444 1.01
statpopgen_q10/duckdb:vortex-compact 5435127077 5361653955 1.01
duckdb / parquet (0.989x ➖, 0↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 304924931 313379487 0.97
statpopgen_q01/duckdb:parquet 394861818 389158603 1.01
statpopgen_q02/duckdb:parquet 978505688 1001486196 0.98
statpopgen_q03/duckdb:parquet 1461207824 1482952967 0.99
statpopgen_q04/duckdb:parquet 1468401129 1514390053 0.97
statpopgen_q05/duckdb:parquet 991068837 1015731815 0.98
statpopgen_q06/duckdb:parquet 1474990900 1472452209 1.00
statpopgen_q07/duckdb:parquet 1854266762 1876710012 0.99
statpopgen_q08/duckdb:parquet 1862434100 1870576184 1.00
statpopgen_q09/duckdb:parquet 1355969428 1363421737 0.99
statpopgen_q10/duckdb:parquet 2640805163 2627124697 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +3.8% -2.7% +6.7% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -0.6% -2.7% +2.1% +10.0% ➖ noise
1 duckdb:vortex-compact -3.6% +1.5% -5.0% +10.6% ➖ noise
1 duckdb:vortex-file-compressed -2.7% +1.5% -4.1% +205.2% ➖ noise
2 duckdb:vortex-compact +0.2% -2.3% +2.6% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -2.0% -2.3% +0.3% +10.0% ➖ noise
3 duckdb:vortex-compact +1.0% -1.5% +2.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -3.5% -1.5% -2.0% +10.0% ➖ noise
4 duckdb:vortex-compact +0.7% -3.0% +3.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.0% -3.0% +3.2% +10.0% ➖ noise
5 duckdb:vortex-compact -1.9% -2.4% +0.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.6% -2.4% +4.2% +10.0% ➖ noise
6 duckdb:vortex-compact -0.5% +0.2% -0.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +2.1% +0.2% +1.9% +10.0% ➖ noise
7 duckdb:vortex-compact -20.4% -1.2% -19.5% +10.0% ✅ faster
7 duckdb:vortex-file-compressed -6.4% -1.2% -5.2% +10.0% ➖ noise
8 duckdb:vortex-compact -20.5% -0.4% -20.2% +10.0% ✅ faster
8 duckdb:vortex-file-compressed -8.0% -0.4% -7.6% +10.0% ➖ noise
9 duckdb:vortex-compact +1.4% -0.5% +1.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.1% -0.5% +0.4% +10.0% ➖ noise
10 duckdb:vortex-compact +1.4% +0.5% +0.8% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.4% +0.5% -1.0% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

File Size Changes (2 files changed, -2.3% overall, 1↑ 1↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 955.21 MB 956.50 MB +1.29 MB +0.1%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.78 GB 1.71 GB 65.30 MB -3.6%

Totals:

  • vortex-compact: 955.47 MB → 956.76 MB (+0.1%)
  • vortex-file-compressed: 1.78 GB → 1.71 GB (-3.6%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: Likely regression (low confidence)
Attributed Vortex impact: +13.7%
Vortex (geomean): 1.207x ❌
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish +4.7%


datafusion / vortex-file-compressed (1.224x ❌, 0↑ 11↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 424457340 396357015 1.07
tpch_q02/datafusion:vortex-file-compressed 🚨 126693435 114449497 1.11
tpch_q03/datafusion:vortex-file-compressed 🚨 241020005 213909447 1.13
tpch_q04/datafusion:vortex-file-compressed 🚨 145433620 107593448 1.35
tpch_q05/datafusion:vortex-file-compressed 404779906 388772210 1.04
tpch_q06/datafusion:vortex-file-compressed 🚨 89661040 42249784 2.12
tpch_q07/datafusion:vortex-file-compressed 585131237 571598725 1.02
tpch_q08/datafusion:vortex-file-compressed 391281433 378934452 1.03
tpch_q09/datafusion:vortex-file-compressed 684684409 673852097 1.02
tpch_q10/datafusion:vortex-file-compressed 🚨 280941440 248507366 1.13
tpch_q11/datafusion:vortex-file-compressed 92028592 86715690 1.06
tpch_q12/datafusion:vortex-file-compressed 🚨 204866502 118701394 1.73
tpch_q13/datafusion:vortex-file-compressed 224201853 219600703 1.02
tpch_q14/datafusion:vortex-file-compressed 🚨 108315520 57052975 1.90
tpch_q15/datafusion:vortex-file-compressed 🚨 166583115 107760700 1.55
tpch_q16/datafusion:vortex-file-compressed 🚨 89513335 77380069 1.16
tpch_q17/datafusion:vortex-file-compressed 668118157 642801685 1.04
tpch_q18/datafusion:vortex-file-compressed 884998024 881867171 1.00
tpch_q19/datafusion:vortex-file-compressed 🚨 191372715 94375698 2.03
tpch_q20/datafusion:vortex-file-compressed 🚨 203500855 171215488 1.19
tpch_q21/datafusion:vortex-file-compressed 709704192 680044151 1.04
tpch_q22/datafusion:vortex-file-compressed 64035154 60679359 1.06
datafusion / vortex-compact (1.217x ❌, 0↑ 10↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 576498705 441266413 1.31
tpch_q02/datafusion:vortex-compact 125268703 121672630 1.03
tpch_q03/datafusion:vortex-compact 🚨 254761089 214563706 1.19
tpch_q04/datafusion:vortex-compact 🚨 173830687 119732294 1.45
tpch_q05/datafusion:vortex-compact 421289898 392615039 1.07
tpch_q06/datafusion:vortex-compact 🚨 114139051 63684533 1.79
tpch_q07/datafusion:vortex-compact 618287064 590929203 1.05
tpch_q08/datafusion:vortex-compact 418949964 383412309 1.09
tpch_q09/datafusion:vortex-compact 705794349 675410909 1.04
tpch_q10/datafusion:vortex-compact 🚨 327621654 271903005 1.20
tpch_q11/datafusion:vortex-compact 94069414 90832231 1.04
tpch_q12/datafusion:vortex-compact 🚨 270931465 165234310 1.64
tpch_q13/datafusion:vortex-compact 277896015 269436483 1.03
tpch_q14/datafusion:vortex-compact 🚨 128028121 73924811 1.73
tpch_q15/datafusion:vortex-compact 🚨 224139277 163815279 1.37
tpch_q16/datafusion:vortex-compact 89876439 83839202 1.07
tpch_q17/datafusion:vortex-compact 672656972 644247273 1.04
tpch_q18/datafusion:vortex-compact 911491244 879005572 1.04
tpch_q19/datafusion:vortex-compact 🚨 246794133 136065294 1.81
tpch_q20/datafusion:vortex-compact 🚨 230020118 195630084 1.18
tpch_q21/datafusion:vortex-compact 762444725 695835649 1.10
tpch_q22/datafusion:vortex-compact 74462257 71643271 1.04
datafusion / parquet (1.001x ➖, 0↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 409650975 415321895 0.99
tpch_q02/datafusion:parquet 185375335 185162820 1.00
tpch_q03/datafusion:parquet 298158999 296387511 1.01
tpch_q04/datafusion:parquet 137033099 136408895 1.00
tpch_q05/datafusion:parquet 452791323 452303950 1.00
tpch_q06/datafusion:parquet 118616708 123601074 0.96
tpch_q07/datafusion:parquet 631140511 627750675 1.01
tpch_q08/datafusion:parquet 499439949 500131804 1.00
tpch_q09/datafusion:parquet 780167204 777752500 1.00
tpch_q10/datafusion:parquet 509725238 510063897 1.00
tpch_q11/datafusion:parquet 132543971 132249632 1.00
tpch_q12/datafusion:parquet 202000578 215355984 0.94
tpch_q13/datafusion:parquet 338682920 339084153 1.00
tpch_q14/datafusion:parquet 160945260 163163795 0.99
tpch_q15/datafusion:parquet 255870137 243308051 1.05
tpch_q16/datafusion:parquet 138190377 135381032 1.02
tpch_q17/datafusion:parquet 697653317 694350608 1.00
tpch_q18/datafusion:parquet 900239147 888296855 1.01
tpch_q19/datafusion:parquet 276423365 269898096 1.02
tpch_q20/datafusion:parquet 309074445 307167718 1.01
tpch_q21/datafusion:parquet 747932684 744745282 1.00
tpch_q22/datafusion:parquet 218330329 215373297 1.01
datafusion / arrow (1.005x ➖, 0↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 590155159 590098634 1.00
tpch_q02/datafusion:arrow 165780155 162637859 1.02
tpch_q03/datafusion:arrow 447591126 446486532 1.00
tpch_q04/datafusion:arrow 338387673 361001020 0.94
tpch_q05/datafusion:arrow 887504066 897303581 0.99
tpch_q06/datafusion:arrow 270377525 265096600 1.02
tpch_q07/datafusion:arrow 1106724766 1112132415 1.00
tpch_q08/datafusion:arrow 1087224009 1085634735 1.00
tpch_q09/datafusion:arrow 1281904694 1281970371 1.00
tpch_q10/datafusion:arrow 588764121 576155635 1.02
tpch_q11/datafusion:arrow 145588340 145113796 1.00
tpch_q12/datafusion:arrow 642226951 641454798 1.00
tpch_q13/datafusion:arrow 506874232 506721553 1.00
tpch_q14/datafusion:arrow 296065196 291369926 1.02
tpch_q15/datafusion:arrow 635616995 629352464 1.01
tpch_q16/datafusion:arrow 105166062 105015270 1.00
tpch_q17/datafusion:arrow 1313518072 1287880890 1.02
tpch_q18/datafusion:arrow 1786996689 1779230690 1.00
tpch_q19/datafusion:arrow 490870501 479807931 1.02
tpch_q20/datafusion:arrow 477550490 465503215 1.03
tpch_q21/datafusion:arrow 2780063006 2764186060 1.01
tpch_q22/datafusion:arrow 141267818 138006930 1.02
duckdb / vortex-file-compressed (1.180x ❌, 0↑ 10↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 218503852 176258617 1.24
tpch_q02/duckdb:vortex-file-compressed 57467377 53361607 1.08
tpch_q03/duckdb:vortex-file-compressed 🚨 146972836 132920835 1.11
tpch_q04/duckdb:vortex-file-compressed 160561005 160514073 1.00
tpch_q05/duckdb:vortex-file-compressed 139456987 131854865 1.06
tpch_q06/duckdb:vortex-file-compressed 🚨 124949343 47886859 2.61
tpch_q07/duckdb:vortex-file-compressed 🚨 177160666 153979345 1.15
tpch_q08/duckdb:vortex-file-compressed 184135009 177712106 1.04
tpch_q09/duckdb:vortex-file-compressed 343920387 337744160 1.02
tpch_q10/duckdb:vortex-file-compressed 🚨 194286434 166008666 1.17
tpch_q11/duckdb:vortex-file-compressed 38490728 35967073 1.07
tpch_q12/duckdb:vortex-file-compressed 🚨 186876370 98534168 1.90
tpch_q13/duckdb:vortex-file-compressed 250185857 248852262 1.01
tpch_q14/duckdb:vortex-file-compressed 🚨 123527182 73023668 1.69
tpch_q15/duckdb:vortex-file-compressed 🚨 110141407 96406258 1.14
tpch_q16/duckdb:vortex-file-compressed 85322987 81135711 1.05
tpch_q17/duckdb:vortex-file-compressed 🚨 116891014 103065712 1.13
tpch_q18/duckdb:vortex-file-compressed 305996475 305283925 1.00
tpch_q19/duckdb:vortex-file-compressed 🚨 122391159 90542438 1.35
tpch_q20/duckdb:vortex-file-compressed 176350691 166064201 1.06
tpch_q21/duckdb:vortex-file-compressed 587777842 600779226 0.98
tpch_q22/duckdb:vortex-file-compressed 77498295 77293159 1.00
duckdb / vortex-compact (1.209x ❌, 0↑ 15↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 393092519 228103163 1.72
tpch_q02/duckdb:vortex-compact 64649287 58827341 1.10
tpch_q03/duckdb:vortex-compact 🚨 173645169 139984627 1.24
tpch_q04/duckdb:vortex-compact 🚨 198267177 178381713 1.11
tpch_q05/duckdb:vortex-compact 🚨 166487197 146983823 1.13
tpch_q06/duckdb:vortex-compact 🚨 163514147 83990273 1.95
tpch_q07/duckdb:vortex-compact 🚨 246051611 204757235 1.20
tpch_q08/duckdb:vortex-compact 🚨 212749519 188673881 1.13
tpch_q09/duckdb:vortex-compact 389752888 363732690 1.07
tpch_q10/duckdb:vortex-compact 🚨 242038709 185490033 1.30
tpch_q11/duckdb:vortex-compact 43945285 41101318 1.07
tpch_q12/duckdb:vortex-compact 🚨 308796670 201418150 1.53
tpch_q13/duckdb:vortex-compact 296408634 296385936 1.00
tpch_q14/duckdb:vortex-compact 🚨 158794720 103403270 1.54
tpch_q15/duckdb:vortex-compact 🚨 140149395 119468603 1.17
tpch_q16/duckdb:vortex-compact 88173250 87696748 1.01
tpch_q17/duckdb:vortex-compact 🚨 135198230 118923615 1.14
tpch_q18/duckdb:vortex-compact 310098346 283914701 1.09
tpch_q19/duckdb:vortex-compact 🚨 147077130 113877697 1.29
tpch_q20/duckdb:vortex-compact 🚨 228553841 206224308 1.11
tpch_q21/duckdb:vortex-compact 🚨 703666283 632706569 1.11
tpch_q22/duckdb:vortex-compact 91760544 90520967 1.01
duckdb / parquet (0.994x ➖, 0↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 258691818 259231501 1.00
tpch_q02/duckdb:parquet 100677598 102484717 0.98
tpch_q03/duckdb:parquet 212086796 210565742 1.01
tpch_q04/duckdb:parquet 133712081 137301132 0.97
tpch_q05/duckdb:parquet 219842455 219601745 1.00
tpch_q06/duckdb:parquet 68678768 66599753 1.03
tpch_q07/duckdb:parquet 178571585 179261796 1.00
tpch_q08/duckdb:parquet 256078483 251857627 1.02
tpch_q09/duckdb:parquet 456799200 460802212 0.99
tpch_q10/duckdb:parquet 605023041 607059544 1.00
tpch_q11/duckdb:parquet 43005751 45666985 0.94
tpch_q12/duckdb:parquet 126880142 124342190 1.02
tpch_q13/duckdb:parquet 424880071 456138608 0.93
tpch_q14/duckdb:parquet 171883277 176470937 0.97
tpch_q15/duckdb:parquet 99568348 98738784 1.01
tpch_q16/duckdb:parquet 158164001 158759807 1.00
tpch_q17/duckdb:parquet 178209577 177281577 1.01
tpch_q18/duckdb:parquet 349112323 348798932 1.00
tpch_q19/duckdb:parquet 277833848 282780582 0.98
tpch_q20/duckdb:parquet 230034335 227665798 1.01
tpch_q21/duckdb:parquet 571619665 576695841 0.99
tpch_q22/duckdb:parquet 293825946 288433294 1.02
duckdb / duckdb (0.998x ➖, 0↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116636702 116715052 1.00
tpch_q02/duckdb:duckdb 45365636 45225673 1.00
tpch_q03/duckdb:duckdb 96811804 96425868 1.00
tpch_q04/duckdb:duckdb 130736329 132179245 0.99
tpch_q05/duckdb:duckdb 109449062 110363937 0.99
tpch_q06/duckdb:duckdb 37008150 37334756 0.99
tpch_q07/duckdb:duckdb 86542659 86344815 1.00
tpch_q08/duckdb:duckdb 110225154 110256321 1.00
tpch_q09/duckdb:duckdb 277321539 279017150 0.99
tpch_q10/duckdb:duckdb 204675006 202734970 1.01
tpch_q11/duckdb:duckdb 15295580 15986410 0.96
tpch_q12/duckdb:duckdb 84853356 84381285 1.01
tpch_q13/duckdb:duckdb 250922850 253209295 0.99
tpch_q14/duckdb:duckdb 70208504 69866086 1.00
tpch_q15/duckdb:duckdb 79061253 78803002 1.00
tpch_q16/duckdb:duckdb 73981543 73819039 1.00
tpch_q17/duckdb:duckdb 85786844 84302753 1.02
tpch_q18/duckdb:duckdb 213756665 213977520 1.00
tpch_q19/duckdb:duckdb 115592477 114619653 1.01
tpch_q20/duckdb:duckdb 112654209 111581997 1.01
tpch_q21/duckdb:duckdb 309974963 299404022 1.04
tpch_q22/duckdb:duckdb 64994906 68797748 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +0.0% -0.8% +0.8% +10.0% ➖ noise
1 datafusion:vortex-compact +30.6% -0.8% +31.7% +10.0% 🚨 regression
1 datafusion:vortex-file-compressed +7.1% -0.8% +7.9% +10.0% ➖ noise
1 duckdb:duckdb -0.1% -0.8% +0.7% +10.0% ➖ noise
1 duckdb:vortex-compact +72.3% -0.8% +73.7% +10.0% 🚨 regression
1 duckdb:vortex-file-compressed +24.0% -0.8% +25.0% +10.0% 🚨 regression
2 datafusion:arrow +1.9% -0.8% +2.8% +10.0% ➖ noise
2 datafusion:vortex-compact +3.0% -0.8% +3.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +10.7% -0.8% +11.6% +10.0% 🚨 regression
2 duckdb:duckdb +0.3% -0.8% +1.1% +10.0% ➖ noise
2 duckdb:vortex-compact +9.9% -0.8% +10.8% +10.0% 🚨 regression
2 duckdb:vortex-file-compressed +7.7% -0.8% +8.6% +10.0% ➖ noise
3 datafusion:arrow +0.2% +0.7% -0.4% +10.0% ➖ noise
3 datafusion:vortex-compact +18.7% +0.7% +18.0% +10.0% 🚨 regression
3 datafusion:vortex-file-compressed +12.7% +0.7% +11.9% +10.0% 🚨 regression
3 duckdb:duckdb +0.4% +0.7% -0.3% +10.0% ➖ noise
3 duckdb:vortex-compact +24.0% +0.7% +23.2% +10.0% 🚨 regression
3 duckdb:vortex-file-compressed +10.6% +0.7% +9.8% +10.0% ➖ noise
4 datafusion:arrow -6.3% -1.1% -5.2% +10.0% ➖ noise
4 datafusion:vortex-compact +45.2% -1.1% +46.8% +10.0% 🚨 regression
4 datafusion:vortex-file-compressed +35.2% -1.1% +36.7% +10.0% 🚨 regression
4 duckdb:duckdb -1.1% -1.1% -0.0% +10.0% ➖ noise
4 duckdb:vortex-compact +11.1% -1.1% +12.4% +10.0% 🚨 regression
4 duckdb:vortex-file-compressed +0.0% -1.1% +1.1% +10.0% ➖ noise
5 datafusion:arrow -1.1% +0.1% -1.2% +10.0% ➖ noise
5 datafusion:vortex-compact +7.3% +0.1% +7.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +4.1% +0.1% +4.0% +10.0% ➖ noise
5 duckdb:duckdb -0.8% +0.1% -0.9% +10.0% ➖ noise
5 duckdb:vortex-compact +13.3% +0.1% +13.1% +10.0% 🚨 regression
5 duckdb:vortex-file-compressed +5.8% +0.1% +5.7% +10.0% ➖ noise
6 datafusion:arrow +2.0% -0.5% +2.5% +10.0% ➖ noise
6 datafusion:vortex-compact +79.2% -0.5% +80.2% +10.0% 🚨 regression
6 datafusion:vortex-file-compressed +112.2% -0.5% +113.3% +10.0% 🚨 regression
6 duckdb:duckdb -0.9% -0.5% -0.4% +10.0% ➖ noise
6 duckdb:vortex-compact +94.7% -0.5% +95.7% +10.0% 🚨 regression
6 duckdb:vortex-file-compressed +160.9% -0.5% +162.3% +10.0% 🚨 regression
7 datafusion:arrow -0.5% +0.1% -0.6% +10.0% ➖ noise
7 datafusion:vortex-compact +4.6% +0.1% +4.5% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +2.4% +0.1% +2.3% +10.0% ➖ noise
7 duckdb:duckdb +0.2% +0.1% +0.2% +10.0% ➖ noise
7 duckdb:vortex-compact +20.2% +0.1% +20.1% +10.0% 🚨 regression
7 duckdb:vortex-file-compressed +15.1% +0.1% +15.0% +10.0% 🚨 regression
8 datafusion:arrow +0.1% +0.8% -0.6% +10.0% ➖ noise
8 datafusion:vortex-compact +9.3% +0.8% +8.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +3.3% +0.8% +2.5% +10.0% ➖ noise
8 duckdb:duckdb -0.0% +0.8% -0.8% +10.0% ➖ noise
8 duckdb:vortex-compact +12.8% +0.8% +11.9% +10.0% 🚨 regression
8 duckdb:vortex-file-compressed +3.6% +0.8% +2.8% +10.0% ➖ noise
9 datafusion:arrow -0.0% -0.3% +0.3% +10.0% ➖ noise
9 datafusion:vortex-compact +4.5% -0.3% +4.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +1.6% -0.3% +1.9% +10.0% ➖ noise
9 duckdb:duckdb -0.6% -0.3% -0.3% +10.0% ➖ noise
9 duckdb:vortex-compact +7.2% -0.3% +7.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.8% -0.3% +2.1% +10.0% ➖ noise
10 datafusion:arrow +2.2% -0.2% +2.4% +10.0% ➖ noise
10 datafusion:vortex-compact +20.5% -0.2% +20.7% +10.0% 🚨 regression
10 datafusion:vortex-file-compressed +13.1% -0.2% +13.3% +10.0% 🚨 regression
10 duckdb:duckdb +1.0% -0.2% +1.2% +10.0% ➖ noise
10 duckdb:vortex-compact +30.5% -0.2% +30.7% +10.0% 🚨 regression
10 duckdb:vortex-file-compressed +17.0% -0.2% +17.3% +10.0% 🚨 regression
11 datafusion:arrow +0.3% -2.8% +3.3% +10.0% ➖ noise
11 datafusion:vortex-compact +3.6% -2.8% +6.6% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +6.1% -2.8% +9.2% +10.0% ➖ noise
11 duckdb:duckdb -4.3% -2.8% -1.5% +10.8% ➖ noise
11 duckdb:vortex-compact +6.9% -2.8% +10.1% +10.0% 🚨 regression
11 duckdb:vortex-file-compressed +7.0% -2.8% +10.2% +10.0% 🚨 regression
12 datafusion:arrow +0.1% -2.2% +2.3% +21.3% ➖ noise
12 datafusion:vortex-compact +64.0% -2.2% +67.6% +10.0% 🚨 regression
12 datafusion:vortex-file-compressed +72.6% -2.2% +76.4% +10.0% 🚨 regression
12 duckdb:duckdb +0.6% -2.2% +2.8% +10.0% ➖ noise
12 duckdb:vortex-compact +53.3% -2.2% +56.7% +10.0% 🚨 regression
12 duckdb:vortex-file-compressed +89.7% -2.2% +93.9% +10.0% 🚨 regression
13 datafusion:arrow +0.0% -3.5% +3.7% +10.0% ➖ noise
13 datafusion:vortex-compact +3.1% -3.5% +6.9% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +2.1% -3.5% +5.8% +10.0% ➖ noise
13 duckdb:duckdb -0.9% -3.5% +2.7% +10.0% ➖ noise
13 duckdb:vortex-compact +0.0% -3.5% +3.7% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.5% -3.5% +4.2% +10.0% ➖ noise
14 datafusion:arrow +1.6% -2.0% +3.7% +10.0% ➖ noise
14 datafusion:vortex-compact +73.2% -2.0% +76.7% +10.0% 🚨 regression
14 datafusion:vortex-file-compressed +89.9% -2.0% +93.7% +10.0% 🚨 regression
14 duckdb:duckdb +0.5% -2.0% +2.5% +10.0% ➖ noise
14 duckdb:vortex-compact +53.6% -2.0% +56.7% +10.0% 🚨 regression
14 duckdb:vortex-file-compressed +69.2% -2.0% +72.6% +10.0% 🚨 regression
15 datafusion:arrow +1.0% +3.0% -1.9% +10.0% ➖ noise
15 datafusion:vortex-compact +36.8% +3.0% +32.9% +10.0% 🚨 regression
15 datafusion:vortex-file-compressed +54.6% +3.0% +50.1% +10.0% 🚨 regression
15 duckdb:duckdb +0.3% +3.0% -2.6% +10.0% ➖ noise
15 duckdb:vortex-compact +17.3% +3.0% +13.9% +10.0% 🚨 regression
15 duckdb:vortex-file-compressed +14.2% +3.0% +10.9% +10.0% 🚨 regression
16 datafusion:arrow +0.1% +0.8% -0.7% +10.0% ➖ noise
16 datafusion:vortex-compact +7.2% +0.8% +6.3% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +15.7% +0.8% +14.7% +10.0% 🚨 regression
16 duckdb:duckdb +0.2% +0.8% -0.6% +10.0% ➖ noise
16 duckdb:vortex-compact +0.5% +0.8% -0.3% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +5.2% +0.8% +4.3% +10.0% ➖ noise
17 datafusion:arrow +2.0% +0.5% +1.5% +10.0% ➖ noise
17 datafusion:vortex-compact +4.4% +0.5% +3.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +3.9% +0.5% +3.4% +10.0% ➖ noise
17 duckdb:duckdb +1.8% +0.5% +1.3% +10.0% ➖ noise
17 duckdb:vortex-compact +13.7% +0.5% +13.1% +10.0% 🚨 regression
17 duckdb:vortex-file-compressed +13.4% +0.5% +12.9% +10.0% 🚨 regression
18 datafusion:arrow +0.4% +0.7% -0.3% +10.0% ➖ noise
18 datafusion:vortex-compact +3.7% +0.7% +3.0% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +0.4% +0.7% -0.4% +10.0% ➖ noise
18 duckdb:duckdb -0.1% +0.7% -0.8% +10.0% ➖ noise
18 duckdb:vortex-compact +9.2% +0.7% +8.4% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +0.2% +0.7% -0.5% +10.0% ➖ noise
19 datafusion:arrow +2.3% +0.3% +2.0% +10.0% ➖ noise
19 datafusion:vortex-compact +81.4% +0.3% +80.8% +10.0% 🚨 regression
19 datafusion:vortex-file-compressed +102.8% +0.3% +102.1% +10.0% 🚨 regression
19 duckdb:duckdb +0.8% +0.3% +0.5% +10.0% ➖ noise
19 duckdb:vortex-compact +29.2% +0.3% +28.8% +10.0% 🚨 regression
19 duckdb:vortex-file-compressed +35.2% +0.3% +34.8% +10.0% 🚨 regression
20 datafusion:arrow +2.6% +0.8% +1.7% +10.0% ➖ noise
20 datafusion:vortex-compact +17.6% +0.8% +16.6% +10.0% 🚨 regression
20 datafusion:vortex-file-compressed +18.9% +0.8% +17.9% +10.0% 🚨 regression
20 duckdb:duckdb +1.0% +0.8% +0.1% +10.0% ➖ noise
20 duckdb:vortex-compact +10.8% +0.8% +9.9% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +6.2% +0.8% +5.3% +10.0% ➖ noise
21 datafusion:arrow +0.6% -0.2% +0.8% +10.0% ➖ noise
21 datafusion:vortex-compact +9.6% -0.2% +9.8% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +4.4% -0.2% +4.6% +10.0% ➖ noise
21 duckdb:duckdb +3.5% -0.2% +3.8% +10.0% ➖ noise
21 duckdb:vortex-compact +11.2% -0.2% +11.5% +10.0% 🚨 regression
21 duckdb:vortex-file-compressed -2.2% -0.2% -1.9% +10.0% ➖ noise
22 datafusion:arrow +2.4% +1.6% +0.7% +10.0% ➖ noise
22 datafusion:vortex-compact +3.9% +1.6% +2.3% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +5.5% +1.6% +3.8% +10.0% ➖ noise
22 duckdb:duckdb -5.5% +1.6% -7.0% +10.0% ➖ noise
22 duckdb:vortex-compact +1.4% +1.6% -0.2% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +0.3% +1.6% -1.3% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

File Size Changes (44 files changed, +0.8% overall, 41↑ 3↓)
File Scale Format Base HEAD Change %
partsupp_0.vortex 10.0 vortex-file-compressed 180.30 MB 185.56 MB +5.26 MB +2.9%
partsupp_1.vortex 10.0 vortex-file-compressed 180.47 MB 185.74 MB +5.26 MB +2.9%
lineitem_6.vortex 10.0 vortex-file-compressed 132.98 MB 135.88 MB +2.90 MB +2.2%
lineitem_3.vortex 10.0 vortex-file-compressed 133.48 MB 135.86 MB +2.39 MB +1.8%
lineitem_5.vortex 10.0 vortex-file-compressed 133.59 MB 135.97 MB +2.38 MB +1.8%
lineitem_7.vortex 10.0 vortex-file-compressed 133.73 MB 135.76 MB +2.03 MB +1.5%
lineitem_8.vortex 10.0 vortex-file-compressed 133.78 MB 135.80 MB +2.02 MB +1.5%
lineitem_1.vortex 10.0 vortex-file-compressed 133.98 MB 135.84 MB +1.86 MB +1.4%
lineitem_2.vortex 10.0 vortex-file-compressed 134.09 MB 135.79 MB +1.70 MB +1.3%
lineitem_4.vortex 10.0 vortex-file-compressed 134.13 MB 135.83 MB +1.69 MB +1.3%
lineitem_12.vortex 10.0 vortex-file-compressed 134.22 MB 135.91 MB +1.69 MB +1.3%
lineitem_10.vortex 10.0 vortex-file-compressed 134.21 MB 135.89 MB +1.68 MB +1.3%
lineitem_0.vortex 10.0 vortex-file-compressed 134.36 MB 135.86 MB +1.50 MB +1.1%
lineitem_9.vortex 10.0 vortex-file-compressed 134.36 MB 135.68 MB +1.32 MB +1.0%
lineitem_11.vortex 10.0 vortex-file-compressed 134.56 MB 135.72 MB +1.16 MB +0.9%
lineitem_12.vortex 10.0 vortex-compact 100.42 MB 101.09 MB +687.70 KB +0.7%
lineitem_0.vortex 10.0 vortex-compact 100.39 MB 101.06 MB +686.13 KB +0.7%
lineitem_3.vortex 10.0 vortex-compact 100.41 MB 101.08 MB +682.23 KB +0.7%
lineitem_4.vortex 10.0 vortex-compact 100.35 MB 101.02 MB +681.75 KB +0.7%
lineitem_9.vortex 10.0 vortex-compact 100.26 MB 100.91 MB +665.58 KB +0.6%
lineitem_5.vortex 10.0 vortex-compact 100.49 MB 101.13 MB +652.68 KB +0.6%
lineitem_10.vortex 10.0 vortex-compact 100.42 MB 101.05 MB +646.25 KB +0.6%
lineitem_7.vortex 10.0 vortex-compact 100.38 MB 101.01 MB +645.68 KB +0.6%
lineitem_11.vortex 10.0 vortex-compact 100.32 MB 100.95 MB +644.11 KB +0.6%
lineitem_2.vortex 10.0 vortex-compact 100.38 MB 101.01 MB +639.65 KB +0.6%
lineitem_6.vortex 10.0 vortex-compact 100.48 MB 101.08 MB +624.16 KB +0.6%
lineitem_8.vortex 10.0 vortex-compact 100.39 MB 101.00 MB +620.62 KB +0.6%
lineitem_1.vortex 10.0 vortex-compact 100.44 MB 101.04 MB +612.48 KB +0.6%
part_0.vortex 10.0 vortex-compact 18.06 MB 18.11 MB +53.14 KB +0.3%
part_1.vortex 10.0 vortex-compact 18.06 MB 18.11 MB +52.95 KB +0.3%
orders_2.vortex 10.0 vortex-compact 114.55 MB 114.79 MB +242.98 KB +0.2%
orders_1.vortex 10.0 vortex-compact 114.53 MB 114.77 MB +241.27 KB +0.2%
orders_0.vortex 10.0 vortex-compact 114.56 MB 114.80 MB +241.10 KB +0.2%
part_1.vortex 10.0 vortex-file-compressed 26.92 MB 26.96 MB +45.41 KB +0.2%
part_0.vortex 10.0 vortex-file-compressed 26.95 MB 27.00 MB +45.41 KB +0.2%
supplier_0.vortex 10.0 vortex-compact 4.72 MB 4.72 MB +3.35 KB +0.1%
customer_0.vortex 10.0 vortex-compact 74.01 MB 74.06 MB +47.65 KB +0.1%
supplier_0.vortex 10.0 vortex-file-compressed 6.67 MB 6.67 MB +4.29 KB +0.1%
customer_0.vortex 10.0 vortex-file-compressed 104.54 MB 104.60 MB +60.91 KB +0.1%
partsupp_1.vortex 10.0 vortex-compact 126.64 MB 126.69 MB +54.83 KB +0.0%
partsupp_0.vortex 10.0 vortex-compact 126.66 MB 126.71 MB +54.44 KB +0.0%
orders_1.vortex 10.0 vortex-file-compressed 163.75 MB 162.25 MB 1.49 MB -0.9%
orders_2.vortex 10.0 vortex-file-compressed 163.59 MB 162.10 MB 1.49 MB -0.9%
orders_0.vortex 10.0 vortex-file-compressed 163.53 MB 162.04 MB 1.49 MB -0.9%

Totals:

  • vortex-compact: 1.97 GB → 1.98 GB (+0.5%)
  • vortex-file-compressed: 2.69 GB → 2.72 GB (+1.1%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.8%
Vortex (geomean): 1.095x ➖
Parquet (geomean): 1.006x ➖
Shifts: Parquet (control) +0.6% · Median polish +0.6%


datafusion / vortex-file-compressed (1.089x ➖, 0↑ 10↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1893075 1860198 1.02
clickbench_q01/datafusion:vortex-file-compressed 🚨 16273514 14107604 1.15
clickbench_q02/datafusion:vortex-file-compressed 35895144 36015616 1.00
clickbench_q03/datafusion:vortex-file-compressed 42512562 39705815 1.07
clickbench_q04/datafusion:vortex-file-compressed 312939619 308101973 1.02
clickbench_q05/datafusion:vortex-file-compressed 318592847 317066595 1.00
clickbench_q06/datafusion:vortex-file-compressed 1931040 1899039 1.02
clickbench_q07/datafusion:vortex-file-compressed 🚨 21910762 18824232 1.16
clickbench_q08/datafusion:vortex-file-compressed 401324261 380865010 1.05
clickbench_q09/datafusion:vortex-file-compressed 584704657 560399683 1.04
clickbench_q10/datafusion:vortex-file-compressed 🚨 104762358 72512262 1.44
clickbench_q11/datafusion:vortex-file-compressed 🚨 123765802 84980421 1.46
clickbench_q12/datafusion:vortex-file-compressed 283498336 268263884 1.06
clickbench_q13/datafusion:vortex-file-compressed 453315865 412591926 1.10
clickbench_q14/datafusion:vortex-file-compressed 277302374 259811808 1.07
clickbench_q15/datafusion:vortex-file-compressed 373895717 358931430 1.04
clickbench_q16/datafusion:vortex-file-compressed 711289621 684172202 1.04
clickbench_q17/datafusion:vortex-file-compressed 700871385 679885984 1.03
clickbench_q18/datafusion:vortex-file-compressed 1453126165 1366512302 1.06
clickbench_q19/datafusion:vortex-file-compressed 27857860 25871541 1.08
clickbench_q20/datafusion:vortex-file-compressed 362505210 353840145 1.02
clickbench_q21/datafusion:vortex-file-compressed 416734811 411730159 1.01
clickbench_q22/datafusion:vortex-file-compressed 525293331 501436886 1.05
clickbench_q23/datafusion:vortex-file-compressed 848327546 773560452 1.10
clickbench_q24/datafusion:vortex-file-compressed 🚨 71086235 55510715 1.28
clickbench_q25/datafusion:vortex-file-compressed 🚨 86905276 72131811 1.20
clickbench_q26/datafusion:vortex-file-compressed 🚨 69045583 47472776 1.45
clickbench_q27/datafusion:vortex-file-compressed 811581143 803681953 1.01
clickbench_q28/datafusion:vortex-file-compressed 6646573723 6759380361 0.98
clickbench_q29/datafusion:vortex-file-compressed 229806390 242188264 0.95
clickbench_q30/datafusion:vortex-file-compressed 🚨 287519315 243559338 1.18
clickbench_q31/datafusion:vortex-file-compressed 🚨 383075302 275082414 1.39
clickbench_q32/datafusion:vortex-file-compressed 🚨 1349257991 1168878832 1.15
clickbench_q33/datafusion:vortex-file-compressed 1414423960 1350512558 1.05
clickbench_q34/datafusion:vortex-file-compressed 1401457769 1373460337 1.02
clickbench_q35/datafusion:vortex-file-compressed 528498971 507187877 1.04
clickbench_q36/datafusion:vortex-file-compressed 78608062 81663280 0.96
clickbench_q37/datafusion:vortex-file-compressed 40946487 38891402 1.05
clickbench_q38/datafusion:vortex-file-compressed 24495225 22854036 1.07
clickbench_q39/datafusion:vortex-file-compressed 145289029 142120276 1.02
clickbench_q40/datafusion:vortex-file-compressed 20342202 19312868 1.05
clickbench_q41/datafusion:vortex-file-compressed 17734302 16443139 1.08
clickbench_q42/datafusion:vortex-file-compressed 19735716 18871352 1.05
datafusion / parquet (1.007x ➖, 0↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1952671 1939696 1.01
clickbench_q01/datafusion:parquet 20861904 20562932 1.01
clickbench_q02/datafusion:parquet 57190378 53289992 1.07
clickbench_q03/datafusion:parquet 45679429 46274325 0.99
clickbench_q04/datafusion:parquet 329175928 329613000 1.00
clickbench_q05/datafusion:parquet 368617085 363756460 1.01
clickbench_q06/datafusion:parquet 1830655 1934798 0.95
clickbench_q07/datafusion:parquet 27066360 25230749 1.07
clickbench_q08/datafusion:parquet 413143530 407425117 1.01
clickbench_q09/datafusion:parquet 637344105 632086569 1.01
clickbench_q10/datafusion:parquet 109720207 113237904 0.97
clickbench_q11/datafusion:parquet 134619451 132721809 1.01
clickbench_q12/datafusion:parquet 359873585 357231199 1.01
clickbench_q13/datafusion:parquet 509000166 495916641 1.03
clickbench_q14/datafusion:parquet 359953199 361238646 1.00
clickbench_q15/datafusion:parquet 377444090 368104449 1.03
clickbench_q16/datafusion:parquet 708476586 682263831 1.04
clickbench_q17/datafusion:parquet 684763630 680731092 1.01
clickbench_q18/datafusion:parquet 1411489272 1382583330 1.02
clickbench_q19/datafusion:parquet 34093193 32773305 1.04
clickbench_q20/datafusion:parquet 612033841 610328849 1.00
clickbench_q21/datafusion:parquet 673059707 662642505 1.02
clickbench_q22/datafusion:parquet 967936204 975164474 0.99
clickbench_q23/datafusion:parquet 3744364154 3649630092 1.03
clickbench_q24/datafusion:parquet 86970960 91775205 0.95
clickbench_q25/datafusion:parquet 142417793 147379843 0.97
clickbench_q26/datafusion:parquet 87950361 88798095 0.99
clickbench_q27/datafusion:parquet 1068693876 1062027823 1.01
clickbench_q28/datafusion:parquet 6633328635 6617276313 1.00
clickbench_q29/datafusion:parquet 236311148 234244238 1.01
clickbench_q30/datafusion:parquet 373768057 364904526 1.02
clickbench_q31/datafusion:parquet 393975002 389889962 1.01
clickbench_q32/datafusion:parquet 1283764579 1285117531 1.00
clickbench_q33/datafusion:parquet 1544495330 1535968856 1.01
clickbench_q34/datafusion:parquet 1527023656 1521975832 1.00
clickbench_q35/datafusion:parquet 528271750 526918760 1.00
clickbench_q36/datafusion:parquet 144870375 145068566 1.00
clickbench_q37/datafusion:parquet 60299041 60425350 1.00
clickbench_q38/datafusion:parquet 93832035 94570559 0.99
clickbench_q39/datafusion:parquet 269991456 274163549 0.98
clickbench_q40/datafusion:parquet 34557833 32875447 1.05
clickbench_q41/datafusion:parquet 30639927 30079663 1.02
clickbench_q42/datafusion:parquet 30947162 31306972 0.99
duckdb / vortex-file-compressed (1.101x ❌, 3↑ 16↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6123602 6222430 0.98
clickbench_q01/duckdb:vortex-file-compressed 🚨 19010324 14560730 1.31
clickbench_q02/duckdb:vortex-file-compressed 🚨 29851760 26415557 1.13
clickbench_q03/duckdb:vortex-file-compressed 🚨 38416880 30584415 1.26
clickbench_q04/duckdb:vortex-file-compressed 192993233 187288936 1.03
clickbench_q05/duckdb:vortex-file-compressed 206849168 196946457 1.05
clickbench_q06/duckdb:vortex-file-compressed 🚨 38773764 19554115 1.98
clickbench_q07/duckdb:vortex-file-compressed 🚨 21588078 16386103 1.32
clickbench_q08/duckdb:vortex-file-compressed 286437869 267235800 1.07
clickbench_q09/duckdb:vortex-file-compressed 🚨 390212182 350409407 1.11
clickbench_q10/duckdb:vortex-file-compressed 🚨 108048361 73978282 1.46
clickbench_q11/duckdb:vortex-file-compressed 🚨 126857734 82990329 1.53
clickbench_q12/duckdb:vortex-file-compressed 236725573 219270359 1.08
clickbench_q13/duckdb:vortex-file-compressed 🚨 490482186 430326439 1.14
clickbench_q14/duckdb:vortex-file-compressed 🚨 289837623 258273024 1.12
clickbench_q15/duckdb:vortex-file-compressed 233359223 230745190 1.01
clickbench_q16/duckdb:vortex-file-compressed 🚀 614611251 698024466 0.88
clickbench_q17/duckdb:vortex-file-compressed 538981912 512787932 1.05
clickbench_q18/duckdb:vortex-file-compressed 1171309820 1187893128 0.99
clickbench_q19/duckdb:vortex-file-compressed 25103782 23715286 1.06
clickbench_q20/duckdb:vortex-file-compressed 386498877 402804229 0.96
clickbench_q21/duckdb:vortex-file-compressed 425864850 417820865 1.02
clickbench_q22/duckdb:vortex-file-compressed 🚀 596812990 698443728 0.85
clickbench_q23/duckdb:vortex-file-compressed 🚨 1323622205 993821949 1.33
clickbench_q24/duckdb:vortex-file-compressed 🚨 59774326 51149654 1.17
clickbench_q25/duckdb:vortex-file-compressed 87213285 83935006 1.04
clickbench_q26/duckdb:vortex-file-compressed 🚨 61215481 41109031 1.49
clickbench_q27/duckdb:vortex-file-compressed 🚨 562629079 497009786 1.13
clickbench_q28/duckdb:vortex-file-compressed 3051472912 3003425306 1.02
clickbench_q29/duckdb:vortex-file-compressed 32345424 30761209 1.05
clickbench_q30/duckdb:vortex-file-compressed 🚨 246317086 201738825 1.22
clickbench_q31/duckdb:vortex-file-compressed 🚨 358005381 275039275 1.30
clickbench_q32/duckdb:vortex-file-compressed 1383956791 1461811050 0.95
clickbench_q33/duckdb:vortex-file-compressed 1515364533 1511589384 1.00
clickbench_q34/duckdb:vortex-file-compressed 1616838845 1535085431 1.05
clickbench_q35/duckdb:vortex-file-compressed 380133093 373044060 1.02
clickbench_q36/duckdb:vortex-file-compressed 31174281 30944944 1.01
clickbench_q37/duckdb:vortex-file-compressed 23078126 24008665 0.96
clickbench_q38/duckdb:vortex-file-compressed 25744256 25377394 1.01
clickbench_q39/duckdb:vortex-file-compressed 45038413 45766361 0.98
clickbench_q40/duckdb:vortex-file-compressed 25090492 23917395 1.05
clickbench_q41/duckdb:vortex-file-compressed 23797889 23740836 1.00
clickbench_q42/duckdb:vortex-file-compressed 🚀 20358852 24259098 0.84
duckdb / parquet (1.005x ➖, 0↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 220143065 217946730 1.01
clickbench_q01/duckdb:parquet 51303255 50101278 1.02
clickbench_q02/duckdb:parquet 65250265 66219638 0.99
clickbench_q03/duckdb:parquet 63201377 63446021 1.00
clickbench_q04/duckdb:parquet 206148341 204837838 1.01
clickbench_q05/duckdb:parquet 279362392 275379337 1.01
clickbench_q06/duckdb:parquet 60861647 61117963 1.00
clickbench_q07/duckdb:parquet 52136397 53013114 0.98
clickbench_q08/duckdb:parquet 269159518 267808029 1.01
clickbench_q09/duckdb:parquet 398012721 394682919 1.01
clickbench_q10/duckdb:parquet 94896504 95935617 0.99
clickbench_q11/duckdb:parquet 108131036 107304493 1.01
clickbench_q12/duckdb:parquet 291312698 295640267 0.99
clickbench_q13/duckdb:parquet 518873687 504547597 1.03
clickbench_q14/duckdb:parquet 329866030 328319924 1.00
clickbench_q15/duckdb:parquet 239808294 240982849 1.00
clickbench_q16/duckdb:parquet 613964470 610206465 1.01
clickbench_q17/duckdb:parquet 512898659 507950261 1.01
clickbench_q18/duckdb:parquet 1063610144 1049439183 1.01
clickbench_q19/duckdb:parquet 50253512 49744860 1.01
clickbench_q20/duckdb:parquet 436949045 437889552 1.00
clickbench_q21/duckdb:parquet 555667441 553577109 1.00
clickbench_q22/duckdb:parquet 924511735 931762130 0.99
clickbench_q23/duckdb:parquet 314958098 309460349 1.02
clickbench_q24/duckdb:parquet 78024002 77590029 1.01
clickbench_q25/duckdb:parquet 141190098 139245804 1.01
clickbench_q26/duckdb:parquet 53359558 54257856 0.98
clickbench_q27/duckdb:parquet 639923609 640498061 1.00
clickbench_q28/duckdb:parquet 4833294383 4884041113 0.99
clickbench_q29/duckdb:parquet 60628963 60242451 1.01
clickbench_q30/duckdb:parquet 306487441 304674804 1.01
clickbench_q31/duckdb:parquet 355117681 353472281 1.00
clickbench_q32/duckdb:parquet 1191927322 1133493541 1.05
clickbench_q33/duckdb:parquet 1216984269 1208002554 1.01
clickbench_q34/duckdb:parquet 1279349361 1251996009 1.02
clickbench_q35/duckdb:parquet 354043817 352392859 1.00
clickbench_q36/duckdb:parquet 63578015 64315732 0.99
clickbench_q37/duckdb:parquet 53913738 53655789 1.00
clickbench_q38/duckdb:parquet 58479399 58593728 1.00
clickbench_q39/duckdb:parquet 94519275 98387863 0.96
clickbench_q40/duckdb:parquet 56320283 54188063 1.04
clickbench_q41/duckdb:parquet 59801458 59020793 1.01
clickbench_q42/duckdb:parquet 50551043 49652042 1.02
duckdb / duckdb (0.951x ➖, 9↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚀 17983780 20673354 0.87
clickbench_q01/duckdb:duckdb 34463399 36424653 0.95
clickbench_q02/duckdb:duckdb 45558184 48966668 0.93
clickbench_q03/duckdb:duckdb 47715884 50855408 0.94
clickbench_q04/duckdb:duckdb 216400248 222485670 0.97
clickbench_q05/duckdb:duckdb 317118401 327189646 0.97
clickbench_q06/duckdb:duckdb 35497027 38865707 0.91
clickbench_q07/duckdb:duckdb 🚀 36038045 40433910 0.89
clickbench_q08/duckdb:duckdb 307201490 314602325 0.98
clickbench_q09/duckdb:duckdb 452947882 469551243 0.96
clickbench_q10/duckdb:duckdb 98194543 99177368 0.99
clickbench_q11/duckdb:duckdb 108581781 107146025 1.01
clickbench_q12/duckdb:duckdb 297307931 301176602 0.99
clickbench_q13/duckdb:duckdb 522114503 545603075 0.96
clickbench_q14/duckdb:duckdb 342149225 337864405 1.01
clickbench_q15/duckdb:duckdb 258418036 259889014 0.99
clickbench_q16/duckdb:duckdb 676660381 689165266 0.98
clickbench_q17/duckdb:duckdb 580685010 593486024 0.98
clickbench_q18/duckdb:duckdb 1261885926 1280459785 0.99
clickbench_q19/duckdb:duckdb 🚀 34560668 38509088 0.90
clickbench_q20/duckdb:duckdb 🚀 932858898 1040199830 0.90
clickbench_q21/duckdb:duckdb 1006043518 1087343718 0.93
clickbench_q22/duckdb:duckdb 1024135264 1090255276 0.94
clickbench_q23/duckdb:duckdb 251155341 271473518 0.93
clickbench_q24/duckdb:duckdb 61497193 65522657 0.94
clickbench_q25/duckdb:duckdb 123417427 130191496 0.95
clickbench_q26/duckdb:duckdb 56794368 60203234 0.94
clickbench_q27/duckdb:duckdb 🚀 952756817 1091997784 0.87
clickbench_q28/duckdb:duckdb 4649103284 4610057540 1.01
clickbench_q29/duckdb:duckdb 48771220 52235075 0.93
clickbench_q30/duckdb:duckdb 292582837 294817929 0.99
clickbench_q31/duckdb:duckdb 420473470 436199779 0.96
clickbench_q32/duckdb:duckdb 1491999061 1430064980 1.04
clickbench_q33/duckdb:duckdb 1875021226 1889427255 0.99
clickbench_q34/duckdb:duckdb 2025971892 2028108587 1.00
clickbench_q35/duckdb:duckdb 265751367 263419178 1.01
clickbench_q36/duckdb:duckdb 40253686 42806026 0.94
clickbench_q37/duckdb:duckdb 🚀 31114780 34913965 0.89
clickbench_q38/duckdb:duckdb 🚀 30584537 34029574 0.90
clickbench_q39/duckdb:duckdb 68919151 68734982 1.00
clickbench_q40/duckdb:duckdb 🚀 31870240 35491907 0.90
clickbench_q41/duckdb:duckdb 29974930 33264279 0.90
clickbench_q42/duckdb:duckdb 🚀 31701826 35570134 0.89
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +1.8% +0.8% +0.9% +665.1% ➖ noise
0 duckdb:duckdb -13.0% +0.8% -13.7% +256.5% ➖ noise
0 duckdb:vortex-file-compressed -1.6% +0.8% -2.4% +321.7% ➖ noise
1 datafusion:vortex-file-compressed +15.4% +1.9% +13.2% +27.2% ➖ noise
1 duckdb:duckdb -5.4% +1.9% -7.2% +64.7% ➖ noise
1 duckdb:vortex-file-compressed +30.6% +1.9% +28.1% +13.5% 🚨 regression
2 datafusion:vortex-file-compressed -0.3% +2.8% -3.1% +17.4% ➖ noise
2 duckdb:duckdb -7.0% +2.8% -9.5% +23.0% ➖ noise
2 duckdb:vortex-file-compressed +13.0% +2.8% +9.9% +12.5% ➖ noise
3 datafusion:vortex-file-compressed +7.1% -0.8% +8.0% +148.6% ➖ noise
3 duckdb:duckdb -6.2% -0.8% -5.4% +50.5% ➖ noise
3 duckdb:vortex-file-compressed +25.6% -0.8% +26.7% +14.5% 🚨 regression
4 datafusion:vortex-file-compressed +1.6% +0.3% +1.3% +10.0% ➖ noise
4 duckdb:duckdb -2.7% +0.3% -3.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +3.0% +0.3% +2.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.5% +1.4% -0.9% +10.0% ➖ noise
5 duckdb:duckdb -3.1% +1.4% -4.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +5.0% +1.4% +3.6% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.7% -2.9% +4.8% +39.5% ➖ noise
6 duckdb:duckdb -8.7% -2.9% -5.9% +29.5% ➖ noise
6 duckdb:vortex-file-compressed +98.3% -2.9% +104.3% +18.0% 🚨 regression
7 datafusion:vortex-file-compressed +16.4% +2.7% +13.3% +10.0% 🚨 regression
7 duckdb:duckdb -10.9% +2.7% -13.2% +14.4% ✅ faster
7 duckdb:vortex-file-compressed +31.7% +2.7% +28.3% +10.0% 🚨 regression
8 datafusion:vortex-file-compressed +5.4% +1.0% +4.4% +10.0% ➖ noise
8 duckdb:duckdb -2.4% +1.0% -3.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +7.2% +1.0% +6.2% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +4.3% +0.8% +3.5% +10.0% ➖ noise
9 duckdb:duckdb -3.5% +0.8% -4.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +11.4% +0.8% +10.4% +10.0% 🚨 regression
10 datafusion:vortex-file-compressed +44.5% -2.1% +47.6% +10.0% 🚨 regression
10 duckdb:duckdb -1.0% -2.1% +1.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +46.1% -2.1% +49.2% +10.0% 🚨 regression
11 datafusion:vortex-file-compressed +45.6% +1.1% +44.1% +10.0% 🚨 regression
11 duckdb:duckdb +1.3% +1.1% +0.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +52.9% +1.1% +51.2% +10.0% 🚨 regression
12 datafusion:vortex-file-compressed +5.7% -0.4% +6.1% +10.0% ➖ noise
12 duckdb:duckdb -1.3% -0.4% -0.9% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +8.0% -0.4% +8.4% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +9.9% +2.7% +6.9% +10.0% ➖ noise
13 duckdb:duckdb -4.3% +2.7% -6.9% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +14.0% +2.7% +10.9% +10.0% 🚨 regression
14 datafusion:vortex-file-compressed +6.7% +0.1% +6.7% +10.0% ➖ noise
14 duckdb:duckdb +1.3% +0.1% +1.2% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +12.2% +0.1% +12.2% +10.0% 🚨 regression
15 datafusion:vortex-file-compressed +4.2% +1.0% +3.1% +10.0% ➖ noise
15 duckdb:duckdb -0.6% +1.0% -1.6% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +1.1% +1.0% +0.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +4.0% +2.2% +1.7% +10.0% ➖ noise
16 duckdb:duckdb -1.8% +2.2% -3.9% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -11.9% +2.2% -13.9% +10.0% ✅ faster
17 datafusion:vortex-file-compressed +3.1% +0.8% +2.3% +10.0% ➖ noise
17 duckdb:duckdb -2.2% +0.8% -2.9% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +5.1% +0.8% +4.3% +13.6% ➖ noise
18 datafusion:vortex-file-compressed +6.3% +1.7% +4.5% +10.0% ➖ noise
18 duckdb:duckdb -1.5% +1.7% -3.1% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.4% +1.7% -3.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +7.7% +2.5% +5.0% +17.9% ➖ noise
19 duckdb:duckdb -10.3% +2.5% -12.5% +11.1% ✅ faster
19 duckdb:vortex-file-compressed +5.9% +2.5% +3.3% +17.6% ➖ noise
20 datafusion:vortex-file-compressed +2.4% +0.0% +2.4% +197.0% ➖ noise
20 duckdb:duckdb -10.3% +0.0% -10.3% +29.2% ➖ noise
20 duckdb:vortex-file-compressed -4.0% +0.0% -4.1% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +1.2% +1.0% +0.2% +10.0% ➖ noise
21 duckdb:duckdb -7.5% +1.0% -8.4% +10.2% ➖ noise
21 duckdb:vortex-file-compressed +1.9% +1.0% +0.9% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +4.8% -0.8% +5.6% +10.0% ➖ noise
22 duckdb:duckdb -6.1% -0.8% -5.3% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -14.6% -0.8% -13.9% +19.2% ➖ noise
23 datafusion:vortex-file-compressed +9.7% +2.2% +7.3% +34.9% ➖ noise
23 duckdb:duckdb -7.5% +2.2% -9.5% +10.0% ✅ faster
23 duckdb:vortex-file-compressed +33.2% +2.2% +30.3% +10.0% 🚨 regression
24 datafusion:vortex-file-compressed +28.1% -2.4% +31.2% +10.5% 🚨 regression
24 duckdb:duckdb -6.1% -2.4% -3.9% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +16.9% -2.4% +19.7% +39.1% ➖ noise
25 datafusion:vortex-file-compressed +20.5% -1.0% +21.7% +11.7% 🚨 regression
25 duckdb:duckdb -5.2% -1.0% -4.2% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +3.9% -1.0% +5.0% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +45.4% -1.3% +47.4% +17.4% 🚨 regression
26 duckdb:duckdb -5.7% -1.3% -4.4% +19.7% ➖ noise
26 duckdb:vortex-file-compressed +48.9% -1.3% +50.9% +28.5% 🚨 regression
27 datafusion:vortex-file-compressed +1.0% +0.3% +0.7% +10.0% ➖ noise
27 duckdb:duckdb -12.8% +0.3% -13.0% +10.0% ✅ faster
27 duckdb:vortex-file-compressed +13.2% +0.3% +12.9% +10.0% 🚨 regression
28 datafusion:vortex-file-compressed -1.7% -0.4% -1.3% +10.0% ➖ noise
28 duckdb:duckdb +0.8% -0.4% +1.3% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +1.6% -0.4% +2.0% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -5.1% +0.8% -5.8% +12.2% ➖ noise
29 duckdb:duckdb -6.6% +0.8% -7.3% +10.5% ➖ noise
29 duckdb:vortex-file-compressed +5.2% +0.8% +4.4% +10.4% ➖ noise
30 datafusion:vortex-file-compressed +18.0% +1.5% +16.3% +10.0% 🚨 regression
30 duckdb:duckdb -0.8% +1.5% -2.2% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +22.1% +1.5% +20.3% +10.0% 🚨 regression
31 datafusion:vortex-file-compressed +39.3% +0.8% +38.2% +10.0% 🚨 regression
31 duckdb:duckdb -3.6% +0.8% -4.3% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +30.2% +0.8% +29.2% +10.0% 🚨 regression
32 datafusion:vortex-file-compressed +15.4% +2.5% +12.6% +10.0% 🚨 regression
32 duckdb:duckdb +4.3% +2.5% +1.8% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -5.3% +2.5% -7.6% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +4.7% +0.6% +4.1% +10.0% ➖ noise
33 duckdb:duckdb -0.8% +0.6% -1.4% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +0.2% +0.6% -0.4% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +2.0% +1.3% +0.8% +10.0% ➖ noise
34 duckdb:duckdb -0.1% +1.3% -1.3% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +5.3% +1.3% +4.0% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +4.2% +0.4% +3.8% +10.0% ➖ noise
35 duckdb:duckdb +0.9% +0.4% +0.5% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +1.9% +0.4% +1.5% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -3.7% -0.6% -3.1% +12.8% ➖ noise
36 duckdb:duckdb -6.0% -0.6% -5.4% +11.0% ➖ noise
36 duckdb:vortex-file-compressed +0.7% -0.6% +1.4% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +5.3% +0.1% +5.1% +10.0% ➖ noise
37 duckdb:duckdb -10.9% +0.1% -11.0% +10.0% ✅ faster
37 duckdb:vortex-file-compressed -3.9% +0.1% -4.0% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +7.2% -0.5% +7.7% +10.0% ➖ noise
38 duckdb:duckdb -10.1% -0.5% -9.7% +10.4% ✅ faster
38 duckdb:vortex-file-compressed +1.4% -0.5% +1.9% +10.0% ➖ noise
39 datafusion:vortex-file-compressed +2.2% -2.7% +5.1% +10.0% ➖ noise
39 duckdb:duckdb +0.3% -2.7% +3.1% +12.8% ➖ noise
39 duckdb:vortex-file-compressed -1.6% -2.7% +1.2% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +5.3% +4.5% +0.8% +10.0% ➖ noise
40 duckdb:duckdb -10.2% +4.5% -14.1% +11.3% ✅ faster
40 duckdb:vortex-file-compressed +4.9% +4.5% +0.4% +10.0% ➖ noise
41 datafusion:vortex-file-compressed +7.9% +1.6% +6.2% +10.0% ➖ noise
41 duckdb:duckdb -9.9% +1.6% -11.3% +10.1% ✅ faster
41 duckdb:vortex-file-compressed +0.2% +1.6% -1.3% +11.5% ➖ noise
42 datafusion:vortex-file-compressed +4.6% +0.3% +4.2% +10.0% ➖ noise
42 duckdb:duckdb -10.9% +0.3% -11.2% +10.0% ✅ faster
42 duckdb:vortex-file-compressed -16.1% +0.3% -16.3% +10.0% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (201 files changed, -33.5% overall, 54↑ 147↓)
File Scale Format Base HEAD Change %
hits_41.vortex 1.0 vortex-file-compressed 297.76 MB 308.92 MB +11.16 MB +3.7%
hits_43.vortex 1.0 vortex-file-compressed 303.02 MB 314.22 MB +11.20 MB +3.7%
hits_42.vortex 1.0 vortex-file-compressed 296.11 MB 306.99 MB +10.88 MB +3.7%
hits_48.vortex 1.0 vortex-file-compressed 28.11 MB 29.10 MB +1018.09 KB +3.5%
hits_44.vortex 1.0 vortex-file-compressed 241.45 MB 248.03 MB +6.58 MB +2.7%
hits_39.vortex 1.0 vortex-file-compressed 92.67 MB 95.09 MB +2.42 MB +2.6%
hits_11.vortex 1.0 vortex-file-compressed 95.07 MB 97.48 MB +2.41 MB +2.5%
hits_36.vortex 1.0 vortex-file-compressed 79.48 MB 81.38 MB +1.90 MB +2.4%
hits_77.vortex 1.0 vortex-file-compressed 217.10 MB 222.15 MB +5.05 MB +2.3%
hits_18.vortex 1.0 vortex-file-compressed 125.20 MB 128.06 MB +2.86 MB +2.3%
hits_88.vortex 1.0 vortex-file-compressed 135.89 MB 138.48 MB +2.59 MB +1.9%
hits_33.vortex 1.0 vortex-file-compressed 61.95 MB 62.95 MB +1019.78 KB +1.6%
hits_29.vortex 1.0 vortex-file-compressed 64.72 MB 65.75 MB +1.03 MB +1.6%
hits_70.vortex 1.0 vortex-file-compressed 114.08 MB 115.81 MB +1.73 MB +1.5%
hits_30.vortex 1.0 vortex-file-compressed 102.83 MB 104.37 MB +1.54 MB +1.5%
hits_86.vortex 1.0 vortex-file-compressed 80.62 MB 81.71 MB +1.09 MB +1.4%
hits_35.vortex 1.0 vortex-file-compressed 137.56 MB 139.10 MB +1.54 MB +1.1%
hits_71.vortex 1.0 vortex-file-compressed 125.12 MB 126.47 MB +1.35 MB +1.1%
hits_93.vortex 1.0 vortex-file-compressed 106.43 MB 107.49 MB +1.07 MB +1.0%
hits_55.vortex 1.0 vortex-file-compressed 250.46 MB 252.95 MB +2.49 MB +1.0%
hits_32.vortex 1.0 vortex-file-compressed 76.12 MB 76.79 MB +687.43 KB +0.9%
hits_83.vortex 1.0 vortex-file-compressed 102.67 MB 103.46 MB +809.91 KB +0.8%
hits_10.vortex 1.0 vortex-file-compressed 81.05 MB 81.67 MB +635.15 KB +0.8%
hits_56.vortex 1.0 vortex-file-compressed 162.66 MB 163.78 MB +1.12 MB +0.7%
hits_81.vortex 1.0 vortex-file-compressed 125.70 MB 126.56 MB +880.51 KB +0.7%
hits_12.vortex 1.0 vortex-file-compressed 124.07 MB 124.88 MB +838.23 KB +0.7%
hits_20.vortex 1.0 vortex-file-compressed 66.58 MB 67.01 MB +445.04 KB +0.7%
hits_64.vortex 1.0 vortex-file-compressed 94.21 MB 94.79 MB +593.30 KB +0.6%
hits_82.vortex 1.0 vortex-file-compressed 121.02 MB 121.76 MB +761.86 KB +0.6%
hits_68.vortex 1.0 vortex-file-compressed 171.22 MB 172.24 MB +1.02 MB +0.6%
hits_8.vortex 1.0 vortex-file-compressed 121.89 MB 122.61 MB +733.14 KB +0.6%
hits_28.vortex 1.0 vortex-file-compressed 166.34 MB 167.26 MB +940.28 KB +0.6%
hits_26.vortex 1.0 vortex-file-compressed 142.56 MB 143.33 MB +781.45 KB +0.5%
hits_6.vortex 1.0 vortex-file-compressed 121.89 MB 122.49 MB +617.99 KB +0.5%
hits_38.vortex 1.0 vortex-file-compressed 117.06 MB 117.64 MB +590.43 KB +0.5%
hits_7.vortex 1.0 vortex-file-compressed 122.77 MB 123.33 MB +577.76 KB +0.5%
hits_50.vortex 1.0 vortex-file-compressed 253.80 MB 254.91 MB +1.10 MB +0.4%
hits_13.vortex 1.0 vortex-file-compressed 121.63 MB 122.14 MB +525.67 KB +0.4%
hits_62.vortex 1.0 vortex-file-compressed 147.10 MB 147.70 MB +617.74 KB +0.4%
hits_72.vortex 1.0 vortex-file-compressed 94.88 MB 95.24 MB +373.27 KB +0.4%
hits_5.vortex 1.0 vortex-file-compressed 121.66 MB 122.09 MB +444.81 KB +0.4%
hits_17.vortex 1.0 vortex-file-compressed 102.70 MB 103.05 MB +357.63 KB +0.3%
hits_0.vortex 1.0 vortex-file-compressed 111.46 MB 111.78 MB +330.12 KB +0.3%
hits_2.vortex 1.0 vortex-file-compressed 239.70 MB 240.38 MB +697.11 KB +0.3%
hits_96.vortex 1.0 vortex-file-compressed 179.48 MB 179.98 MB +516.58 KB +0.3%
hits_59.vortex 1.0 vortex-file-compressed 120.49 MB 120.75 MB +263.59 KB +0.2%
hits_27.vortex 1.0 vortex-file-compressed 173.50 MB 173.87 MB +379.20 KB +0.2%
hits_75.vortex 1.0 vortex-file-compressed 73.40 MB 73.54 MB +145.71 KB +0.2%
hits_54.vortex 1.0 vortex-file-compressed 360.62 MB 361.22 MB +614.01 KB +0.2%
hits_67.vortex 1.0 vortex-file-compressed 264.44 MB 264.88 MB +441.98 KB +0.2%
hits_53.vortex 1.0 vortex-file-compressed 96.77 MB 96.90 MB +133.23 KB +0.1%
hits_47.vortex 1.0 vortex-file-compressed 41.47 MB 41.51 MB +35.80 KB +0.1%
hits_22.vortex 1.0 vortex-file-compressed 78.94 MB 79.00 MB +64.28 KB +0.1%
hits_37.vortex 1.0 vortex-file-compressed 96.35 MB 96.37 MB +26.78 KB +0.0%
hits_79.vortex 1.0 vortex-file-compressed 202.78 MB 202.76 MB 18.95 KB -0.0%
hits_51.vortex 1.0 vortex-file-compressed 426.74 MB 426.64 MB 104.01 KB -0.0%
hits_89.vortex 1.0 vortex-file-compressed 264.74 MB 264.52 MB 224.52 KB -0.1%
hits_91.vortex 1.0 vortex-file-compressed 115.26 MB 115.13 MB 125.37 KB -0.1%
hits_23.vortex 1.0 vortex-file-compressed 78.38 MB 78.28 MB 96.48 KB -0.1%
hits_95.vortex 1.0 vortex-file-compressed 113.14 MB 112.99 MB 163.02 KB -0.1%
hits_94.vortex 1.0 vortex-file-compressed 183.76 MB 183.46 MB 310.25 KB -0.2%
hits_4.vortex 1.0 vortex-file-compressed 137.68 MB 137.35 MB 336.09 KB -0.2%
hits_90.vortex 1.0 vortex-file-compressed 202.76 MB 202.15 MB 628.66 KB -0.3%
hits_24.vortex 1.0 vortex-file-compressed 77.97 MB 77.61 MB 363.05 KB -0.5%
hits_92.vortex 1.0 vortex-file-compressed 195.24 MB 194.26 MB 998.46 KB -0.5%
hits_46.vortex 1.0 vortex-file-compressed 79.26 MB 78.85 MB 411.88 KB -0.5%
hits_87.vortex 1.0 vortex-file-compressed 219.62 MB 218.50 MB 1.12 MB -0.5%
hits_65.vortex 1.0 vortex-file-compressed 236.04 MB 234.80 MB 1.24 MB -0.5%
hits_99.vortex 1.0 vortex-file-compressed 157.59 MB 156.71 MB 901.44 KB -0.6%
hits_49.vortex 1.0 vortex-file-compressed 87.66 MB 87.10 MB 579.35 KB -0.6%
hits_3.vortex 1.0 vortex-file-compressed 191.80 MB 190.44 MB 1.36 MB -0.7%
hits_1.vortex 1.0 vortex-file-compressed 180.21 MB 178.92 MB 1.29 MB -0.7%
hits_78.vortex 1.0 vortex-file-compressed 237.45 MB 235.70 MB 1.74 MB -0.7%
hits_66.vortex 1.0 vortex-file-compressed 104.02 MB 103.15 MB 888.73 KB -0.8%
hits_74.vortex 1.0 vortex-file-compressed 150.52 MB 149.25 MB 1.27 MB -0.8%
hits_31.vortex 1.0 vortex-file-compressed 103.21 MB 102.23 MB 1003.88 KB -0.9%
hits_85.vortex 1.0 vortex-file-compressed 105.07 MB 104.04 MB 1.03 MB -1.0%
hits_63.vortex 1.0 vortex-file-compressed 79.72 MB 78.92 MB 817.80 KB -1.0%
hits_57.vortex 1.0 vortex-file-compressed 156.87 MB 155.25 MB 1.62 MB -1.0%
hits_14.vortex 1.0 vortex-file-compressed 133.90 MB 132.41 MB 1.49 MB -1.1%
hits_52.vortex 1.0 vortex-file-compressed 119.21 MB 117.75 MB 1.47 MB -1.2%
hits_25.vortex 1.0 vortex-file-compressed 135.54 MB 133.87 MB 1.67 MB -1.2%
hits_98.vortex 1.0 vortex-file-compressed 149.39 MB 147.50 MB 1.89 MB -1.3%
hits_19.vortex 1.0 vortex-file-compressed 81.13 MB 80.06 MB 1.07 MB -1.3%
hits_21.vortex 1.0 vortex-file-compressed 99.70 MB 98.32 MB 1.38 MB -1.4%
hits_58.vortex 1.0 vortex-file-compressed 113.02 MB 111.18 MB 1.84 MB -1.6%
hits_61.vortex 1.0 vortex-file-compressed 112.74 MB 110.86 MB 1.88 MB -1.7%
hits_76.vortex 1.0 vortex-file-compressed 138.22 MB 135.80 MB 2.43 MB -1.8%
hits_97.vortex 1.0 vortex-file-compressed 129.62 MB 127.15 MB 2.47 MB -1.9%
hits_15.vortex 1.0 vortex-file-compressed 95.39 MB 93.56 MB 1.83 MB -1.9%
hits_84.vortex 1.0 vortex-file-compressed 143.42 MB 140.52 MB 2.90 MB -2.0%
hits_60.vortex 1.0 vortex-file-compressed 120.45 MB 117.95 MB 2.50 MB -2.1%
hits_40.vortex 1.0 vortex-file-compressed 141.59 MB 138.63 MB 2.96 MB -2.1%
hits_73.vortex 1.0 vortex-file-compressed 130.48 MB 127.74 MB 2.74 MB -2.1%
hits_80.vortex 1.0 vortex-file-compressed 122.75 MB 119.48 MB 3.27 MB -2.7%
hits_9.vortex 1.0 vortex-file-compressed 123.24 MB 119.92 MB 3.33 MB -2.7%
hits_45.vortex 1.0 vortex-file-compressed 143.54 MB 139.66 MB 3.88 MB -2.7%
hits_69.vortex 1.0 vortex-file-compressed 145.96 MB 141.97 MB 3.99 MB -2.7%
hits_16.vortex 1.0 vortex-file-compressed 86.38 MB 83.05 MB 3.33 MB -3.9%
hits_34.vortex 1.0 vortex-file-compressed 110.35 MB 105.94 MB 4.42 MB -4.0%
hits_38.vortex 1.0 vortex-compact 62.85 MB 0 B 62.85 MB -100.0%
hits_39.vortex 1.0 vortex-compact 49.56 MB 0 B 49.56 MB -100.0%
hits_27.vortex 1.0 vortex-compact 69.68 MB 0 B 69.68 MB -100.0%
hits_95.vortex 1.0 vortex-compact 57.47 MB 0 B 57.47 MB -100.0%
hits_97.vortex 1.0 vortex-compact 68.91 MB 0 B 68.91 MB -100.0%
hits_67.vortex 1.0 vortex-compact 113.75 MB 0 B 113.75 MB -100.0%
hits_84.vortex 1.0 vortex-compact 72.85 MB 0 B 72.85 MB -100.0%
hits_87.vortex 1.0 vortex-compact 118.73 MB 0 B 118.73 MB -100.0%
hits_52.vortex 1.0 vortex-compact 63.44 MB 0 B 63.44 MB -100.0%
hits_11.vortex 1.0 vortex-compact 54.10 MB 0 B 54.10 MB -100.0%
hits_78.vortex 1.0 vortex-compact 97.53 MB 0 B 97.53 MB -100.0%
hits_8.vortex 1.0 vortex-compact 62.67 MB 0 B 62.67 MB -100.0%
hits_14.vortex 1.0 vortex-compact 73.52 MB 0 B 73.52 MB -100.0%
hits_0.vortex 1.0 vortex-compact 58.39 MB 0 B 58.39 MB -100.0%
hits_53.vortex 1.0 vortex-compact 58.85 MB 0 B 58.85 MB -100.0%
hits_35.vortex 1.0 vortex-compact 74.79 MB 0 B 74.79 MB -100.0%
hits_10.vortex 1.0 vortex-compact 48.67 MB 0 B 48.67 MB -100.0%
hits_36.vortex 1.0 vortex-compact 48.75 MB 0 B 48.75 MB -100.0%
hits_4.vortex 1.0 vortex-compact 71.55 MB 0 B 71.55 MB -100.0%
hits_42.vortex 1.0 vortex-compact 163.89 MB 0 B 163.89 MB -100.0%
hits_13.vortex 1.0 vortex-compact 67.72 MB 0 B 67.72 MB -100.0%
hits_5.vortex 1.0 vortex-compact 62.68 MB 0 B 62.68 MB -100.0%
hits_68.vortex 1.0 vortex-compact 75.68 MB 0 B 75.68 MB -100.0%
hits_86.vortex 1.0 vortex-compact 48.01 MB 0 B 48.01 MB -100.0%
hits_63.vortex 1.0 vortex-compact 45.88 MB 0 B 45.88 MB -100.0%
hits_81.vortex 1.0 vortex-compact 65.21 MB 0 B 65.21 MB -100.0%
hits_1.vortex 1.0 vortex-compact 90.07 MB 0 B 90.07 MB -100.0%
hits_23.vortex 1.0 vortex-compact 43.94 MB 0 B 43.94 MB -100.0%
hits_65.vortex 1.0 vortex-compact 129.63 MB 0 B 129.63 MB -100.0%
hits_12.vortex 1.0 vortex-compact 69.04 MB 0 B 69.04 MB -100.0%
hits_91.vortex 1.0 vortex-compact 60.68 MB 0 B 60.68 MB -100.0%
hits_30.vortex 1.0 vortex-compact 58.46 MB 0 B 58.46 MB -100.0%
hits_71.vortex 1.0 vortex-compact 69.03 MB 0 B 69.03 MB -100.0%
hits_55.vortex 1.0 vortex-compact 93.45 MB 0 B 93.45 MB -100.0%
hits_73.vortex 1.0 vortex-compact 69.77 MB 0 B 69.77 MB -100.0%
hits_24.vortex 1.0 vortex-compact 43.39 MB 0 B 43.39 MB -100.0%
hits_43.vortex 1.0 vortex-compact 168.57 MB 0 B 168.57 MB -100.0%
hits_80.vortex 1.0 vortex-compact 67.81 MB 0 B 67.81 MB -100.0%
hits_40.vortex 1.0 vortex-compact 75.65 MB 0 B 75.65 MB -100.0%
hits_70.vortex 1.0 vortex-compact 61.06 MB 0 B 61.06 MB -100.0%
hits_79.vortex 1.0 vortex-compact 85.36 MB 0 B 85.36 MB -100.0%
hits_17.vortex 1.0 vortex-compact 58.08 MB 0 B 58.08 MB -100.0%
hits_28.vortex 1.0 vortex-compact 70.05 MB 0 B 70.05 MB -100.0%
hits_34.vortex 1.0 vortex-compact 58.01 MB 0 B 58.01 MB -100.0%
hits_99.vortex 1.0 vortex-compact 77.04 MB 0 B 77.04 MB -100.0%
hits_51.vortex 1.0 vortex-compact 167.28 MB 0 B 167.28 MB -100.0%
hits_41.vortex 1.0 vortex-compact 165.44 MB 0 B 165.44 MB -100.0%
hits_19.vortex 1.0 vortex-compact 44.56 MB 0 B 44.56 MB -100.0%
hits_98.vortex 1.0 vortex-compact 72.46 MB 0 B 72.46 MB -100.0%
hits_26.vortex 1.0 vortex-compact 70.65 MB 0 B 70.65 MB -100.0%
hits_75.vortex 1.0 vortex-compact 43.41 MB 0 B 43.41 MB -100.0%
hits_44.vortex 1.0 vortex-compact 132.13 MB 0 B 132.13 MB -100.0%
hits_82.vortex 1.0 vortex-compact 66.59 MB 0 B 66.59 MB -100.0%
hits_46.vortex 1.0 vortex-compact 41.67 MB 0 B 41.67 MB -100.0%
hits_93.vortex 1.0 vortex-compact 58.65 MB 0 B 58.65 MB -100.0%
hits_33.vortex 1.0 vortex-compact 35.72 MB 0 B 35.72 MB -100.0%
hits_18.vortex 1.0 vortex-compact 64.03 MB 0 B 64.03 MB -100.0%
hits_61.vortex 1.0 vortex-compact 57.40 MB 0 B 57.40 MB -100.0%
hits_85.vortex 1.0 vortex-compact 52.51 MB 0 B 52.51 MB -100.0%
hits_32.vortex 1.0 vortex-compact 43.89 MB 0 B 43.89 MB -100.0%
hits_59.vortex 1.0 vortex-compact 65.96 MB 0 B 65.96 MB -100.0%
hits_3.vortex 1.0 vortex-compact 93.91 MB 0 B 93.91 MB -100.0%
hits_72.vortex 1.0 vortex-compact 51.54 MB 0 B 51.54 MB -100.0%
hits_16.vortex 1.0 vortex-compact 48.10 MB 0 B 48.10 MB -100.0%
hits_69.vortex 1.0 vortex-compact 80.76 MB 0 B 80.76 MB -100.0%
hits_76.vortex 1.0 vortex-compact 76.12 MB 0 B 76.12 MB -100.0%
hits_31.vortex 1.0 vortex-compact 55.28 MB 0 B 55.28 MB -100.0%
hits_89.vortex 1.0 vortex-compact 112.45 MB 0 B 112.45 MB -100.0%
hits_15.vortex 1.0 vortex-compact 47.88 MB 0 B 47.88 MB -100.0%
hits_90.vortex 1.0 vortex-compact 81.59 MB 0 B 81.59 MB -100.0%
hits_49.vortex 1.0 vortex-compact 50.27 MB 0 B 50.27 MB -100.0%
hits_57.vortex 1.0 vortex-compact 83.30 MB 0 B 83.30 MB -100.0%
hits_37.vortex 1.0 vortex-compact 53.61 MB 0 B 53.61 MB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_22.vortex 1.0 vortex-compact 44.48 MB 0 B 44.48 MB -100.0%
hits_54.vortex 1.0 vortex-compact 117.25 MB 0 B 117.25 MB -100.0%
hits_60.vortex 1.0 vortex-compact 64.06 MB 0 B 64.06 MB -100.0%
hits_45.vortex 1.0 vortex-compact 75.70 MB 0 B 75.70 MB -100.0%
hits_77.vortex 1.0 vortex-compact 117.87 MB 0 B 117.87 MB -100.0%
hits_48.vortex 1.0 vortex-compact 17.12 MB 0 B 17.12 MB -100.0%
hits_58.vortex 1.0 vortex-compact 60.19 MB 0 B 60.19 MB -100.0%
hits_96.vortex 1.0 vortex-compact 90.83 MB 0 B 90.83 MB -100.0%
hits_29.vortex 1.0 vortex-compact 36.38 MB 0 B 36.38 MB -100.0%
hits_21.vortex 1.0 vortex-compact 51.31 MB 0 B 51.31 MB -100.0%
hits_64.vortex 1.0 vortex-compact 53.69 MB 0 B 53.69 MB -100.0%
hits_83.vortex 1.0 vortex-compact 52.30 MB 0 B 52.30 MB -100.0%
hits_66.vortex 1.0 vortex-compact 53.26 MB 0 B 53.26 MB -100.0%
hits_9.vortex 1.0 vortex-compact 65.45 MB 0 B 65.45 MB -100.0%
hits_20.vortex 1.0 vortex-compact 37.88 MB 0 B 37.88 MB -100.0%
hits_56.vortex 1.0 vortex-compact 77.69 MB 0 B 77.69 MB -100.0%
hits_74.vortex 1.0 vortex-compact 71.37 MB 0 B 71.37 MB -100.0%
hits_50.vortex 1.0 vortex-compact 112.75 MB 0 B 112.75 MB -100.0%
hits_7.vortex 1.0 vortex-compact 63.58 MB 0 B 63.58 MB -100.0%
hits_47.vortex 1.0 vortex-compact 18.06 MB 0 B 18.06 MB -100.0%
hits_6.vortex 1.0 vortex-compact 62.94 MB 0 B 62.94 MB -100.0%
hits_62.vortex 1.0 vortex-compact 74.04 MB 0 B 74.04 MB -100.0%
hits_94.vortex 1.0 vortex-compact 90.36 MB 0 B 90.36 MB -100.0%
hits_2.vortex 1.0 vortex-compact 129.05 MB 0 B 129.05 MB -100.0%
hits_25.vortex 1.0 vortex-compact 72.87 MB 0 B 72.87 MB -100.0%
hits_88.vortex 1.0 vortex-compact 73.07 MB 0 B 73.07 MB -100.0%
hits_92.vortex 1.0 vortex-compact 94.00 MB 0 B 94.00 MB -100.0%

Totals:

  • vortex-compact: 7.03 GB → 0 B (-100.0%)
  • vortex-file-compressed: 13.88 GB → 13.90 GB (+0.1%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +6.1%
Vortex (geomean): 1.118x ➖
Parquet (geomean): 1.054x ➖
Shifts: Parquet (control) +5.4% · Median polish +7.7%


datafusion / vortex-file-compressed (1.236x ➖, 1↑ 9↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 549460705 199597542 2.75
tpch_q02/datafusion:vortex-file-compressed 🚨 634525497 444769819 1.43
tpch_q03/datafusion:vortex-file-compressed 431460727 343484176 1.26
tpch_q04/datafusion:vortex-file-compressed 🚨 254374467 181976994 1.40
tpch_q05/datafusion:vortex-file-compressed 428386709 378220489 1.13
tpch_q06/datafusion:vortex-file-compressed 🚨 400785544 266223568 1.51
tpch_q07/datafusion:vortex-file-compressed 🚨 485452459 349955866 1.39
tpch_q08/datafusion:vortex-file-compressed 624268601 554274771 1.13
tpch_q09/datafusion:vortex-file-compressed 445505664 354997801 1.25
tpch_q10/datafusion:vortex-file-compressed 497655014 431260601 1.15
tpch_q11/datafusion:vortex-file-compressed 343286414 312227182 1.10
tpch_q12/datafusion:vortex-file-compressed 🚨 480432021 354021323 1.36
tpch_q13/datafusion:vortex-file-compressed 180175141 156358784 1.15
tpch_q14/datafusion:vortex-file-compressed 256291927 261219876 0.98
tpch_q15/datafusion:vortex-file-compressed 485261251 454906807 1.07
tpch_q16/datafusion:vortex-file-compressed 🚀 207529522 365868625 0.57
tpch_q17/datafusion:vortex-file-compressed 361862897 409285463 0.88
tpch_q18/datafusion:vortex-file-compressed 386128047 339267584 1.14
tpch_q19/datafusion:vortex-file-compressed 536327523 439836570 1.22
tpch_q20/datafusion:vortex-file-compressed 🚨 603916254 382468202 1.58
tpch_q21/datafusion:vortex-file-compressed 🚨 682983549 470750523 1.45
tpch_q22/datafusion:vortex-file-compressed 🚨 219262917 159290368 1.38
datafusion / vortex-compact (1.085x ➖, 1↑ 3↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 264636633 232639589 1.14
tpch_q02/datafusion:vortex-compact 513364920 414116105 1.24
tpch_q03/datafusion:vortex-compact 414161704 399996754 1.04
tpch_q04/datafusion:vortex-compact 299414566 272135171 1.10
tpch_q05/datafusion:vortex-compact 514560020 397110492 1.30
tpch_q06/datafusion:vortex-compact 🚨 429346351 328264255 1.31
tpch_q07/datafusion:vortex-compact 🚨 612344782 450551164 1.36
tpch_q08/datafusion:vortex-compact 592948553 588125624 1.01
tpch_q09/datafusion:vortex-compact 506374096 476637149 1.06
tpch_q10/datafusion:vortex-compact 492752236 483515370 1.02
tpch_q11/datafusion:vortex-compact 251553770 281143827 0.89
tpch_q12/datafusion:vortex-compact 🚨 564450169 403100115 1.40
tpch_q13/datafusion:vortex-compact 169199821 157376548 1.08
tpch_q14/datafusion:vortex-compact 361304712 291957083 1.24
tpch_q15/datafusion:vortex-compact 552188711 523448142 1.05
tpch_q16/datafusion:vortex-compact 192047643 187391450 1.02
tpch_q17/datafusion:vortex-compact 378099577 347710610 1.09
tpch_q18/datafusion:vortex-compact 293169304 286383154 1.02
tpch_q19/datafusion:vortex-compact 455073492 443510966 1.03
tpch_q20/datafusion:vortex-compact 441227472 426679273 1.03
tpch_q21/datafusion:vortex-compact 576588785 507319610 1.14
tpch_q22/datafusion:vortex-compact 🚀 148134035 241886345 0.61
datafusion / parquet (1.055x ➖, 0↑ 1↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 244355769 252175272 0.97
tpch_q02/datafusion:parquet 🚨 616538569 437846786 1.41
tpch_q03/datafusion:parquet 351345575 305676976 1.15
tpch_q04/datafusion:parquet 147887788 153496288 0.96
tpch_q05/datafusion:parquet 523234721 508167032 1.03
tpch_q06/datafusion:parquet 165541963 138306373 1.20
tpch_q07/datafusion:parquet 570906905 520838073 1.10
tpch_q08/datafusion:parquet 639053961 601079926 1.06
tpch_q09/datafusion:parquet 473368011 509992617 0.93
tpch_q10/datafusion:parquet 525594881 501018236 1.05
tpch_q11/datafusion:parquet 390780227 378930583 1.03
tpch_q12/datafusion:parquet 259471436 257373388 1.01
tpch_q13/datafusion:parquet 432197101 448491547 0.96
tpch_q14/datafusion:parquet 224914493 189799964 1.19
tpch_q15/datafusion:parquet 332987543 291725236 1.14
tpch_q16/datafusion:parquet 209478478 175860352 1.19
tpch_q17/datafusion:parquet 427877032 400965258 1.07
tpch_q18/datafusion:parquet 503655862 439237319 1.15
tpch_q19/datafusion:parquet 331209111 404872787 0.82
tpch_q20/datafusion:parquet 352698883 363439453 0.97
tpch_q21/datafusion:parquet 529560503 611483644 0.87
tpch_q22/datafusion:parquet 124619328 110583348 1.13
duckdb / vortex-file-compressed (1.090x ➖, 0↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 291497005 278633860 1.05
tpch_q02/duckdb:vortex-file-compressed 1044726796 948661244 1.10
tpch_q03/duckdb:vortex-file-compressed 686099312 622491005 1.10
tpch_q04/duckdb:vortex-file-compressed 385409877 356537799 1.08
tpch_q05/duckdb:vortex-file-compressed 973609443 873697175 1.11
tpch_q06/duckdb:vortex-file-compressed 515880786 427121580 1.21
tpch_q07/duckdb:vortex-file-compressed 750151511 721914143 1.04
tpch_q08/duckdb:vortex-file-compressed 984017946 868684763 1.13
tpch_q09/duckdb:vortex-file-compressed 906523014 877603160 1.03
tpch_q10/duckdb:vortex-file-compressed 774956797 660277564 1.17
tpch_q11/duckdb:vortex-file-compressed 580656663 503469509 1.15
tpch_q12/duckdb:vortex-file-compressed 501865957 467737938 1.07
tpch_q13/duckdb:vortex-file-compressed 482198325 474067120 1.02
tpch_q14/duckdb:vortex-file-compressed 591949254 461528099 1.28
tpch_q15/duckdb:vortex-file-compressed 323313873 305599934 1.06
tpch_q16/duckdb:vortex-file-compressed 408284676 371565728 1.10
tpch_q17/duckdb:vortex-file-compressed 693151540 650294612 1.07
tpch_q18/duckdb:vortex-file-compressed 540175833 548451497 0.98
tpch_q19/duckdb:vortex-file-compressed 461762847 474143805 0.97
tpch_q20/duckdb:vortex-file-compressed 855645765 795430320 1.08
tpch_q21/duckdb:vortex-file-compressed 1170866173 1049416163 1.12
tpch_q22/duckdb:vortex-file-compressed 386492681 352848910 1.10
duckdb / vortex-compact (1.071x ➖, 0↑ 2↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 335157732 295269576 1.14
tpch_q02/duckdb:vortex-compact 987215278 922102037 1.07
tpch_q03/duckdb:vortex-compact 620570079 571974570 1.08
tpch_q04/duckdb:vortex-compact 344559501 374965521 0.92
tpch_q05/duckdb:vortex-compact 954764230 809393860 1.18
tpch_q06/duckdb:vortex-compact 🚨 590689403 401399185 1.47
tpch_q07/duckdb:vortex-compact 740615505 681390093 1.09
tpch_q08/duckdb:vortex-compact 857325917 914789162 0.94
tpch_q09/duckdb:vortex-compact 954951038 888617204 1.07
tpch_q10/duckdb:vortex-compact 815621867 706815743 1.15
tpch_q11/duckdb:vortex-compact 469997377 502057579 0.94
tpch_q12/duckdb:vortex-compact 493483004 478209354 1.03
tpch_q13/duckdb:vortex-compact 439350245 449154760 0.98
tpch_q14/duckdb:vortex-compact 🚨 714778421 422981252 1.69
tpch_q15/duckdb:vortex-compact 314105516 307006736 1.02
tpch_q16/duckdb:vortex-compact 353611429 378809498 0.93
tpch_q17/duckdb:vortex-compact 629266699 599741059 1.05
tpch_q18/duckdb:vortex-compact 479406263 514818303 0.93
tpch_q19/duckdb:vortex-compact 482602134 470323531 1.03
tpch_q20/duckdb:vortex-compact 754031452 765260963 0.99
tpch_q21/duckdb:vortex-compact 1093547654 977115025 1.12
tpch_q22/duckdb:vortex-compact 345296850 345297692 1.00
duckdb / parquet (1.053x ➖, 0↑ 0↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 490349625 513748905 0.95
tpch_q02/duckdb:parquet 1388664389 1350152185 1.03
tpch_q03/duckdb:parquet 1068848387 986626896 1.08
tpch_q04/duckdb:parquet 696629897 638279639 1.09
tpch_q05/duckdb:parquet 1576634003 1544773961 1.02
tpch_q06/duckdb:parquet 427539392 447987053 0.95
tpch_q07/duckdb:parquet 1309227277 1212898738 1.08
tpch_q08/duckdb:parquet 1735427183 1728961128 1.00
tpch_q09/duckdb:parquet 1452087023 1421283544 1.02
tpch_q10/duckdb:parquet 1399527658 1359940875 1.03
tpch_q11/duckdb:parquet 999640630 830118096 1.20
tpch_q12/duckdb:parquet 715000089 587565114 1.22
tpch_q13/duckdb:parquet 901039483 860818692 1.05
tpch_q14/duckdb:parquet 763243169 718895169 1.06
tpch_q15/duckdb:parquet 558465866 523665616 1.07
tpch_q16/duckdb:parquet 596114636 551561755 1.08
tpch_q17/duckdb:parquet 836830591 772251314 1.08
tpch_q18/duckdb:parquet 843264500 842768531 1.00
tpch_q19/duckdb:parquet 807317568 821757651 0.98
tpch_q20/duckdb:parquet 1127870892 1089257368 1.04
tpch_q21/duckdb:parquet 1244626425 1177744123 1.06
tpch_q22/duckdb:parquet 528139354 473785401 1.11
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +13.8% -3.8% +18.3% +73.8% ➖ noise
1 datafusion:vortex-file-compressed +175.3% -3.8% +186.2% +70.6% 🚨 regression
1 duckdb:vortex-compact +13.5% -3.8% +18.0% +41.1% ➖ noise
1 duckdb:vortex-file-compressed +4.6% -3.8% +8.8% +46.3% ➖ noise
2 datafusion:vortex-compact +24.0% +20.3% +3.0% +30.3% ➖ noise
2 datafusion:vortex-file-compressed +42.7% +20.3% +18.5% +35.5% ➖ noise
2 duckdb:vortex-compact +7.1% +20.3% -11.0% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +10.1% +20.3% -8.5% +30.0% ➖ noise
3 datafusion:vortex-compact +3.5% +11.6% -7.2% +51.2% ➖ noise
3 datafusion:vortex-file-compressed +25.6% +11.6% +12.6% +63.3% ➖ noise
3 duckdb:vortex-compact +8.5% +11.6% -2.8% +31.7% ➖ noise
3 duckdb:vortex-file-compressed +10.2% +11.6% -1.2% +32.1% ➖ noise
4 datafusion:vortex-compact +10.0% +2.5% +7.3% +43.8% ➖ noise
4 datafusion:vortex-file-compressed +39.8% +2.5% +36.3% +30.0% 🚨 regression
4 duckdb:vortex-compact -8.1% +2.5% -10.4% +40.2% ➖ noise
4 duckdb:vortex-file-compressed +8.1% +2.5% +5.4% +30.0% ➖ noise
5 datafusion:vortex-compact +29.6% +2.5% +26.4% +41.1% ➖ noise
5 datafusion:vortex-file-compressed +13.3% +2.5% +10.5% +30.0% ➖ noise
5 duckdb:vortex-compact +18.0% +2.5% +15.1% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +11.4% +2.5% +8.7% +30.0% ➖ noise
6 datafusion:vortex-compact +30.8% +6.9% +22.4% +35.8% ➖ noise
6 datafusion:vortex-file-compressed +50.5% +6.9% +40.9% +30.0% 🚨 regression
6 duckdb:vortex-compact +47.2% +6.9% +37.7% +30.0% 🚨 regression
6 duckdb:vortex-file-compressed +20.8% +6.9% +13.0% +30.0% ➖ noise
7 datafusion:vortex-compact +35.9% +8.8% +24.9% +34.2% ➖ noise
7 datafusion:vortex-file-compressed +38.7% +8.8% +27.5% +30.0% ➖ noise
7 duckdb:vortex-compact +8.7% +8.8% -0.1% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +3.9% +8.8% -4.5% +30.0% ➖ noise
8 datafusion:vortex-compact +0.8% +3.3% -2.4% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +12.6% +3.3% +9.0% +30.0% ➖ noise
8 duckdb:vortex-compact -6.3% +3.3% -9.3% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +13.3% +3.3% +9.7% +30.0% ➖ noise
9 datafusion:vortex-compact +6.2% -2.6% +9.1% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +25.5% -2.6% +28.9% +30.0% ➖ noise
9 duckdb:vortex-compact +7.5% -2.6% +10.4% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +3.3% -2.6% +6.1% +30.0% ➖ noise
10 datafusion:vortex-compact +1.9% +3.9% -1.9% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +15.4% +3.9% +11.1% +30.0% ➖ noise
10 duckdb:vortex-compact +15.4% +3.9% +11.1% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +17.4% +3.9% +13.0% +30.0% ➖ noise
11 datafusion:vortex-compact -10.5% +11.4% -19.7% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +9.9% +11.4% -1.3% +30.0% ➖ noise
11 duckdb:vortex-compact -6.4% +11.4% -16.0% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +15.3% +11.4% +3.5% +30.0% ➖ noise
12 datafusion:vortex-compact +40.0% +10.8% +26.4% +34.3% ➖ noise
12 datafusion:vortex-file-compressed +35.7% +10.8% +22.5% +30.0% ➖ noise
12 duckdb:vortex-compact +3.2% +10.8% -6.8% +31.4% ➖ noise
12 duckdb:vortex-file-compressed +7.3% +10.8% -3.1% +30.0% ➖ noise
13 datafusion:vortex-compact +7.5% +0.4% +7.0% +61.6% ➖ noise
13 datafusion:vortex-file-compressed +15.2% +0.4% +14.7% +42.1% ➖ noise
13 duckdb:vortex-compact -2.2% +0.4% -2.6% +40.9% ➖ noise
13 duckdb:vortex-file-compressed +1.7% +0.4% +1.3% +36.2% ➖ noise
14 datafusion:vortex-compact +23.8% +12.2% +10.3% +37.7% ➖ noise
14 datafusion:vortex-file-compressed -1.9% +12.2% -12.5% +34.4% ➖ noise
14 duckdb:vortex-compact +69.0% +12.2% +50.7% +30.0% 🚨 regression
14 duckdb:vortex-file-compressed +28.3% +12.2% +14.3% +30.0% ➖ noise
15 datafusion:vortex-compact +5.5% +10.3% -4.4% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +6.7% +10.3% -3.3% +30.0% ➖ noise
15 duckdb:vortex-compact +2.3% +10.3% -7.3% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +5.8% +10.3% -4.1% +30.0% ➖ noise
16 datafusion:vortex-compact +2.5% +13.5% -9.7% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -43.3% +13.5% -50.0% +37.3% ✅ faster
16 duckdb:vortex-compact -6.7% +13.5% -17.7% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +9.9% +13.5% -3.2% +30.0% ➖ noise
17 datafusion:vortex-compact +8.7% +7.5% +1.1% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -11.6% +7.5% -17.8% +40.2% ➖ noise
17 duckdb:vortex-compact +4.9% +7.5% -2.4% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +6.6% +7.5% -0.9% +30.0% ➖ noise
18 datafusion:vortex-compact +2.4% +7.1% -4.4% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +13.8% +7.1% +6.3% +30.0% ➖ noise
18 duckdb:vortex-compact -6.9% +7.1% -13.1% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -1.5% +7.1% -8.0% +30.0% ➖ noise
19 datafusion:vortex-compact +2.6% -10.4% +14.5% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +21.9% -10.4% +36.0% +30.0% 🚨 regression
19 duckdb:vortex-compact +2.6% -10.4% +14.5% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -2.6% -10.4% +8.6% +30.0% ➖ noise
20 datafusion:vortex-compact +3.4% +0.2% +3.2% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +57.9% +0.2% +57.5% +30.0% 🚨 regression
20 duckdb:vortex-compact -1.5% +0.2% -1.7% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +7.6% +0.2% +7.3% +30.0% ➖ noise
21 datafusion:vortex-compact +13.7% -4.3% +18.8% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +45.1% -4.3% +51.7% +30.0% 🚨 regression
21 duckdb:vortex-compact +11.9% -4.3% +17.0% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +11.6% -4.3% +16.6% +30.0% ➖ noise
22 datafusion:vortex-compact -38.8% +12.1% -45.4% +41.4% ✅ faster
22 datafusion:vortex-file-compressed +37.6% +12.1% +22.8% +37.3% ➖ noise
22 duckdb:vortex-compact -0.0% +12.1% -10.8% +31.6% ➖ noise
22 duckdb:vortex-file-compressed +9.5% +12.1% -2.3% +31.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.055x ➖
Parquet (geomean): 1.029x ➖


unknown / unknown (1.038x ➖, 0↑ 18↓)
name PR 8622793 (ns) base 9406303 (ns) ratio (PR/base)
compress time/Arade 1266966561 1197117783 1.06
compress time/Bimbo 7302983581 7218317130 1.01
compress time/CMSprovider 🚨 3230575229 2932866407 1.10
compress time/Euro2016 469082152 439032264 1.07
compress time/Food 415009820 400030646 1.04
compress time/HashTags 🚨 1010813844 819920738 1.23
compress time/TPC-H l_comment canonical 1321338173 1308998380 1.01
compress time/TPC-H l_comment chunked 1346224016 1321040374 1.02
compress time/taxi 🚨 859936676 718859501 1.20
compress time/wide table cols=100 chunks=1 rows=1000 12894170 12745622 1.01
compress time/wide table cols=100 chunks=50 rows=1000 13020574 13030780 1.00
compress time/wide table cols=1000 chunks=1 rows=1000 138668593 135108934 1.03
compress time/wide table cols=1000 chunks=50 rows=1000 138174794 138506820 1.00
compress time/wide table cols=10000 chunks=1 rows=1000 1410296717 1415166601 1.00
compress time/wide table cols=10000 chunks=50 rows=1000 1418252710 1435480583 0.99
decompress time/Arade 🚨 49747133 32587493 1.53
decompress time/Bimbo 🚨 212948544 106095694 2.01
decompress time/CMSprovider 🚨 107481800 85641756 1.26
decompress time/Euro2016 21532476 20609398 1.04
decompress time/Food 🚨 11665428 9564160 1.22
decompress time/HashTags 79130026 80003548 0.99
decompress time/TPC-H l_comment canonical 45097429 41536986 1.09
decompress time/TPC-H l_comment chunked 43589906 42570529 1.02
decompress time/taxi 🚨 27580812 22357859 1.23
decompress time/wide table cols=100 chunks=1 rows=1000 2853227 2972470 0.96
decompress time/wide table cols=100 chunks=50 rows=1000 2684993 2927522 0.92
decompress time/wide table cols=1000 chunks=1 rows=1000 24584200 24474266 1.00
decompress time/wide table cols=1000 chunks=50 rows=1000 25244586 25176171 1.00
decompress time/wide table cols=10000 chunks=1 rows=1000 250179068 261147276 0.96
decompress time/wide table cols=10000 chunks=50 rows=1000 249069146 261592725 0.95
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3026158405 3048851605 0.99
parquet_rs-zstd compress time/Bimbo 17331283137 17197471784 1.01
parquet_rs-zstd compress time/CMSprovider 7734466391 7827557918 0.99
parquet_rs-zstd compress time/Euro2016 1341805204 1348863098 0.99
parquet_rs-zstd compress time/Food 931624881 928351545 1.00
parquet_rs-zstd compress time/HashTags 2463632996 2509327225 0.98
parquet_rs-zstd compress time/TPC-H l_comment canonical 3112266058 3132527869 0.99
parquet_rs-zstd compress time/TPC-H l_comment chunked 3071616406 3108641766 0.99
parquet_rs-zstd compress time/taxi 1525798532 1531271638 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6764128 6738752 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6656987 6880694 0.97
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 84927779 92607466 0.92
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 85816304 89613134 0.96
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 884624206 890197768 0.99
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 858929008 913826947 0.94
parquet_rs-zstd decompress time/Arade 649358118 655183891 0.99
parquet_rs-zstd decompress time/Bimbo 1734836296 1747752449 0.99
parquet_rs-zstd decompress time/CMSprovider 1921744362 1943632074 0.99
parquet_rs-zstd decompress time/Euro2016 385286057 390975089 0.99
parquet_rs-zstd decompress time/Food 220212151 219941971 1.00
parquet_rs-zstd decompress time/HashTags 620211751 646997093 0.96
parquet_rs-zstd decompress time/TPC-H l_comment canonical 559106149 572049276 0.98
parquet_rs-zstd decompress time/TPC-H l_comment chunked 560368826 566423943 0.99
parquet_rs-zstd decompress time/taxi 248174106 247414817 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2751131 2736414 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2654454 2685213 0.99
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 31219920 33064844 0.94
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 31467949 32773002 0.96
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 375472714 374044127 1.00
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 369122826 372144895 0.99
vortex-file-compressed size/Arade 147508596 145363828 1.01
vortex-file-compressed size/Bimbo 485566692 468763364 1.04
vortex-file-compressed size/CMSprovider 420392012 417907844 1.01
vortex-file-compressed size/Euro2016 163288596 163599188 1.00
vortex-file-compressed size/Food 42589608 41926968 1.02
vortex-file-compressed size/HashTags 204795908 195647860 1.05
vortex-file-compressed size/TPC-H l_comment canonical 181357208 179087392 1.01
vortex-file-compressed size/TPC-H l_comment chunked 181357208 179087392 1.01
vortex-file-compressed size/taxi 53249412 52363980 1.02
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930880 930880 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930880 930880 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293680 9293680 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293680 9293680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957680 92957680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957680 92957680 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.07
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.00
vortex:parquet-zstd ratio compress time/CMSprovider 🚨 0 0 1.11
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.07
vortex:parquet-zstd ratio compress time/Food 0 0 1.03
vortex:parquet-zstd ratio compress time/HashTags 🚨 0 0 1.26
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.02
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.03
vortex:parquet-zstd ratio compress time/taxi 🚨 0 0 1.20
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 🚨 1 1 1.12
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.04
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.05
vortex:parquet-zstd ratio decompress time/Arade 🚨 0 0 1.54
vortex:parquet-zstd ratio decompress time/Bimbo 🚨 0 0 2.02
vortex:parquet-zstd ratio decompress time/CMSprovider 🚨 0 0 1.27
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.06
vortex:parquet-zstd ratio decompress time/Food 🚨 0 0 1.22
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.03
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 🚨 0 0 1.11
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.04
vortex:parquet-zstd ratio decompress time/taxi 🚨 0 0 1.23
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1 1 0.95
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 1 1 0.93
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.06
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.95
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.96
vortex:parquet-zstd size/Arade 0 0 1.01
vortex:parquet-zstd size/Bimbo 1 1 1.04
vortex:parquet-zstd size/CMSprovider 1 1 1.01
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.02
vortex:parquet-zstd size/HashTags 1 1 1.05
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.01
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.01
vortex:parquet-zstd size/taxi 0 0 1.02
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +6.1%
Vortex (geomean): 1.087x ➖
Parquet (geomean): 1.024x ➖
Shifts: Parquet (control) +2.4% · Median polish +4.9%


datafusion / vortex-file-compressed (1.106x ➖, 1↑ 2↓)
name PR 8622793 (ns) base bff43dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 816907531 681921591 1.20
tpch_q02/datafusion:vortex-file-compressed 922512014 918664157 1.00
tpch_q03/datafusion:vortex-file-compressed 916644128 873348931 1.05
tpch_q04/datafusion:vortex-file-compressed 661833322 628976974 1.05
tpch_q05/datafusion:vortex-file-compressed 1069817238 1028451390 1.04
tpch_q06/datafusion:vortex-file-compressed 884268999 689685533 1.28
tpch_q07/datafusion:vortex-file-compressed 1245617139 1102916232 1.13
tpch_q08/datafusion:vortex-file-compressed 1301302259 1212721985 1.07
tpch_q09/datafusion:vortex-file-compressed 1426025279 1357014879 1.05
tpch_q10/datafusion:vortex-file-compressed 1106610814 957306002 1.16
tpch_q11/datafusion:vortex-file-compressed 563263671 498504546 1.13
tpch_q12/datafusion:vortex-file-compressed 🚨 2588853555 1150451116 2.25
tpch_q13/datafusion:vortex-file-compressed 573482527 470655452 1.22
tpch_q14/datafusion:vortex-file-compressed 🚨 831051726 618230921 1.34
tpch_q15/datafusion:vortex-file-compressed 1370632724 1259696529 1.09
tpch_q16/datafusion:vortex-file-compressed 490991942 474963381 1.03
tpch_q17/datafusion:vortex-file-compressed 1225932573 1199047573 1.02
tpch_q18/datafusion:vortex-file-compressed 1343856310 1300299007 1.03
tpch_q19/datafusion:vortex-file-compressed 915164277 774311886 1.18
tpch_q20/datafusion:vortex-file-compressed 1136115704 1025936084 1.11
tpch_q21/datafusion:vortex-file-compressed 1742301667 1838504549 0.95
tpch_q22/datafusion:vortex-file-compressed 🚀 449807979 788570182 0.57
datafusion / vortex-compact (1.089x ➖, 1↑ 5↓)
name PR 8622793 (ns) base bff43dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 838312273 924976635 0.91
tpch_q02/datafusion:vortex-compact 🚀 663405245 1153539417 0.58
tpch_q03/datafusion:vortex-compact 795315453 900324911 0.88
tpch_q04/datafusion:vortex-compact 576255607 580293468 0.99
tpch_q05/datafusion:vortex-compact 1028069367 907555134 1.13
tpch_q06/datafusion:vortex-compact 🚨 882173066 633130262 1.39
tpch_q07/datafusion:vortex-compact 1166972017 1011526402 1.15
tpch_q08/datafusion:vortex-compact 1171458588 1096718587 1.07
tpch_q09/datafusion:vortex-compact 1315722022 1569236843 0.84
tpch_q10/datafusion:vortex-compact 1069709969 989116024 1.08
tpch_q11/datafusion:vortex-compact 🚨 647309838 457591080 1.41
tpch_q12/datafusion:vortex-compact 1313257140 1071218580 1.23
tpch_q13/datafusion:vortex-compact 438982205 458793593 0.96
tpch_q14/datafusion:vortex-compact 760044419 585110805 1.30
tpch_q15/datafusion:vortex-compact 🚨 1429006578 1018870553 1.40
tpch_q16/datafusion:vortex-compact 🚨 555569171 331383294 1.68
tpch_q17/datafusion:vortex-compact 1446873000 1208521606 1.20
tpch_q18/datafusion:vortex-compact 1216026728 1129634581 1.08
tpch_q19/datafusion:vortex-compact 877644659 843038509 1.04
tpch_q20/datafusion:vortex-compact 1077701805 1107500983 0.97
tpch_q21/datafusion:vortex-compact 1470844132 1714092786 0.86
tpch_q22/datafusion:vortex-compact 🚨 498294193 346602041 1.44
datafusion / parquet (1.059x ➖, 0↑ 2↓)
name PR 8622793 (ns) base bff43dc (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 890460273 824746462 1.08
tpch_q02/datafusion:parquet 🚨 1161389544 695574163 1.67
tpch_q03/datafusion:parquet 1125997945 973952853 1.16
tpch_q04/datafusion:parquet 567415443 455494885 1.25
tpch_q05/datafusion:parquet 1296857016 1244446958 1.04
tpch_q06/datafusion:parquet 534030297 504535331 1.06
tpch_q07/datafusion:parquet 1344152298 1460110736 0.92
tpch_q08/datafusion:parquet 1725901561 1653897152 1.04
tpch_q09/datafusion:parquet 1733959573 1866560537 0.93
tpch_q10/datafusion:parquet 2073852747 2326645046 0.89
tpch_q11/datafusion:parquet 655127117 538526571 1.22
tpch_q12/datafusion:parquet 764626445 665235928 1.15
tpch_q13/datafusion:parquet 699845048 712494460 0.98
tpch_q14/datafusion:parquet 775567021 812375481 0.95
tpch_q15/datafusion:parquet 1184661983 1273714742 0.93
tpch_q16/datafusion:parquet 🚨 604278388 455430796 1.33
tpch_q17/datafusion:parquet 1447517109 1471472018 0.98
tpch_q18/datafusion:parquet 1773670271 1542609166 1.15
tpch_q19/datafusion:parquet 984953881 991825158 0.99
tpch_q20/datafusion:parquet 1150713308 1194281706 0.96
tpch_q21/datafusion:parquet 1846362205 1769145264 1.04
tpch_q22/datafusion:parquet 746892475 880561560 0.85
duckdb / vortex-file-compressed (1.095x ➖, 0↑ 2↓)
name PR 8622793 (ns) base bff43dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 734751053 677805869 1.08
tpch_q02/duckdb:vortex-file-compressed 1303067353 1151626613 1.13
tpch_q03/duckdb:vortex-file-compressed 1173211363 1017858655 1.15
tpch_q04/duckdb:vortex-file-compressed 638835349 747058312 0.86
tpch_q05/duckdb:vortex-file-compressed 1200023291 1129222784 1.06
tpch_q06/duckdb:vortex-file-compressed 🚨 1364241164 829942074 1.64
tpch_q07/duckdb:vortex-file-compressed 1227906672 1177821547 1.04
tpch_q08/duckdb:vortex-file-compressed 1513808517 1501471905 1.01
tpch_q09/duckdb:vortex-file-compressed 1600020718 1521173164 1.05
tpch_q10/duckdb:vortex-file-compressed 1327796069 1226107291 1.08
tpch_q11/duckdb:vortex-file-compressed 742039671 643862399 1.15
tpch_q12/duckdb:vortex-file-compressed 854038804 694230282 1.23
tpch_q13/duckdb:vortex-file-compressed 875752379 916208849 0.96
tpch_q14/duckdb:vortex-file-compressed 🚨 1243416553 841915344 1.48
tpch_q15/duckdb:vortex-file-compressed 595177821 554585882 1.07
tpch_q16/duckdb:vortex-file-compressed 523361137 555447968 0.94
tpch_q17/duckdb:vortex-file-compressed 1052055930 978918474 1.07
tpch_q18/duckdb:vortex-file-compressed 1020944184 1075167141 0.95
tpch_q19/duckdb:vortex-file-compressed 915110887 772397507 1.18
tpch_q20/duckdb:vortex-file-compressed 1494181764 1242654998 1.20
tpch_q21/duckdb:vortex-file-compressed 2164325432 2031622136 1.07
tpch_q22/duckdb:vortex-file-compressed 642584468 688616099 0.93
duckdb / vortex-compact (1.058x ➖, 0↑ 3↓)
name PR 8622793 (ns) base bff43dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 831999956 619392743 1.34
tpch_q02/duckdb:vortex-compact 1094428911 1107778898 0.99
tpch_q03/duckdb:vortex-compact 982551030 908337112 1.08
tpch_q04/duckdb:vortex-compact 535453511 548228326 0.98
tpch_q05/duckdb:vortex-compact 1106013162 1102502381 1.00
tpch_q06/duckdb:vortex-compact 🚨 1371884576 702607436 1.95
tpch_q07/duckdb:vortex-compact 1096927466 1059991893 1.03
tpch_q08/duckdb:vortex-compact 1310806488 1387199024 0.94
tpch_q09/duckdb:vortex-compact 1429606499 1423614237 1.00
tpch_q10/duckdb:vortex-compact 1325551154 1157426672 1.15
tpch_q11/duckdb:vortex-compact 650703490 715428123 0.91
tpch_q12/duckdb:vortex-compact 777988337 688422710 1.13
tpch_q13/duckdb:vortex-compact 813140055 893047978 0.91
tpch_q14/duckdb:vortex-compact 🚨 1174437152 867861838 1.35
tpch_q15/duckdb:vortex-compact 529987252 551014170 0.96
tpch_q16/duckdb:vortex-compact 388786611 454942853 0.85
tpch_q17/duckdb:vortex-compact 937462817 894320783 1.05
tpch_q18/duckdb:vortex-compact 743589400 825644439 0.90
tpch_q19/duckdb:vortex-compact 772602106 724972584 1.07
tpch_q20/duckdb:vortex-compact 1231755064 1223726705 1.01
tpch_q21/duckdb:vortex-compact 1796384081 1732902002 1.04
tpch_q22/duckdb:vortex-compact 602835766 589442582 1.02
duckdb / parquet (0.991x ➖, 0↑ 0↓)
name PR 8622793 (ns) base bff43dc (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1009622266 933565149 1.08
tpch_q02/duckdb:parquet 1653962647 1631373050 1.01
tpch_q03/duckdb:parquet 1787578082 1805594387 0.99
tpch_q04/duckdb:parquet 1065028758 1192015432 0.89
tpch_q05/duckdb:parquet 2245828379 2249910131 1.00
tpch_q06/duckdb:parquet 765551493 706637298 1.08
tpch_q07/duckdb:parquet 1853368195 2053703966 0.90
tpch_q08/duckdb:parquet 2706652000 2472301734 1.09
tpch_q09/duckdb:parquet 2397352148 2426129752 0.99
tpch_q10/duckdb:parquet 3257179676 3047282484 1.07
tpch_q11/duckdb:parquet 1047955977 1007035967 1.04
tpch_q12/duckdb:parquet 1077138532 1051154605 1.02
tpch_q13/duckdb:parquet 1258336581 1216834734 1.03
tpch_q14/duckdb:parquet 1343110683 1255195824 1.07
tpch_q15/duckdb:parquet 890372314 888371834 1.00
tpch_q16/duckdb:parquet 754259471 870132595 0.87
tpch_q17/duckdb:parquet 1352916957 1326760433 1.02
tpch_q18/duckdb:parquet 1294935568 1405997600 0.92
tpch_q19/duckdb:parquet 1505522688 1499778761 1.00
tpch_q20/duckdb:parquet 1704048084 1815134196 0.94
tpch_q21/duckdb:parquet 1781316628 2014594558 0.88
tpch_q22/duckdb:parquet 995970726 1072314228 0.93
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -9.4% +8.1% -16.1% +42.2% ➖ noise
1 datafusion:vortex-file-compressed +19.8% +8.1% +10.9% +48.7% ➖ noise
1 duckdb:vortex-compact +34.3% +8.1% +24.3% +33.1% ➖ noise
1 duckdb:vortex-file-compressed +8.4% +8.1% +0.3% +32.4% ➖ noise
2 datafusion:vortex-compact -42.5% +30.1% -55.8% +39.9% ✅ faster
2 datafusion:vortex-file-compressed +0.4% +30.1% -22.8% +46.2% ➖ noise
2 duckdb:vortex-compact -1.2% +30.1% -24.1% +30.8% ✅ faster
2 duckdb:vortex-file-compressed +13.2% +30.1% -13.0% +30.9% ➖ noise
3 datafusion:vortex-compact -11.7% +7.0% -17.4% +46.1% ➖ noise
3 datafusion:vortex-file-compressed +5.0% +7.0% -1.9% +45.0% ➖ noise
3 duckdb:vortex-compact +8.2% +7.0% +1.1% +37.5% ➖ noise
3 duckdb:vortex-file-compressed +15.3% +7.0% +7.7% +37.1% ➖ noise
4 datafusion:vortex-compact -0.7% +5.5% -5.9% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +5.2% +5.5% -0.3% +30.0% ➖ noise
4 duckdb:vortex-compact -2.3% +5.5% -7.4% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -14.5% +5.5% -18.9% +30.1% ➖ noise
5 datafusion:vortex-compact +13.3% +2.0% +11.1% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +4.0% +2.0% +2.0% +30.0% ➖ noise
5 duckdb:vortex-compact +0.3% +2.0% -1.6% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +6.3% +2.0% +4.2% +30.0% ➖ noise
6 datafusion:vortex-compact +39.3% +7.1% +30.1% +30.0% 🚨 regression
6 datafusion:vortex-file-compressed +28.2% +7.1% +19.7% +30.0% ➖ noise
6 duckdb:vortex-compact +95.3% +7.1% +82.3% +30.0% 🚨 regression
6 duckdb:vortex-file-compressed +64.4% +7.1% +53.5% +30.0% 🚨 regression
7 datafusion:vortex-compact +15.4% -8.9% +26.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +12.9% -8.9% +23.9% +30.0% ➖ noise
7 duckdb:vortex-compact +3.5% -8.9% +13.5% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +4.3% -8.9% +14.4% +30.0% ➖ noise
8 datafusion:vortex-compact +6.8% +6.9% -0.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +7.3% +6.9% +0.4% +30.0% ➖ noise
8 duckdb:vortex-compact -5.5% +6.9% -11.6% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +0.8% +6.9% -5.7% +30.0% ➖ noise
9 datafusion:vortex-compact -16.2% -4.2% -12.5% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +5.1% -4.2% +9.7% +30.0% ➖ noise
9 duckdb:vortex-compact +0.4% -4.2% +4.8% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +5.2% -4.2% +9.8% +30.0% ➖ noise
10 datafusion:vortex-compact +8.1% -2.4% +10.8% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +15.6% -2.4% +18.4% +30.0% ➖ noise
10 duckdb:vortex-compact +14.5% -2.4% +17.3% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +8.3% -2.4% +10.9% +30.0% ➖ noise
11 datafusion:vortex-compact +41.5% +12.5% +25.7% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +13.0% +12.5% +0.4% +30.0% ➖ noise
11 duckdb:vortex-compact -9.0% +12.5% -19.2% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +15.2% +12.5% +2.4% +30.0% ➖ noise
12 datafusion:vortex-compact +22.6% +8.5% +13.0% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +125.0% +8.5% +107.3% +38.9% 🚨 regression
12 duckdb:vortex-compact +13.0% +8.5% +4.1% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +23.0% +8.5% +13.4% +30.0% ➖ noise
13 datafusion:vortex-compact -4.3% +0.8% -5.1% +30.0% ➖ noise
13 datafusion:vortex-file-compressed +21.8% +0.8% +20.9% +37.8% ➖ noise
13 duckdb:vortex-compact -8.9% +0.8% -9.7% +39.2% ➖ noise
13 duckdb:vortex-file-compressed -4.4% +0.8% -5.2% +49.5% ➖ noise
14 datafusion:vortex-compact +29.9% +1.1% +28.5% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +34.4% +1.1% +33.0% +30.7% 🚨 regression
14 duckdb:vortex-compact +35.3% +1.1% +33.9% +30.0% 🚨 regression
14 duckdb:vortex-file-compressed +47.7% +1.1% +46.1% +30.0% 🚨 regression
15 datafusion:vortex-compact +40.3% -3.5% +45.3% +30.0% 🚨 regression
15 datafusion:vortex-file-compressed +8.8% -3.5% +12.7% +30.0% ➖ noise
15 duckdb:vortex-compact -3.8% -3.5% -0.4% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +7.3% -3.5% +11.2% +30.0% ➖ noise
16 datafusion:vortex-compact +67.7% +7.2% +56.3% +31.6% 🚨 regression
16 datafusion:vortex-file-compressed +3.4% +7.2% -3.6% +30.0% ➖ noise
16 duckdb:vortex-compact -14.5% +7.2% -20.3% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -5.8% +7.2% -12.1% +31.0% ➖ noise
17 datafusion:vortex-compact +19.7% +0.2% +19.5% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +2.2% +0.2% +2.1% +30.0% ➖ noise
17 duckdb:vortex-compact +4.8% +0.2% +4.7% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +7.5% +0.2% +7.3% +30.0% ➖ noise
18 datafusion:vortex-compact +7.6% +2.9% +4.6% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +3.3% +2.9% +0.4% +30.0% ➖ noise
18 duckdb:vortex-compact -9.9% +2.9% -12.5% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -5.0% +2.9% -7.7% +30.0% ➖ noise
19 datafusion:vortex-compact +4.1% -0.2% +4.3% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +18.2% -0.2% +18.4% +30.0% ➖ noise
19 duckdb:vortex-compact +6.6% -0.2% +6.7% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +18.5% -0.2% +18.7% +30.0% ➖ noise
20 datafusion:vortex-compact -2.7% -4.9% +2.3% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +10.7% -4.9% +16.4% +30.0% ➖ noise
20 duckdb:vortex-compact +0.7% -4.9% +5.8% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +20.2% -4.9% +26.4% +30.0% ➖ noise
21 datafusion:vortex-compact -14.2% -3.9% -10.7% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -5.2% -3.9% -1.3% +30.0% ➖ noise
21 duckdb:vortex-compact +3.7% -3.9% +7.9% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +6.5% -3.9% +10.9% +30.0% ➖ noise
22 datafusion:vortex-compact +43.8% -11.2% +62.0% +32.9% 🚨 regression
22 datafusion:vortex-file-compressed -43.0% -11.2% -35.7% +30.0% ✅ faster
22 duckdb:vortex-compact +2.3% -11.2% +15.2% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -6.7% -11.2% +5.1% +30.0% ➖ noise

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants