Skip to content

Change default segment size#7455

Draft
mprammer wants to merge 1 commit intodevelopfrom
mp/resize-segment-4
Draft

Change default segment size#7455
mprammer wants to merge 1 commit intodevelopfrom
mp/resize-segment-4

Conversation

@mprammer
Copy link
Copy Markdown

Summary

Changes the default segment size. PR for testing.

Testing

N/A

Signed-off-by: Martin Prammer <martin@spiraldb.com>
@mprammer mprammer requested a review from gatesn April 15, 2026 19:16
@mprammer mprammer added the action/benchmark Trigger full benchmarks to run on this PR label Apr 15, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 15, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 333c48f 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.977x ➖


datafusion / vortex-file-compressed (0.977x ➖, 1↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 124464062 123836664 1.01
polarsignals_q01/datafusion:vortex-file-compressed 359113759 371420246 0.97
polarsignals_q02/datafusion:vortex-file-compressed 23915671 24590176 0.97
polarsignals_q03/datafusion:vortex-file-compressed 371233422 365755096 1.01
polarsignals_q04/datafusion:vortex-file-compressed 12006840 11405335 1.05
polarsignals_q05/datafusion:vortex-file-compressed 16712547 16383909 1.02
polarsignals_q06/datafusion:vortex-file-compressed 19353679 19289469 1.00
polarsignals_q07/datafusion:vortex-file-compressed 13568723 14403220 0.94
polarsignals_q08/datafusion:vortex-file-compressed 450672386 442423701 1.02
polarsignals_q09/datafusion:vortex-file-compressed 🚀 10088087 12658430 0.80

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 689.06 MB 689.02 MB 40.95 KB -0.0%

Totals:

  • vortex-file-compressed: 689.06 MB → 689.02 MB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Vortex (geomean): 0.995x ➖
Parquet (geomean): 0.989x ➖
Shifts: Parquet (control) -1.1% · Median polish -0.4%


datafusion / vortex-file-compressed (0.929x ➖, 3↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 4914465 5499087 0.89
fineweb_q01/datafusion:vortex-file-compressed 26259756 26316843 1.00
fineweb_q02/datafusion:vortex-file-compressed 🚀 26809242 32098125 0.84
fineweb_q03/datafusion:vortex-file-compressed 🚀 81817519 95804345 0.85
fineweb_q04/datafusion:vortex-file-compressed 254665644 257295931 0.99
fineweb_q05/datafusion:vortex-file-compressed 226953158 235413104 0.96
fineweb_q06/datafusion:vortex-file-compressed 67150438 70747725 0.95
fineweb_q07/datafusion:vortex-file-compressed 70542578 71806657 0.98
fineweb_q08/datafusion:vortex-file-compressed 25087037 27663290 0.91
datafusion / vortex-compact (1.001x ➖, 0↑ 1↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 5512895 4816728 1.14
fineweb_q01/datafusion:vortex-compact 170873902 165699590 1.03
fineweb_q02/datafusion:vortex-compact 164997590 164605463 1.00
fineweb_q03/datafusion:vortex-compact 1471378283 1451614938 1.01
fineweb_q04/datafusion:vortex-compact 1573826623 1550876441 1.01
fineweb_q05/datafusion:vortex-compact 1248395656 1246873042 1.00
fineweb_q06/datafusion:vortex-compact 692305443 700935884 0.99
fineweb_q07/datafusion:vortex-compact 736990383 792461589 0.93
fineweb_q08/datafusion:vortex-compact 22957796 25477404 0.90
datafusion / parquet (0.985x ➖, 0↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6497920 6571120 0.99
fineweb_q01/datafusion:parquet 277540245 288681894 0.96
fineweb_q02/datafusion:parquet 279528131 285215358 0.98
fineweb_q03/datafusion:parquet 276726527 280063415 0.99
fineweb_q04/datafusion:parquet 298650007 294645028 1.01
fineweb_q05/datafusion:parquet 291576633 289316897 1.01
fineweb_q06/datafusion:parquet 282439154 300582084 0.94
fineweb_q07/datafusion:parquet 279174196 280375112 1.00
fineweb_q08/datafusion:parquet 278712479 280082821 1.00
duckdb / vortex-file-compressed (1.040x ➖, 0↑ 2↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 4551427 3387446 1.34
fineweb_q01/duckdb:vortex-file-compressed 25339683 26440809 0.96
fineweb_q02/duckdb:vortex-file-compressed 28478417 26332065 1.08
fineweb_q03/duckdb:vortex-file-compressed 🚨 177192117 156148170 1.13
fineweb_q04/duckdb:vortex-file-compressed 225891360 235904017 0.96
fineweb_q05/duckdb:vortex-file-compressed 214688046 225116230 0.95
fineweb_q06/duckdb:vortex-file-compressed 67945971 67945707 1.00
fineweb_q07/duckdb:vortex-file-compressed 65596649 67577252 0.97
fineweb_q08/duckdb:vortex-file-compressed 25088715 24790269 1.01
duckdb / vortex-compact (1.016x ➖, 0↑ 1↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 4836328 3994289 1.21
fineweb_q01/duckdb:vortex-compact 107188320 100317081 1.07
fineweb_q02/duckdb:vortex-compact 113981792 113204237 1.01
fineweb_q03/duckdb:vortex-compact 862871212 867815044 0.99
fineweb_q04/duckdb:vortex-compact 910351758 906356560 1.00
fineweb_q05/duckdb:vortex-compact 817071684 864921456 0.94
fineweb_q06/duckdb:vortex-compact 470122324 479163220 0.98
fineweb_q07/duckdb:vortex-compact 487862179 471382258 1.03
fineweb_q08/duckdb:vortex-compact 22207760 24084458 0.92
duckdb / parquet (0.993x ➖, 0↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 36150358 37450887 0.97
fineweb_q01/duckdb:parquet 93055082 91270180 1.02
fineweb_q02/duckdb:parquet 97158011 99234453 0.98
fineweb_q03/duckdb:parquet 306218850 309591404 0.99
fineweb_q04/duckdb:parquet 437411078 436411165 1.00
fineweb_q05/duckdb:parquet 409039704 413561106 0.99
fineweb_q06/duckdb:parquet 200281863 200375106 1.00
fineweb_q07/duckdb:parquet 211197607 210034390 1.01
fineweb_q08/duckdb:parquet 56741943 57263084 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +14.5% -2.3% +17.1% +44.9% ➖ noise
0 datafusion:vortex-file-compressed -10.6% -2.3% -8.5% +92.2% ➖ noise
0 duckdb:vortex-compact +21.1% -2.3% +23.9% +35.3% ➖ noise
0 duckdb:vortex-file-compressed +34.4% -2.3% +37.5% +49.6% ➖ noise
1 datafusion:vortex-compact +3.1% -1.0% +4.2% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -0.2% -1.0% +0.8% +18.2% ➖ noise
1 duckdb:vortex-compact +6.8% -1.0% +7.9% +18.5% ➖ noise
1 duckdb:vortex-file-compressed -4.2% -1.0% -3.2% +49.3% ➖ noise
2 datafusion:vortex-compact +0.2% -2.0% +2.3% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -16.5% -2.0% -14.7% +24.3% ➖ noise
2 duckdb:vortex-compact +0.7% -2.0% +2.8% +10.6% ➖ noise
2 duckdb:vortex-file-compressed +8.2% -2.0% +10.4% +10.0% 🚨 regression
3 datafusion:vortex-compact +1.4% -1.1% +2.5% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -14.6% -1.1% -13.6% +18.7% ➖ noise
3 duckdb:vortex-compact -0.6% -1.1% +0.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +13.5% -1.1% +14.8% +27.6% ➖ noise
4 datafusion:vortex-compact +1.5% +0.8% +0.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -1.0% +0.8% -1.8% +10.0% ➖ noise
4 duckdb:vortex-compact +0.4% +0.8% -0.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -4.2% +0.8% -5.0% +10.0% ➖ noise
5 datafusion:vortex-compact +0.1% -0.2% +0.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -3.6% -0.2% -3.4% +10.0% ➖ noise
5 duckdb:vortex-compact -5.5% -0.2% -5.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -4.6% -0.2% -4.5% +10.0% ➖ noise
6 datafusion:vortex-compact -1.2% -3.1% +1.9% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -5.1% -3.1% -2.1% +15.0% ➖ noise
6 duckdb:vortex-compact -1.9% -3.1% +1.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.0% -3.1% +3.2% +16.4% ➖ noise
7 datafusion:vortex-compact -7.0% +0.1% -7.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -1.8% +0.1% -1.8% +16.0% ➖ noise
7 duckdb:vortex-compact +3.5% +0.1% +3.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -2.9% +0.1% -3.0% +15.4% ➖ noise
8 datafusion:vortex-compact -9.9% -0.7% -9.3% +14.0% ➖ noise
8 datafusion:vortex-file-compressed -9.3% -0.7% -8.7% +30.7% ➖ noise
8 duckdb:vortex-compact -7.8% -0.7% -7.1% +16.2% ➖ noise
8 duckdb:vortex-file-compressed +1.2% -0.7% +1.9% +14.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

File Size Changes (2 files changed, +0.0% overall, 1↑ 1↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.79 GB 1.79 GB +16.70 KB +0.0%
sample.vortex 1.0 vortex-compact 1.23 GB 1.23 GB 16.48 KB -0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (-0.0%)
  • vortex-file-compressed: 1.79 GB → 1.79 GB (+0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.1%
Vortex (geomean): 1.049x ➖
Parquet (geomean): 0.992x ➖
Shifts: Parquet (control) -0.8% · Median polish -0.2%


datafusion / vortex-file-compressed (0.978x ➖, 2↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 49088804 48463064 1.01
tpch_q02/datafusion:vortex-file-compressed 32622848 32615581 1.00
tpch_q03/datafusion:vortex-file-compressed 27337436 27458299 1.00
tpch_q04/datafusion:vortex-file-compressed 19027680 19218861 0.99
tpch_q05/datafusion:vortex-file-compressed 51307518 53884694 0.95
tpch_q06/datafusion:vortex-file-compressed 🚀 9718960 10948296 0.89
tpch_q07/datafusion:vortex-file-compressed 62692693 64085145 0.98
tpch_q08/datafusion:vortex-file-compressed 46534062 46024064 1.01
tpch_q09/datafusion:vortex-file-compressed 54326757 56134736 0.97
tpch_q10/datafusion:vortex-file-compressed 44389939 47561454 0.93
tpch_q11/datafusion:vortex-file-compressed 17561294 17979916 0.98
tpch_q12/datafusion:vortex-file-compressed 🚀 22659214 25285559 0.90
tpch_q13/datafusion:vortex-file-compressed 27315956 27512478 0.99
tpch_q14/datafusion:vortex-file-compressed 16016288 16342576 0.98
tpch_q15/datafusion:vortex-file-compressed 23653547 25504290 0.93
tpch_q16/datafusion:vortex-file-compressed 24953180 24507542 1.02
tpch_q17/datafusion:vortex-file-compressed 64178947 63815634 1.01
tpch_q18/datafusion:vortex-file-compressed 77983745 78835075 0.99
tpch_q19/datafusion:vortex-file-compressed 23865905 23845004 1.00
tpch_q20/datafusion:vortex-file-compressed 33210095 32966061 1.01
tpch_q21/datafusion:vortex-file-compressed 76610836 76440929 1.00
tpch_q22/datafusion:vortex-file-compressed 16557314 16362146 1.01
datafusion / vortex-compact (1.001x ➖, 0↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 53364355 57945557 0.92
tpch_q02/datafusion:vortex-compact 36365545 36997865 0.98
tpch_q03/datafusion:vortex-compact 31530756 30384236 1.04
tpch_q04/datafusion:vortex-compact 23310533 22729060 1.03
tpch_q05/datafusion:vortex-compact 56046094 56566419 0.99
tpch_q06/datafusion:vortex-compact 12915474 13937013 0.93
tpch_q07/datafusion:vortex-compact 68991527 70838848 0.97
tpch_q08/datafusion:vortex-compact 50153771 49572412 1.01
tpch_q09/datafusion:vortex-compact 61744065 61755305 1.00
tpch_q10/datafusion:vortex-compact 52064898 52837729 0.99
tpch_q11/datafusion:vortex-compact 19791881 19908219 0.99
tpch_q12/datafusion:vortex-compact 32749163 34344702 0.95
tpch_q13/datafusion:vortex-compact 36074061 35807789 1.01
tpch_q14/datafusion:vortex-compact 21299156 20461146 1.04
tpch_q15/datafusion:vortex-compact 34376859 34496435 1.00
tpch_q16/datafusion:vortex-compact 29643622 29708259 1.00
tpch_q17/datafusion:vortex-compact 68425063 66950949 1.02
tpch_q18/datafusion:vortex-compact 84422057 83180237 1.01
tpch_q19/datafusion:vortex-compact 36285374 34331213 1.06
tpch_q20/datafusion:vortex-compact 39709124 37811247 1.05
tpch_q21/datafusion:vortex-compact 88296957 86073186 1.03
tpch_q22/datafusion:vortex-compact 17268970 16831629 1.03
datafusion / parquet (1.000x ➖, 0↑ 2↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 134655007 114615825 1.17
tpch_q02/datafusion:parquet 69278900 69983827 0.99
tpch_q03/datafusion:parquet 74926875 73232547 1.02
tpch_q04/datafusion:parquet 48886523 48737089 1.00
tpch_q05/datafusion:parquet 100266397 103345900 0.97
tpch_q06/datafusion:parquet 41581877 44102415 0.94
tpch_q07/datafusion:parquet 112130239 113601790 0.99
tpch_q08/datafusion:parquet 98418640 102812643 0.96
tpch_q09/datafusion:parquet 133253268 132183845 1.01
tpch_q10/datafusion:parquet 120150506 120415344 1.00
tpch_q11/datafusion:parquet 48504812 48946696 0.99
tpch_q12/datafusion:parquet 93353749 86634263 1.08
tpch_q13/datafusion:parquet 201474159 203372457 0.99
tpch_q14/datafusion:parquet 49390885 51287524 0.96
tpch_q15/datafusion:parquet 62516610 66019224 0.95
tpch_q16/datafusion:parquet 49121667 50409301 0.97
tpch_q17/datafusion:parquet 126479394 134413115 0.94
tpch_q18/datafusion:parquet 166540348 164765247 1.01
tpch_q19/datafusion:parquet 🚨 84772094 71702806 1.18
tpch_q20/datafusion:parquet 72721738 76956093 0.94
tpch_q21/datafusion:parquet 146593017 147032628 1.00
tpch_q22/datafusion:parquet 34999675 36123749 0.97
datafusion / arrow (0.998x ➖, 0↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 52854431 54766590 0.97
tpch_q02/datafusion:arrow 21427826 21341400 1.00
tpch_q03/datafusion:arrow 32386842 32767529 0.99
tpch_q04/datafusion:arrow 26736276 27015314 0.99
tpch_q05/datafusion:arrow 75995156 75295483 1.01
tpch_q06/datafusion:arrow 19923944 18951050 1.05
tpch_q07/datafusion:arrow 112519876 109138071 1.03
tpch_q08/datafusion:arrow 43475787 43593003 1.00
tpch_q09/datafusion:arrow 69343815 68711583 1.01
tpch_q10/datafusion:arrow 51058226 51185766 1.00
tpch_q11/datafusion:arrow 11399424 11616688 0.98
tpch_q12/datafusion:arrow 53561806 59388338 0.90
tpch_q13/datafusion:arrow 49005693 48494588 1.01
tpch_q14/datafusion:arrow 21995391 22082535 1.00
tpch_q15/datafusion:arrow 43859503 42965619 1.02
tpch_q16/datafusion:arrow 20919880 21203446 0.99
tpch_q17/datafusion:arrow 69898248 69217735 1.01
tpch_q18/datafusion:arrow 140562621 141127927 1.00
tpch_q19/datafusion:arrow 38266341 37569161 1.02
tpch_q20/datafusion:arrow 37774320 37479834 1.01
tpch_q21/datafusion:arrow 151913805 149716963 1.01
tpch_q22/datafusion:arrow 19794909 20261716 0.98
duckdb / vortex-file-compressed (1.115x ❌, 0↑ 12↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 35319255 33361207 1.06
tpch_q02/duckdb:vortex-file-compressed 🚨 32253111 27771887 1.16
tpch_q03/duckdb:vortex-file-compressed 32415498 30375105 1.07
tpch_q04/duckdb:vortex-file-compressed 🚨 38033606 31131528 1.22
tpch_q05/duckdb:vortex-file-compressed 🚨 38469190 34497453 1.12
tpch_q06/duckdb:vortex-file-compressed 10953434 10954751 1.00
tpch_q07/duckdb:vortex-file-compressed 🚨 42817628 38160004 1.12
tpch_q08/duckdb:vortex-file-compressed 45866052 42387319 1.08
tpch_q09/duckdb:vortex-file-compressed 🚨 92810883 81177480 1.14
tpch_q10/duckdb:vortex-file-compressed 38354126 37577779 1.02
tpch_q11/duckdb:vortex-file-compressed 🚨 18973029 16564231 1.15
tpch_q12/duckdb:vortex-file-compressed 🚨 29581628 23695807 1.25
tpch_q13/duckdb:vortex-file-compressed 37057161 37113741 1.00
tpch_q14/duckdb:vortex-file-compressed 24889379 22655008 1.10
tpch_q15/duckdb:vortex-file-compressed 🚨 18291325 15748857 1.16
tpch_q16/duckdb:vortex-file-compressed 🚨 35016245 31036508 1.13
tpch_q17/duckdb:vortex-file-compressed 27731611 25483239 1.09
tpch_q18/duckdb:vortex-file-compressed 56756519 52048472 1.09
tpch_q19/duckdb:vortex-file-compressed 🚨 36567657 30653277 1.19
tpch_q20/duckdb:vortex-file-compressed 🚨 41287219 33996875 1.21
tpch_q21/duckdb:vortex-file-compressed 🚨 119619593 107886876 1.11
tpch_q22/duckdb:vortex-file-compressed 20683019 18831951 1.10
duckdb / vortex-compact (1.109x ❌, 0↑ 10↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39009576 39542596 0.99
tpch_q02/duckdb:vortex-compact 🚨 46530336 38146737 1.22
tpch_q03/duckdb:vortex-compact 🚨 37243199 32445598 1.15
tpch_q04/duckdb:vortex-compact 🚨 40751258 34108266 1.19
tpch_q05/duckdb:vortex-compact 🚨 43589200 38061707 1.15
tpch_q06/duckdb:vortex-compact 15130300 14461173 1.05
tpch_q07/duckdb:vortex-compact 47701197 43421703 1.10
tpch_q08/duckdb:vortex-compact 🚨 51484926 45904040 1.12
tpch_q09/duckdb:vortex-compact 🚨 101210046 90605583 1.12
tpch_q10/duckdb:vortex-compact 44498175 40846569 1.09
tpch_q11/duckdb:vortex-compact 🚨 25585194 21375827 1.20
tpch_q12/duckdb:vortex-compact 🚨 45482004 36083391 1.26
tpch_q13/duckdb:vortex-compact 48488825 45638459 1.06
tpch_q14/duckdb:vortex-compact 34692921 33943358 1.02
tpch_q15/duckdb:vortex-compact 21047941 20436891 1.03
tpch_q16/duckdb:vortex-compact 🚨 43587470 38024874 1.15
tpch_q17/duckdb:vortex-compact 32714789 30745408 1.06
tpch_q18/duckdb:vortex-compact 59335910 54082224 1.10
tpch_q19/duckdb:vortex-compact 42788283 40541487 1.06
tpch_q20/duckdb:vortex-compact 48851529 45025173 1.08
tpch_q21/duckdb:vortex-compact 118244439 110817418 1.07
tpch_q22/duckdb:vortex-compact 🚨 24719276 20887954 1.18
duckdb / parquet (0.983x ➖, 3↑ 1↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77532576 76250902 1.02
tpch_q02/duckdb:parquet 39462394 39020907 1.01
tpch_q03/duckdb:parquet 72722286 68717189 1.06
tpch_q04/duckdb:parquet 46822617 47411736 0.99
tpch_q05/duckdb:parquet 66280002 65489304 1.01
tpch_q06/duckdb:parquet 🚀 23246715 27301342 0.85
tpch_q07/duckdb:parquet 🚀 67332418 81627654 0.82
tpch_q08/duckdb:parquet 80593631 82328270 0.98
tpch_q09/duckdb:parquet 🚀 133591565 152914347 0.87
tpch_q10/duckdb:parquet 136344409 143565558 0.95
tpch_q11/duckdb:parquet 22131153 23211266 0.95
tpch_q12/duckdb:parquet 46652309 50231226 0.93
tpch_q13/duckdb:parquet 262926359 265696385 0.99
tpch_q14/duckdb:parquet 48365218 48803436 0.99
tpch_q15/duckdb:parquet 23929974 24486145 0.98
tpch_q16/duckdb:parquet 55545557 56986263 0.97
tpch_q17/duckdb:parquet 55332354 57080679 0.97
tpch_q18/duckdb:parquet 120215134 117525465 1.02
tpch_q19/duckdb:parquet 75626265 69088645 1.09
tpch_q20/duckdb:parquet 🚨 80734792 63493325 1.27
tpch_q21/duckdb:parquet 176451087 179372695 0.98
tpch_q22/duckdb:parquet 51761032 52537297 0.99
duckdb / duckdb (1.002x ➖, 0↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16540147 15965128 1.04
tpch_q02/duckdb:duckdb 12440752 12366007 1.01
tpch_q03/duckdb:duckdb 19514311 19396591 1.01
tpch_q04/duckdb:duckdb 19678757 19052127 1.03
tpch_q05/duckdb:duckdb 19803107 20138520 0.98
tpch_q06/duckdb:duckdb 5351726 5326396 1.00
tpch_q07/duckdb:duckdb 21950781 21741821 1.01
tpch_q08/duckdb:duckdb 20975397 20628043 1.02
tpch_q09/duckdb:duckdb 54046539 54316986 1.00
tpch_q10/duckdb:duckdb 43089736 41949523 1.03
tpch_q11/duckdb:duckdb 5905282 5579580 1.06
tpch_q12/duckdb:duckdb 13438141 14081799 0.95
tpch_q13/duckdb:duckdb 37647058 37179778 1.01
tpch_q14/duckdb:duckdb 16033704 15991152 1.00
tpch_q15/duckdb:duckdb 11812104 11828872 1.00
tpch_q16/duckdb:duckdb 23716472 23457774 1.01
tpch_q17/duckdb:duckdb 13489862 13938402 0.97
tpch_q18/duckdb:duckdb 38252292 38210881 1.00
tpch_q19/duckdb:duckdb 26515698 28121276 0.94
tpch_q20/duckdb:duckdb 22069067 22567907 0.98
tpch_q21/duckdb:duckdb 56263017 55719847 1.01
tpch_q22/duckdb:duckdb 23910362 23904627 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -3.5% +9.3% -11.7% +18.8% ➖ noise
1 datafusion:vortex-compact -7.9% +9.3% -15.7% +17.3% ✅ faster
1 datafusion:vortex-file-compressed +1.3% +9.3% -7.3% +18.6% ➖ noise
1 duckdb:duckdb +3.6% +9.3% -5.2% +17.7% ➖ noise
1 duckdb:vortex-compact -1.3% +9.3% -9.7% +16.8% ➖ noise
1 duckdb:vortex-file-compressed +5.9% +9.3% -3.1% +17.6% ➖ noise
2 datafusion:arrow +0.4% +0.1% +0.3% +15.8% ➖ noise
2 datafusion:vortex-compact -1.7% +0.1% -1.8% +15.8% ➖ noise
2 datafusion:vortex-file-compressed +0.0% +0.1% -0.0% +15.8% ➖ noise
2 duckdb:duckdb +0.6% +0.1% +0.5% +15.8% ➖ noise
2 duckdb:vortex-compact +22.0% +0.1% +21.9% +15.8% 🚨 regression
2 duckdb:vortex-file-compressed +16.1% +0.1% +16.1% +15.8% 🚨 regression
3 datafusion:arrow -1.2% +4.1% -5.0% +15.8% ➖ noise
3 datafusion:vortex-compact +3.8% +4.1% -0.3% +15.8% ➖ noise
3 datafusion:vortex-file-compressed -0.4% +4.1% -4.3% +15.8% ➖ noise
3 duckdb:duckdb +0.6% +4.1% -3.3% +15.8% ➖ noise
3 duckdb:vortex-compact +14.8% +4.1% +10.3% +15.8% ➖ noise
3 duckdb:vortex-file-compressed +6.7% +4.1% +2.6% +15.8% ➖ noise
4 datafusion:arrow -1.0% -0.5% -0.6% +15.8% ➖ noise
4 datafusion:vortex-compact +2.6% -0.5% +3.0% +15.8% ➖ noise
4 datafusion:vortex-file-compressed -1.0% -0.5% -0.5% +15.8% ➖ noise
4 duckdb:duckdb +3.3% -0.5% +3.8% +15.8% ➖ noise
4 duckdb:vortex-compact +19.5% -0.5% +20.0% +15.8% 🚨 regression
4 duckdb:vortex-file-compressed +22.2% -0.5% +22.7% +15.8% 🚨 regression
5 datafusion:arrow +0.9% -0.9% +1.9% +15.8% ➖ noise
5 datafusion:vortex-compact -0.9% -0.9% -0.0% +15.8% ➖ noise
5 datafusion:vortex-file-compressed -4.8% -0.9% -3.9% +15.8% ➖ noise
5 duckdb:duckdb -1.7% -0.9% -0.8% +15.8% ➖ noise
5 duckdb:vortex-compact +14.5% -0.9% +15.6% +15.8% ➖ noise
5 duckdb:vortex-file-compressed +11.5% -0.9% +12.5% +15.8% ➖ noise
6 datafusion:arrow +5.1% -10.4% +17.3% +15.8% 🚨 regression
6 datafusion:vortex-compact -7.3% -10.4% +3.4% +15.8% ➖ noise
6 datafusion:vortex-file-compressed -11.2% -10.4% -0.9% +16.0% ➖ noise
6 duckdb:duckdb +0.5% -10.4% +12.1% +17.3% ➖ noise
6 duckdb:vortex-compact +4.6% -10.4% +16.8% +15.8% 🚨 regression
6 duckdb:vortex-file-compressed -0.0% -10.4% +11.6% +19.8% ➖ noise
7 datafusion:arrow +3.1% -9.8% +14.3% +15.8% ➖ noise
7 datafusion:vortex-compact -2.6% -9.8% +7.9% +15.8% ➖ noise
7 datafusion:vortex-file-compressed -2.2% -9.8% +8.4% +15.8% ➖ noise
7 duckdb:duckdb +1.0% -9.8% +11.9% +15.8% ➖ noise
7 duckdb:vortex-compact +9.9% -9.8% +21.7% +15.8% 🚨 regression
7 duckdb:vortex-file-compressed +12.2% -9.8% +24.4% +15.8% 🚨 regression
8 datafusion:arrow -0.3% -3.2% +3.0% +15.8% ➖ noise
8 datafusion:vortex-compact +1.2% -3.2% +4.5% +15.8% ➖ noise
8 datafusion:vortex-file-compressed +1.1% -3.2% +4.4% +15.8% ➖ noise
8 duckdb:duckdb +1.7% -3.2% +5.0% +15.8% ➖ noise
8 duckdb:vortex-compact +12.2% -3.2% +15.9% +15.8% 🚨 regression
8 duckdb:vortex-file-compressed +8.2% -3.2% +11.8% +15.8% ➖ noise
9 datafusion:arrow +0.9% -6.2% +7.5% +15.8% ➖ noise
9 datafusion:vortex-compact -0.0% -6.2% +6.5% +15.8% ➖ noise
9 datafusion:vortex-file-compressed -3.2% -6.2% +3.1% +15.8% ➖ noise
9 duckdb:duckdb -0.5% -6.2% +6.0% +15.8% ➖ noise
9 duckdb:vortex-compact +11.7% -6.2% +19.0% +15.8% 🚨 regression
9 duckdb:vortex-file-compressed +14.3% -6.2% +21.8% +15.8% 🚨 regression
10 datafusion:arrow -0.2% -2.7% +2.5% +15.8% ➖ noise
10 datafusion:vortex-compact -1.5% -2.7% +1.2% +15.8% ➖ noise
10 datafusion:vortex-file-compressed -6.7% -2.7% -4.1% +15.8% ➖ noise
10 duckdb:duckdb +2.7% -2.7% +5.5% +15.8% ➖ noise
10 duckdb:vortex-compact +8.9% -2.7% +11.9% +15.8% ➖ noise
10 duckdb:vortex-file-compressed +2.1% -2.7% +4.8% +15.8% ➖ noise
11 datafusion:arrow -1.9% -2.8% +1.0% +15.8% ➖ noise
11 datafusion:vortex-compact -0.6% -2.8% +2.3% +15.8% ➖ noise
11 datafusion:vortex-file-compressed -2.3% -2.8% +0.5% +15.8% ➖ noise
11 duckdb:duckdb +5.8% -2.8% +8.9% +15.8% ➖ noise
11 duckdb:vortex-compact +19.7% -2.8% +23.1% +15.8% 🚨 regression
11 duckdb:vortex-file-compressed +14.5% -2.8% +17.8% +15.8% 🚨 regression
12 datafusion:arrow -9.8% +0.0% -9.8% +15.8% ➖ noise
12 datafusion:vortex-compact -4.6% +0.0% -4.7% +15.8% ➖ noise
12 datafusion:vortex-file-compressed -10.4% +0.0% -10.4% +15.8% ➖ noise
12 duckdb:duckdb -4.6% +0.0% -4.6% +15.8% ➖ noise
12 duckdb:vortex-compact +26.0% +0.0% +26.0% +15.8% 🚨 regression
12 duckdb:vortex-file-compressed +24.8% +0.0% +24.8% +15.8% 🚨 regression
13 datafusion:arrow +1.1% -1.0% +2.1% +15.8% ➖ noise
13 datafusion:vortex-compact +0.7% -1.0% +1.7% +15.8% ➖ noise
13 datafusion:vortex-file-compressed -0.7% -1.0% +0.3% +15.8% ➖ noise
13 duckdb:duckdb +1.3% -1.0% +2.3% +15.8% ➖ noise
13 duckdb:vortex-compact +6.2% -1.0% +7.3% +15.8% ➖ noise
13 duckdb:vortex-file-compressed -0.2% -1.0% +0.8% +15.8% ➖ noise
14 datafusion:arrow -0.4% -2.3% +2.0% +15.8% ➖ noise
14 datafusion:vortex-compact +4.1% -2.3% +6.6% +15.8% ➖ noise
14 datafusion:vortex-file-compressed -2.0% -2.3% +0.3% +15.8% ➖ noise
14 duckdb:duckdb +0.3% -2.3% +2.6% +18.5% ➖ noise
14 duckdb:vortex-compact +2.2% -2.3% +4.6% +15.8% ➖ noise
14 duckdb:vortex-file-compressed +9.9% -2.3% +12.5% +15.8% ➖ noise
15 datafusion:arrow +2.1% -3.8% +6.1% +15.8% ➖ noise
15 datafusion:vortex-compact -0.3% -3.8% +3.6% +15.8% ➖ noise
15 datafusion:vortex-file-compressed -7.3% -3.8% -3.6% +15.8% ➖ noise
15 duckdb:duckdb -0.1% -3.8% +3.8% +15.8% ➖ noise
15 duckdb:vortex-compact +3.0% -3.8% +7.1% +15.8% ➖ noise
15 duckdb:vortex-file-compressed +16.1% -3.8% +20.7% +15.8% 🚨 regression
16 datafusion:arrow -1.3% -2.5% +1.2% +15.8% ➖ noise
16 datafusion:vortex-compact -0.2% -2.5% +2.4% +15.8% ➖ noise
16 datafusion:vortex-file-compressed +1.8% -2.5% +4.5% +15.8% ➖ noise
16 duckdb:duckdb +1.1% -2.5% +3.7% +15.8% ➖ noise
16 duckdb:vortex-compact +14.6% -2.5% +17.6% +15.8% 🚨 regression
16 duckdb:vortex-file-compressed +12.8% -2.5% +15.8% +15.8% ➖ noise
17 datafusion:arrow +1.0% -4.5% +5.7% +15.8% ➖ noise
17 datafusion:vortex-compact +2.2% -4.5% +7.0% +15.8% ➖ noise
17 datafusion:vortex-file-compressed +0.6% -4.5% +5.3% +15.8% ➖ noise
17 duckdb:duckdb -3.2% -4.5% +1.3% +15.8% ➖ noise
17 duckdb:vortex-compact +6.4% -4.5% +11.4% +15.8% ➖ noise
17 duckdb:vortex-file-compressed +8.8% -4.5% +13.9% +15.8% ➖ noise
18 datafusion:arrow -0.4% +1.7% -2.0% +15.8% ➖ noise
18 datafusion:vortex-compact +1.5% +1.7% -0.2% +15.8% ➖ noise
18 datafusion:vortex-file-compressed -1.1% +1.7% -2.7% +15.8% ➖ noise
18 duckdb:duckdb +0.1% +1.7% -1.5% +15.8% ➖ noise
18 duckdb:vortex-compact +9.7% +1.7% +7.9% +15.8% ➖ noise
18 duckdb:vortex-file-compressed +9.0% +1.7% +7.2% +15.8% ➖ noise
19 datafusion:arrow +1.9% +13.8% -10.5% +15.8% ➖ noise
19 datafusion:vortex-compact +5.7% +13.8% -7.1% +15.8% ➖ noise
19 datafusion:vortex-file-compressed +0.1% +13.8% -12.0% +15.8% ➖ noise
19 duckdb:duckdb -5.7% +13.8% -17.1% +15.8% ✅ faster
19 duckdb:vortex-compact +5.5% +13.8% -7.2% +15.8% ➖ noise
19 duckdb:vortex-file-compressed +19.3% +13.8% +4.9% +15.8% ➖ noise
20 datafusion:arrow +0.8% +9.6% -8.1% +15.8% ➖ noise
20 datafusion:vortex-compact +5.0% +9.6% -4.2% +15.8% ➖ noise
20 datafusion:vortex-file-compressed +0.7% +9.6% -8.1% +15.8% ➖ noise
20 duckdb:duckdb -2.2% +9.6% -10.8% +15.8% ➖ noise
20 duckdb:vortex-compact +8.5% +9.6% -1.0% +15.8% ➖ noise
20 duckdb:vortex-file-compressed +21.4% +9.6% +10.8% +15.8% ➖ noise
21 datafusion:arrow +1.5% -1.0% +2.5% +15.8% ➖ noise
21 datafusion:vortex-compact +2.6% -1.0% +3.6% +15.8% ➖ noise
21 datafusion:vortex-file-compressed +0.2% -1.0% +1.2% +15.8% ➖ noise
21 duckdb:duckdb +1.0% -1.0% +2.0% +15.8% ➖ noise
21 duckdb:vortex-compact +6.7% -1.0% +7.7% +15.8% ➖ noise
21 duckdb:vortex-file-compressed +10.9% -1.0% +12.0% +15.8% ➖ noise
22 datafusion:arrow -2.3% -2.3% -0.0% +15.8% ➖ noise
22 datafusion:vortex-compact +2.6% -2.3% +5.0% +15.8% ➖ noise
22 datafusion:vortex-file-compressed +1.2% -2.3% +3.6% +15.8% ➖ noise
22 duckdb:duckdb +0.0% -2.3% +2.4% +15.8% ➖ noise
22 duckdb:vortex-compact +18.3% -2.3% +21.1% +15.8% 🚨 regression
22 duckdb:vortex-file-compressed +9.8% -2.3% +12.4% +15.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

File Size Changes (14 files changed, -0.0% overall, 2↑ 12↓)
File Scale Format Base HEAD Change %
orders_0.vortex 1.0 vortex-file-compressed 43.36 MB 43.54 MB +183.65 KB +0.4%
lineitem_0.vortex 1.0 vortex-compact 62.86 MB 62.89 MB +30.78 KB +0.0%
lineitem_1.vortex 1.0 vortex-compact 62.89 MB 62.88 MB 3.45 KB -0.0%
customer_0.vortex 1.0 vortex-file-compressed 10.48 MB 10.47 MB 808 B -0.0%
partsupp_0.vortex 1.0 vortex-compact 25.21 MB 25.21 MB 2.44 KB -0.0%
part_0.vortex 1.0 vortex-file-compressed 5.42 MB 5.42 MB 584 B -0.0%
customer_0.vortex 1.0 vortex-compact 7.42 MB 7.42 MB 920 B -0.0%
partsupp_0.vortex 1.0 vortex-file-compressed 35.90 MB 35.89 MB 4.48 KB -0.0%
part_0.vortex 1.0 vortex-compact 3.62 MB 3.62 MB 480 B -0.0%
orders_0.vortex 1.0 vortex-compact 31.68 MB 31.67 MB 5.39 KB -0.0%
lineitem_1.vortex 1.0 vortex-file-compressed 84.72 MB 84.70 MB 18.07 KB -0.0%
supplier_0.vortex 1.0 vortex-compact 491.84 KB 491.66 KB 192 B -0.0%
supplier_0.vortex 1.0 vortex-file-compressed 700.20 KB 699.52 KB 704 B -0.1%
lineitem_0.vortex 1.0 vortex-file-compressed 85.24 MB 84.85 MB 390.04 KB -0.4%

Totals:

  • vortex-compact: 194.43 MB → 194.45 MB (+0.0%)
  • vortex-file-compressed: 266.07 MB → 265.85 MB (-0.1%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +7.6%
Vortex (geomean): 1.084x ➖
Parquet (geomean): 0.990x ➖
Shifts: Parquet (control) -1.0% · Median polish -0.3%


datafusion / vortex-file-compressed (0.966x ➖, 7↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 28064090 29988636 0.94
tpcds_q02/datafusion:vortex-file-compressed 53232919 53122378 1.00
tpcds_q03/datafusion:vortex-file-compressed 21276021 21575563 0.99
tpcds_q04/datafusion:vortex-file-compressed 292709715 296849371 0.99
tpcds_q05/datafusion:vortex-file-compressed 53854424 59281163 0.91
tpcds_q06/datafusion:vortex-file-compressed 🚀 48566857 55620064 0.87
tpcds_q07/datafusion:vortex-file-compressed 🚀 50408423 58086609 0.87
tpcds_q08/datafusion:vortex-file-compressed 35742771 38500525 0.93
tpcds_q09/datafusion:vortex-file-compressed 61287911 60638796 1.01
tpcds_q10/datafusion:vortex-file-compressed 46243579 44581916 1.04
tpcds_q11/datafusion:vortex-file-compressed 168737823 175777917 0.96
tpcds_q12/datafusion:vortex-file-compressed 22821746 24039679 0.95
tpcds_q13/datafusion:vortex-file-compressed 56741595 57585119 0.99
tpcds_q14/datafusion:vortex-file-compressed 196852104 202315240 0.97
tpcds_q15/datafusion:vortex-file-compressed 🚀 33566445 39322782 0.85
tpcds_q16/datafusion:vortex-file-compressed 🚀 27386440 30569720 0.90
tpcds_q17/datafusion:vortex-file-compressed 64198649 70487496 0.91
tpcds_q18/datafusion:vortex-file-compressed 🚀 76225841 86052118 0.89
tpcds_q19/datafusion:vortex-file-compressed 29764290 30894298 0.96
tpcds_q20/datafusion:vortex-file-compressed 25087363 27371136 0.92
tpcds_q21/datafusion:vortex-file-compressed 🚀 133766949 153257210 0.87
tpcds_q22/datafusion:vortex-file-compressed 56397251 61530507 0.92
tpcds_q23/datafusion:vortex-file-compressed 141924913 148852214 0.95
tpcds_q24/datafusion:vortex-file-compressed 109060859 111991872 0.97
tpcds_q25/datafusion:vortex-file-compressed 67411269 68023651 0.99
tpcds_q26/datafusion:vortex-file-compressed 36660557 37872623 0.97
tpcds_q27/datafusion:vortex-file-compressed 117990790 121524532 0.97
tpcds_q28/datafusion:vortex-file-compressed 55103891 52682216 1.05
tpcds_q29/datafusion:vortex-file-compressed 64460274 69437449 0.93
tpcds_q30/datafusion:vortex-file-compressed 31958249 32597991 0.98
tpcds_q31/datafusion:vortex-file-compressed 94052019 94142643 1.00
tpcds_q32/datafusion:vortex-file-compressed 21392419 21495180 1.00
tpcds_q33/datafusion:vortex-file-compressed 37430919 38666966 0.97
tpcds_q34/datafusion:vortex-file-compressed 29770373 30367495 0.98
tpcds_q35/datafusion:vortex-file-compressed 55790282 55175183 1.01
tpcds_q36/datafusion:vortex-file-compressed 73132524 74860449 0.98
tpcds_q37/datafusion:vortex-file-compressed 32708346 35357418 0.93
tpcds_q38/datafusion:vortex-file-compressed 51431977 51099821 1.01
tpcds_q39/datafusion:vortex-file-compressed 135681066 149186883 0.91
tpcds_q40/datafusion:vortex-file-compressed 51502025 53982182 0.95
tpcds_q41/datafusion:vortex-file-compressed 18539987 19190899 0.97
tpcds_q42/datafusion:vortex-file-compressed 18280218 18858632 0.97
tpcds_q43/datafusion:vortex-file-compressed 32232271 31363943 1.03
tpcds_q44/datafusion:vortex-file-compressed 41262202 40843512 1.01
tpcds_q45/datafusion:vortex-file-compressed 33777122 35477133 0.95
tpcds_q46/datafusion:vortex-file-compressed 46258832 50640766 0.91
tpcds_q47/datafusion:vortex-file-compressed 201430316 210720276 0.96
tpcds_q48/datafusion:vortex-file-compressed 46321907 46687061 0.99
tpcds_q49/datafusion:vortex-file-compressed 69238048 72748345 0.95
tpcds_q50/datafusion:vortex-file-compressed 43913570 46551538 0.94
tpcds_q51/datafusion:vortex-file-compressed 87957493 91895277 0.96
tpcds_q52/datafusion:vortex-file-compressed 17522009 18781951 0.93
tpcds_q53/datafusion:vortex-file-compressed 24442484 26847275 0.91
tpcds_q54/datafusion:vortex-file-compressed 41807042 45618655 0.92
tpcds_q55/datafusion:vortex-file-compressed 🚀 17086031 19071674 0.90
tpcds_q56/datafusion:vortex-file-compressed 40255120 40399195 1.00
tpcds_q57/datafusion:vortex-file-compressed 122771378 133140743 0.92
tpcds_q58/datafusion:vortex-file-compressed 68306734 73020505 0.94
tpcds_q59/datafusion:vortex-file-compressed 70754670 72830462 0.97
tpcds_q60/datafusion:vortex-file-compressed 41245344 41710112 0.99
tpcds_q61/datafusion:vortex-file-compressed 49556993 50566461 0.98
tpcds_q62/datafusion:vortex-file-compressed 30372989 32678154 0.93
tpcds_q63/datafusion:vortex-file-compressed 24724385 26378435 0.94
tpcds_q64/datafusion:vortex-file-compressed 458393240 480172637 0.95
tpcds_q65/datafusion:vortex-file-compressed 47991576 48231749 1.00
tpcds_q66/datafusion:vortex-file-compressed 90831721 93949059 0.97
tpcds_q67/datafusion:vortex-file-compressed 117808844 120306397 0.98
tpcds_q68/datafusion:vortex-file-compressed 44264766 46209883 0.96
tpcds_q69/datafusion:vortex-file-compressed 43594202 44014997 0.99
tpcds_q70/datafusion:vortex-file-compressed 109837307 111471576 0.99
tpcds_q71/datafusion:vortex-file-compressed 30827950 31699119 0.97
tpcds_q72/datafusion:vortex-file-compressed 2554800518 2637128502 0.97
tpcds_q73/datafusion:vortex-file-compressed 31452552 33156496 0.95
tpcds_q74/datafusion:vortex-file-compressed 115578307 114353609 1.01
tpcds_q75/datafusion:vortex-file-compressed 123508211 120866896 1.02
tpcds_q76/datafusion:vortex-file-compressed 33657732 33139545 1.02
tpcds_q77/datafusion:vortex-file-compressed 50513615 51818840 0.97
tpcds_q78/datafusion:vortex-file-compressed 120274455 124407474 0.97
tpcds_q79/datafusion:vortex-file-compressed 38297822 38171482 1.00
tpcds_q80/datafusion:vortex-file-compressed 114847445 115017542 1.00
tpcds_q81/datafusion:vortex-file-compressed 36812167 37448218 0.98
tpcds_q82/datafusion:vortex-file-compressed 34781452 34744137 1.00
tpcds_q83/datafusion:vortex-file-compressed 50736642 50764634 1.00
tpcds_q84/datafusion:vortex-file-compressed 16686559 15834571 1.05
tpcds_q85/datafusion:vortex-file-compressed 101637118 101888073 1.00
tpcds_q86/datafusion:vortex-file-compressed 18412121 19027502 0.97
tpcds_q87/datafusion:vortex-file-compressed 52251661 52880072 0.99
tpcds_q88/datafusion:vortex-file-compressed 71108151 68378184 1.04
tpcds_q89/datafusion:vortex-file-compressed 36059397 35557542 1.01
tpcds_q90/datafusion:vortex-file-compressed 17555463 17906760 0.98
tpcds_q91/datafusion:vortex-file-compressed 26076633 25660252 1.02
tpcds_q92/datafusion:vortex-file-compressed 19349416 20315620 0.95
tpcds_q93/datafusion:vortex-file-compressed 34371480 33783337 1.02
tpcds_q94/datafusion:vortex-file-compressed 24604116 25367216 0.97
tpcds_q95/datafusion:vortex-file-compressed 62514124 61689972 1.01
tpcds_q96/datafusion:vortex-file-compressed 15392210 15556117 0.99
tpcds_q97/datafusion:vortex-file-compressed 29321128 30709026 0.95
tpcds_q98/datafusion:vortex-file-compressed 32733042 32296954 1.01
tpcds_q99/datafusion:vortex-file-compressed 44123648 45868713 0.96
datafusion / vortex-compact (1.009x ➖, 0↑ 2↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚨 41097531 35648244 1.15
tpcds_q02/datafusion:vortex-compact 59756769 61214661 0.98
tpcds_q03/datafusion:vortex-compact 27467642 25762291 1.07
tpcds_q04/datafusion:vortex-compact 346108887 331640696 1.04
tpcds_q05/datafusion:vortex-compact 66777625 64054445 1.04
tpcds_q06/datafusion:vortex-compact 56125070 58595132 0.96
tpcds_q07/datafusion:vortex-compact 66627167 63972027 1.04
tpcds_q08/datafusion:vortex-compact 44128415 44137274 1.00
tpcds_q09/datafusion:vortex-compact 74008724 73218784 1.01
tpcds_q10/datafusion:vortex-compact 70423678 66146144 1.06
tpcds_q11/datafusion:vortex-compact 200067138 189879305 1.05
tpcds_q12/datafusion:vortex-compact 28053251 27551399 1.02
tpcds_q13/datafusion:vortex-compact 120092131 120017075 1.00
tpcds_q14/datafusion:vortex-compact 254094087 254804297 1.00
tpcds_q15/datafusion:vortex-compact 39725500 38612559 1.03
tpcds_q16/datafusion:vortex-compact 41416327 38781277 1.07
tpcds_q17/datafusion:vortex-compact 94432200 93027751 1.02
tpcds_q18/datafusion:vortex-compact 86373124 88460955 0.98
tpcds_q19/datafusion:vortex-compact 43742584 44366366 0.99
tpcds_q20/datafusion:vortex-compact 30359187 29634160 1.02
tpcds_q21/datafusion:vortex-compact 144940169 145288681 1.00
tpcds_q22/datafusion:vortex-compact 65237697 65004667 1.00
tpcds_q23/datafusion:vortex-compact 181738255 183020660 0.99
tpcds_q24/datafusion:vortex-compact 139735006 137199543 1.02
tpcds_q25/datafusion:vortex-compact 97714135 96322325 1.01
tpcds_q26/datafusion:vortex-compact 45459148 48635586 0.93
tpcds_q27/datafusion:vortex-compact 154586125 160769855 0.96
tpcds_q28/datafusion:vortex-compact 89376834 87254446 1.02
tpcds_q29/datafusion:vortex-compact 95253775 95395956 1.00
tpcds_q30/datafusion:vortex-compact 🚨 39991951 35762865 1.12
tpcds_q31/datafusion:vortex-compact 136807653 135894924 1.01
tpcds_q32/datafusion:vortex-compact 27079513 27117664 1.00
tpcds_q33/datafusion:vortex-compact 54555900 56127611 0.97
tpcds_q34/datafusion:vortex-compact 48887363 50041843 0.98
tpcds_q35/datafusion:vortex-compact 74376893 71252927 1.04
tpcds_q36/datafusion:vortex-compact 100251966 101295679 0.99
tpcds_q37/datafusion:vortex-compact 50064631 47766004 1.05
tpcds_q38/datafusion:vortex-compact 69641022 69815901 1.00
tpcds_q39/datafusion:vortex-compact 148037920 144370283 1.03
tpcds_q40/datafusion:vortex-compact 57690133 59348013 0.97
tpcds_q41/datafusion:vortex-compact 20512056 20427127 1.00
tpcds_q42/datafusion:vortex-compact 24734318 24198564 1.02
tpcds_q43/datafusion:vortex-compact 37982809 38514257 0.99
tpcds_q44/datafusion:vortex-compact 74799390 75068240 1.00
tpcds_q45/datafusion:vortex-compact 40125186 38837308 1.03
tpcds_q46/datafusion:vortex-compact 67803107 73180761 0.93
tpcds_q47/datafusion:vortex-compact 228699089 234950532 0.97
tpcds_q48/datafusion:vortex-compact 93444181 88088548 1.06
tpcds_q49/datafusion:vortex-compact 94041788 88936027 1.06
tpcds_q50/datafusion:vortex-compact 63397053 63500163 1.00
tpcds_q51/datafusion:vortex-compact 99090681 99393397 1.00
tpcds_q52/datafusion:vortex-compact 24699872 25795125 0.96
tpcds_q53/datafusion:vortex-compact 35650990 35821621 1.00
tpcds_q54/datafusion:vortex-compact 60495923 60894762 0.99
tpcds_q55/datafusion:vortex-compact 26243838 24543906 1.07
tpcds_q56/datafusion:vortex-compact 57134457 56301177 1.01
tpcds_q57/datafusion:vortex-compact 137845450 141098432 0.98
tpcds_q58/datafusion:vortex-compact 80621374 78529280 1.03
tpcds_q59/datafusion:vortex-compact 83612521 85575177 0.98
tpcds_q60/datafusion:vortex-compact 56553533 57965677 0.98
tpcds_q61/datafusion:vortex-compact 76158923 75937128 1.00
tpcds_q62/datafusion:vortex-compact 34593883 34487595 1.00
tpcds_q63/datafusion:vortex-compact 35850683 37019283 0.97
tpcds_q64/datafusion:vortex-compact 534323195 542897317 0.98
tpcds_q65/datafusion:vortex-compact 71140609 72085427 0.99
tpcds_q66/datafusion:vortex-compact 98268065 97639719 1.01
tpcds_q67/datafusion:vortex-compact 125144604 124586375 1.00
tpcds_q68/datafusion:vortex-compact 70436116 71785844 0.98
tpcds_q69/datafusion:vortex-compact 65020879 61971947 1.05
tpcds_q70/datafusion:vortex-compact 121489411 125980855 0.96
tpcds_q71/datafusion:vortex-compact 48855920 47157888 1.04
tpcds_q72/datafusion:vortex-compact 2592815915 2599667983 1.00
tpcds_q73/datafusion:vortex-compact 51945115 49988886 1.04
tpcds_q74/datafusion:vortex-compact 144778482 138025749 1.05
tpcds_q75/datafusion:vortex-compact 172169295 163760047 1.05
tpcds_q76/datafusion:vortex-compact 51122583 52119038 0.98
tpcds_q77/datafusion:vortex-compact 68344885 68679016 1.00
tpcds_q78/datafusion:vortex-compact 153639060 149321759 1.03
tpcds_q79/datafusion:vortex-compact 58939059 62808376 0.94
tpcds_q80/datafusion:vortex-compact 134464669 133919866 1.00
tpcds_q81/datafusion:vortex-compact 45160860 43072853 1.05
tpcds_q82/datafusion:vortex-compact 52128513 47982247 1.09
tpcds_q83/datafusion:vortex-compact 58345288 57719704 1.01
tpcds_q84/datafusion:vortex-compact 21165794 19458215 1.09
tpcds_q85/datafusion:vortex-compact 133397692 125911455 1.06
tpcds_q86/datafusion:vortex-compact 22399570 22422346 1.00
tpcds_q87/datafusion:vortex-compact 69011859 69297085 1.00
tpcds_q88/datafusion:vortex-compact 127945105 139781410 0.92
tpcds_q89/datafusion:vortex-compact 46605450 46184646 1.01
tpcds_q90/datafusion:vortex-compact 26264386 24233554 1.08
tpcds_q91/datafusion:vortex-compact 39224344 39814056 0.99
tpcds_q92/datafusion:vortex-compact 26561021 25471922 1.04
tpcds_q93/datafusion:vortex-compact 46801529 45668810 1.02
tpcds_q94/datafusion:vortex-compact 32819367 31812378 1.03
tpcds_q95/datafusion:vortex-compact 73475615 69450970 1.06
tpcds_q96/datafusion:vortex-compact 25375986 27346265 0.93
tpcds_q97/datafusion:vortex-compact 41977661 43887077 0.96
tpcds_q98/datafusion:vortex-compact 37744065 39527114 0.95
tpcds_q99/datafusion:vortex-compact 49663543 49927379 0.99
datafusion / parquet (0.984x ➖, 2↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 35873613 38479985 0.93
tpcds_q02/datafusion:parquet 45332741 46554574 0.97
tpcds_q03/datafusion:parquet 14749924 15434591 0.96
tpcds_q04/datafusion:parquet 305956473 317061080 0.96
tpcds_q05/datafusion:parquet 50386445 53111136 0.95
tpcds_q06/datafusion:parquet 64171134 65234917 0.98
tpcds_q07/datafusion:parquet 83993462 86352803 0.97
tpcds_q08/datafusion:parquet 33684238 31764432 1.06
tpcds_q09/datafusion:parquet 58195352 56446048 1.03
tpcds_q10/datafusion:parquet 85125482 81544821 1.04
tpcds_q11/datafusion:parquet 173230207 180783782 0.96
tpcds_q12/datafusion:parquet 22471482 24310346 0.92
tpcds_q13/datafusion:parquet 87616456 87500142 1.00
tpcds_q14/datafusion:parquet 198106411 196597274 1.01
tpcds_q15/datafusion:parquet 🚀 25050827 28193949 0.89
tpcds_q16/datafusion:parquet 28389828 28378096 1.00
tpcds_q17/datafusion:parquet 72244895 70495599 1.02
tpcds_q18/datafusion:parquet 131451538 130696397 1.01
tpcds_q19/datafusion:parquet 26697793 27640895 0.97
tpcds_q20/datafusion:parquet 19733491 20491919 0.96
tpcds_q21/datafusion:parquet 21270717 22784807 0.93
tpcds_q22/datafusion:parquet 148164793 150719568 0.98
tpcds_q23/datafusion:parquet 156186483 158852385 0.98
tpcds_q24/datafusion:parquet 104208600 104544568 1.00
tpcds_q25/datafusion:parquet 71368103 72822815 0.98
tpcds_q26/datafusion:parquet 75272877 74157132 1.02
tpcds_q27/datafusion:parquet 162933977 163578410 1.00
tpcds_q28/datafusion:parquet 48999334 49476083 0.99
tpcds_q29/datafusion:parquet 74974134 73659982 1.02
tpcds_q30/datafusion:parquet 44309586 43002895 1.03
tpcds_q31/datafusion:parquet 76107539 75653614 1.01
tpcds_q32/datafusion:parquet 22769655 22490823 1.01
tpcds_q33/datafusion:parquet 36517682 36742653 0.99
tpcds_q34/datafusion:parquet 27570655 27053990 1.02
tpcds_q35/datafusion:parquet 83094003 83211052 1.00
tpcds_q36/datafusion:parquet 63624803 64907940 0.98
tpcds_q37/datafusion:parquet 23497109 22625500 1.04
tpcds_q38/datafusion:parquet 48673076 51397158 0.95
tpcds_q39/datafusion:parquet 81470280 82430240 0.99
tpcds_q40/datafusion:parquet 27844523 27073915 1.03
tpcds_q41/datafusion:parquet 15383689 16495880 0.93
tpcds_q42/datafusion:parquet 13995042 14361484 0.97
tpcds_q43/datafusion:parquet 18686004 18801026 0.99
tpcds_q44/datafusion:parquet 39650518 41382047 0.96
tpcds_q45/datafusion:parquet 31700561 32341618 0.98
tpcds_q46/datafusion:parquet 37795693 38459322 0.98
tpcds_q47/datafusion:parquet 133162519 134048578 0.99
tpcds_q48/datafusion:parquet 77826637 79659333 0.98
tpcds_q49/datafusion:parquet 64784467 65721206 0.99
tpcds_q50/datafusion:parquet 47590459 48241437 0.99
tpcds_q51/datafusion:parquet 86506455 88626141 0.98
tpcds_q52/datafusion:parquet 14261846 14756941 0.97
tpcds_q53/datafusion:parquet 20775971 21493503 0.97
tpcds_q54/datafusion:parquet 42092486 42732100 0.99
tpcds_q55/datafusion:parquet 13796261 14232805 0.97
tpcds_q56/datafusion:parquet 34783858 35209995 0.99
tpcds_q57/datafusion:parquet 103328931 105494016 0.98
tpcds_q58/datafusion:parquet 59324228 57233534 1.04
tpcds_q59/datafusion:parquet 59047385 58340835 1.01
tpcds_q60/datafusion:parquet 35918906 36367317 0.99
tpcds_q61/datafusion:parquet 51544823 50810017 1.01
tpcds_q62/datafusion:parquet 25784244 27587948 0.93
tpcds_q63/datafusion:parquet 22372908 22567861 0.99
tpcds_q64/datafusion:parquet 550511191 556178489 0.99
tpcds_q65/datafusion:parquet 44702062 45972862 0.97
tpcds_q66/datafusion:parquet 76464455 77572480 0.99
tpcds_q67/datafusion:parquet 150099868 149308941 1.01
tpcds_q68/datafusion:parquet 37869887 39950795 0.95
tpcds_q69/datafusion:parquet 77190795 79345900 0.97
tpcds_q70/datafusion:parquet 95866164 96833255 0.99
tpcds_q71/datafusion:parquet 27255470 26839906 1.02
tpcds_q72/datafusion:parquet 635598123 637428475 1.00
tpcds_q73/datafusion:parquet 27729000 26964700 1.03
tpcds_q74/datafusion:parquet 103516200 104270105 0.99
tpcds_q75/datafusion:parquet 115537572 118956699 0.97
tpcds_q76/datafusion:parquet 35201614 35822935 0.98
tpcds_q77/datafusion:parquet 47169623 49026305 0.96
tpcds_q78/datafusion:parquet 123039685 125887579 0.98
tpcds_q79/datafusion:parquet 30859787 31482064 0.98
tpcds_q80/datafusion:parquet 92737368 93698799 0.99
tpcds_q81/datafusion:parquet 40682405 42723787 0.95
tpcds_q82/datafusion:parquet 22696869 23365698 0.97
tpcds_q83/datafusion:parquet 46890909 47821337 0.98
tpcds_q84/datafusion:parquet 47666881 48687375 0.98
tpcds_q85/datafusion:parquet 167692738 169691792 0.99
tpcds_q86/datafusion:parquet 17029302 16385764 1.04
tpcds_q87/datafusion:parquet 50306452 50757717 0.99
tpcds_q88/datafusion:parquet 68917522 68486991 1.01
tpcds_q89/datafusion:parquet 24431673 25170893 0.97
tpcds_q90/datafusion:parquet 18073251 17949114 1.01
tpcds_q91/datafusion:parquet 70009246 71287237 0.98
tpcds_q92/datafusion:parquet 21503932 22697392 0.95
tpcds_q93/datafusion:parquet 34011163 34969746 0.97
tpcds_q94/datafusion:parquet 25330691 24931061 1.02
tpcds_q95/datafusion:parquet 68093339 67701000 1.01
tpcds_q96/datafusion:parquet 14052673 13673194 1.03
tpcds_q97/datafusion:parquet 32610016 33073471 0.99
tpcds_q98/datafusion:parquet 24551125 26208077 0.94
tpcds_q99/datafusion:parquet 🚀 27492125 31725960 0.87
duckdb / vortex-file-compressed (1.160x ❌, 0↑ 68↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 🚨 34052911 26196826 1.30
tpcds_q02/duckdb:vortex-file-compressed 🚨 127333431 82646098 1.54
tpcds_q03/duckdb:vortex-file-compressed 🚨 35991187 30804525 1.17
tpcds_q04/duckdb:vortex-file-compressed 111508727 107198399 1.04
tpcds_q05/duckdb:vortex-file-compressed 104445767 101897696 1.03
tpcds_q06/duckdb:vortex-file-compressed 37721571 34687716 1.09
tpcds_q07/duckdb:vortex-file-compressed 🚨 27684012 23264513 1.19
tpcds_q08/duckdb:vortex-file-compressed 27859007 26408771 1.05
tpcds_q09/duckdb:vortex-file-compressed 🚨 44678947 38827232 1.15
tpcds_q10/duckdb:vortex-file-compressed 🚨 40994546 36527845 1.12
tpcds_q11/duckdb:vortex-file-compressed 65512389 64814500 1.01
tpcds_q12/duckdb:vortex-file-compressed 15554126 14326050 1.09
tpcds_q13/duckdb:vortex-file-compressed 🚨 42123389 30661016 1.37
tpcds_q14/duckdb:vortex-file-compressed 🚨 226161469 192533575 1.17
tpcds_q15/duckdb:vortex-file-compressed 43219812 39459676 1.10
tpcds_q16/duckdb:vortex-file-compressed 🚨 32424766 29122675 1.11
tpcds_q17/duckdb:vortex-file-compressed 🚨 47455308 37178353 1.28
tpcds_q18/duckdb:vortex-file-compressed 🚨 50638192 44829688 1.13
tpcds_q19/duckdb:vortex-file-compressed 34780257 33136058 1.05
tpcds_q20/duckdb:vortex-file-compressed 16760321 15940879 1.05
tpcds_q21/duckdb:vortex-file-compressed 20795842 19153333 1.09
tpcds_q22/duckdb:vortex-file-compressed 🚨 138245478 103137632 1.34
tpcds_q23/duckdb:vortex-file-compressed 🚨 145355503 119600403 1.22
tpcds_q24/duckdb:vortex-file-compressed 🚨 73944232 54111822 1.37
tpcds_q25/duckdb:vortex-file-compressed 🚨 45015422 35899958 1.25
tpcds_q26/duckdb:vortex-file-compressed 🚨 44399017 39862138 1.11
tpcds_q27/duckdb:vortex-file-compressed 🚨 99075409 85154472 1.16
tpcds_q28/duckdb:vortex-file-compressed 42182563 39104945 1.08
tpcds_q29/duckdb:vortex-file-compressed 🚨 46334982 35372053 1.31
tpcds_q30/duckdb:vortex-file-compressed 🚨 32798597 29250788 1.12
tpcds_q31/duckdb:vortex-file-compressed 🚨 29584977 26283125 1.13
tpcds_q32/duckdb:vortex-file-compressed 🚨 19827073 16878813 1.17
tpcds_q33/duckdb:vortex-file-compressed 🚨 72506617 61335001 1.18
tpcds_q34/duckdb:vortex-file-compressed 🚨 20921643 18801359 1.11
tpcds_q35/duckdb:vortex-file-compressed 🚨 71170999 63571544 1.12
tpcds_q36/duckdb:vortex-file-compressed 🚨 37393673 27394507 1.37
tpcds_q37/duckdb:vortex-file-compressed 22658831 22199836 1.02
tpcds_q38/duckdb:vortex-file-compressed 🚨 43437282 37073548 1.17
tpcds_q39/duckdb:vortex-file-compressed 48690815 45056872 1.08
tpcds_q40/duckdb:vortex-file-compressed 🚨 26379354 22993476 1.15
tpcds_q41/duckdb:vortex-file-compressed 13770392 13798522 1.00
tpcds_q42/duckdb:vortex-file-compressed 🚨 14863425 11772183 1.26
tpcds_q43/duckdb:vortex-file-compressed 32418102 29630980 1.09
tpcds_q44/duckdb:vortex-file-compressed 22486610 22557124 1.00
tpcds_q45/duckdb:vortex-file-compressed 28263526 28112291 1.01
tpcds_q46/duckdb:vortex-file-compressed 🚨 52830739 47186899 1.12
tpcds_q47/duckdb:vortex-file-compressed 🚨 58312478 48968007 1.19
tpcds_q48/duckdb:vortex-file-compressed 🚨 38459046 28935969 1.33
tpcds_q49/duckdb:vortex-file-compressed 🚨 35094595 30118848 1.17
tpcds_q50/duckdb:vortex-file-compressed 🚨 45797034 34879273 1.31
tpcds_q51/duckdb:vortex-file-compressed 105324223 109718079 0.96
tpcds_q52/duckdb:vortex-file-compressed 🚨 14271870 12285208 1.16
tpcds_q53/duckdb:vortex-file-compressed 🚨 19916188 16792823 1.19
tpcds_q54/duckdb:vortex-file-compressed 🚨 57674934 47049412 1.23
tpcds_q55/duckdb:vortex-file-compressed 🚨 14181776 11758504 1.21
tpcds_q56/duckdb:vortex-file-compressed 67972500 62067324 1.10
tpcds_q57/duckdb:vortex-file-compressed 🚨 61622929 44403743 1.39
tpcds_q58/duckdb:vortex-file-compressed 33901960 35075279 0.97
tpcds_q59/duckdb:vortex-file-compressed 🚨 116103995 80059912 1.45
tpcds_q60/duckdb:vortex-file-compressed 🚨 72214229 64504331 1.12
tpcds_q61/duckdb:vortex-file-compressed 🚨 40952660 36284070 1.13
tpcds_q62/duckdb:vortex-file-compressed 🚨 23607838 17868345 1.32
tpcds_q63/duckdb:vortex-file-compressed 🚨 21030750 16944388 1.24
tpcds_q64/duckdb:vortex-file-compressed 85605817 80957564 1.06
tpcds_q65/duckdb:vortex-file-compressed 🚨 28674554 22790706 1.26
tpcds_q66/duckdb:vortex-file-compressed 🚨 72805699 57786727 1.26
tpcds_q67/duckdb:vortex-file-compressed 🚨 190606169 143854769 1.32
tpcds_q68/duckdb:vortex-file-compressed 🚨 47202000 41624805 1.13
tpcds_q69/duckdb:vortex-file-compressed 🚨 43120401 37161807 1.16
tpcds_q70/duckdb:vortex-file-compressed 29519060 27310298 1.08
tpcds_q71/duckdb:vortex-file-compressed 🚨 23176072 19627586 1.18
tpcds_q72/duckdb:vortex-file-compressed 🚨 213466417 174540024 1.22
tpcds_q73/duckdb:vortex-file-compressed 🚨 22570489 19638321 1.15
tpcds_q74/duckdb:vortex-file-compressed 51580954 53358410 0.97
tpcds_q75/duckdb:vortex-file-compressed 64351021 60472416 1.06
tpcds_q76/duckdb:vortex-file-compressed 64942623 64270514 1.01
tpcds_q77/duckdb:vortex-file-compressed 68431263 65187944 1.05
tpcds_q78/duckdb:vortex-file-compressed 🚨 89519796 76249274 1.17
tpcds_q79/duckdb:vortex-file-compressed 🚨 44093841 34317930 1.28
tpcds_q80/duckdb:vortex-file-compressed 🚨 101182815 86703258 1.17
tpcds_q81/duckdb:vortex-file-compressed 36599716 33864112 1.08
tpcds_q82/duckdb:vortex-file-compressed 🚨 24275979 21750977 1.12
tpcds_q83/duckdb:vortex-file-compressed 29609524 30754235 0.96
tpcds_q84/duckdb:vortex-file-compressed 🚨 19844417 17890355 1.11
tpcds_q85/duckdb:vortex-file-compressed 49946370 47064502 1.06
tpcds_q86/duckdb:vortex-file-compressed 🚨 21094770 16794705 1.26
tpcds_q87/duckdb:vortex-file-compressed 🚨 44945626 39916119 1.13
tpcds_q88/duckdb:vortex-file-compressed 36691133 33942224 1.08
tpcds_q89/duckdb:vortex-file-compressed 🚨 21826040 16993387 1.28
tpcds_q90/duckdb:vortex-file-compressed 🚨 16359686 13525926 1.21
tpcds_q91/duckdb:vortex-file-compressed 30416130 29433300 1.03
tpcds_q92/duckdb:vortex-file-compressed 🚨 17408640 14514552 1.20
tpcds_q93/duckdb:vortex-file-compressed 🚨 35781475 29552812 1.21
tpcds_q94/duckdb:vortex-file-compressed 🚨 24722843 21160439 1.17
tpcds_q95/duckdb:vortex-file-compressed 🚨 178083258 146966300 1.21
tpcds_q96/duckdb:vortex-file-compressed 🚨 13630442 10534926 1.29
tpcds_q97/duckdb:vortex-file-compressed 🚨 45655258 38003415 1.20
tpcds_q98/duckdb:vortex-file-compressed 🚨 20439236 17623575 1.16
tpcds_q99/duckdb:vortex-file-compressed 🚨 49820139 31953110 1.56
duckdb / vortex-compact (1.221x ❌, 0↑ 83↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚨 42686261 31964050 1.34
tpcds_q02/duckdb:vortex-compact 🚨 172008555 117009783 1.47
tpcds_q03/duckdb:vortex-compact 🚨 82684323 57569096 1.44
tpcds_q04/duckdb:vortex-compact 🚨 138581160 124854532 1.11
tpcds_q05/duckdb:vortex-compact 164016667 155421579 1.06
tpcds_q06/duckdb:vortex-compact 🚨 41983746 37780915 1.11
tpcds_q07/duckdb:vortex-compact 🚨 49012166 35573440 1.38
tpcds_q08/duckdb:vortex-compact 🚨 41148789 35090544 1.17
tpcds_q09/duckdb:vortex-compact 59714712 58855393 1.01
tpcds_q10/duckdb:vortex-compact 🚨 59895828 47628132 1.26
tpcds_q11/duckdb:vortex-compact 🚨 86360210 74288150 1.16
tpcds_q12/duckdb:vortex-compact 🚨 21590596 19056903 1.13
tpcds_q13/duckdb:vortex-compact 🚨 65590278 49164612 1.33
tpcds_q14/duckdb:vortex-compact 🚨 361237499 263173091 1.37
tpcds_q15/duckdb:vortex-compact 46532582 44761221 1.04
tpcds_q16/duckdb:vortex-compact 🚨 47891853 35104390 1.36
tpcds_q17/duckdb:vortex-compact 🚨 62408579 47557474 1.31
tpcds_q18/duckdb:vortex-compact 🚨 66974340 57602329 1.16
tpcds_q19/duckdb:vortex-compact 🚨 47727844 40059626 1.19
tpcds_q20/duckdb:vortex-compact 🚨 23367436 20496894 1.14
tpcds_q21/duckdb:vortex-compact 30204777 28210275 1.07
tpcds_q22/duckdb:vortex-compact 🚨 149574592 111392644 1.34
tpcds_q23/duckdb:vortex-compact 🚨 199808091 163652422 1.22
tpcds_q24/duckdb:vortex-compact 🚨 96336297 68182474 1.41
tpcds_q25/duckdb:vortex-compact 🚨 67162556 48848269 1.37
tpcds_q26/duckdb:vortex-compact 🚨 56952562 48502192 1.17
tpcds_q27/duckdb:vortex-compact 🚨 171446265 127467890 1.35
tpcds_q28/duckdb:vortex-compact 🚨 94412822 84095890 1.12
tpcds_q29/duckdb:vortex-compact 🚨 67899799 48676012 1.39
tpcds_q30/duckdb:vortex-compact 🚨 38963984 33790382 1.15
tpcds_q31/duckdb:vortex-compact 🚨 38889682 31164432 1.25
tpcds_q32/duckdb:vortex-compact 🚨 28009774 23630050 1.19
tpcds_q33/duckdb:vortex-compact 🚨 147448194 128115848 1.15
tpcds_q34/duckdb:vortex-compact 🚨 31662368 26736525 1.18
tpcds_q35/duckdb:vortex-compact 🚨 82013450 70044901 1.17
tpcds_q36/duckdb:vortex-compact 🚨 49006723 35854321 1.37
tpcds_q37/duckdb:vortex-compact 32739730 31365588 1.04
tpcds_q38/duckdb:vortex-compact 45225005 41304950 1.09
tpcds_q39/duckdb:vortex-compact 🚨 59266091 52716479 1.12
tpcds_q40/duckdb:vortex-compact 🚨 33583465 29613229 1.13
tpcds_q41/duckdb:vortex-compact 17191341 17138258 1.00
tpcds_q42/duckdb:vortex-compact 🚨 21845085 16304241 1.34
tpcds_q43/duckdb:vortex-compact 39043803 37558536 1.04
tpcds_q44/duckdb:vortex-compact 34460918 32155509 1.07
tpcds_q45/duckdb:vortex-compact 34902554 32182781 1.08
tpcds_q46/duckdb:vortex-compact 🚨 71722235 57582100 1.25
tpcds_q47/duckdb:vortex-compact 🚨 72149404 57284900 1.26
tpcds_q48/duckdb:vortex-compact 🚨 53590033 40517481 1.32
tpcds_q49/duckdb:vortex-compact 🚨 58993295 43026105 1.37
tpcds_q50/duckdb:vortex-compact 🚨 65223715 48877309 1.33
tpcds_q51/duckdb:vortex-compact 108397083 103090218 1.05
tpcds_q52/duckdb:vortex-compact 🚨 23010730 16418315 1.40
tpcds_q53/duckdb:vortex-compact 🚨 32307932 24385293 1.32
tpcds_q54/duckdb:vortex-compact 🚨 108031741 76881636 1.41
tpcds_q55/duckdb:vortex-compact 🚨 22367372 16291823 1.37
tpcds_q56/duckdb:vortex-compact 🚨 142482065 122169123 1.17
tpcds_q57/duckdb:vortex-compact 🚨 66682548 47465818 1.40
tpcds_q58/duckdb:vortex-compact 🚨 49471268 41840279 1.18
tpcds_q59/duckdb:vortex-compact 🚨 127657646 102366782 1.25
tpcds_q60/duckdb:vortex-compact 🚨 153178322 128595935 1.19
tpcds_q61/duckdb:vortex-compact 57797264 53334985 1.08
tpcds_q62/duckdb:vortex-compact 🚨 28309296 20507561 1.38
tpcds_q63/duckdb:vortex-compact 🚨 31048374 24747987 1.25
tpcds_q64/duckdb:vortex-compact 🚨 125603592 102149776 1.23
tpcds_q65/duckdb:vortex-compact 🚨 37759378 30978787 1.22
tpcds_q66/duckdb:vortex-compact 🚨 117504440 90148673 1.30
tpcds_q67/duckdb:vortex-compact 🚨 196915545 150058545 1.31
tpcds_q68/duckdb:vortex-compact 🚨 67053742 51206844 1.31
tpcds_q69/duckdb:vortex-compact 🚨 54477436 47639579 1.14
tpcds_q70/duckdb:vortex-compact 🚨 47560080 34175080 1.39
tpcds_q71/duckdb:vortex-compact 🚨 30811327 25422555 1.21
tpcds_q72/duckdb:vortex-compact 🚨 234547567 194343049 1.21
tpcds_q73/duckdb:vortex-compact 🚨 30556606 25683542 1.19
tpcds_q74/duckdb:vortex-compact 61407400 59785033 1.03
tpcds_q75/duckdb:vortex-compact 🚨 85497974 70920588 1.21
tpcds_q76/duckdb:vortex-compact 🚨 151813244 127499299 1.19
tpcds_q77/duckdb:vortex-compact 🚨 150078467 119725965 1.25
tpcds_q78/duckdb:vortex-compact 🚨 96283266 82366054 1.17
tpcds_q79/duckdb:vortex-compact 🚨 82675097 58310971 1.42
tpcds_q80/duckdb:vortex-compact 🚨 183488610 156880337 1.17
tpcds_q81/duckdb:vortex-compact 🚨 44057715 39078018 1.13
tpcds_q82/duckdb:vortex-compact 33237078 30858903 1.08
tpcds_q83/duckdb:vortex-compact 45960931 45545761 1.01
tpcds_q84/duckdb:vortex-compact 🚨 25648424 22295853 1.15
tpcds_q85/duckdb:vortex-compact 66276858 60330290 1.10
tpcds_q86/duckdb:vortex-compact 🚨 24928827 20814489 1.20
tpcds_q87/duckdb:vortex-compact 🚨 49814332 45193074 1.10
tpcds_q88/duckdb:vortex-compact 🚨 43997340 39578331 1.11
tpcds_q89/duckdb:vortex-compact 🚨 32524391 24213441 1.34
tpcds_q90/duckdb:vortex-compact 🚨 17839210 15471570 1.15
tpcds_q91/duckdb:vortex-compact 🚨 50661806 45951699 1.10
tpcds_q92/duckdb:vortex-compact 🚨 23919941 19519772 1.23
tpcds_q93/duckdb:vortex-compact 🚨 45881604 31942489 1.44
tpcds_q94/duckdb:vortex-compact 🚨 31551378 24701241 1.28
tpcds_q95/duckdb:vortex-compact 🚨 193714025 133680247 1.45
tpcds_q96/duckdb:vortex-compact 🚨 18081285 13065897 1.38
tpcds_q97/duckdb:vortex-compact 🚨 43826920 39104933 1.12
tpcds_q98/duckdb:vortex-compact 🚨 30101222 24954060 1.21
tpcds_q99/duckdb:vortex-compact 🚨 54078650 34305073 1.58
duckdb / parquet (0.996x ➖, 1↑ 1↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 44919133 44513678 1.01
tpcds_q02/duckdb:parquet 62073066 59571692 1.04
tpcds_q03/duckdb:parquet 11835250 11645405 1.02
tpcds_q04/duckdb:parquet 126402438 125971662 1.00
tpcds_q05/duckdb:parquet 74335853 74566621 1.00
tpcds_q06/duckdb:parquet 28306521 29331266 0.97
tpcds_q07/duckdb:parquet 23404319 23119557 1.01
tpcds_q08/duckdb:parquet 28091908 28340090 0.99
tpcds_q09/duckdb:parquet 39901359 39545882 1.01
tpcds_q10/duckdb:parquet 35063014 35408018 0.99
tpcds_q11/duckdb:parquet 88797952 89891594 0.99
tpcds_q12/duckdb:parquet 14276118 14505299 0.98
tpcds_q13/duckdb:parquet 33130923 33700669 0.98
tpcds_q14/duckdb:parquet 159328905 163358361 0.98
tpcds_q15/duckdb:parquet 29918680 28899711 1.04
tpcds_q16/duckdb:parquet 22137905 21042856 1.05
tpcds_q17/duckdb:parquet 38676907 37997589 1.02
tpcds_q18/duckdb:parquet 46482889 46472237 1.00
tpcds_q19/duckdb:parquet 29497538 29169397 1.01
tpcds_q20/duckdb:parquet 15226877 15306394 0.99
tpcds_q21/duckdb:parquet 11562888 10897173 1.06
tpcds_q22/duckdb:parquet 66507139 64753691 1.03
tpcds_q23/duckdb:parquet 114278343 121090427 0.94
tpcds_q24/duckdb:parquet 45472795 46047602 0.99
tpcds_q25/duckdb:parquet 32646726 31779461 1.03
tpcds_q26/duckdb:parquet 36936848 37033791 1.00
tpcds_q27/duckdb:parquet 88120274 89132393 0.99
tpcds_q28/duckdb:parquet 36847473 37348146 0.99
tpcds_q29/duckdb:parquet 34799980 35570750 0.98
tpcds_q30/duckdb:parquet 40522736 39693454 1.02
tpcds_q31/duckdb:parquet 22320346 21943718 1.02
tpcds_q32/duckdb:parquet 11790662 11848434 1.00
tpcds_q33/duckdb:parquet 70793977 70332350 1.01
tpcds_q34/duckdb:parquet 21408166 21250364 1.01
tpcds_q35/duckdb:parquet 59342085 61416808 0.97
tpcds_q36/duckdb:parquet 20637527 20505323 1.01
tpcds_q37/duckdb:parquet 13624048 13366832 1.02
tpcds_q38/duckdb:parquet 34104392 33756017 1.01
tpcds_q39/duckdb:parquet 32964981 33158382 0.99
tpcds_q40/duckdb:parquet 17631728 17384117 1.01
tpcds_q41/duckdb:parquet 7417610 7575238 0.98
tpcds_q42/duckdb:parquet 10196778 10410909 0.98
tpcds_q43/duckdb:parquet 15287093 15457856 0.99
tpcds_q44/duckdb:parquet 21803966 21124602 1.03
tpcds_q45/duckdb:parquet 27041456 26999466 1.00
tpcds_q46/duckdb:parquet 45848606 47211591 0.97
tpcds_q47/duckdb:parquet 45883165 46303437 0.99
tpcds_q48/duckdb:parquet 30465417 31907184 0.95
tpcds_q49/duckdb:parquet 23637394 24897733 0.95
tpcds_q50/duckdb:parquet 24347732 25118959 0.97
tpcds_q51/duckdb:parquet 94841942 95247692 1.00
tpcds_q52/duckdb:parquet 11102150 10856477 1.02
tpcds_q53/duckdb:parquet 16178211 16391295 0.99
tpcds_q54/duckdb:parquet 40081979 40260463 1.00
tpcds_q55/duckdb:parquet 10267670 10734750 0.96
tpcds_q56/duckdb:parquet 69300760 68098687 1.02
tpcds_q57/duckdb:parquet 34845722 34634987 1.01
tpcds_q58/duckdb:parquet 21090218 21141007 1.00
tpcds_q59/duckdb:parquet 36563449 36531171 1.00
tpcds_q60/duckdb:parquet 🚀 69257475 79028199 0.88
tpcds_q61/duckdb:parquet 30806104 29389172 1.05
tpcds_q62/duckdb:parquet 11499887 11221930 1.02
tpcds_q63/duckdb:parquet 14956630 15434614 0.97
tpcds_q64/duckdb:parquet 72500569 74847846 0.97
tpcds_q65/duckdb:parquet 19692570 21453195 0.92
tpcds_q66/duckdb:parquet 53139012 56992946 0.93
tpcds_q67/duckdb:parquet 134725593 135674904 0.99
tpcds_q68/duckdb:parquet 38047290 37689589 1.01
tpcds_q69/duckdb:parquet 37623568 38172073 0.99
tpcds_q70/duckdb:parquet 19771770 19723796 1.00
tpcds_q71/duckdb:parquet 17715438 18914590 0.94
tpcds_q72/duckdb:parquet 163453160 164369646 0.99
tpcds_q73/duckdb:parquet 18084333 18082762 1.00
tpcds_q74/duckdb:parquet 49372918 50048908 0.99
tpcds_q75/duckdb:parquet 53221413 53596708 0.99
tpcds_q76/duckdb:parquet 68185091 70125951 0.97
tpcds_q77/duckdb:parquet 62281693 63130350 0.99
tpcds_q78/duckdb:parquet 74303705 75298298 0.99
tpcds_q79/duckdb:parquet 26932001 27372542 0.98
tpcds_q80/duckdb:parquet 82700787 87608645 0.94
tpcds_q81/duckdb:parquet 48228110 47295379 1.02
tpcds_q82/duckdb:parquet 14694532 15929017 0.92
tpcds_q83/duckdb:parquet 15796704 15970868 0.99
tpcds_q84/duckdb:parquet 20373304 19866755 1.03
tpcds_q85/duckdb:parquet 39396066 38945559 1.01
tpcds_q86/duckdb:parquet 12287585 12180430 1.01
tpcds_q87/duckdb:parquet 37394629 37798203 0.99
tpcds_q88/duckdb:parquet 29062987 29005993 1.00
tpcds_q89/duckdb:parquet 17521905 17233987 1.02
tpcds_q90/duckdb:parquet 8152147 7449832 1.09
tpcds_q91/duckdb:parquet 23299254 23255389 1.00
tpcds_q92/duckdb:parquet 12095267 11454383 1.06
tpcds_q93/duckdb:parquet 29341273 30723610 0.96
tpcds_q94/duckdb:parquet 15619189 15865318 0.98
tpcds_q95/duckdb:parquet 🚨 143262944 119439661 1.20
tpcds_q96/duckdb:parquet 9265977 9148912 1.01
tpcds_q97/duckdb:parquet 34182012 36460000 0.94
tpcds_q98/duckdb:parquet 18268988 18285596 1.00
tpcds_q99/duckdb:parquet 20139854 20833924 0.97
duckdb / duckdb (0.993x ➖, 1↑ 1↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20269720 20747708 0.98
tpcds_q02/duckdb:duckdb 18487875 17913996 1.03
tpcds_q03/duckdb:duckdb 8197327 7926810 1.03
tpcds_q04/duckdb:duckdb 161160192 159496485 1.01
tpcds_q05/duckdb:duckdb 17571289 18325316 0.96
tpcds_q06/duckdb:duckdb 22221049 22495382 0.99
tpcds_q07/duckdb:duckdb 38054125 37150574 1.02
tpcds_q08/duckdb:duckdb 118940906 120190188 0.99
tpcds_q09/duckdb:duckdb 19289540 19631269 0.98
tpcds_q10/duckdb:duckdb 22963269 23437921 0.98
tpcds_q11/duckdb:duckdb 139279122 136084115 1.02
tpcds_q12/duckdb:duckdb 10919458 11053649 0.99
tpcds_q13/duckdb:duckdb 23185275 23479217 0.99
tpcds_q14/duckdb:duckdb 91903666 96063655 0.96
tpcds_q15/duckdb:duckdb 24284042 24088578 1.01
tpcds_q16/duckdb:duckdb 18141376 17227079 1.05
tpcds_q17/duckdb:duckdb 22137533 21544990 1.03
tpcds_q18/duckdb:duckdb 42895203 43780406 0.98
tpcds_q19/duckdb:duckdb 16152179 15989829 1.01
tpcds_q20/duckdb:duckdb 10902944 11819403 0.92
tpcds_q21/duckdb:duckdb 6306833 6466780 0.98
tpcds_q22/duckdb:duckdb 60887228 61089376 1.00
tpcds_q23/duckdb:duckdb 74868703 80044677 0.94
tpcds_q24/duckdb:duckdb 22941457 24201477 0.95
tpcds_q25/duckdb:duckdb 16440197 16524871 0.99
tpcds_q26/duckdb:duckdb 25518603 27088111 0.94
tpcds_q27/duckdb:duckdb 37071268 40709975 0.91
tpcds_q28/duckdb:duckdb 21411392 21067272 1.02
tpcds_q29/duckdb:duckdb 20002308 20255439 0.99
tpcds_q30/duckdb:duckdb 29055727 26649195 1.09
tpcds_q31/duckdb:duckdb 20287905 19856513 1.02
tpcds_q32/duckdb:duckdb 7035118 6718269 1.05
tpcds_q33/duckdb:duckdb 12118905 12471641 0.97
tpcds_q34/duckdb:duckdb 15014939 15262842 0.98
tpcds_q35/duckdb:duckdb 31410710 31609542 0.99
tpcds_q36/duckdb:duckdb 68010272 69171863 0.98
tpcds_q37/duckdb:duckdb 6977800 7203928 0.97
tpcds_q38/duckdb:duckdb 30510383 30300518 1.01
tpcds_q39/duckdb:duckdb 25575278 25405378 1.01
tpcds_q40/duckdb:duckdb 🚀 11995953 13941607 0.86
tpcds_q41/duckdb:duckdb 8567198 8402021 1.02
tpcds_q42/duckdb:duckdb 6241462 6349768 0.98
tpcds_q43/duckdb:duckdb 11098619 10876260 1.02
tpcds_q44/duckdb:duckdb 13336368 13413260 0.99
tpcds_q45/duckdb:duckdb 16498379 17204008 0.96
tpcds_q46/duckdb:duckdb 34952797 35654223 0.98
tpcds_q47/duckdb:duckdb 40603784 40763344 1.00
tpcds_q48/duckdb:duckdb 21245903 22513343 0.94
tpcds_q49/duckdb:duckdb 15502583 16333533 0.95
tpcds_q50/duckdb:duckdb 13587659 13790456 0.99
tpcds_q51/duckdb:duckdb 90965396 89746493 1.01
tpcds_q52/duckdb:duckdb 7222359 6921817 1.04
tpcds_q53/duckdb:duckdb 11490994 11772361 0.98
tpcds_q54/duckdb:duckdb 17741088 16275787 1.09
tpcds_q55/duckdb:duckdb 6888763 6717449 1.03
tpcds_q56/duckdb:duckdb 13398513 13113609 1.02
tpcds_q57/duckdb:duckdb 30687185 31319874 0.98
tpcds_q58/duckdb:duckdb 12681508 12080188 1.05
tpcds_q59/duckdb:duckdb 34652806 34914306 0.99
tpcds_q60/duckdb:duckdb 14039922 15035311 0.93
tpcds_q61/duckdb:duckdb 13840746 14204592 0.97
tpcds_q62/duckdb:duckdb 9138960 8944910 1.02
tpcds_q63/duckdb:duckdb 10897027 10942410 1.00
tpcds_q64/duckdb:duckdb 51964279 53585423 0.97
tpcds_q65/duckdb:duckdb 32354912 32372233 1.00
tpcds_q66/duckdb:duckdb 25511218 25118163 1.02
tpcds_q67/duckdb:duckdb 129334228 130902232 0.99
tpcds_q68/duckdb:duckdb 24742076 24719169 1.00
tpcds_q69/duckdb:duckdb 24253472 22916521 1.06
tpcds_q70/duckdb:duckdb 15233721 14096467 1.08
tpcds_q71/duckdb:duckdb 12525818 12779984 0.98
tpcds_q72/duckdb:duckdb 41904459 41981332 1.00
tpcds_q73/duckdb:duckdb 10417226 10095600 1.03
tpcds_q74/duckdb:duckdb 96210846 95156561 1.01
tpcds_q75/duckdb:duckdb 40448081 41826686 0.97
tpcds_q76/duckdb:duckdb 11200051 11807724 0.95
tpcds_q77/duckdb:duckdb 11536688 11100325 1.04
tpcds_q78/duckdb:duckdb 61136328 63028687 0.97
tpcds_q79/duckdb:duckdb 17412294 17372374 1.00
tpcds_q80/duckdb:duckdb 27314832 28033810 0.97
tpcds_q81/duckdb:duckdb 38091010 36495171 1.04
tpcds_q82/duckdb:duckdb 7812533 7953213 0.98
tpcds_q83/duckdb:duckdb 8860813 8785846 1.01
tpcds_q84/duckdb:duckdb 13982268 14112324 0.99
tpcds_q85/duckdb:duckdb 22857698 22830357 1.00
tpcds_q86/duckdb:duckdb 10361267 11415114 0.91
tpcds_q87/duckdb:duckdb 🚨 35965952 32331632 1.11
tpcds_q88/duckdb:duckdb 23815229 23887797 1.00
tpcds_q89/duckdb:duckdb 13102197 13861986 0.95
tpcds_q90/duckdb:duckdb 5346216 5533292 0.97
tpcds_q91/duckdb:duckdb 12838015 12638488 1.02
tpcds_q92/duckdb:duckdb 8696027 9258737 0.94
tpcds_q93/duckdb:duckdb 21830778 20583868 1.06
tpcds_q94/duckdb:duckdb 12986114 12609100 1.03
tpcds_q95/duckdb:duckdb 123207196 126944648 0.97
tpcds_q96/duckdb:duckdb 4487394 4476605 1.00
tpcds_q97/duckdb:duckdb 27976494 29916218 0.94
tpcds_q98/duckdb:duckdb 12392980 13566685 0.91
tpcds_q99/duckdb:duckdb 16125413 15815576 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +15.3% -3.0% +18.9% +10.0% 🚨 regression
1 datafusion:vortex-file-compressed -6.4% -3.0% -3.5% +11.4% ➖ noise
1 duckdb:duckdb -2.3% -3.0% +0.7% +13.6% ➖ noise
1 duckdb:vortex-compact +33.5% -3.0% +37.7% +11.5% 🚨 regression
1 duckdb:vortex-file-compressed +30.0% -3.0% +34.0% +11.1% 🚨 regression
2 datafusion:vortex-compact -2.4% +0.7% -3.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +0.2% +0.7% -0.5% +10.0% ➖ noise
2 duckdb:duckdb +3.2% +0.7% +2.5% +10.3% ➖ noise
2 duckdb:vortex-compact +47.0% +0.7% +45.9% +17.5% 🚨 regression
2 duckdb:vortex-file-compressed +54.1% +0.7% +53.0% +15.1% 🚨 regression
3 datafusion:vortex-compact +6.6% -1.4% +8.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -1.4% -1.4% +0.1% +10.4% ➖ noise
3 duckdb:duckdb +3.4% -1.4% +4.9% +18.7% ➖ noise
3 duckdb:vortex-compact +43.6% -1.4% +45.7% +10.0% 🚨 regression
3 duckdb:vortex-file-compressed +16.8% -1.4% +18.6% +10.0% 🚨 regression
4 datafusion:vortex-compact +4.4% -1.6% +6.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -1.4% -1.6% +0.2% +10.0% ➖ noise
4 duckdb:duckdb +1.0% -1.6% +2.7% +10.0% ➖ noise
4 duckdb:vortex-compact +11.0% -1.6% +12.8% +10.0% 🚨 regression
4 duckdb:vortex-file-compressed +4.0% -1.6% +5.7% +10.0% ➖ noise
5 datafusion:vortex-compact +4.3% -2.7% +7.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -9.2% -2.7% -6.6% +10.0% ➖ noise
5 duckdb:duckdb -4.1% -2.7% -1.4% +14.9% ➖ noise
5 duckdb:vortex-compact +5.5% -2.7% +8.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.5% -2.7% +5.4% +13.4% ➖ noise
6 datafusion:vortex-compact -4.2% -2.6% -1.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -12.7% -2.6% -10.4% +10.0% ✅ faster
6 duckdb:duckdb -1.2% -2.6% +1.4% +14.1% ➖ noise
6 duckdb:vortex-compact +11.1% -2.6% +14.1% +10.0% 🚨 regression
6 duckdb:vortex-file-compressed +8.7% -2.6% +11.6% +10.0% 🚨 regression
7 datafusion:vortex-compact +4.2% -0.8% +5.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -13.2% -0.8% -12.5% +10.0% ✅ faster
7 duckdb:duckdb +2.4% -0.8% +3.2% +19.9% ➖ noise
7 duckdb:vortex-compact +37.8% -0.8% +38.8% +16.7% 🚨 regression
7 duckdb:vortex-file-compressed +19.0% -0.8% +19.9% +10.0% 🚨 regression
8 datafusion:vortex-compact -0.0% +2.5% -2.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -7.2% +2.5% -9.4% +10.0% ✅ faster
8 duckdb:duckdb -1.0% +2.5% -3.5% +10.0% ➖ noise
8 duckdb:vortex-compact +17.3% +2.5% +14.4% +12.0% 🚨 regression
8 duckdb:vortex-file-compressed +5.5% +2.5% +2.9% +10.4% ➖ noise
9 datafusion:vortex-compact +1.1% +2.0% -0.9% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +1.1% +2.0% -0.9% +10.0% ➖ noise
9 duckdb:duckdb -1.7% +2.0% -3.7% +10.0% ➖ noise
9 duckdb:vortex-compact +1.5% +2.0% -0.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +15.1% +2.0% +12.8% +10.0% 🚨 regression
10 datafusion:vortex-compact +6.5% +1.7% +4.7% +10.4% ➖ noise
10 datafusion:vortex-file-compressed +3.7% +1.7% +2.0% +10.0% ➖ noise
10 duckdb:duckdb -2.0% +1.7% -3.6% +10.0% ➖ noise
10 duckdb:vortex-compact +25.8% +1.7% +23.7% +10.0% 🚨 regression
10 duckdb:vortex-file-compressed +12.2% +1.7% +10.4% +10.0% 🚨 regression
11 datafusion:vortex-compact +5.4% -2.7% +8.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -4.0% -2.7% -1.3% +10.0% ➖ noise
11 duckdb:duckdb +2.3% -2.7% +5.2% +10.0% ➖ noise
11 duckdb:vortex-compact +16.3% -2.7% +19.5% +10.9% 🚨 regression
11 duckdb:vortex-file-compressed +1.1% -2.7% +3.9% +10.0% ➖ noise
12 datafusion:vortex-compact +1.8% -4.6% +6.8% +10.3% ➖ noise
12 datafusion:vortex-file-compressed -5.1% -4.6% -0.5% +10.0% ➖ noise
12 duckdb:duckdb -1.2% -4.6% +3.6% +10.0% ➖ noise
12 duckdb:vortex-compact +13.3% -4.6% +18.8% +13.4% 🚨 regression
12 duckdb:vortex-file-compressed +8.6% -4.6% +13.8% +13.4% 🚨 regression
13 datafusion:vortex-compact +0.1% -0.8% +0.9% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.5% -0.8% -0.7% +10.0% ➖ noise
13 duckdb:duckdb -1.3% -0.8% -0.5% +10.0% ➖ noise
13 duckdb:vortex-compact +33.4% -0.8% +34.5% +10.0% 🚨 regression
13 duckdb:vortex-file-compressed +37.4% -0.8% +38.5% +10.2% 🚨 regression
14 datafusion:vortex-compact -0.3% -0.9% +0.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -2.7% -0.9% -1.9% +10.1% ➖ noise
14 duckdb:duckdb -4.3% -0.9% -3.5% +10.0% ➖ noise
14 duckdb:vortex-compact +37.3% -0.9% +38.5% +12.2% 🚨 regression
14 duckdb:vortex-file-compressed +17.5% -0.9% +18.5% +10.0% 🚨 regression
15 datafusion:vortex-compact +2.9% -4.1% +7.3% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -14.6% -4.1% -11.0% +10.0% ✅ faster
15 duckdb:duckdb +0.8% -4.1% +5.1% +10.0% ➖ noise
15 duckdb:vortex-compact +4.0% -4.1% +8.4% +19.0% ➖ noise
15 duckdb:vortex-file-compressed +9.5% -4.1% +14.2% +18.4% ➖ noise
16 datafusion:vortex-compact +6.8% +2.6% +4.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -10.4% +2.6% -12.7% +10.0% ✅ faster
16 duckdb:duckdb +5.3% +2.6% +2.6% +18.8% ➖ noise
16 duckdb:vortex-compact +36.4% +2.6% +33.0% +22.8% 🚨 regression
16 duckdb:vortex-file-compressed +11.3% +2.6% +8.5% +12.7% ➖ noise
17 datafusion:vortex-compact +1.5% +2.1% -0.6% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -8.9% +2.1% -10.8% +14.5% ➖ noise
17 duckdb:duckdb +2.8% +2.1% +0.6% +10.0% ➖ noise
17 duckdb:vortex-compact +31.2% +2.1% +28.5% +10.0% 🚨 regression
17 duckdb:vortex-file-compressed +27.6% +2.1% +25.0% +10.0% 🚨 regression
18 datafusion:vortex-compact -2.4% +0.3% -2.7% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -11.4% +0.3% -11.7% +12.8% ✅ faster
18 duckdb:duckdb -2.0% +0.3% -2.3% +10.0% ➖ noise
18 duckdb:vortex-compact +16.3% +0.3% +15.9% +10.0% 🚨 regression
18 duckdb:vortex-file-compressed +13.0% +0.3% +12.6% +10.0% 🚨 regression
19 datafusion:vortex-compact -1.4% -1.2% -0.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -3.7% -1.2% -2.5% +12.1% ➖ noise
19 duckdb:duckdb +1.0% -1.2% +2.2% +10.7% ➖ noise
19 duckdb:vortex-compact +19.1% -1.2% +20.6% +10.0% 🚨 regression
19 duckdb:vortex-file-compressed +5.0% -1.2% +6.2% +11.6% ➖ noise
20 datafusion:vortex-compact +2.4% -2.1% +4.7% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -8.3% -2.1% -6.4% +20.6% ➖ noise
20 duckdb:duckdb -7.8% -2.1% -5.8% +12.5% ➖ noise
20 duckdb:vortex-compact +14.0% -2.1% +16.5% +12.6% 🚨 regression
20 duckdb:vortex-file-compressed +5.1% -2.1% +7.4% +10.0% ➖ noise
21 datafusion:vortex-compact -0.2% -0.5% +0.2% +10.3% ➖ noise
21 datafusion:vortex-file-compressed -12.7% -0.5% -12.3% +11.7% ✅ faster
21 duckdb:duckdb -2.5% -0.5% -2.0% +20.7% ➖ noise
21 duckdb:vortex-compact +7.1% -0.5% +7.6% +19.6% ➖ noise
21 duckdb:vortex-file-compressed +8.6% -0.5% +9.1% +22.1% ➖ noise
22 datafusion:vortex-compact +0.4% +0.5% -0.1% +11.9% ➖ noise
22 datafusion:vortex-file-compressed -8.3% +0.5% -8.8% +23.9% ➖ noise
22 duckdb:duckdb -0.3% +0.5% -0.8% +11.9% ➖ noise
22 duckdb:vortex-compact +34.3% +0.5% +33.6% +20.5% 🚨 regression
22 duckdb:vortex-file-compressed +34.0% +0.5% +33.4% +19.5% 🚨 regression
23 datafusion:vortex-compact -0.7% -3.7% +3.1% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -4.7% -3.7% -1.0% +10.0% ➖ noise
23 duckdb:duckdb -6.5% -3.7% -2.9% +11.8% ➖ noise
23 duckdb:vortex-compact +22.1% -3.7% +26.7% +10.0% 🚨 regression
23 duckdb:vortex-file-compressed +21.5% -3.7% +26.2% +11.4% 🚨 regression
24 datafusion:vortex-compact +1.8% -0.8% +2.7% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -2.6% -0.8% -1.8% +10.0% ➖ noise
24 duckdb:duckdb -5.2% -0.8% -4.5% +10.1% ➖ noise
24 duckdb:vortex-compact +41.3% -0.8% +42.4% +10.0% 🚨 regression
24 duckdb:vortex-file-compressed +36.7% -0.8% +37.7% +10.5% 🚨 regression
25 datafusion:vortex-compact +1.4% +0.3% +1.1% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -0.9% +0.3% -1.2% +10.0% ➖ noise
25 duckdb:duckdb -0.5% +0.3% -0.8% +15.4% ➖ noise
25 duckdb:vortex-compact +37.5% +0.3% +37.0% +10.0% 🚨 regression
25 duckdb:vortex-file-compressed +25.4% +0.3% +25.0% +11.5% 🚨 regression
26 datafusion:vortex-compact -6.5% +0.6% -7.1% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -3.2% +0.6% -3.8% +10.0% ➖ noise
26 duckdb:duckdb -5.8% +0.6% -6.4% +12.4% ➖ noise
26 duckdb:vortex-compact +17.4% +0.6% +16.7% +18.9% ➖ noise
26 duckdb:vortex-file-compressed +11.4% +0.6% +10.7% +10.9% ➖ noise
27 datafusion:vortex-compact -3.8% -0.8% -3.1% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -2.9% -0.8% -2.2% +10.0% ➖ noise
27 duckdb:duckdb -8.9% -0.8% -8.2% +21.3% ➖ noise
27 duckdb:vortex-compact +34.5% -0.8% +35.5% +10.0% 🚨 regression
27 duckdb:vortex-file-compressed +16.3% -0.8% +17.2% +10.0% 🚨 regression
28 datafusion:vortex-compact +2.4% -1.2% +3.6% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +4.6% -1.2% +5.8% +10.0% ➖ noise
28 duckdb:duckdb +1.6% -1.2% +2.8% +10.0% ➖ noise
28 duckdb:vortex-compact +12.3% -1.2% +13.6% +10.0% 🚨 regression
28 duckdb:vortex-file-compressed +7.9% -1.2% +9.1% +10.0% ➖ noise
29 datafusion:vortex-compact -0.1% -0.2% +0.1% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -7.2% -0.2% -7.0% +10.0% ➖ noise
29 duckdb:duckdb -1.2% -0.2% -1.0% +10.0% ➖ noise
29 duckdb:vortex-compact +39.5% -0.2% +39.8% +10.9% 🚨 regression
29 duckdb:vortex-file-compressed +31.0% -0.2% +31.3% +10.3% 🚨 regression
30 datafusion:vortex-compact +11.8% +2.6% +9.0% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -2.0% +2.6% -4.4% +10.0% ➖ noise
30 duckdb:duckdb +9.0% +2.6% +6.3% +10.1% ➖ noise
30 duckdb:vortex-compact +15.3% +2.6% +12.4% +10.0% 🚨 regression
30 duckdb:vortex-file-compressed +12.1% +2.6% +9.3% +10.0% ➖ noise
31 datafusion:vortex-compact +0.7% +1.2% -0.5% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -0.1% +1.2% -1.2% +10.0% ➖ noise
31 duckdb:duckdb +2.2% +1.2% +1.0% +10.0% ➖ noise
31 duckdb:vortex-compact +24.8% +1.2% +23.4% +10.0% 🚨 regression
31 duckdb:vortex-file-compressed +12.6% +1.2% +11.3% +10.0% 🚨 regression
32 datafusion:vortex-compact -0.1% +0.4% -0.5% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -0.5% +0.4% -0.8% +10.0% ➖ noise
32 duckdb:duckdb +4.7% +0.4% +4.3% +16.3% ➖ noise
32 duckdb:vortex-compact +18.5% +0.4% +18.1% +10.4% 🚨 regression
32 duckdb:vortex-file-compressed +17.5% +0.4% +17.0% +10.0% 🚨 regression
33 datafusion:vortex-compact -2.8% +0.0% -2.8% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -3.2% +0.0% -3.2% +10.0% ➖ noise
33 duckdb:duckdb -2.8% +0.0% -2.8% +12.9% ➖ noise
33 duckdb:vortex-compact +15.1% +0.0% +15.1% +10.1% 🚨 regression
33 duckdb:vortex-file-compressed +18.2% +0.0% +18.2% +10.3% 🚨 regression
34 datafusion:vortex-compact -2.3% +1.3% -3.6% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -2.0% +1.3% -3.2% +10.0% ➖ noise
34 duckdb:duckdb -1.6% +1.3% -2.9% +15.2% ➖ noise
34 duckdb:vortex-compact +18.4% +1.3% +16.9% +10.0% 🚨 regression
34 duckdb:vortex-file-compressed +11.3% +1.3% +9.8% +11.5% ➖ noise
35 datafusion:vortex-compact +4.4% -1.8% +6.3% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +1.1% -1.8% +2.9% +10.0% ➖ noise
35 duckdb:duckdb -0.6% -1.8% +1.2% +10.9% ➖ noise
35 duckdb:vortex-compact +17.1% -1.8% +19.2% +10.0% 🚨 regression
35 duckdb:vortex-file-compressed +12.0% -1.8% +14.0% +11.0% 🚨 regression
36 datafusion:vortex-compact -1.0% -0.7% -0.4% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -2.3% -0.7% -1.6% +10.0% ➖ noise
36 duckdb:duckdb -1.7% -0.7% -1.0% +11.3% ➖ noise
36 duckdb:vortex-compact +36.7% -0.7% +37.6% +10.2% 🚨 regression
36 duckdb:vortex-file-compressed +36.5% -0.7% +37.4% +18.0% 🚨 regression
37 datafusion:vortex-compact +4.8% +2.9% +1.9% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -7.5% +2.9% -10.1% +10.0% ✅ faster
37 duckdb:duckdb -3.1% +2.9% -5.9% +14.4% ➖ noise
37 duckdb:vortex-compact +4.4% +2.9% +1.5% +12.3% ➖ noise
37 duckdb:vortex-file-compressed +2.1% +2.9% -0.8% +12.7% ➖ noise
38 datafusion:vortex-compact -0.3% -2.2% +2.0% +10.1% ➖ noise
38 datafusion:vortex-file-compressed +0.7% -2.2% +2.9% +10.0% ➖ noise
38 duckdb:duckdb +0.7% -2.2% +2.9% +16.7% ➖ noise
38 duckdb:vortex-compact +9.5% -2.2% +11.9% +19.4% ➖ noise
38 duckdb:vortex-file-compressed +17.2% -2.2% +19.8% +12.9% 🚨 regression
39 datafusion:vortex-compact +2.5% -0.9% +3.4% +16.1% ➖ noise
39 datafusion:vortex-file-compressed -9.1% -0.9% -8.3% +14.2% ➖ noise
39 duckdb:duckdb +0.7% -0.9% +1.6% +11.5% ➖ noise
39 duckdb:vortex-compact +12.4% -0.9% +13.4% +18.7% ➖ noise
39 duckdb:vortex-file-compressed +8.1% -0.9% +9.0% +15.7% ➖ noise
40 datafusion:vortex-compact -2.8% +2.1% -4.8% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -4.6% +2.1% -6.6% +10.0% ➖ noise
40 duckdb:duckdb -14.0% +2.1% -15.8% +23.1% ➖ noise
40 duckdb:vortex-compact +13.4% +2.1% +11.0% +13.9% ➖ noise
40 duckdb:vortex-file-compressed +14.7% +2.1% +12.3% +11.3% 🚨 regression
41 datafusion:vortex-compact +0.4% -4.4% +5.1% +11.0% ➖ noise
41 datafusion:vortex-file-compressed -3.4% -4.4% +1.1% +13.0% ➖ noise
41 duckdb:duckdb +2.0% -4.4% +6.7% +13.8% ➖ noise
41 duckdb:vortex-compact +0.3% -4.4% +5.0% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -0.2% -4.4% +4.4% +10.0% ➖ noise
42 datafusion:vortex-compact +2.2% -2.3% +4.6% +11.9% ➖ noise
42 datafusion:vortex-file-compressed -3.1% -2.3% -0.8% +15.5% ➖ noise
42 duckdb:duckdb -1.7% -2.3% +0.6% +14.0% ➖ noise
42 duckdb:vortex-compact +34.0% -2.3% +37.1% +10.7% 🚨 regression
42 duckdb:vortex-file-compressed +26.3% -2.3% +29.2% +17.4% 🚨 regression
43 datafusion:vortex-compact -1.4% -0.9% -0.5% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +2.8% -0.9% +3.7% +11.0% ➖ noise
43 duckdb:duckdb +2.0% -0.9% +2.9% +22.2% ➖ noise
43 duckdb:vortex-compact +4.0% -0.9% +4.9% +40.1% ➖ noise
43 duckdb:vortex-file-compressed +9.4% -0.9% +10.4% +28.6% ➖ noise
44 datafusion:vortex-compact -0.4% -0.6% +0.2% +10.0% ➖ noise
44 datafusion:vortex-file-compressed +1.0% -0.6% +1.6% +10.0% ➖ noise
44 duckdb:duckdb -0.6% -0.6% -0.0% +11.0% ➖ noise
44 duckdb:vortex-compact +7.2% -0.6% +7.8% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -0.3% -0.6% +0.2% +10.0% ➖ noise
45 datafusion:vortex-compact +3.3% -0.9% +4.3% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -4.8% -0.9% -3.9% +10.0% ➖ noise
45 duckdb:duckdb -4.1% -0.9% -3.2% +11.6% ➖ noise
45 duckdb:vortex-compact +8.5% -0.9% +9.5% +10.0% ➖ noise
45 duckdb:vortex-file-compressed +0.5% -0.9% +1.5% +13.7% ➖ noise
46 datafusion:vortex-compact -7.3% -2.3% -5.2% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -8.7% -2.3% -6.5% +10.0% ➖ noise
46 duckdb:duckdb -2.0% -2.3% +0.3% +10.0% ➖ noise
46 duckdb:vortex-compact +24.6% -2.3% +27.5% +10.0% 🚨 regression
46 duckdb:vortex-file-compressed +12.0% -2.3% +14.6% +10.0% 🚨 regression
47 datafusion:vortex-compact -2.7% -0.8% -1.9% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -4.4% -0.8% -3.7% +10.0% ➖ noise
47 duckdb:duckdb -0.4% -0.8% +0.4% +10.0% ➖ noise
47 duckdb:vortex-compact +25.9% -0.8% +26.9% +10.0% 🚨 regression
47 duckdb:vortex-file-compressed +19.1% -0.8% +20.0% +10.7% 🚨 regression
48 datafusion:vortex-compact +6.1% -3.4% +9.8% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -0.8% -3.4% +2.7% +10.0% ➖ noise
48 duckdb:duckdb -5.6% -3.4% -2.3% +10.8% ➖ noise
48 duckdb:vortex-compact +32.3% -3.4% +36.9% +10.8% 🚨 regression
48 duckdb:vortex-file-compressed +32.9% -3.4% +37.6% +10.0% 🚨 regression
49 datafusion:vortex-compact +5.7% -3.3% +9.3% +10.0% ➖ noise
49 datafusion:vortex-file-compressed -4.8% -3.3% -1.6% +10.0% ➖ noise
49 duckdb:duckdb -5.1% -3.3% -1.9% +13.2% ➖ noise
49 duckdb:vortex-compact +37.1% -3.3% +41.7% +15.8% 🚨 regression
49 duckdb:vortex-file-compressed +16.5% -3.3% +20.4% +24.8% ➖ noise
50 datafusion:vortex-compact -0.2% -2.2% +2.1% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -5.7% -2.2% -3.5% +10.0% ➖ noise
50 duckdb:duckdb -1.5% -2.2% +0.8% +10.8% ➖ noise
50 duckdb:vortex-compact +33.4% -2.2% +36.5% +10.0% 🚨 regression
50 duckdb:vortex-file-compressed +31.3% -2.2% +34.3% +10.0% 🚨 regression
51 datafusion:vortex-compact -0.3% -1.4% +1.1% +10.0% ➖ noise
51 datafusion:vortex-file-compressed -4.3% -1.4% -2.9% +10.0% ➖ noise
51 duckdb:duckdb +1.4% -1.4% +2.8% +10.0% ➖ noise
51 duckdb:vortex-compact +5.1% -1.4% +6.7% +15.7% ➖ noise
51 duckdb:vortex-file-compressed -4.0% -1.4% -2.6% +28.9% ➖ noise
52 datafusion:vortex-compact -4.2% -0.6% -3.7% +12.8% ➖ noise
52 datafusion:vortex-file-compressed -6.7% -0.6% -6.2% +13.4% ➖ noise
52 duckdb:duckdb +4.3% -0.6% +5.0% +16.1% ➖ noise
52 duckdb:vortex-compact +40.2% -0.6% +41.0% +14.5% 🚨 regression
52 duckdb:vortex-file-compressed +16.2% -0.6% +16.9% +25.0% ➖ noise
53 datafusion:vortex-compact -0.5% -2.3% +1.9% +10.0% ➖ noise
53 datafusion:vortex-file-compressed -9.0% -2.3% -6.8% +12.9% ➖ noise
53 duckdb:duckdb -2.4% -2.3% -0.1% +10.4% ➖ noise
53 duckdb:vortex-compact +32.5% -2.3% +35.6% +10.0% 🚨 regression
53 duckdb:vortex-file-compressed +18.6% -2.3% +21.4% +10.0% 🚨 regression
54 datafusion:vortex-compact -0.7% -1.0% +0.3% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -8.4% -1.0% -7.5% +11.5% ➖ noise
54 duckdb:duckdb +9.0% -1.0% +10.1% +10.8% ➖ noise
54 duckdb:vortex-compact +40.5% -1.0% +41.9% +18.9% 🚨 regression
54 duckdb:vortex-file-compressed +22.6% -1.0% +23.8% +10.0% 🚨 regression
55 datafusion:vortex-compact +6.9% -3.7% +11.0% +11.1% ➖ noise
55 datafusion:vortex-file-compressed -10.4% -3.7% -7.0% +11.0% ➖ noise
55 duckdb:duckdb +2.6% -3.7% +6.5% +14.6% ➖ noise
55 duckdb:vortex-compact +37.3% -3.7% +42.6% +14.9% 🚨 regression
55 duckdb:vortex-file-compressed +20.6% -3.7% +25.3% +12.7% 🚨 regression
56 datafusion:vortex-compact +1.5% +0.3% +1.2% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -0.4% +0.3% -0.6% +10.0% ➖ noise
56 duckdb:duckdb +2.2% +0.3% +1.9% +12.7% ➖ noise
56 duckdb:vortex-compact +16.6% +0.3% +16.3% +10.0% 🚨 regression
56 duckdb:vortex-file-compressed +9.5% +0.3% +9.2% +11.5% ➖ noise
57 datafusion:vortex-compact -2.3% -0.7% -1.6% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -7.8% -0.7% -7.1% +10.2% ➖ noise
57 duckdb:duckdb -2.0% -0.7% -1.3% +14.1% ➖ noise
57 duckdb:vortex-compact +40.5% -0.7% +41.5% +21.8% 🚨 regression
57 duckdb:vortex-file-compressed +38.8% -0.7% +39.8% +13.6% 🚨 regression
58 datafusion:vortex-compact +2.7% +1.7% +1.0% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -6.5% +1.7% -8.0% +10.0% ➖ noise
58 duckdb:duckdb +5.0% +1.7% +3.2% +11.1% ➖ noise
58 duckdb:vortex-compact +18.2% +1.7% +16.3% +16.1% 🚨 regression
58 duckdb:vortex-file-compressed -3.3% +1.7% -4.9% +11.5% ➖ noise
59 datafusion:vortex-compact -2.3% +0.6% -2.9% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -2.9% +0.6% -3.5% +10.0% ➖ noise
59 duckdb:duckdb -0.7% +0.6% -1.4% +10.0% ➖ noise
59 duckdb:vortex-compact +24.7% +0.6% +23.9% +14.5% 🚨 regression
59 duckdb:vortex-file-compressed +45.0% +0.6% +44.1% +22.7% 🚨 regression
60 datafusion:vortex-compact -2.4% -7.0% +4.9% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -1.1% -7.0% +6.3% +10.1% ➖ noise
60 duckdb:duckdb -6.6% -7.0% +0.4% +12.5% ➖ noise
60 duckdb:vortex-compact +19.1% -7.0% +28.0% +10.0% 🚨 regression
60 duckdb:vortex-file-compressed +12.0% -7.0% +20.3% +13.9% 🚨 regression
61 datafusion:vortex-compact +0.3% +3.1% -2.7% +10.6% ➖ noise
61 datafusion:vortex-file-compressed -2.0% +3.1% -5.0% +10.0% ➖ noise
61 duckdb:duckdb -2.6% +3.1% -5.5% +10.1% ➖ noise
61 duckdb:vortex-compact +8.4% +3.1% +5.1% +10.8% ➖ noise
61 duckdb:vortex-file-compressed +12.9% +3.1% +9.5% +11.1% ➖ noise
62 datafusion:vortex-compact +0.3% -2.1% +2.5% +11.1% ➖ noise
62 datafusion:vortex-file-compressed -7.1% -2.1% -5.0% +12.7% ➖ noise
62 duckdb:duckdb +2.2% -2.1% +4.4% +12.9% ➖ noise
62 duckdb:vortex-compact +38.0% -2.1% +41.1% +14.3% 🚨 regression
62 duckdb:vortex-file-compressed +32.1% -2.1% +35.0% +15.3% 🚨 regression
63 datafusion:vortex-compact -3.2% -2.0% -1.2% +11.2% ➖ noise
63 datafusion:vortex-file-compressed -6.3% -2.0% -4.4% +10.0% ➖ noise
63 duckdb:duckdb -0.4% -2.0% +1.6% +10.5% ➖ noise
63 duckdb:vortex-compact +25.5% -2.0% +28.0% +10.0% 🚨 regression
63 duckdb:vortex-file-compressed +24.1% -2.0% +26.6% +10.0% 🚨 regression
64 datafusion:vortex-compact -1.6% -2.1% +0.5% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -4.5% -2.1% -2.5% +10.0% ➖ noise
64 duckdb:duckdb -3.0% -2.1% -1.0% +10.0% ➖ noise
64 duckdb:vortex-compact +23.0% -2.1% +25.6% +10.0% 🚨 regression
64 duckdb:vortex-file-compressed +5.7% -2.1% +8.0% +10.0% ➖ noise
65 datafusion:vortex-compact -1.3% -5.5% +4.5% +10.2% ➖ noise
65 datafusion:vortex-file-compressed -0.5% -5.5% +5.3% +10.6% ➖ noise
65 duckdb:duckdb -0.1% -5.5% +5.8% +17.3% ➖ noise
65 duckdb:vortex-compact +21.9% -5.5% +29.0% +10.0% 🚨 regression
65 duckdb:vortex-file-compressed +25.8% -5.5% +33.2% +10.0% 🚨 regression
66 datafusion:vortex-compact +0.6% -4.1% +5.0% +10.0% ➖ noise
66 datafusion:vortex-file-compressed -3.3% -4.1% +0.8% +12.8% ➖ noise
66 duckdb:duckdb +1.6% -4.1% +5.9% +16.3% ➖ noise
66 duckdb:vortex-compact +30.3% -4.1% +36.0% +17.4% 🚨 regression
66 duckdb:vortex-file-compressed +26.0% -4.1% +31.4% +11.7% 🚨 regression
67 datafusion:vortex-compact +0.4% -0.1% +0.5% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -2.1% -0.1% -2.0% +10.0% ➖ noise
67 duckdb:duckdb -1.2% -0.1% -1.1% +10.0% ➖ noise
67 duckdb:vortex-compact +31.2% -0.1% +31.3% +10.0% 🚨 regression
67 duckdb:vortex-file-compressed +32.5% -0.1% +32.6% +14.0% 🚨 regression
68 datafusion:vortex-compact -1.9% -2.2% +0.3% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -4.2% -2.2% -2.1% +11.4% ➖ noise
68 duckdb:duckdb +0.1% -2.2% +2.3% +10.0% ➖ noise
68 duckdb:vortex-compact +30.9% -2.2% +33.9% +10.0% 🚨 regression
68 duckdb:vortex-file-compressed +13.4% -2.2% +15.9% +10.0% 🚨 regression
69 datafusion:vortex-compact +4.9% -2.1% +7.1% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -1.0% -2.1% +1.1% +10.0% ➖ noise
69 duckdb:duckdb +5.8% -2.1% +8.1% +10.0% ➖ noise
69 duckdb:vortex-compact +14.4% -2.1% +16.8% +10.0% 🚨 regression
69 duckdb:vortex-file-compressed +16.0% -2.1% +18.5% +10.0% 🚨 regression
70 datafusion:vortex-compact -3.6% -0.4% -3.2% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -1.5% -0.4% -1.1% +10.0% ➖ noise
70 duckdb:duckdb +8.1% -0.4% +8.5% +17.0% ➖ noise
70 duckdb:vortex-compact +39.2% -0.4% +39.7% +24.8% 🚨 regression
70 duckdb:vortex-file-compressed +8.1% -0.4% +8.5% +13.9% ➖ noise
71 datafusion:vortex-compact +3.6% -2.5% +6.2% +12.1% ➖ noise
71 datafusion:vortex-file-compressed -2.7% -2.5% -0.3% +15.1% ➖ noise
71 duckdb:duckdb -2.0% -2.5% +0.5% +17.6% ➖ noise
71 duckdb:vortex-compact +21.2% -2.5% +24.3% +13.9% 🚨 regression
71 duckdb:vortex-file-compressed +18.1% -2.5% +21.1% +18.2% 🚨 regression
72 datafusion:vortex-compact -0.3% -0.4% +0.2% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -3.1% -0.4% -2.7% +10.0% ➖ noise
72 duckdb:duckdb -0.2% -0.4% +0.2% +11.6% ➖ noise
72 duckdb:vortex-compact +20.7% -0.4% +21.2% +10.0% 🚨 regression
72 duckdb:vortex-file-compressed +22.3% -0.4% +22.8% +10.8% 🚨 regression
73 datafusion:vortex-compact +3.9% +1.4% +2.5% +18.0% ➖ noise
73 datafusion:vortex-file-compressed -5.1% +1.4% -6.5% +15.9% ➖ noise
73 duckdb:duckdb +3.2% +1.4% +1.7% +13.7% ➖ noise
73 duckdb:vortex-compact +19.0% +1.4% +17.3% +16.7% 🚨 regression
73 duckdb:vortex-file-compressed +14.9% +1.4% +13.3% +13.4% ➖ noise
74 datafusion:vortex-compact +4.9% -1.0% +6.0% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +1.1% -1.0% +2.1% +10.0% ➖ noise
74 duckdb:duckdb +1.1% -1.0% +2.2% +10.6% ➖ noise
74 duckdb:vortex-compact +2.7% -1.0% +3.8% +10.0% ➖ noise
74 duckdb:vortex-file-compressed -3.3% -1.0% -2.3% +10.5% ➖ noise
75 datafusion:vortex-compact +5.1% -1.8% +7.1% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +2.2% -1.8% +4.1% +10.0% ➖ noise
75 duckdb:duckdb -3.3% -1.8% -1.5% +10.0% ➖ noise
75 duckdb:vortex-compact +20.6% -1.8% +22.8% +10.0% 🚨 regression
75 duckdb:vortex-file-compressed +6.4% -1.8% +8.4% +10.0% ➖ noise
76 datafusion:vortex-compact -1.9% -2.3% +0.3% +10.0% ➖ noise
76 datafusion:vortex-file-compressed +1.6% -2.3% +3.9% +10.0% ➖ noise
76 duckdb:duckdb -5.1% -2.3% -3.0% +17.0% ➖ noise
76 duckdb:vortex-compact +19.1% -2.3% +21.8% +10.0% 🚨 regression
76 duckdb:vortex-file-compressed +1.0% -2.3% +3.4% +17.5% ➖ noise
77 datafusion:vortex-compact -0.5% -2.6% +2.1% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -2.5% -2.6% +0.1% +10.0% ➖ noise
77 duckdb:duckdb +3.9% -2.6% +6.7% +15.1% ➖ noise
77 duckdb:vortex-compact +25.4% -2.6% +28.7% +10.0% 🚨 regression
77 duckdb:vortex-file-compressed +5.0% -2.6% +7.7% +12.2% ➖ noise
78 datafusion:vortex-compact +2.9% -1.8% +4.8% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -3.3% -1.8% -1.6% +10.0% ➖ noise
78 duckdb:duckdb -3.0% -1.8% -1.2% +10.0% ➖ noise
78 duckdb:vortex-compact +16.9% -1.8% +19.0% +10.0% 🚨 regression
78 duckdb:vortex-file-compressed +17.4% -1.8% +19.5% +10.6% 🚨 regression
79 datafusion:vortex-compact -6.2% -1.8% -4.4% +11.5% ➖ noise
79 datafusion:vortex-file-compressed +0.3% -1.8% +2.2% +10.0% ➖ noise
79 duckdb:duckdb +0.2% -1.8% +2.1% +10.0% ➖ noise
79 duckdb:vortex-compact +41.8% -1.8% +44.4% +10.0% 🚨 regression
79 duckdb:vortex-file-compressed +28.5% -1.8% +30.8% +11.8% 🚨 regression
80 datafusion:vortex-compact +0.4% -3.3% +3.9% +10.0% ➖ noise
80 datafusion:vortex-file-compressed -0.1% -3.3% +3.3% +10.0% ➖ noise
80 duckdb:duckdb -2.6% -3.3% +0.8% +10.7% ➖ noise
80 duckdb:vortex-compact +17.0% -3.3% +21.0% +10.0% 🚨 regression
80 duckdb:vortex-file-compressed +16.7% -3.3% +20.7% +10.0% 🚨 regression
81 datafusion:vortex-compact +4.8% -1.5% +6.4% +13.2% ➖ noise
81 datafusion:vortex-file-compressed -1.7% -1.5% -0.2% +12.4% ➖ noise
81 duckdb:duckdb +4.4% -1.5% +5.9% +12.0% ➖ noise
81 duckdb:vortex-compact +12.7% -1.5% +14.4% +12.5% 🚨 regression
81 duckdb:vortex-file-compressed +8.1% -1.5% +9.7% +15.3% ➖ noise
82 datafusion:vortex-compact +8.6% -5.3% +14.8% +12.1% 🚨 regression
82 datafusion:vortex-file-compressed +0.1% -5.3% +5.8% +10.0% ➖ noise
82 duckdb:duckdb -1.8% -5.3% +3.8% +13.2% ➖ noise
82 duckdb:vortex-compact +7.7% -5.3% +13.8% +11.3% 🚨 regression
82 duckdb:vortex-file-compressed +11.6% -5.3% +17.9% +15.6% 🚨 regression
83 datafusion:vortex-compact +1.1% -1.5% +2.6% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -0.1% -1.5% +1.5% +10.0% ➖ noise
83 duckdb:duckdb +0.9% -1.5% +2.4% +12.4% ➖ noise
83 duckdb:vortex-compact +0.9% -1.5% +2.5% +10.0% ➖ noise
83 duckdb:vortex-file-compressed -3.7% -1.5% -2.2% +10.0% ➖ noise
84 datafusion:vortex-compact +8.8% +0.2% +8.6% +12.6% ➖ noise
84 datafusion:vortex-file-compressed +5.4% +0.2% +5.2% +10.2% ➖ noise
84 duckdb:duckdb -0.9% +0.2% -1.1% +11.7% ➖ noise
84 duckdb:vortex-compact +15.0% +0.2% +14.8% +10.0% 🚨 regression
84 duckdb:vortex-file-compressed +10.9% +0.2% +10.7% +10.0% 🚨 regression
85 datafusion:vortex-compact +5.9% -0.0% +6.0% +10.0% ➖ noise
85 datafusion:vortex-file-compressed -0.2% -0.0% -0.2% +10.0% ➖ noise
85 duckdb:duckdb +0.1% -0.0% +0.1% +10.0% ➖ noise
85 duckdb:vortex-compact +9.9% -0.0% +9.9% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +6.1% -0.0% +6.1% +10.2% ➖ noise
86 datafusion:vortex-compact -0.1% +2.4% -2.4% +12.6% ➖ noise
86 datafusion:vortex-file-compressed -3.2% +2.4% -5.5% +14.6% ➖ noise
86 duckdb:duckdb -9.2% +2.4% -11.4% +18.3% ➖ noise
86 duckdb:vortex-compact +19.8% +2.4% +17.0% +17.2% ➖ noise
86 duckdb:vortex-file-compressed +25.6% +2.4% +22.7% +15.0% 🚨 regression
87 datafusion:vortex-compact -0.4% -1.0% +0.6% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -1.2% -1.0% -0.2% +10.0% ➖ noise
87 duckdb:duckdb +11.2% -1.0% +12.3% +16.7% ➖ noise
87 duckdb:vortex-compact +10.2% -1.0% +11.3% +10.3% 🚨 regression
87 duckdb:vortex-file-compressed +12.6% -1.0% +13.7% +10.3% 🚨 regression
88 datafusion:vortex-compact -8.5% +0.4% -8.8% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +4.0% +0.4% +3.6% +10.0% ➖ noise
88 duckdb:duckdb -0.3% +0.4% -0.7% +10.0% ➖ noise
88 duckdb:vortex-compact +11.2% +0.4% +10.7% +10.0% 🚨 regression
88 duckdb:vortex-file-compressed +8.1% +0.4% +7.7% +10.0% ➖ noise
89 datafusion:vortex-compact +0.9% -0.7% +1.6% +10.0% ➖ noise
89 datafusion:vortex-file-compressed +1.4% -0.7% +2.1% +10.0% ➖ noise
89 duckdb:duckdb -5.5% -0.7% -4.9% +11.7% ➖ noise
89 duckdb:vortex-compact +34.3% -0.7% +35.2% +10.0% 🚨 regression
89 duckdb:vortex-file-compressed +28.4% -0.7% +29.3% +10.8% 🚨 regression
90 datafusion:vortex-compact +8.4% +5.0% +3.3% +10.0% ➖ noise
90 datafusion:vortex-file-compressed -2.0% +5.0% -6.6% +10.0% ➖ noise
90 duckdb:duckdb -3.4% +5.0% -8.0% +14.9% ➖ noise
90 duckdb:vortex-compact +15.3% +5.0% +9.8% +10.3% ➖ noise
90 duckdb:vortex-file-compressed +21.0% +5.0% +15.2% +14.8% 🚨 regression
91 datafusion:vortex-compact -1.5% -0.8% -0.7% +11.6% ➖ noise
91 datafusion:vortex-file-compressed +1.6% -0.8% +2.4% +10.0% ➖ noise
91 duckdb:duckdb +1.6% -0.8% +2.4% +10.0% ➖ noise
91 duckdb:vortex-compact +10.3% -0.8% +11.1% +10.0% 🚨 regression
91 duckdb:vortex-file-compressed +3.3% -0.8% +4.2% +10.0% ➖ noise
92 datafusion:vortex-compact +4.3% +0.0% +4.3% +10.0% ➖ noise
92 datafusion:vortex-file-compressed -4.8% +0.0% -4.8% +10.9% ➖ noise
92 duckdb:duckdb -6.1% +0.0% -6.1% +16.2% ➖ noise
92 duckdb:vortex-compact +22.5% +0.0% +22.5% +13.5% 🚨 regression
92 duckdb:vortex-file-compressed +19.9% +0.0% +19.9% +14.4% 🚨 regression
93 datafusion:vortex-compact +2.5% -3.6% +6.3% +10.0% ➖ noise
93 datafusion:vortex-file-compressed +1.7% -3.6% +5.6% +10.0% ➖ noise
93 duckdb:duckdb +6.1% -3.6% +10.0% +13.5% ➖ noise
93 duckdb:vortex-compact +43.6% -3.6% +49.0% +10.0% 🚨 regression
93 duckdb:vortex-file-compressed +21.1% -3.6% +25.6% +10.0% 🚨 regression
94 datafusion:vortex-compact +3.2% +0.0% +3.2% +10.0% ➖ noise
94 datafusion:vortex-file-compressed -3.0% +0.0% -3.0% +10.0% ➖ noise
94 duckdb:duckdb +3.0% +0.0% +3.0% +10.0% ➖ noise
94 duckdb:vortex-compact +27.7% +0.0% +27.7% +10.3% 🚨 regression
94 duckdb:vortex-file-compressed +16.8% +0.0% +16.8% +12.0% 🚨 regression
95 datafusion:vortex-compact +5.8% +9.8% -3.7% +11.3% ➖ noise
95 datafusion:vortex-file-compressed +1.3% +9.8% -7.7% +11.0% ➖ noise
95 duckdb:duckdb -2.9% +9.8% -11.6% +20.1% ➖ noise
95 duckdb:vortex-compact +44.9% +9.8% +31.9% +16.5% 🚨 regression
95 duckdb:vortex-file-compressed +21.2% +9.8% +10.3% +20.5% ➖ noise
96 datafusion:vortex-compact -7.2% +2.0% -9.0% +11.2% ➖ noise
96 datafusion:vortex-file-compressed -1.1% +2.0% -3.0% +12.5% ➖ noise
96 duckdb:duckdb +0.2% +2.0% -1.7% +14.8% ➖ noise
96 duckdb:vortex-compact +38.4% +2.0% +35.6% +13.1% 🚨 regression
96 duckdb:vortex-file-compressed +29.4% +2.0% +26.8% +16.5% 🚨 regression
97 datafusion:vortex-compact -4.4% -3.9% -0.5% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -4.5% -3.9% -0.7% +10.0% ➖ noise
97 duckdb:duckdb -6.5% -3.9% -2.7% +12.6% ➖ noise
97 duckdb:vortex-compact +12.1% -3.9% +16.6% +19.3% ➖ noise
97 duckdb:vortex-file-compressed +20.1% -3.9% +25.0% +15.8% 🚨 regression
98 datafusion:vortex-compact -4.5% -3.3% -1.3% +10.0% ➖ noise
98 datafusion:vortex-file-compressed +1.4% -3.3% +4.8% +10.1% ➖ noise
98 duckdb:duckdb -8.7% -3.3% -5.6% +12.2% ➖ noise
98 duckdb:vortex-compact +20.6% -3.3% +24.7% +10.0% 🚨 regression
98 duckdb:vortex-file-compressed +16.0% -3.3% +19.9% +11.9% 🚨 regression
99 datafusion:vortex-compact -0.5% -8.5% +8.7% +18.3% ➖ noise
99 datafusion:vortex-file-compressed -3.8% -8.5% +5.1% +21.2% ➖ noise
99 duckdb:duckdb +2.0% -8.5% +11.4% +26.1% ➖ noise
99 duckdb:vortex-compact +57.6% -8.5% +72.2% +31.4% 🚨 regression
99 duckdb:vortex-file-compressed +55.9% -8.5% +70.4% +20.4% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

File Size Changes (24 files changed, +0.2% overall, 8↑ 16↓)
File Scale Format Base HEAD Change %
time_dim.vortex 1.0 vortex-file-compressed 673.29 KB 695.80 KB +22.52 KB +3.3%
date_dim.vortex 1.0 vortex-file-compressed 1.01 MB 1.04 MB +32.83 KB +3.2%
customer_address.vortex 1.0 vortex-file-compressed 992.07 KB 1004.81 KB +12.74 KB +1.3%
store_sales.vortex 1.0 vortex-file-compressed 96.78 MB 97.86 MB +1.08 MB +1.1%
customer.vortex 1.0 vortex-file-compressed 4.49 MB 4.52 MB +28.91 KB +0.6%
store_returns.vortex 1.0 vortex-file-compressed 11.10 MB 11.13 MB +25.18 KB +0.2%
catalog_returns.vortex 1.0 vortex-file-compressed 7.28 MB 7.29 MB +10.57 KB +0.1%
web_sales.vortex 1.0 vortex-file-compressed 33.58 MB 33.62 MB +41.34 KB +0.1%
catalog_sales.vortex 1.0 vortex-file-compressed 69.41 MB 69.40 MB 7.20 KB -0.0%
catalog_returns.vortex 1.0 vortex-compact 5.98 MB 5.98 MB 648 B -0.0%
customer_address.vortex 1.0 vortex-compact 546.29 KB 546.08 KB 216 B -0.0%
customer.vortex 1.0 vortex-compact 3.27 MB 3.27 MB 1.89 KB -0.1%
store_returns.vortex 1.0 vortex-compact 9.28 MB 9.27 MB 6.12 KB -0.1%
store_sales.vortex 1.0 vortex-compact 77.67 MB 77.61 MB 68.70 KB -0.1%
catalog_page.vortex 1.0 vortex-compact 354.04 KB 353.66 KB 384 B -0.1%
inventory.vortex 1.0 vortex-compact 15.95 MB 15.93 MB 17.48 KB -0.1%
inventory.vortex 1.0 vortex-file-compressed 36.56 MB 36.51 MB 51.18 KB -0.1%
web_sales.vortex 1.0 vortex-compact 29.26 MB 29.22 MB 42.91 KB -0.1%
catalog_sales.vortex 1.0 vortex-compact 59.15 MB 59.06 MB 91.73 KB -0.2%
catalog_page.vortex 1.0 vortex-file-compressed 601.56 KB 597.18 KB 4.38 KB -0.7%
date_dim.vortex 1.0 vortex-compact 130.84 KB 129.76 KB 1.08 KB -0.8%
time_dim.vortex 1.0 vortex-compact 85.30 KB 82.63 KB 2.66 KB -3.1%
customer_demographics.vortex 1.0 vortex-compact 623.93 KB 593.56 KB 30.37 KB -4.9%
customer_demographics.vortex 1.0 vortex-file-compressed 1.47 MB 1.33 MB 144.99 KB -9.7%

Totals:

  • vortex-compact: 206.62 MB → 206.37 MB (-0.1%)
  • vortex-file-compressed: 269.55 MB → 270.59 MB (+0.4%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.5%
Vortex (geomean): 0.988x ➖
Parquet (geomean): 1.014x ➖
Shifts: Parquet (control) +1.4% · Median polish -0.2%


datafusion / vortex-file-compressed (0.999x ➖, 0↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 36886989 37630210 0.98
fineweb_q01/datafusion:vortex-file-compressed 488997359 490713877 1.00
fineweb_q02/datafusion:vortex-file-compressed 394373189 446633079 0.88
fineweb_q03/datafusion:vortex-file-compressed 1409197547 1380621016 1.02
fineweb_q04/datafusion:vortex-file-compressed 1380167792 1360698639 1.01
fineweb_q05/datafusion:vortex-file-compressed 1365290625 1341155188 1.02
fineweb_q06/datafusion:vortex-file-compressed 1487176881 1455480076 1.02
fineweb_q07/datafusion:vortex-file-compressed 1363601092 1322894129 1.03
fineweb_q08/datafusion:vortex-file-compressed 543001044 525161289 1.03
datafusion / vortex-compact (0.987x ➖, 0↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 30764105 38785068 0.79
fineweb_q01/datafusion:vortex-compact 557756496 522675272 1.07
fineweb_q02/datafusion:vortex-compact 593710729 626097096 0.95
fineweb_q03/datafusion:vortex-compact 1886353024 1875760321 1.01
fineweb_q04/datafusion:vortex-compact 2268891097 2274928883 1.00
fineweb_q05/datafusion:vortex-compact 1695898695 1726614352 0.98
fineweb_q06/datafusion:vortex-compact 1533499249 1409066538 1.09
fineweb_q07/datafusion:vortex-compact 1427594147 1313091528 1.09
fineweb_q08/datafusion:vortex-compact 376614042 395467638 0.95
datafusion / parquet (0.999x ➖, 0↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1131510102 1021928320 1.11
fineweb_q01/datafusion:parquet 1751399567 1988131736 0.88
fineweb_q02/datafusion:parquet 1842255085 2161310820 0.85
fineweb_q03/datafusion:parquet 1729999132 1737987212 1.00
fineweb_q04/datafusion:parquet 1748455769 1762211000 0.99
fineweb_q05/datafusion:parquet 1828843972 1776514235 1.03
fineweb_q06/datafusion:parquet 2104342379 1873834627 1.12
fineweb_q07/datafusion:parquet 1927125967 1906287748 1.01
fineweb_q08/datafusion:parquet 1796425886 1731825690 1.04
duckdb / vortex-file-compressed (0.993x ➖, 0↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 80026381 88503854 0.90
fineweb_q01/duckdb:vortex-file-compressed 697909195 564565594 1.24
fineweb_q02/duckdb:vortex-file-compressed 490856894 438739301 1.12
fineweb_q03/duckdb:vortex-file-compressed 1492943712 1564257016 0.95
fineweb_q04/duckdb:vortex-file-compressed 1577375004 1658170825 0.95
fineweb_q05/duckdb:vortex-file-compressed 1504662231 1667535089 0.90
fineweb_q06/duckdb:vortex-file-compressed 1705165317 1699410737 1.00
fineweb_q07/duckdb:vortex-file-compressed 1463344308 1493541993 0.98
fineweb_q08/duckdb:vortex-file-compressed 593453223 634677859 0.94
duckdb / vortex-compact (0.974x ➖, 0↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 56927164 79736490 0.71
fineweb_q01/duckdb:vortex-compact 549336082 540750905 1.02
fineweb_q02/duckdb:vortex-compact 524003866 541245238 0.97
fineweb_q03/duckdb:vortex-compact 1728068270 1715183347 1.01
fineweb_q04/duckdb:vortex-compact 1799133898 1847461929 0.97
fineweb_q05/duckdb:vortex-compact 1611595067 1596033010 1.01
fineweb_q06/duckdb:vortex-compact 1537032033 1557973411 0.99
fineweb_q07/duckdb:vortex-compact 1427684933 1418922386 1.01
fineweb_q08/duckdb:vortex-compact 522252616 458239043 1.14
duckdb / parquet (1.029x ➖, 0↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1173746126 1178247040 1.00
fineweb_q01/duckdb:parquet 1697189922 1630545816 1.04
fineweb_q02/duckdb:parquet 1697829204 1621306869 1.05
fineweb_q03/duckdb:parquet 4356401409 4066682841 1.07
fineweb_q04/duckdb:parquet 1973263444 1900652804 1.04
fineweb_q05/duckdb:parquet 2732262878 2723440873 1.00
fineweb_q06/duckdb:parquet 3565731424 3539138732 1.01
fineweb_q07/duckdb:parquet 4299696990 3988981977 1.08
fineweb_q08/duckdb:parquet 1089278730 1110921971 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -20.7% +5.0% -24.5% +268.9% ➖ noise
0 datafusion:vortex-file-compressed -2.0% +5.0% -6.7% +229.4% ➖ noise
0 duckdb:vortex-compact -28.6% +5.0% -32.0% +61.2% ➖ noise
0 duckdb:vortex-file-compressed -9.6% +5.0% -13.9% +75.0% ➖ noise
1 datafusion:vortex-compact +6.7% -4.2% +11.4% +79.4% ➖ noise
1 datafusion:vortex-file-compressed -0.3% -4.2% +4.1% +98.5% ➖ noise
1 duckdb:vortex-compact +1.6% -4.2% +6.1% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +23.6% -4.2% +29.1% +37.2% ➖ noise
2 datafusion:vortex-compact -5.2% -5.5% +0.4% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -11.7% -5.5% -6.5% +58.4% ➖ noise
2 duckdb:vortex-compact -3.2% -5.5% +2.5% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +11.9% -5.5% +18.4% +39.1% ➖ noise
3 datafusion:vortex-compact +0.6% +3.3% -2.6% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +2.1% +3.3% -1.2% +30.0% ➖ noise
3 duckdb:vortex-compact +0.8% +3.3% -2.4% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -4.6% +3.3% -7.6% +30.0% ➖ noise
4 datafusion:vortex-compact -0.3% +1.5% -1.7% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +1.4% +1.5% -0.1% +30.0% ➖ noise
4 duckdb:vortex-compact -2.6% +1.5% -4.0% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -4.9% +1.5% -6.3% +30.0% ➖ noise
5 datafusion:vortex-compact -1.8% +1.6% -3.4% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +1.8% +1.6% +0.2% +30.0% ➖ noise
5 duckdb:vortex-compact +1.0% +1.6% -0.6% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -9.8% +1.6% -11.2% +30.0% ➖ noise
6 datafusion:vortex-compact +8.8% +6.4% +2.3% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +2.2% +6.4% -3.9% +30.0% ➖ noise
6 duckdb:vortex-compact -1.3% +6.4% -7.3% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +0.3% +6.4% -5.7% +30.0% ➖ noise
7 datafusion:vortex-compact +8.7% +4.4% +4.2% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +3.1% +4.4% -1.3% +30.0% ➖ noise
7 duckdb:vortex-compact +0.6% +4.4% -3.6% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -2.0% +4.4% -6.1% +30.0% ➖ noise
8 datafusion:vortex-compact -4.8% +0.9% -5.6% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +3.4% +0.9% +2.5% +30.0% ➖ noise
8 duckdb:vortex-compact +14.0% +0.9% +13.0% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -6.5% +0.9% -7.3% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.887x ✅
Parquet (geomean): 1.061x ➖


unknown / unknown (1.011x ➖, 10↑ 14↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 2957887 2580322 1.15
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 🚨 1450613 1285468 1.13
random-access/feature-vectors/correlated/parquet-tokio-local-disk 11835923294 11270783953 1.05
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11294455840 11173990391 1.01
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚀 6068099 9358591 0.65
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 4803240 7551741 0.64
random-access/feature-vectors/uniform/lance-tokio-local-disk 🚨 1698713 1496365 1.14
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 🚨 2711795 2379132 1.14
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11236282068 11164346140 1.01
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11241817128 11189701282 1.00
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚀 12541852 15345123 0.82
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚀 12686217 15464865 0.82
random-access/lance-tokio-local-disk 803461 746639 1.08
random-access/lance-tokio-local-disk-footer 🚨 1491483 1346753 1.11
random-access/nested-lists/correlated/lance-tokio-local-disk 🚨 292007 260884 1.12
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 🚨 773849 694624 1.11
random-access/nested-lists/correlated/parquet-tokio-local-disk 146381373 138703247 1.06
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 143561571 138626969 1.04
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚨 837254 724062 1.16
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 765584 743155 1.03
random-access/nested-lists/uniform/lance-tokio-local-disk 1280680 1188176 1.08
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1815707 1653604 1.10
random-access/nested-lists/uniform/parquet-tokio-local-disk 142798894 138693088 1.03
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 145317367 138822631 1.05
random-access/nested-lists/uniform/vortex-tokio-local-disk 2601552 2505107 1.04
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2676234 2652476 1.01
random-access/nested-structs/correlated/lance-tokio-local-disk 469303 434581 1.08
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 704458 642297 1.10
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 29473134 25578766 1.15
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 29813205 25642294 1.16
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚨 1468268 922411 1.59
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚨 1555140 931471 1.67
random-access/nested-structs/uniform/lance-tokio-local-disk 3114800 2874740 1.08
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3373637 3104769 1.09
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 29405165 26131543 1.13
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 29650487 26138048 1.13
random-access/nested-structs/uniform/vortex-tokio-local-disk 1812705 1904865 0.95
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1875738 1856809 1.01
random-access/parquet-tokio-local-disk 193767002 186481902 1.04
random-access/parquet-tokio-local-disk-footer 190614050 184138483 1.04
random-access/taxi/correlated/lance-tokio-local-disk 1047666 982342 1.07
random-access/taxi/correlated/lance-tokio-local-disk-footer 1792420 1660268 1.08
random-access/taxi/correlated/parquet-tokio-local-disk 279728488 269687751 1.04
random-access/taxi/correlated/parquet-tokio-local-disk-footer 287049587 266356364 1.08
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 2240978 2856351 0.78
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 2019208 3022653 0.67
random-access/taxi/uniform/lance-tokio-local-disk 9165907 8640084 1.06
random-access/taxi/uniform/lance-tokio-local-disk-footer 9847646 9374200 1.05
random-access/taxi/uniform/parquet-tokio-local-disk 300676679 284266627 1.06
random-access/taxi/uniform/parquet-tokio-local-disk-footer 302673154 285395259 1.06
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 3771284 5831718 0.65
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 3727084 5830814 0.64
random-access/vortex-tokio-local-disk 🚀 1544285 2007749 0.77
random-access/vortex-tokio-local-disk-footer 🚀 1569255 1999314 0.78

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.5%
Vortex (geomean): 1.059x ➖
Parquet (geomean): 1.007x ➖
Shifts: Parquet (control) +0.7% · Median polish +1.7%


datafusion / vortex-file-compressed (1.022x ➖, 0↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 416165646 396357015 1.05
tpch_q02/datafusion:vortex-file-compressed 116406587 114449497 1.02
tpch_q03/datafusion:vortex-file-compressed 223941977 213909447 1.05
tpch_q04/datafusion:vortex-file-compressed 115548007 107593448 1.07
tpch_q05/datafusion:vortex-file-compressed 393699498 388772210 1.01
tpch_q06/datafusion:vortex-file-compressed 42413612 42249784 1.00
tpch_q07/datafusion:vortex-file-compressed 588853016 571598725 1.03
tpch_q08/datafusion:vortex-file-compressed 380534059 378934452 1.00
tpch_q09/datafusion:vortex-file-compressed 677101306 673852097 1.00
tpch_q10/datafusion:vortex-file-compressed 256460611 248507366 1.03
tpch_q11/datafusion:vortex-file-compressed 86709265 86715690 1.00
tpch_q12/datafusion:vortex-file-compressed 122521012 118701394 1.03
tpch_q13/datafusion:vortex-file-compressed 222936327 219600703 1.02
tpch_q14/datafusion:vortex-file-compressed 56052657 57052975 0.98
tpch_q15/datafusion:vortex-file-compressed 106806624 107760700 0.99
tpch_q16/datafusion:vortex-file-compressed 78178506 77380069 1.01
tpch_q17/datafusion:vortex-file-compressed 650974360 642801685 1.01
tpch_q18/datafusion:vortex-file-compressed 898193483 881867171 1.02
tpch_q19/datafusion:vortex-file-compressed 96943632 94375698 1.03
tpch_q20/datafusion:vortex-file-compressed 178539499 171215488 1.04
tpch_q21/datafusion:vortex-file-compressed 713397630 680044151 1.05
tpch_q22/datafusion:vortex-file-compressed 63009622 60679359 1.04
datafusion / vortex-compact (1.039x ➖, 0↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 441810271 441266413 1.00
tpch_q02/datafusion:vortex-compact 123449777 121672630 1.01
tpch_q03/datafusion:vortex-compact 225622152 214563706 1.05
tpch_q04/datafusion:vortex-compact 125112757 119732294 1.04
tpch_q05/datafusion:vortex-compact 401415858 392615039 1.02
tpch_q06/datafusion:vortex-compact 65820503 63684533 1.03
tpch_q07/datafusion:vortex-compact 604443232 590929203 1.02
tpch_q08/datafusion:vortex-compact 393096837 383412309 1.03
tpch_q09/datafusion:vortex-compact 685986682 675410909 1.02
tpch_q10/datafusion:vortex-compact 281295452 271903005 1.03
tpch_q11/datafusion:vortex-compact 93763593 90832231 1.03
tpch_q12/datafusion:vortex-compact 176985097 165234310 1.07
tpch_q13/datafusion:vortex-compact 278665234 269436483 1.03
tpch_q14/datafusion:vortex-compact 76382021 73924811 1.03
tpch_q15/datafusion:vortex-compact 178889707 163815279 1.09
tpch_q16/datafusion:vortex-compact 87101822 83839202 1.04
tpch_q17/datafusion:vortex-compact 664650538 644247273 1.03
tpch_q18/datafusion:vortex-compact 903511713 879005572 1.03
tpch_q19/datafusion:vortex-compact 143326182 136065294 1.05
tpch_q20/datafusion:vortex-compact 209028489 195630084 1.07
tpch_q21/datafusion:vortex-compact 730738791 695835649 1.05
tpch_q22/datafusion:vortex-compact 75390427 71643271 1.05
datafusion / parquet (1.011x ➖, 0↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 416498268 415321895 1.00
tpch_q02/datafusion:parquet 189828840 185162820 1.03
tpch_q03/datafusion:parquet 302365916 296387511 1.02
tpch_q04/datafusion:parquet 136706761 136408895 1.00
tpch_q05/datafusion:parquet 454082693 452303950 1.00
tpch_q06/datafusion:parquet 123491120 123601074 1.00
tpch_q07/datafusion:parquet 629908654 627750675 1.00
tpch_q08/datafusion:parquet 506047848 500131804 1.01
tpch_q09/datafusion:parquet 783891021 777752500 1.01
tpch_q10/datafusion:parquet 515354294 510063897 1.01
tpch_q11/datafusion:parquet 134812486 132249632 1.02
tpch_q12/datafusion:parquet 211525888 215355984 0.98
tpch_q13/datafusion:parquet 341042132 339084153 1.01
tpch_q14/datafusion:parquet 162314233 163163795 0.99
tpch_q15/datafusion:parquet 248943183 243308051 1.02
tpch_q16/datafusion:parquet 139747789 135381032 1.03
tpch_q17/datafusion:parquet 708354098 694350608 1.02
tpch_q18/datafusion:parquet 905482764 888296855 1.02
tpch_q19/datafusion:parquet 274382882 269898096 1.02
tpch_q20/datafusion:parquet 313720516 307167718 1.02
tpch_q21/datafusion:parquet 755154836 744745282 1.01
tpch_q22/datafusion:parquet 215707525 215373297 1.00
datafusion / arrow (1.018x ➖, 0↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 601605275 590098634 1.02
tpch_q02/datafusion:arrow 163348323 162637859 1.00
tpch_q03/datafusion:arrow 456270539 446486532 1.02
tpch_q04/datafusion:arrow 345102765 361001020 0.96
tpch_q05/datafusion:arrow 904028768 897303581 1.01
tpch_q06/datafusion:arrow 268614829 265096600 1.01
tpch_q07/datafusion:arrow 1096937827 1112132415 0.99
tpch_q08/datafusion:arrow 1088240855 1085634735 1.00
tpch_q09/datafusion:arrow 1308055649 1281970371 1.02
tpch_q10/datafusion:arrow 582009904 576155635 1.01
tpch_q11/datafusion:arrow 146928081 145113796 1.01
tpch_q12/datafusion:arrow 651364902 641454798 1.02
tpch_q13/datafusion:arrow 515012954 506721553 1.02
tpch_q14/datafusion:arrow 301965631 291369926 1.04
tpch_q15/datafusion:arrow 651537540 629352464 1.04
tpch_q16/datafusion:arrow 106921240 105015270 1.02
tpch_q17/datafusion:arrow 1327232147 1287880890 1.03
tpch_q18/datafusion:arrow 1839218523 1779230690 1.03
tpch_q19/datafusion:arrow 504054158 479807931 1.05
tpch_q20/datafusion:arrow 480275743 465503215 1.03
tpch_q21/datafusion:arrow 2836272194 2764186060 1.03
tpch_q22/datafusion:arrow 144563592 138006930 1.05
duckdb / vortex-file-compressed (1.100x ❌, 0↑ 12↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 189518421 176258617 1.08
tpch_q02/duckdb:vortex-file-compressed 🚨 61012929 53361607 1.14
tpch_q03/duckdb:vortex-file-compressed 🚨 148287602 132920835 1.12
tpch_q04/duckdb:vortex-file-compressed 🚨 181373696 160514073 1.13
tpch_q05/duckdb:vortex-file-compressed 🚨 147649444 131854865 1.12
tpch_q06/duckdb:vortex-file-compressed 47140369 47886859 0.98
tpch_q07/duckdb:vortex-file-compressed 🚨 180257063 153979345 1.17
tpch_q08/duckdb:vortex-file-compressed 🚨 197022850 177712106 1.11
tpch_q09/duckdb:vortex-file-compressed 368339067 337744160 1.09
tpch_q10/duckdb:vortex-file-compressed 170343179 166008666 1.03
tpch_q11/duckdb:vortex-file-compressed 🚨 40487120 35967073 1.13
tpch_q12/duckdb:vortex-file-compressed 107690754 98534168 1.09
tpch_q13/duckdb:vortex-file-compressed 250573507 248852262 1.01
tpch_q14/duckdb:vortex-file-compressed 78036266 73023668 1.07
tpch_q15/duckdb:vortex-file-compressed 105260011 96406258 1.09
tpch_q16/duckdb:vortex-file-compressed 🚨 92678238 81135711 1.14
tpch_q17/duckdb:vortex-file-compressed 🚨 113401414 103065712 1.10
tpch_q18/duckdb:vortex-file-compressed 321123004 305283925 1.05
tpch_q19/duckdb:vortex-file-compressed 🚨 115310996 90542438 1.27
tpch_q20/duckdb:vortex-file-compressed 🚨 189729310 166064201 1.14
tpch_q21/duckdb:vortex-file-compressed 🚨 680746461 600779226 1.13
tpch_q22/duckdb:vortex-file-compressed 81275110 77293159 1.05
duckdb / vortex-compact (1.075x ➖, 0↑ 4↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 225853322 228103163 0.99
tpch_q02/duckdb:vortex-compact 🚨 68860115 58827341 1.17
tpch_q03/duckdb:vortex-compact 148843347 139984627 1.06
tpch_q04/duckdb:vortex-compact 189227286 178381713 1.06
tpch_q05/duckdb:vortex-compact 155164210 146983823 1.06
tpch_q06/duckdb:vortex-compact 83229882 83990273 0.99
tpch_q07/duckdb:vortex-compact 214341188 204757235 1.05
tpch_q08/duckdb:vortex-compact 201707614 188673881 1.07
tpch_q09/duckdb:vortex-compact 392586101 363732690 1.08
tpch_q10/duckdb:vortex-compact 188959503 185490033 1.02
tpch_q11/duckdb:vortex-compact 🚨 49587001 41101318 1.21
tpch_q12/duckdb:vortex-compact 210563158 201418150 1.05
tpch_q13/duckdb:vortex-compact 306298466 296385936 1.03
tpch_q14/duckdb:vortex-compact 110048480 103403270 1.06
tpch_q15/duckdb:vortex-compact 122922581 119468603 1.03
tpch_q16/duckdb:vortex-compact 🚨 105320807 87696748 1.20
tpch_q17/duckdb:vortex-compact 127549606 118923615 1.07
tpch_q18/duckdb:vortex-compact 299608142 283914701 1.06
tpch_q19/duckdb:vortex-compact 🚨 144758756 113877697 1.27
tpch_q20/duckdb:vortex-compact 226487045 206224308 1.10
tpch_q21/duckdb:vortex-compact 656261479 632706569 1.04
tpch_q22/duckdb:vortex-compact 94732825 90520967 1.05
duckdb / parquet (1.004x ➖, 0↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 255980249 259231501 0.99
tpch_q02/duckdb:parquet 103295287 102484717 1.01
tpch_q03/duckdb:parquet 212266139 210565742 1.01
tpch_q04/duckdb:parquet 136273248 137301132 0.99
tpch_q05/duckdb:parquet 223128099 219601745 1.02
tpch_q06/duckdb:parquet 66935985 66599753 1.01
tpch_q07/duckdb:parquet 183274357 179261796 1.02
tpch_q08/duckdb:parquet 259256299 251857627 1.03
tpch_q09/duckdb:parquet 466698509 460802212 1.01
tpch_q10/duckdb:parquet 611446056 607059544 1.01
tpch_q11/duckdb:parquet 42624686 45666985 0.93
tpch_q12/duckdb:parquet 124300813 124342190 1.00
tpch_q13/duckdb:parquet 457522509 456138608 1.00
tpch_q14/duckdb:parquet 179143886 176470937 1.02
tpch_q15/duckdb:parquet 99055238 98738784 1.00
tpch_q16/duckdb:parquet 160679509 158759807 1.01
tpch_q17/duckdb:parquet 178162203 177281577 1.00
tpch_q18/duckdb:parquet 353928118 348798932 1.01
tpch_q19/duckdb:parquet 275792040 282780582 0.98
tpch_q20/duckdb:parquet 232379989 227665798 1.02
tpch_q21/duckdb:parquet 580830252 576695841 1.01
tpch_q22/duckdb:parquet 293186381 288433294 1.02
duckdb / duckdb (1.005x ➖, 0↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116930540 116715052 1.00
tpch_q02/duckdb:duckdb 48791486 45225673 1.08
tpch_q03/duckdb:duckdb 96665244 96425868 1.00
tpch_q04/duckdb:duckdb 132283363 132179245 1.00
tpch_q05/duckdb:duckdb 111412178 110363937 1.01
tpch_q06/duckdb:duckdb 37156408 37334756 1.00
tpch_q07/duckdb:duckdb 86688023 86344815 1.00
tpch_q08/duckdb:duckdb 110776667 110256321 1.00
tpch_q09/duckdb:duckdb 278691792 279017150 1.00
tpch_q10/duckdb:duckdb 210048004 202734970 1.04
tpch_q11/duckdb:duckdb 15382797 15986410 0.96
tpch_q12/duckdb:duckdb 85028984 84381285 1.01
tpch_q13/duckdb:duckdb 253250166 253209295 1.00
tpch_q14/duckdb:duckdb 70446011 69866086 1.01
tpch_q15/duckdb:duckdb 78241160 78803002 0.99
tpch_q16/duckdb:duckdb 73369162 73819039 0.99
tpch_q17/duckdb:duckdb 84054442 84302753 1.00
tpch_q18/duckdb:duckdb 214309659 213977520 1.00
tpch_q19/duckdb:duckdb 115622621 114619653 1.01
tpch_q20/duckdb:duckdb 112053542 111581997 1.00
tpch_q21/duckdb:duckdb 309806729 299404022 1.03
tpch_q22/duckdb:duckdb 67056712 68797748 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +1.9% -0.5% +2.5% +10.0% ➖ noise
1 datafusion:vortex-compact +0.1% -0.5% +0.6% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +5.0% -0.5% +5.5% +10.0% ➖ noise
1 duckdb:duckdb +0.2% -0.5% +0.7% +10.0% ➖ noise
1 duckdb:vortex-compact -1.0% -0.5% -0.5% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +7.5% -0.5% +8.1% +10.0% ➖ noise
2 datafusion:arrow +0.4% +1.7% -1.2% +10.0% ➖ noise
2 datafusion:vortex-compact +1.5% +1.7% -0.2% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +1.7% +1.7% +0.1% +10.0% ➖ noise
2 duckdb:duckdb +7.9% +1.7% +6.1% +10.0% ➖ noise
2 duckdb:vortex-compact +17.1% +1.7% +15.2% +10.0% 🚨 regression
2 duckdb:vortex-file-compressed +14.3% +1.7% +12.5% +10.0% 🚨 regression
3 datafusion:arrow +2.2% +1.4% +0.8% +10.0% ➖ noise
3 datafusion:vortex-compact +5.2% +1.4% +3.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +4.7% +1.4% +3.2% +10.0% ➖ noise
3 duckdb:duckdb +0.2% +1.4% -1.1% +10.0% ➖ noise
3 duckdb:vortex-compact +6.3% +1.4% +4.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +11.6% +1.4% +10.0% +10.0% 🚨 regression
4 datafusion:arrow -4.4% -0.3% -4.1% +10.0% ➖ noise
4 datafusion:vortex-compact +4.5% -0.3% +4.8% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +7.4% -0.3% +7.7% +10.0% ➖ noise
4 duckdb:duckdb +0.1% -0.3% +0.3% +10.0% ➖ noise
4 duckdb:vortex-compact +6.1% -0.3% +6.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +13.0% -0.3% +13.3% +10.0% 🚨 regression
5 datafusion:arrow +0.7% +1.0% -0.2% +10.0% ➖ noise
5 datafusion:vortex-compact +2.2% +1.0% +1.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +1.3% +1.0% +0.3% +10.0% ➖ noise
5 duckdb:duckdb +0.9% +1.0% -0.0% +10.0% ➖ noise
5 duckdb:vortex-compact +5.6% +1.0% +4.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +12.0% +1.0% +10.9% +10.0% 🚨 regression
6 datafusion:arrow +1.3% +0.2% +1.1% +10.0% ➖ noise
6 datafusion:vortex-compact +3.4% +0.2% +3.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +0.4% +0.2% +0.2% +10.0% ➖ noise
6 duckdb:duckdb -0.5% +0.2% -0.7% +10.0% ➖ noise
6 duckdb:vortex-compact -0.9% +0.2% -1.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.6% +0.2% -1.8% +11.0% ➖ noise
7 datafusion:arrow -1.4% +1.3% -2.6% +10.0% ➖ noise
7 datafusion:vortex-compact +2.3% +1.3% +1.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +3.0% +1.3% +1.7% +10.0% ➖ noise
7 duckdb:duckdb +0.4% +1.3% -0.9% +10.0% ➖ noise
7 duckdb:vortex-compact +4.7% +1.3% +3.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +17.1% +1.3% +15.6% +10.0% 🚨 regression
8 datafusion:arrow +0.2% +2.1% -1.8% +10.0% ➖ noise
8 datafusion:vortex-compact +2.5% +2.1% +0.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +0.4% +2.1% -1.6% +10.0% ➖ noise
8 duckdb:duckdb +0.5% +2.1% -1.6% +10.0% ➖ noise
8 duckdb:vortex-compact +6.9% +2.1% +4.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +10.9% +2.1% +8.6% +10.0% ➖ noise
9 datafusion:arrow +2.0% +1.0% +1.0% +10.0% ➖ noise
9 datafusion:vortex-compact +1.6% +1.0% +0.5% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +0.5% +1.0% -0.5% +10.0% ➖ noise
9 duckdb:duckdb -0.1% +1.0% -1.1% +10.0% ➖ noise
9 duckdb:vortex-compact +7.9% +1.0% +6.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +9.1% +1.0% +7.9% +10.0% ➖ noise
10 datafusion:arrow +1.0% +0.9% +0.1% +10.0% ➖ noise
10 datafusion:vortex-compact +3.5% +0.9% +2.6% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +3.2% +0.9% +2.3% +10.0% ➖ noise
10 duckdb:duckdb +3.6% +0.9% +2.7% +10.0% ➖ noise
10 duckdb:vortex-compact +1.9% +0.9% +1.0% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.6% +0.9% +1.7% +10.0% ➖ noise
11 datafusion:arrow +1.3% -2.5% +3.8% +10.0% ➖ noise
11 datafusion:vortex-compact +3.2% -2.5% +5.8% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -0.0% -2.5% +2.5% +10.0% ➖ noise
11 duckdb:duckdb -3.8% -2.5% -1.4% +10.5% ➖ noise
11 duckdb:vortex-compact +20.6% -2.5% +23.7% +10.0% 🚨 regression
11 duckdb:vortex-file-compressed +12.6% -2.5% +15.4% +10.0% 🚨 regression
12 datafusion:arrow +1.5% -0.9% +2.5% +20.9% ➖ noise
12 datafusion:vortex-compact +7.1% -0.9% +8.1% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +3.2% -0.9% +4.2% +10.0% ➖ noise
12 duckdb:duckdb +0.8% -0.9% +1.7% +10.0% ➖ noise
12 duckdb:vortex-compact +4.5% -0.9% +5.5% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +9.3% -0.9% +10.3% +10.0% 🚨 regression
13 datafusion:arrow +1.6% +0.4% +1.2% +10.0% ➖ noise
13 datafusion:vortex-compact +3.4% +0.4% +3.0% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +1.5% +0.4% +1.1% +10.0% ➖ noise
13 duckdb:duckdb +0.0% +0.4% -0.4% +10.0% ➖ noise
13 duckdb:vortex-compact +3.3% +0.4% +2.9% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.7% +0.4% +0.3% +10.0% ➖ noise
14 datafusion:arrow +3.6% +0.5% +3.1% +10.0% ➖ noise
14 datafusion:vortex-compact +3.3% +0.5% +2.8% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.8% +0.5% -2.2% +10.0% ➖ noise
14 duckdb:duckdb +0.8% +0.5% +0.3% +10.0% ➖ noise
14 duckdb:vortex-compact +6.4% +0.5% +5.9% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +6.9% +0.5% +6.3% +10.0% ➖ noise
15 datafusion:arrow +3.5% +1.3% +2.2% +10.0% ➖ noise
15 datafusion:vortex-compact +9.2% +1.3% +7.8% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.9% +1.3% -2.2% +10.0% ➖ noise
15 duckdb:duckdb -0.7% +1.3% -2.0% +10.0% ➖ noise
15 duckdb:vortex-compact +2.9% +1.3% +1.6% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +9.2% +1.3% +7.8% +10.0% ➖ noise
16 datafusion:arrow +1.8% +2.2% -0.4% +10.0% ➖ noise
16 datafusion:vortex-compact +3.9% +2.2% +1.6% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.0% +2.2% -1.2% +10.0% ➖ noise
16 duckdb:duckdb -0.6% +2.2% -2.8% +10.0% ➖ noise
16 duckdb:vortex-compact +20.1% +2.2% +17.5% +10.0% 🚨 regression
16 duckdb:vortex-file-compressed +14.2% +2.2% +11.8% +10.0% 🚨 regression
17 datafusion:arrow +3.1% +1.3% +1.8% +10.0% ➖ noise
17 datafusion:vortex-compact +3.2% +1.3% +1.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +1.3% +1.3% +0.0% +10.0% ➖ noise
17 duckdb:duckdb -0.3% +1.3% -1.5% +10.0% ➖ noise
17 duckdb:vortex-compact +7.3% +1.3% +5.9% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +10.0% +1.3% +8.7% +10.0% ➖ noise
18 datafusion:arrow +3.4% +1.7% +1.6% +10.0% ➖ noise
18 datafusion:vortex-compact +2.8% +1.7% +1.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +1.9% +1.7% +0.1% +10.0% ➖ noise
18 duckdb:duckdb +0.2% +1.7% -1.5% +10.0% ➖ noise
18 duckdb:vortex-compact +5.5% +1.7% +3.8% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +5.2% +1.7% +3.4% +10.0% ➖ noise
19 datafusion:arrow +5.1% -0.4% +5.5% +10.0% ➖ noise
19 datafusion:vortex-compact +5.3% -0.4% +5.8% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +2.7% -0.4% +3.2% +10.0% ➖ noise
19 duckdb:duckdb +0.9% -0.4% +1.3% +10.0% ➖ noise
19 duckdb:vortex-compact +27.1% -0.4% +27.7% +10.0% 🚨 regression
19 duckdb:vortex-file-compressed +27.4% -0.4% +27.9% +10.0% 🚨 regression
20 datafusion:arrow +3.2% +2.1% +1.0% +10.0% ➖ noise
20 datafusion:vortex-compact +6.8% +2.1% +4.6% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +4.3% +2.1% +2.1% +10.0% ➖ noise
20 duckdb:duckdb +0.4% +2.1% -1.6% +10.0% ➖ noise
20 duckdb:vortex-compact +9.8% +2.1% +7.6% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +14.3% +2.1% +11.9% +10.0% 🚨 regression
21 datafusion:arrow +2.6% +1.1% +1.5% +10.0% ➖ noise
21 datafusion:vortex-compact +5.0% +1.1% +3.9% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +4.9% +1.1% +3.8% +10.0% ➖ noise
21 duckdb:duckdb +3.5% +1.1% +2.4% +10.0% ➖ noise
21 duckdb:vortex-compact +3.7% +1.1% +2.6% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +13.3% +1.1% +12.1% +10.0% 🚨 regression
22 datafusion:arrow +4.8% +0.9% +3.8% +10.0% ➖ noise
22 datafusion:vortex-compact +5.2% +0.9% +4.3% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +3.8% +0.9% +2.9% +10.0% ➖ noise
22 duckdb:duckdb -2.5% +0.9% -3.4% +10.0% ➖ noise
22 duckdb:vortex-compact +4.7% +0.9% +3.7% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +5.2% +0.9% +4.2% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

File Size Changes (42 files changed, +0.1% overall, 12↑ 30↓)
File Scale Format Base HEAD Change %
lineitem_8.vortex 10.0 vortex-file-compressed 133.78 MB 135.87 MB +2.09 MB +1.6%
lineitem_7.vortex 10.0 vortex-file-compressed 133.73 MB 134.71 MB +1002.60 KB +0.7%
lineitem_9.vortex 10.0 vortex-file-compressed 134.36 MB 135.24 MB +898.77 KB +0.7%
lineitem_4.vortex 10.0 vortex-file-compressed 134.13 MB 135.00 MB +890.63 KB +0.6%
lineitem_1.vortex 10.0 vortex-file-compressed 133.98 MB 134.79 MB +830.49 KB +0.6%
lineitem_12.vortex 10.0 vortex-file-compressed 134.22 MB 134.87 MB +661.77 KB +0.5%
lineitem_2.vortex 10.0 vortex-file-compressed 134.09 MB 134.73 MB +659.27 KB +0.5%
lineitem_10.vortex 10.0 vortex-compact 100.42 MB 100.49 MB +72.52 KB +0.1%
lineitem_3.vortex 10.0 vortex-file-compressed 133.48 MB 133.54 MB +65.60 KB +0.0%
lineitem_4.vortex 10.0 vortex-compact 100.35 MB 100.40 MB +45.07 KB +0.0%
lineitem_0.vortex 10.0 vortex-compact 100.39 MB 100.41 MB +17.39 KB +0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 132.98 MB 132.98 MB +168 B +0.0%
lineitem_12.vortex 10.0 vortex-compact 100.42 MB 100.42 MB 2.96 KB -0.0%
lineitem_5.vortex 10.0 vortex-compact 100.49 MB 100.49 MB 3.38 KB -0.0%
customer_0.vortex 10.0 vortex-compact 74.01 MB 74.01 MB 4.76 KB -0.0%
customer_0.vortex 10.0 vortex-file-compressed 104.54 MB 104.54 MB 7.35 KB -0.0%
part_0.vortex 10.0 vortex-compact 18.06 MB 18.06 MB 1.73 KB -0.0%
part_1.vortex 10.0 vortex-compact 18.06 MB 18.06 MB 1.99 KB -0.0%
partsupp_1.vortex 10.0 vortex-file-compressed 180.47 MB 180.45 MB 22.09 KB -0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 180.30 MB 180.28 MB 22.09 KB -0.0%
part_0.vortex 10.0 vortex-file-compressed 26.95 MB 26.95 MB 4.21 KB -0.0%
lineitem_8.vortex 10.0 vortex-compact 100.39 MB 100.37 MB 17.78 KB -0.0%
part_1.vortex 10.0 vortex-file-compressed 26.92 MB 26.91 MB 5.87 KB -0.0%
lineitem_11.vortex 10.0 vortex-compact 100.32 MB 100.30 MB 25.71 KB -0.0%
lineitem_11.vortex 10.0 vortex-file-compressed 134.56 MB 134.52 MB 39.59 KB -0.0%
lineitem_3.vortex 10.0 vortex-compact 100.41 MB 100.38 MB 34.01 KB -0.0%
orders_1.vortex 10.0 vortex-compact 114.53 MB 114.47 MB 61.87 KB -0.1%
orders_2.vortex 10.0 vortex-compact 114.55 MB 114.49 MB 61.95 KB -0.1%
orders_0.vortex 10.0 vortex-compact 114.56 MB 114.50 MB 62.02 KB -0.1%
partsupp_0.vortex 10.0 vortex-compact 126.66 MB 126.58 MB 86.52 KB -0.1%
lineitem_9.vortex 10.0 vortex-compact 100.26 MB 100.19 MB 72.66 KB -0.1%
lineitem_7.vortex 10.0 vortex-compact 100.38 MB 100.30 MB 78.34 KB -0.1%
lineitem_6.vortex 10.0 vortex-compact 100.48 MB 100.39 MB 83.23 KB -0.1%
lineitem_1.vortex 10.0 vortex-compact 100.44 MB 100.34 MB 99.48 KB -0.1%
lineitem_2.vortex 10.0 vortex-compact 100.38 MB 100.28 MB 109.41 KB -0.1%
partsupp_1.vortex 10.0 vortex-compact 126.64 MB 126.49 MB 151.34 KB -0.1%
orders_2.vortex 10.0 vortex-file-compressed 163.59 MB 163.33 MB 267.55 KB -0.2%
orders_0.vortex 10.0 vortex-file-compressed 163.53 MB 163.06 MB 482.67 KB -0.3%
lineitem_0.vortex 10.0 vortex-file-compressed 134.36 MB 133.93 MB 442.40 KB -0.3%
lineitem_5.vortex 10.0 vortex-file-compressed 133.59 MB 133.06 MB 546.34 KB -0.4%
orders_1.vortex 10.0 vortex-file-compressed 163.75 MB 163.01 MB 751.45 KB -0.4%
lineitem_10.vortex 10.0 vortex-file-compressed 134.21 MB 133.59 MB 642.62 KB -0.5%

Totals:

  • vortex-compact: 1.97 GB → 1.97 GB (-0.0%)
  • vortex-file-compressed: 2.69 GB → 2.70 GB (+0.1%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.0%
Vortex (geomean): 1.058x ➖
Parquet (geomean): 1.048x ➖
Shifts: Parquet (control) +4.8% · Median polish +4.7%


duckdb / vortex-file-compressed (1.064x ➖, 0↑ 1↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11961377 10916627 1.10
statpopgen_q01/duckdb:vortex-file-compressed 48020940 46660979 1.03
statpopgen_q02/duckdb:vortex-file-compressed 1376553631 1320698010 1.04
statpopgen_q03/duckdb:vortex-file-compressed 3227197640 3101988019 1.04
statpopgen_q04/duckdb:vortex-file-compressed 3259758065 3046118618 1.07
statpopgen_q05/duckdb:vortex-file-compressed 1482189131 1372874588 1.08
statpopgen_q06/duckdb:vortex-file-compressed 2162472823 2057604097 1.05
statpopgen_q07/duckdb:vortex-file-compressed 🚨 383893946 337537209 1.14
statpopgen_q08/duckdb:vortex-file-compressed 391148809 364093338 1.07
statpopgen_q09/duckdb:vortex-file-compressed 3015787443 2871288846 1.05
statpopgen_q10/duckdb:vortex-file-compressed 4822428251 4622295667 1.04
duckdb / vortex-compact (1.052x ➖, 0↑ 1↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11045362 10744867 1.03
statpopgen_q01/duckdb:vortex-compact 171229465 172010423 1.00
statpopgen_q02/duckdb:vortex-compact 1895163987 1805820506 1.05
statpopgen_q03/duckdb:vortex-compact 3655300800 3461356611 1.06
statpopgen_q04/duckdb:vortex-compact 3674290399 3495731995 1.05
statpopgen_q05/duckdb:vortex-compact 1949650931 1808046134 1.08
statpopgen_q06/duckdb:vortex-compact 2777332024 2672504921 1.04
statpopgen_q07/duckdb:vortex-compact 1002598508 927886292 1.08
statpopgen_q08/duckdb:vortex-compact 🚨 1056325425 953852757 1.11
statpopgen_q09/duckdb:vortex-compact 3450538384 3325253444 1.04
statpopgen_q10/duckdb:vortex-compact 5649117006 5361653955 1.05
duckdb / parquet (1.048x ➖, 0↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 327787096 313379487 1.05
statpopgen_q01/duckdb:parquet 417100184 389158603 1.07
statpopgen_q02/duckdb:parquet 1048370618 1001486196 1.05
statpopgen_q03/duckdb:parquet 1539942524 1482952967 1.04
statpopgen_q04/duckdb:parquet 1579465939 1514390053 1.04
statpopgen_q05/duckdb:parquet 1037756950 1015731815 1.02
statpopgen_q06/duckdb:parquet 1541653054 1472452209 1.05
statpopgen_q07/duckdb:parquet 1977976117 1876710012 1.05
statpopgen_q08/duckdb:parquet 1965567199 1870576184 1.05
statpopgen_q09/duckdb:parquet 1445473804 1363421737 1.06
statpopgen_q10/duckdb:parquet 2743496377 2627124697 1.04
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +2.8% +4.6% -1.7% +14.3% ➖ noise
0 duckdb:vortex-file-compressed +9.6% +4.6% +4.8% +10.0% ➖ noise
1 duckdb:vortex-compact -0.5% +7.2% -7.1% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +2.9% +7.2% -4.0% +209.9% ➖ noise
2 duckdb:vortex-compact +4.9% +4.7% +0.3% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +4.2% +4.7% -0.4% +10.0% ➖ noise
3 duckdb:vortex-compact +5.6% +3.8% +1.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +4.0% +3.8% +0.2% +10.0% ➖ noise
4 duckdb:vortex-compact +5.1% +4.3% +0.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +7.0% +4.3% +2.6% +10.0% ➖ noise
5 duckdb:vortex-compact +7.8% +2.2% +5.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +8.0% +2.2% +5.7% +10.0% ➖ noise
6 duckdb:vortex-compact +3.9% +4.7% -0.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +5.1% +4.7% +0.4% +10.0% ➖ noise
7 duckdb:vortex-compact +8.1% +5.4% +2.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +13.7% +5.4% +7.9% +10.0% ➖ noise
8 duckdb:vortex-compact +10.7% +5.1% +5.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +7.4% +5.1% +2.2% +10.0% ➖ noise
9 duckdb:vortex-compact +3.8% +6.0% -2.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +5.0% +6.0% -0.9% +10.0% ➖ noise
10 duckdb:vortex-compact +5.4% +4.4% +0.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +4.3% +4.4% -0.1% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

File Size Changes (2 files changed, +0.5% overall, 1↑ 1↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.78 GB 1.79 GB +15.01 MB +0.8%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 955.21 MB 954.54 MB 686.88 KB -0.1%

Totals:

  • vortex-compact: 955.47 MB → 954.80 MB (-0.1%)
  • vortex-file-compressed: 1.78 GB → 1.79 GB (+0.8%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.0%
Vortex (geomean): 0.997x ➖
Parquet (geomean): 1.072x ➖
Shifts: Parquet (control) +7.2% · Median polish +2.8%


datafusion / vortex-file-compressed (1.037x ➖, 1↑ 5↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 187582688 199597542 0.94
tpch_q02/datafusion:vortex-file-compressed 464786097 444769819 1.05
tpch_q03/datafusion:vortex-file-compressed 405777893 343484176 1.18
tpch_q04/datafusion:vortex-file-compressed 230976519 181976994 1.27
tpch_q05/datafusion:vortex-file-compressed 🚨 562810919 378220489 1.49
tpch_q06/datafusion:vortex-file-compressed 309029287 266223568 1.16
tpch_q07/datafusion:vortex-file-compressed 🚨 474053939 349955866 1.35
tpch_q08/datafusion:vortex-file-compressed 574025574 554274771 1.04
tpch_q09/datafusion:vortex-file-compressed 🚨 482154370 354997801 1.36
tpch_q10/datafusion:vortex-file-compressed 498967362 431260601 1.16
tpch_q11/datafusion:vortex-file-compressed 🚨 450369681 312227182 1.44
tpch_q12/datafusion:vortex-file-compressed 332395364 354021323 0.94
tpch_q13/datafusion:vortex-file-compressed 156946173 156358784 1.00
tpch_q14/datafusion:vortex-file-compressed 203837700 261219876 0.78
tpch_q15/datafusion:vortex-file-compressed 342373024 454906807 0.75
tpch_q16/datafusion:vortex-file-compressed 🚀 231186711 365868625 0.63
tpch_q17/datafusion:vortex-file-compressed 308247709 409285463 0.75
tpch_q18/datafusion:vortex-file-compressed 246947046 339267584 0.73
tpch_q19/datafusion:vortex-file-compressed 357642145 439836570 0.81
tpch_q20/datafusion:vortex-file-compressed 350993885 382468202 0.92
tpch_q21/datafusion:vortex-file-compressed 511634564 470750523 1.09
tpch_q22/datafusion:vortex-file-compressed 🚨 280319160 159290368 1.76
datafusion / vortex-compact (0.883x ➖, 2↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 201923119 232639589 0.87
tpch_q02/datafusion:vortex-compact 434133191 414116105 1.05
tpch_q03/datafusion:vortex-compact 459967489 399996754 1.15
tpch_q04/datafusion:vortex-compact 222092560 272135171 0.82
tpch_q05/datafusion:vortex-compact 353908767 397110492 0.89
tpch_q06/datafusion:vortex-compact 255331021 328264255 0.78
tpch_q07/datafusion:vortex-compact 339525880 450551164 0.75
tpch_q08/datafusion:vortex-compact 499452666 588125624 0.85
tpch_q09/datafusion:vortex-compact 424970655 476637149 0.89
tpch_q10/datafusion:vortex-compact 416396460 483515370 0.86
tpch_q11/datafusion:vortex-compact 306336976 281143827 1.09
tpch_q12/datafusion:vortex-compact 337339778 403100115 0.84
tpch_q13/datafusion:vortex-compact 170969191 157376548 1.09
tpch_q14/datafusion:vortex-compact 🚀 185483079 291957083 0.64
tpch_q15/datafusion:vortex-compact 369240985 523448142 0.71
tpch_q16/datafusion:vortex-compact 179827505 187391450 0.96
tpch_q17/datafusion:vortex-compact 384080720 347710610 1.10
tpch_q18/datafusion:vortex-compact 234682770 286383154 0.82
tpch_q19/datafusion:vortex-compact 385332890 443510966 0.87
tpch_q20/datafusion:vortex-compact 381226918 426679273 0.89
tpch_q21/datafusion:vortex-compact 602673703 507319610 1.19
tpch_q22/datafusion:vortex-compact 🚀 150034515 241886345 0.62
datafusion / parquet (1.132x ➖, 0↑ 5↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 259748123 252175272 1.03
tpch_q02/datafusion:parquet 439086725 437846786 1.00
tpch_q03/datafusion:parquet 🚨 457051415 305676976 1.50
tpch_q04/datafusion:parquet 🚨 211021435 153496288 1.37
tpch_q05/datafusion:parquet 648541188 508167032 1.28
tpch_q06/datafusion:parquet 171961141 138306373 1.24
tpch_q07/datafusion:parquet 600583820 520838073 1.15
tpch_q08/datafusion:parquet 714814023 601079926 1.19
tpch_q09/datafusion:parquet 615202708 509992617 1.21
tpch_q10/datafusion:parquet 🚨 701757696 501018236 1.40
tpch_q11/datafusion:parquet 370509895 378930583 0.98
tpch_q12/datafusion:parquet 276460473 257373388 1.07
tpch_q13/datafusion:parquet 434288712 448491547 0.97
tpch_q14/datafusion:parquet 204837470 189799964 1.08
tpch_q15/datafusion:parquet 🚨 476819829 291725236 1.63
tpch_q16/datafusion:parquet 🚨 230470345 175860352 1.31
tpch_q17/datafusion:parquet 364891890 400965258 0.91
tpch_q18/datafusion:parquet 456779282 439237319 1.04
tpch_q19/datafusion:parquet 336709355 404872787 0.83
tpch_q20/datafusion:parquet 377040044 363439453 1.04
tpch_q21/datafusion:parquet 539053626 611483644 0.88
tpch_q22/datafusion:parquet 129198714 110583348 1.17
duckdb / vortex-file-compressed (1.071x ➖, 0↑ 1↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 313025715 278633860 1.12
tpch_q02/duckdb:vortex-file-compressed 941060554 948661244 0.99
tpch_q03/duckdb:vortex-file-compressed 630540809 622491005 1.01
tpch_q04/duckdb:vortex-file-compressed 419980721 356537799 1.18
tpch_q05/duckdb:vortex-file-compressed 904396205 873697175 1.04
tpch_q06/duckdb:vortex-file-compressed 424587221 427121580 0.99
tpch_q07/duckdb:vortex-file-compressed 780651026 721914143 1.08
tpch_q08/duckdb:vortex-file-compressed 1039218213 868684763 1.20
tpch_q09/duckdb:vortex-file-compressed 915837776 877603160 1.04
tpch_q10/duckdb:vortex-file-compressed 713646951 660277564 1.08
tpch_q11/duckdb:vortex-file-compressed 457020800 503469509 0.91
tpch_q12/duckdb:vortex-file-compressed 560957108 467737938 1.20
tpch_q13/duckdb:vortex-file-compressed 467626477 474067120 0.99
tpch_q14/duckdb:vortex-file-compressed 518782597 461528099 1.12
tpch_q15/duckdb:vortex-file-compressed 353058040 305599934 1.16
tpch_q16/duckdb:vortex-file-compressed 410715096 371565728 1.11
tpch_q17/duckdb:vortex-file-compressed 673732273 650294612 1.04
tpch_q18/duckdb:vortex-file-compressed 551364162 548451497 1.01
tpch_q19/duckdb:vortex-file-compressed 430078959 474143805 0.91
tpch_q20/duckdb:vortex-file-compressed 801449269 795430320 1.01
tpch_q21/duckdb:vortex-file-compressed 🚨 1408036184 1049416163 1.34
tpch_q22/duckdb:vortex-file-compressed 402205434 352848910 1.14
duckdb / vortex-compact (1.008x ➖, 0↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 311989606 295269576 1.06
tpch_q02/duckdb:vortex-compact 959295650 922102037 1.04
tpch_q03/duckdb:vortex-compact 602587810 571974570 1.05
tpch_q04/duckdb:vortex-compact 350706605 374965521 0.94
tpch_q05/duckdb:vortex-compact 919579234 809393860 1.14
tpch_q06/duckdb:vortex-compact 399228926 401399185 0.99
tpch_q07/duckdb:vortex-compact 714995720 681390093 1.05
tpch_q08/duckdb:vortex-compact 879904395 914789162 0.96
tpch_q09/duckdb:vortex-compact 906189057 888617204 1.02
tpch_q10/duckdb:vortex-compact 627775934 706815743 0.89
tpch_q11/duckdb:vortex-compact 482258563 502057579 0.96
tpch_q12/duckdb:vortex-compact 461522509 478209354 0.97
tpch_q13/duckdb:vortex-compact 423925401 449154760 0.94
tpch_q14/duckdb:vortex-compact 439068583 422981252 1.04
tpch_q15/duckdb:vortex-compact 298542732 307006736 0.97
tpch_q16/duckdb:vortex-compact 381514341 378809498 1.01
tpch_q17/duckdb:vortex-compact 641027916 599741059 1.07
tpch_q18/duckdb:vortex-compact 487867563 514818303 0.95
tpch_q19/duckdb:vortex-compact 452829062 470323531 0.96
tpch_q20/duckdb:vortex-compact 831921130 765260963 1.09
tpch_q21/duckdb:vortex-compact 1048122812 977115025 1.07
tpch_q22/duckdb:vortex-compact 362797455 345297692 1.05
duckdb / parquet (1.015x ➖, 0↑ 0↓)
name PR 333c48f (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 641180700 513748905 1.25
tpch_q02/duckdb:parquet 1423316429 1350152185 1.05
tpch_q03/duckdb:parquet 1021484975 986626896 1.04
tpch_q04/duckdb:parquet 650351601 638279639 1.02
tpch_q05/duckdb:parquet 1621394060 1544773961 1.05
tpch_q06/duckdb:parquet 414519822 447987053 0.93
tpch_q07/duckdb:parquet 1213473579 1212898738 1.00
tpch_q08/duckdb:parquet 1717387753 1728961128 0.99
tpch_q09/duckdb:parquet 1459116713 1421283544 1.03
tpch_q10/duckdb:parquet 1362072801 1359940875 1.00
tpch_q11/duckdb:parquet 859682972 830118096 1.04
tpch_q12/duckdb:parquet 610882651 587565114 1.04
tpch_q13/duckdb:parquet 876978369 860818692 1.02
tpch_q14/duckdb:parquet 618388986 718895169 0.86
tpch_q15/duckdb:parquet 509921544 523665616 0.97
tpch_q16/duckdb:parquet 537792902 551561755 0.98
tpch_q17/duckdb:parquet 826345605 772251314 1.07
tpch_q18/duckdb:parquet 850670507 842768531 1.01
tpch_q19/duckdb:parquet 788410850 821757651 0.96
tpch_q20/duckdb:parquet 1016132355 1089257368 0.93
tpch_q21/duckdb:parquet 1192670820 1177744123 1.01
tpch_q22/duckdb:parquet 540923065 473785401 1.14
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -13.2% +13.4% -23.4% +72.9% ➖ noise
1 datafusion:vortex-file-compressed -6.0% +13.4% -17.1% +86.7% ➖ noise
1 duckdb:vortex-compact +5.7% +13.4% -6.8% +58.3% ➖ noise
1 duckdb:vortex-file-compressed +12.3% +13.4% -0.9% +45.5% ➖ noise
2 datafusion:vortex-compact +4.8% +2.8% +2.0% +30.0% ➖ noise
2 datafusion:vortex-file-compressed +4.5% +2.8% +1.6% +30.0% ➖ noise
2 duckdb:vortex-compact +4.0% +2.8% +1.2% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -0.8% +2.8% -3.5% +30.0% ➖ noise
3 datafusion:vortex-compact +15.0% +24.4% -7.6% +48.2% ➖ noise
3 datafusion:vortex-file-compressed +18.1% +24.4% -5.1% +58.1% ➖ noise
3 duckdb:vortex-compact +5.4% +24.4% -15.3% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +1.3% +24.4% -18.6% +30.0% ➖ noise
4 datafusion:vortex-compact -18.4% +18.4% -31.0% +32.1% ✅ faster
4 datafusion:vortex-file-compressed +26.9% +18.4% +7.2% +30.0% ➖ noise
4 duckdb:vortex-compact -6.5% +18.4% -21.0% +53.3% ➖ noise
4 duckdb:vortex-file-compressed +17.8% +18.4% -0.5% +30.0% ➖ noise
5 datafusion:vortex-compact -10.9% +15.7% -23.0% +41.6% ➖ noise
5 datafusion:vortex-file-compressed +48.8% +15.7% +28.6% +30.0% ➖ noise
5 duckdb:vortex-compact +13.6% +15.7% -1.8% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +3.5% +15.7% -10.6% +30.0% ➖ noise
6 datafusion:vortex-compact -22.2% +7.3% -27.5% +34.4% ✅ faster
6 datafusion:vortex-file-compressed +16.1% +7.3% +8.2% +30.0% ➖ noise
6 duckdb:vortex-compact -0.5% +7.3% -7.3% +33.1% ➖ noise
6 duckdb:vortex-file-compressed -0.6% +7.3% -7.3% +30.8% ➖ noise
7 datafusion:vortex-compact -24.6% +7.4% -29.8% +31.4% ✅ faster
7 datafusion:vortex-file-compressed +35.5% +7.4% +26.1% +30.0% ➖ noise
7 duckdb:vortex-compact +4.9% +7.4% -2.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +8.1% +7.4% +0.7% +30.0% ➖ noise
8 datafusion:vortex-compact -15.1% +8.7% -21.9% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +3.6% +8.7% -4.7% +30.0% ➖ noise
8 duckdb:vortex-compact -3.8% +8.7% -11.5% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +19.6% +8.7% +10.1% +30.0% ➖ noise
9 datafusion:vortex-compact -10.8% +11.3% -19.9% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +35.8% +11.3% +22.0% +30.0% ➖ noise
9 duckdb:vortex-compact +2.0% +11.3% -8.4% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +4.4% +11.3% -6.2% +30.0% ➖ noise
10 datafusion:vortex-compact -13.9% +18.4% -27.3% +30.0% ✅ faster
10 datafusion:vortex-file-compressed +15.7% +18.4% -2.3% +30.0% ➖ noise
10 duckdb:vortex-compact -11.2% +18.4% -25.0% +30.0% ✅ faster
10 duckdb:vortex-file-compressed +8.1% +18.4% -8.7% +30.0% ➖ noise
11 datafusion:vortex-compact +9.0% +0.6% +8.3% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +44.2% +0.6% +43.3% +42.2% 🚨 regression
11 duckdb:vortex-compact -3.9% +0.6% -4.5% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -9.2% +0.6% -9.8% +30.0% ➖ noise
12 datafusion:vortex-compact -16.3% +5.7% -20.8% +42.0% ➖ noise
12 datafusion:vortex-file-compressed -6.1% +5.7% -11.2% +30.0% ➖ noise
12 duckdb:vortex-compact -3.5% +5.7% -8.7% +31.8% ➖ noise
12 duckdb:vortex-file-compressed +19.9% +5.7% +13.5% +30.0% ➖ noise
13 datafusion:vortex-compact +8.6% -0.7% +9.4% +72.2% ➖ noise
13 datafusion:vortex-file-compressed +0.4% -0.7% +1.1% +46.4% ➖ noise
13 duckdb:vortex-compact -5.6% -0.7% -5.0% +40.4% ➖ noise
13 duckdb:vortex-file-compressed -1.4% -0.7% -0.7% +36.1% ➖ noise
14 datafusion:vortex-compact -36.5% -3.6% -34.1% +32.5% ✅ faster
14 datafusion:vortex-file-compressed -22.0% -3.6% -19.0% +32.5% ➖ noise
14 duckdb:vortex-compact +3.8% -3.6% +7.7% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +12.4% -3.6% +16.7% +30.0% ➖ noise
15 datafusion:vortex-compact -29.5% +26.2% -44.1% +30.0% ✅ faster
15 datafusion:vortex-file-compressed -24.7% +26.2% -40.3% +30.0% ✅ faster
15 duckdb:vortex-compact -2.8% +26.2% -22.9% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +15.5% +26.2% -8.4% +36.8% ➖ noise
16 datafusion:vortex-compact -4.0% +13.0% -15.1% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -36.8% +13.0% -44.1% +30.0% ✅ faster
16 duckdb:vortex-compact +0.7% +13.0% -10.9% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +10.5% +13.0% -2.2% +30.0% ➖ noise
17 datafusion:vortex-compact +10.5% -1.3% +11.9% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -24.7% -1.3% -23.7% +45.7% ➖ noise
17 duckdb:vortex-compact +6.9% -1.3% +8.3% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +3.6% -1.3% +5.0% +30.0% ➖ noise
18 datafusion:vortex-compact -18.1% +2.5% -20.0% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -27.2% +2.5% -29.0% +34.6% ✅ faster
18 duckdb:vortex-compact -5.2% +2.5% -7.5% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +0.5% +2.5% -1.9% +30.0% ➖ noise
19 datafusion:vortex-compact -13.1% -10.7% -2.7% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -18.7% -10.7% -9.0% +30.0% ➖ noise
19 duckdb:vortex-compact -3.7% -10.7% +7.8% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -9.3% -10.7% +1.5% +30.0% ➖ noise
20 datafusion:vortex-compact -10.7% -1.6% -9.2% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -8.2% -1.6% -6.7% +30.0% ➖ noise
20 duckdb:vortex-compact +8.7% -1.6% +10.5% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +0.8% -1.6% +2.4% +30.0% ➖ noise
21 datafusion:vortex-compact +18.8% -5.5% +25.7% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +8.7% -5.5% +15.0% +30.0% ➖ noise
21 duckdb:vortex-compact +7.3% -5.5% +13.5% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +34.2% -5.5% +42.0% +30.0% 🚨 regression
22 datafusion:vortex-compact -38.0% +15.5% -46.3% +35.2% ✅ faster
22 datafusion:vortex-file-compressed +76.0% +15.5% +52.4% +55.0% ➖ noise
22 duckdb:vortex-compact +5.1% +15.5% -9.0% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +14.0% +15.5% -1.3% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.3%
Vortex (geomean): 1.101x ❌
Parquet (geomean): 1.072x ➖
Shifts: Parquet (control) +7.2% · Median polish +5.4%


datafusion / vortex-file-compressed (1.134x ❌, 0↑ 26↓)
name PR 333c48f (ns) base bff43dc (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 2210870 2041482 1.08
clickbench_q01/datafusion:vortex-file-compressed 🚨 17938469 14041953 1.28
clickbench_q02/datafusion:vortex-file-compressed 🚨 43633594 34513089 1.26
clickbench_q03/datafusion:vortex-file-compressed 🚨 47437687 39842851 1.19
clickbench_q04/datafusion:vortex-file-compressed 🚨 348120104 310504941 1.12
clickbench_q05/datafusion:vortex-file-compressed 344211899 318002027 1.08
clickbench_q06/datafusion:vortex-file-compressed 🚨 3497653 1900248 1.84
clickbench_q07/datafusion:vortex-file-compressed 🚨 23509683 19174231 1.23
clickbench_q08/datafusion:vortex-file-compressed 🚨 429924498 389264423 1.10
clickbench_q09/datafusion:vortex-file-compressed 🚨 635187740 561514517 1.13
clickbench_q10/datafusion:vortex-file-compressed 🚨 82342035 72477551 1.14
clickbench_q11/datafusion:vortex-file-compressed 🚨 93260298 83784151 1.11
clickbench_q12/datafusion:vortex-file-compressed 🚨 298977241 271244124 1.10
clickbench_q13/datafusion:vortex-file-compressed 🚨 460916665 413443328 1.11
clickbench_q14/datafusion:vortex-file-compressed 289093877 269538133 1.07
clickbench_q15/datafusion:vortex-file-compressed 🚨 402241557 363386218 1.11
clickbench_q16/datafusion:vortex-file-compressed 🚨 769792096 697231236 1.10
clickbench_q17/datafusion:vortex-file-compressed 🚨 765575270 686285958 1.12
clickbench_q18/datafusion:vortex-file-compressed 🚨 1499251502 1333487505 1.12
clickbench_q19/datafusion:vortex-file-compressed 🚨 32320830 26251525 1.23
clickbench_q20/datafusion:vortex-file-compressed 367770087 360123599 1.02
clickbench_q21/datafusion:vortex-file-compressed 431046236 401442381 1.07
clickbench_q22/datafusion:vortex-file-compressed 527981756 502704763 1.05
clickbench_q23/datafusion:vortex-file-compressed 🚨 941125262 755171055 1.25
clickbench_q24/datafusion:vortex-file-compressed 47721427 48082508 0.99
clickbench_q25/datafusion:vortex-file-compressed 76049138 73006772 1.04
clickbench_q26/datafusion:vortex-file-compressed 🚨 54106163 48570563 1.11
clickbench_q27/datafusion:vortex-file-compressed 835246673 814816168 1.03
clickbench_q28/datafusion:vortex-file-compressed 7232982668 6723058240 1.08
clickbench_q29/datafusion:vortex-file-compressed 264600959 240577772 1.10
clickbench_q30/datafusion:vortex-file-compressed 🚨 264739497 239324487 1.11
clickbench_q31/datafusion:vortex-file-compressed 🚨 297246845 269857652 1.10
clickbench_q32/datafusion:vortex-file-compressed 1293191642 1197382429 1.08
clickbench_q33/datafusion:vortex-file-compressed 1529596118 1396780561 1.10
clickbench_q34/datafusion:vortex-file-compressed 1522217004 1395000465 1.09
clickbench_q35/datafusion:vortex-file-compressed 561489259 512345767 1.10
clickbench_q36/datafusion:vortex-file-compressed 🚨 89277922 79108915 1.13
clickbench_q37/datafusion:vortex-file-compressed 42548547 38880951 1.09
clickbench_q38/datafusion:vortex-file-compressed 🚨 25379309 22582612 1.12
clickbench_q39/datafusion:vortex-file-compressed 158301732 145716563 1.09
clickbench_q40/datafusion:vortex-file-compressed 🚨 21493458 17807064 1.21
clickbench_q41/datafusion:vortex-file-compressed 🚨 19809309 16710653 1.19
clickbench_q42/datafusion:vortex-file-compressed 🚨 25198361 19223616 1.31
datafusion / parquet (1.100x ➖, 0↑ 22↓)
name PR 333c48f (ns) base bff43dc (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚨 2269121 1949546 1.16
clickbench_q01/datafusion:parquet 🚨 22210616 20133152 1.10
clickbench_q02/datafusion:parquet 55883529 57014321 0.98
clickbench_q03/datafusion:parquet 45215914 46766080 0.97
clickbench_q04/datafusion:parquet 🚨 375924819 330654236 1.14
clickbench_q05/datafusion:parquet 🚨 402395078 358800564 1.12
clickbench_q06/datafusion:parquet 🚨 2030328 1795952 1.13
clickbench_q07/datafusion:parquet 27216052 25246672 1.08
clickbench_q08/datafusion:parquet 🚨 457117853 406587952 1.12
clickbench_q09/datafusion:parquet 🚨 732786497 634963720 1.15
clickbench_q10/datafusion:parquet 120562089 113560887 1.06
clickbench_q11/datafusion:parquet 145360067 134303365 1.08
clickbench_q12/datafusion:parquet 🚨 399030343 351571368 1.13
clickbench_q13/datafusion:parquet 🚨 550617502 494961028 1.11
clickbench_q14/datafusion:parquet 🚨 389700061 350506115 1.11
clickbench_q15/datafusion:parquet 412455567 378111440 1.09
clickbench_q16/datafusion:parquet 🚨 770349597 682782599 1.13
clickbench_q17/datafusion:parquet 🚨 743730171 675709008 1.10
clickbench_q18/datafusion:parquet 🚨 1561522257 1386350415 1.13
clickbench_q19/datafusion:parquet 🚨 41666199 33250181 1.25
clickbench_q20/datafusion:parquet 658866434 604878950 1.09
clickbench_q21/datafusion:parquet 725151927 679774086 1.07
clickbench_q22/datafusion:parquet 1040209473 988733152 1.05
clickbench_q23/datafusion:parquet 3988684506 3659073999 1.09
clickbench_q24/datafusion:parquet 96591592 91043622 1.06
clickbench_q25/datafusion:parquet 149008385 143268501 1.04
clickbench_q26/datafusion:parquet 97673992 93504998 1.04
clickbench_q27/datafusion:parquet 1141519180 1046534922 1.09
clickbench_q28/datafusion:parquet 6701422587 6567052525 1.02
clickbench_q29/datafusion:parquet 251749517 243141866 1.04
clickbench_q30/datafusion:parquet 🚨 399487798 352941619 1.13
clickbench_q31/datafusion:parquet 🚨 431570559 391090218 1.10
clickbench_q32/datafusion:parquet 🚨 1479695923 1177434578 1.26
clickbench_q33/datafusion:parquet 🚨 1721678375 1502230730 1.15
clickbench_q34/datafusion:parquet 1629222258 1511115635 1.08
clickbench_q35/datafusion:parquet 🚨 586923397 527109999 1.11
clickbench_q36/datafusion:parquet 🚨 168416492 141269812 1.19
clickbench_q37/datafusion:parquet 67038991 61126537 1.10
clickbench_q38/datafusion:parquet 🚨 104423130 91357734 1.14
clickbench_q39/datafusion:parquet 🚨 300422616 265759295 1.13
clickbench_q40/datafusion:parquet 36721052 35573218 1.03
clickbench_q41/datafusion:parquet 32498808 29761399 1.09
clickbench_q42/datafusion:parquet 33465565 31059392 1.08
duckdb / vortex-file-compressed (1.069x ➖, 2↑ 9↓)
name PR 333c48f (ns) base bff43dc (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚨 7299585 5946027 1.23
clickbench_q01/duckdb:vortex-file-compressed 🚨 17621878 14324841 1.23
clickbench_q02/duckdb:vortex-file-compressed 🚨 31553429 26755744 1.18
clickbench_q03/duckdb:vortex-file-compressed 33690717 31636930 1.06
clickbench_q04/duckdb:vortex-file-compressed 199210443 189358707 1.05
clickbench_q05/duckdb:vortex-file-compressed 213007808 196698039 1.08
clickbench_q06/duckdb:vortex-file-compressed 🚨 27386466 18267543 1.50
clickbench_q07/duckdb:vortex-file-compressed 🚨 22919331 15701740 1.46
clickbench_q08/duckdb:vortex-file-compressed 285819481 267093770 1.07
clickbench_q09/duckdb:vortex-file-compressed 376343690 350446297 1.07
clickbench_q10/duckdb:vortex-file-compressed 75956799 74131975 1.02
clickbench_q11/duckdb:vortex-file-compressed 83419339 81695783 1.02
clickbench_q12/duckdb:vortex-file-compressed 233087871 225037631 1.04
clickbench_q13/duckdb:vortex-file-compressed 454225990 446037491 1.02
clickbench_q14/duckdb:vortex-file-compressed 272644015 259125275 1.05
clickbench_q15/duckdb:vortex-file-compressed 241824913 228386887 1.06
clickbench_q16/duckdb:vortex-file-compressed 744208843 729256108 1.02
clickbench_q17/duckdb:vortex-file-compressed 579498565 560326010 1.03
clickbench_q18/duckdb:vortex-file-compressed 1190314193 1230813338 0.97
clickbench_q19/duckdb:vortex-file-compressed 🚨 27382198 23489739 1.17
clickbench_q20/duckdb:vortex-file-compressed 405977355 396125646 1.02
clickbench_q21/duckdb:vortex-file-compressed 442134315 418518263 1.06
clickbench_q22/duckdb:vortex-file-compressed 🚨 758985789 567304661 1.34
clickbench_q23/duckdb:vortex-file-compressed 999005658 932708690 1.07
clickbench_q24/duckdb:vortex-file-compressed 50263468 55467197 0.91
clickbench_q25/duckdb:vortex-file-compressed 83125640 81089221 1.03
clickbench_q26/duckdb:vortex-file-compressed 52561297 51201942 1.03
clickbench_q27/duckdb:vortex-file-compressed 532175542 515108378 1.03
clickbench_q28/duckdb:vortex-file-compressed 3059449696 3002599208 1.02
clickbench_q29/duckdb:vortex-file-compressed 🚨 34692035 29934808 1.16
clickbench_q30/duckdb:vortex-file-compressed 206870515 199097298 1.04
clickbench_q31/duckdb:vortex-file-compressed 282289496 273461469 1.03
clickbench_q32/duckdb:vortex-file-compressed 1456777076 1458541228 1.00
clickbench_q33/duckdb:vortex-file-compressed 🚀 1553143583 1814311151 0.86
clickbench_q34/duckdb:vortex-file-compressed 🚀 1616744190 1849079000 0.87
clickbench_q35/duckdb:vortex-file-compressed 389734739 364996602 1.07
clickbench_q36/duckdb:vortex-file-compressed 30841456 30417174 1.01
clickbench_q37/duckdb:vortex-file-compressed 22781102 22255258 1.02
clickbench_q38/duckdb:vortex-file-compressed 25509963 24279123 1.05
clickbench_q39/duckdb:vortex-file-compressed 44811825 43572943 1.03
clickbench_q40/duckdb:vortex-file-compressed 22237646 21901691 1.02
clickbench_q41/duckdb:vortex-file-compressed 23155730 21903478 1.06
clickbench_q42/duckdb:vortex-file-compressed 🚨 27125710 23023179 1.18
duckdb / parquet (1.045x ➖, 0↑ 2↓)
name PR 333c48f (ns) base bff43dc (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚨 255096997 219249137 1.16
clickbench_q01/duckdb:parquet 53647348 51038969 1.05
clickbench_q02/duckdb:parquet 70513440 66813721 1.06
clickbench_q03/duckdb:parquet 68684608 64503902 1.06
clickbench_q04/duckdb:parquet 215575146 203932803 1.06
clickbench_q05/duckdb:parquet 294485184 280964305 1.05
clickbench_q06/duckdb:parquet 63208548 61556610 1.03
clickbench_q07/duckdb:parquet 55558838 52411964 1.06
clickbench_q08/duckdb:parquet 282316577 265701345 1.06
clickbench_q09/duckdb:parquet 412000673 399552106 1.03
clickbench_q10/duckdb:parquet 🚨 104284864 94790771 1.10
clickbench_q11/duckdb:parquet 114755664 107025795 1.07
clickbench_q12/duckdb:parquet 305896036 300268541 1.02
clickbench_q13/duckdb:parquet 547563528 526838986 1.04
clickbench_q14/duckdb:parquet 343707192 333899878 1.03
clickbench_q15/duckdb:parquet 259699861 241222161 1.08
clickbench_q16/duckdb:parquet 644668213 615344883 1.05
clickbench_q17/duckdb:parquet 528251180 516657732 1.02
clickbench_q18/duckdb:parquet 1105393162 1043567432 1.06
clickbench_q19/duckdb:parquet 53360413 49248102 1.08
clickbench_q20/duckdb:parquet 443613933 431712790 1.03
clickbench_q21/duckdb:parquet 567442901 564051422 1.01
clickbench_q22/duckdb:parquet 952500686 928689371 1.03
clickbench_q23/duckdb:parquet 319965370 318401319 1.00
clickbench_q24/duckdb:parquet 83350233 77959484 1.07
clickbench_q25/duckdb:parquet 141666234 142036785 1.00
clickbench_q26/duckdb:parquet 54815526 53555754 1.02
clickbench_q27/duckdb:parquet 664381303 647505384 1.03
clickbench_q28/duckdb:parquet 4926992875 4854474604 1.01
clickbench_q29/duckdb:parquet 62256466 62435168 1.00
clickbench_q30/duckdb:parquet 312359067 304814247 1.02
clickbench_q31/duckdb:parquet 360308287 346717801 1.04
clickbench_q32/duckdb:parquet 1197791339 1109829345 1.08
clickbench_q33/duckdb:parquet 1299999933 1234339549 1.05
clickbench_q34/duckdb:parquet 1339933182 1298200949 1.03
clickbench_q35/duckdb:parquet 361984719 352311568 1.03
clickbench_q36/duckdb:parquet 67348346 66014979 1.02
clickbench_q37/duckdb:parquet 56160786 54063674 1.04
clickbench_q38/duckdb:parquet 61434388 57920549 1.06
clickbench_q39/duckdb:parquet 102919128 97968787 1.05
clickbench_q40/duckdb:parquet 58784504 56519476 1.04
clickbench_q41/duckdb:parquet 62053871 60477675 1.03
clickbench_q42/duckdb:parquet 54843732 50339095 1.09
duckdb / duckdb (1.056x ➖, 0↑ 3↓)
name PR 333c48f (ns) base bff43dc (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 20016701 1986284 1.01
clickbench_q01/duckdb:duckdb 37040380 34887544 1.06
clickbench_q02/duckdb:duckdb 50022455 46953554 1.07
clickbench_q03/duckdb:duckdb 52485912 48613647 1.08
clickbench_q04/duckdb:duckdb 227721988 211488045 1.08
clickbench_q05/duckdb:duckdb 336059087 318861969 1.05
clickbench_q06/duckdb:duckdb 39675116 36844590 1.08
clickbench_q07/duckdb:duckdb 39831462 36951454 1.08
clickbench_q08/duckdb:duckdb 309468261 303856717 1.02
clickbench_q09/duckdb:duckdb 490227644 468019005 1.05
clickbench_q10/duckdb:duckdb 102668958 99502179 1.03
clickbench_q11/duckdb:duckdb 111588941 107933719 1.03
clickbench_q12/duckdb:duckdb 311228164 297500269 1.05
clickbench_q13/duckdb:duckdb 588412769 558238785 1.05
clickbench_q14/duckdb:duckdb 352472798 347777214 1.01
clickbench_q15/duckdb:duckdb 274797675 259319961 1.06
clickbench_q16/duckdb:duckdb 737732108 674884869 1.09
clickbench_q17/duckdb:duckdb 616305248 572367370 1.08
clickbench_q18/duckdb:duckdb 1356989747 1252847594 1.08
clickbench_q19/duckdb:duckdb 38339818 35934168 1.07
clickbench_q20/duckdb:duckdb 940212269 887183988 1.06
clickbench_q21/duckdb:duckdb 993899753 1011236373 0.98
clickbench_q22/duckdb:duckdb 1096039015 1079444089 1.02
clickbench_q23/duckdb:duckdb 269196321 259560505 1.04
clickbench_q24/duckdb:duckdb 65461172 62183499 1.05
clickbench_q25/duckdb:duckdb 128950217 121705022 1.06
clickbench_q26/duckdb:duckdb 🚨 61422882 53856791 1.14
clickbench_q27/duckdb:duckdb 1017813475 973036423 1.05
clickbench_q28/duckdb:duckdb 4697692699 4606239928 1.02
clickbench_q29/duckdb:duckdb 53420598 51290380 1.04
clickbench_q30/duckdb:duckdb 291044212 279846594 1.04
clickbench_q31/duckdb:duckdb 429033535 390670819 1.10
clickbench_q32/duckdb:duckdb 1473501080 1425660073 1.03
clickbench_q33/duckdb:duckdb 1979999214 1948830466 1.02
clickbench_q34/duckdb:duckdb 2101574709 2020564725 1.04
clickbench_q35/duckdb:duckdb 275670311 265417161 1.04
clickbench_q36/duckdb:duckdb 47682531 43471164 1.10
clickbench_q37/duckdb:duckdb 33918099 32964442 1.03
clickbench_q38/duckdb:duckdb 🚨 37352961 32512135 1.15
clickbench_q39/duckdb:duckdb 🚨 71570074 65004320 1.10
clickbench_q40/duckdb:duckdb 35713572 33538080 1.06
clickbench_q41/duckdb:duckdb 33866743 31815259 1.06
clickbench_q42/duckdb:duckdb 35765586 33517051 1.07
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +8.3% +16.4% -6.9% +520.1% ➖ noise
0 duckdb:duckdb +0.8% +16.4% -13.4% +249.0% ➖ noise
0 duckdb:vortex-file-compressed +22.8% +16.4% +5.5% +289.1% ➖ noise
1 datafusion:vortex-file-compressed +27.7% +7.7% +18.6% +26.2% ➖ noise
1 duckdb:duckdb +6.2% +7.7% -1.4% +50.6% ➖ noise
1 duckdb:vortex-file-compressed +23.0% +7.7% +14.2% +14.6% ➖ noise
2 datafusion:vortex-file-compressed +26.4% +1.7% +24.3% +12.3% 🚨 regression
2 duckdb:duckdb +6.5% +1.7% +4.7% +12.0% ➖ noise
2 duckdb:vortex-file-compressed +17.9% +1.7% +16.0% +10.0% 🚨 regression
3 datafusion:vortex-file-compressed +19.1% +1.5% +17.3% +128.9% ➖ noise
3 duckdb:duckdb +8.0% +1.5% +6.4% +30.8% ➖ noise
3 duckdb:vortex-file-compressed +6.5% +1.5% +5.0% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +12.1% +9.6% +2.3% +10.0% ➖ noise
4 duckdb:duckdb +7.7% +9.6% -1.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +5.2% +9.6% -4.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +8.2% +8.4% -0.2% +10.0% ➖ noise
5 duckdb:duckdb +5.4% +8.4% -2.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +8.3% +8.4% -0.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +84.1% +7.7% +70.8% +32.7% 🚨 regression
6 duckdb:duckdb +7.7% +7.7% -0.1% +27.4% ➖ noise
6 duckdb:vortex-file-compressed +49.9% +7.7% +39.1% +17.1% 🚨 regression
7 datafusion:vortex-file-compressed +22.6% +6.9% +14.7% +10.0% 🚨 regression
7 duckdb:duckdb +7.8% +6.9% +0.8% +11.7% ➖ noise
7 duckdb:vortex-file-compressed +46.0% +6.9% +36.5% +11.4% 🚨 regression
8 datafusion:vortex-file-compressed +10.4% +9.3% +1.1% +10.0% ➖ noise
8 duckdb:duckdb +1.8% +9.3% -6.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +7.0% +9.3% -2.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +13.1% +9.1% +3.7% +10.0% ➖ noise
9 duckdb:duckdb +4.7% +9.1% -4.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +7.4% +9.1% -1.6% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +13.6% +8.1% +5.1% +10.0% ➖ noise
10 duckdb:duckdb +3.2% +8.1% -4.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.5% +8.1% -5.2% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +11.3% +7.7% +3.3% +10.0% ➖ noise
11 duckdb:duckdb +3.4% +7.7% -4.0% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +2.1% +7.7% -5.2% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +10.2% +7.5% +2.5% +10.0% ➖ noise
12 duckdb:duckdb +4.6% +7.5% -2.7% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +3.6% +7.5% -3.7% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +11.5% +7.5% +3.7% +10.0% ➖ noise
13 duckdb:duckdb +5.4% +7.5% -2.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +1.8% +7.5% -5.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +7.3% +7.0% +0.3% +10.0% ➖ noise
14 duckdb:duckdb +1.4% +7.0% -5.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +5.2% +7.0% -1.6% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +10.7% +8.4% +2.1% +10.0% ➖ noise
15 duckdb:duckdb +6.0% +8.4% -2.2% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +5.9% +8.4% -2.3% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +10.4% +8.7% +1.6% +10.0% ➖ noise
16 duckdb:duckdb +9.3% +8.7% +0.5% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +2.1% +8.7% -6.1% +14.9% ➖ noise
17 datafusion:vortex-file-compressed +11.6% +6.1% +5.2% +10.0% ➖ noise
17 duckdb:duckdb +7.7% +6.1% +1.5% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +3.4% +6.1% -2.5% +12.6% ➖ noise
18 datafusion:vortex-file-compressed +12.4% +9.2% +2.9% +10.0% ➖ noise
18 duckdb:duckdb +8.3% +9.2% -0.8% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -3.3% +9.2% -11.5% +10.0% ✅ faster
19 datafusion:vortex-file-compressed +23.1% +16.5% +5.7% +12.5% ➖ noise
19 duckdb:duckdb +6.7% +16.5% -8.4% +14.4% ➖ noise
19 duckdb:vortex-file-compressed +16.6% +16.5% +0.0% +25.4% ➖ noise
20 datafusion:vortex-file-compressed +2.1% +5.8% -3.5% +184.0% ➖ noise
20 duckdb:duckdb +6.0% +5.8% +0.2% +24.3% ➖ noise
20 duckdb:vortex-file-compressed +2.5% +5.8% -3.1% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +7.4% +3.6% +3.6% +10.0% ➖ noise
21 duckdb:duckdb -1.7% +3.6% -5.1% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +5.6% +3.6% +2.0% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +5.0% +3.9% +1.1% +10.0% ➖ noise
22 duckdb:duckdb +1.5% +3.9% -2.3% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +33.8% +3.9% +28.8% +18.7% 🚨 regression
23 datafusion:vortex-file-compressed +24.6% +4.7% +19.1% +36.3% ➖ noise
23 duckdb:duckdb +3.7% +4.7% -0.9% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +7.1% +4.7% +2.3% +31.7% ➖ noise
24 datafusion:vortex-file-compressed -0.8% +6.5% -6.8% +10.0% ➖ noise
24 duckdb:duckdb +5.3% +6.5% -1.2% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -9.4% +6.5% -14.9% +31.3% ➖ noise
25 datafusion:vortex-file-compressed +4.2% +1.9% +2.3% +10.0% ➖ noise
25 duckdb:duckdb +6.0% +1.9% +4.0% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +2.5% +1.9% +0.6% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +11.4% +3.4% +7.7% +10.0% ➖ noise
26 duckdb:duckdb +14.0% +3.4% +10.3% +10.0% 🚨 regression
26 duckdb:vortex-file-compressed +2.7% +3.4% -0.7% +24.5% ➖ noise
27 datafusion:vortex-file-compressed +2.5% +5.8% -3.1% +10.0% ➖ noise
27 duckdb:duckdb +4.6% +5.8% -1.1% +10.4% ➖ noise
27 duckdb:vortex-file-compressed +3.3% +5.8% -2.3% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +7.6% +1.8% +5.7% +10.0% ➖ noise
28 duckdb:duckdb +2.0% +1.8% +0.2% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +1.9% +1.8% +0.1% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +10.0% +1.6% +8.2% +10.0% ➖ noise
29 duckdb:duckdb +4.2% +1.6% +2.5% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +15.9% +1.6% +14.1% +10.0% 🚨 regression
30 datafusion:vortex-file-compressed +10.6% +7.7% +2.7% +10.0% ➖ noise
30 duckdb:duckdb +4.0% +7.7% -3.4% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +3.9% +7.7% -3.5% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +10.1% +7.1% +2.9% +10.0% ➖ noise
31 duckdb:duckdb +9.8% +7.1% +2.6% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +3.2% +7.1% -3.6% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +8.0% +16.5% -7.3% +16.3% ➖ noise
32 duckdb:duckdb +3.4% +16.5% -11.3% +10.0% ✅ faster
32 duckdb:vortex-file-compressed -0.1% +16.5% -14.2% +10.0% ✅ faster
33 datafusion:vortex-file-compressed +9.5% +9.9% -0.3% +10.0% ➖ noise
33 duckdb:duckdb +1.6% +9.9% -7.5% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -14.4% +9.9% -22.1% +10.0% ✅ faster
34 datafusion:vortex-file-compressed +9.1% +5.5% +3.4% +10.0% ➖ noise
34 duckdb:duckdb +4.0% +5.5% -1.4% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -12.6% +5.5% -17.1% +10.0% ✅ faster
35 datafusion:vortex-file-compressed +9.6% +7.0% +2.5% +10.0% ➖ noise
35 duckdb:duckdb +3.9% +7.0% -2.9% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +6.8% +7.0% -0.2% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +12.9% +10.3% +2.3% +10.0% ➖ noise
36 duckdb:duckdb +9.7% +10.3% -0.5% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +1.4% +10.3% -8.1% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +9.4% +6.7% +2.5% +10.0% ➖ noise
37 duckdb:duckdb +2.9% +6.7% -3.6% +10.7% ➖ noise
37 duckdb:vortex-file-compressed +2.4% +6.7% -4.1% +10.9% ➖ noise
38 datafusion:vortex-file-compressed +12.4% +10.1% +2.1% +10.0% ➖ noise
38 duckdb:duckdb +14.9% +10.1% +4.3% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +5.1% +10.1% -4.6% +10.0% ➖ noise
39 datafusion:vortex-file-compressed +8.6% +9.0% -0.3% +10.0% ➖ noise
39 duckdb:duckdb +10.1% +9.0% +1.0% +23.8% ➖ noise
39 duckdb:vortex-file-compressed +2.8% +9.0% -5.6% +11.1% ➖ noise
40 datafusion:vortex-file-compressed +20.7% +3.6% +16.5% +10.0% 🚨 regression
40 duckdb:duckdb +6.5% +3.6% +2.8% +10.0% ➖ noise
40 duckdb:vortex-file-compressed +1.5% +3.6% -2.0% +15.9% ➖ noise
41 datafusion:vortex-file-compressed +18.5% +5.9% +12.0% +10.4% 🚨 regression
41 duckdb:duckdb +6.4% +5.9% +0.6% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +5.7% +5.9% -0.1% +21.8% ➖ noise
42 datafusion:vortex-file-compressed +31.1% +8.3% +21.0% +10.0% 🚨 regression
42 duckdb:duckdb +6.7% +8.3% -1.5% +10.0% ➖ noise
42 duckdb:vortex-file-compressed +17.8% +8.3% +8.7% +14.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (201 files changed, +0.3% overall, 86↑ 115↓)
File Scale Format Base HEAD Change %
hits_85.vortex 1.0 vortex-file-compressed 105.07 MB 111.36 MB +6.29 MB +6.0%
hits_21.vortex 1.0 vortex-file-compressed 99.70 MB 104.49 MB +4.79 MB +4.8%
hits_61.vortex 1.0 vortex-file-compressed 112.74 MB 117.27 MB +4.54 MB +4.0%
hits_72.vortex 1.0 vortex-file-compressed 94.88 MB 98.46 MB +3.59 MB +3.8%
hits_66.vortex 1.0 vortex-file-compressed 104.02 MB 107.79 MB +3.78 MB +3.6%
hits_62.vortex 1.0 vortex-file-compressed 147.10 MB 152.01 MB +4.91 MB +3.3%
hits_70.vortex 1.0 vortex-file-compressed 114.08 MB 117.31 MB +3.23 MB +2.8%
hits_33.vortex 1.0 vortex-file-compressed 61.95 MB 63.71 MB +1.75 MB +2.8%
hits_57.vortex 1.0 vortex-file-compressed 156.87 MB 161.04 MB +4.17 MB +2.7%
hits_69.vortex 1.0 vortex-file-compressed 145.96 MB 149.60 MB +3.64 MB +2.5%
hits_91.vortex 1.0 vortex-file-compressed 115.26 MB 117.96 MB +2.70 MB +2.3%
hits_19.vortex 1.0 vortex-file-compressed 81.13 MB 82.88 MB +1.75 MB +2.2%
hits_15.vortex 1.0 vortex-file-compressed 95.39 MB 97.26 MB +1.87 MB +2.0%
hits_83.vortex 1.0 vortex-file-compressed 102.67 MB 104.65 MB +1.98 MB +1.9%
hits_89.vortex 1.0 vortex-file-compressed 264.74 MB 269.08 MB +4.34 MB +1.6%
hits_20.vortex 1.0 vortex-file-compressed 66.58 MB 67.60 MB +1.02 MB +1.5%
hits_39.vortex 1.0 vortex-file-compressed 92.67 MB 94.04 MB +1.37 MB +1.5%
hits_52.vortex 1.0 vortex-file-compressed 119.21 MB 120.93 MB +1.72 MB +1.4%
hits_77.vortex 1.0 vortex-file-compressed 217.10 MB 220.16 MB +3.07 MB +1.4%
hits_88.vortex 1.0 vortex-file-compressed 135.89 MB 137.80 MB +1.91 MB +1.4%
hits_14.vortex 1.0 vortex-file-compressed 133.90 MB 135.74 MB +1.84 MB +1.4%
hits_46.vortex 1.0 vortex-file-compressed 79.26 MB 80.31 MB +1.05 MB +1.3%
hits_65.vortex 1.0 vortex-file-compressed 236.04 MB 239.14 MB +3.10 MB +1.3%
hits_87.vortex 1.0 vortex-file-compressed 219.62 MB 222.34 MB +2.72 MB +1.2%
hits_99.vortex 1.0 vortex-file-compressed 157.59 MB 159.44 MB +1.85 MB +1.2%
hits_31.vortex 1.0 vortex-file-compressed 103.21 MB 104.38 MB +1.17 MB +1.1%
hits_44.vortex 1.0 vortex-file-compressed 241.45 MB 244.10 MB +2.65 MB +1.1%
hits_59.vortex 1.0 vortex-file-compressed 120.49 MB 121.79 MB +1.30 MB +1.1%
hits_78.vortex 1.0 vortex-file-compressed 237.45 MB 239.97 MB +2.52 MB +1.1%
hits_94.vortex 1.0 vortex-file-compressed 183.76 MB 185.64 MB +1.88 MB +1.0%
hits_74.vortex 1.0 vortex-compact 71.37 MB 72.09 MB +744.73 KB +1.0%
hits_74.vortex 1.0 vortex-file-compressed 150.52 MB 151.97 MB +1.45 MB +1.0%
hits_9.vortex 1.0 vortex-file-compressed 123.24 MB 124.36 MB +1.11 MB +0.9%
hits_71.vortex 1.0 vortex-file-compressed 125.12 MB 126.25 MB +1.13 MB +0.9%
hits_82.vortex 1.0 vortex-file-compressed 121.02 MB 122.08 MB +1.06 MB +0.9%
hits_60.vortex 1.0 vortex-file-compressed 120.45 MB 121.45 MB +1.00 MB +0.8%
hits_81.vortex 1.0 vortex-file-compressed 125.70 MB 126.69 MB +1009.82 KB +0.8%
hits_67.vortex 1.0 vortex-file-compressed 264.44 MB 266.50 MB +2.06 MB +0.8%
hits_11.vortex 1.0 vortex-file-compressed 95.07 MB 95.79 MB +737.75 KB +0.8%
hits_90.vortex 1.0 vortex-file-compressed 202.76 MB 204.30 MB +1.53 MB +0.8%
hits_92.vortex 1.0 vortex-file-compressed 195.24 MB 196.67 MB +1.43 MB +0.7%
hits_58.vortex 1.0 vortex-file-compressed 113.02 MB 113.83 MB +834.94 KB +0.7%
hits_76.vortex 1.0 vortex-file-compressed 138.22 MB 139.10 MB +895.72 KB +0.6%
hits_85.vortex 1.0 vortex-compact 52.51 MB 52.81 MB +304.71 KB +0.6%
hits_84.vortex 1.0 vortex-file-compressed 143.42 MB 144.21 MB +810.94 KB +0.6%
hits_25.vortex 1.0 vortex-file-compressed 135.54 MB 136.28 MB +762.61 KB +0.5%
hits_68.vortex 1.0 vortex-file-compressed 171.22 MB 172.14 MB +945.56 KB +0.5%
hits_28.vortex 1.0 vortex-file-compressed 166.34 MB 167.18 MB +860.08 KB +0.5%
hits_2.vortex 1.0 vortex-file-compressed 239.70 MB 240.90 MB +1.20 MB +0.5%
hits_93.vortex 1.0 vortex-file-compressed 106.43 MB 106.83 MB +414.29 KB +0.4%
hits_73.vortex 1.0 vortex-file-compressed 130.48 MB 130.94 MB +472.27 KB +0.4%
hits_61.vortex 1.0 vortex-compact 57.40 MB 57.60 MB +203.58 KB +0.3%
hits_12.vortex 1.0 vortex-file-compressed 124.07 MB 124.48 MB +426.31 KB +0.3%
hits_45.vortex 1.0 vortex-file-compressed 143.54 MB 144.02 MB +486.82 KB +0.3%
hits_38.vortex 1.0 vortex-file-compressed 117.06 MB 117.43 MB +372.50 KB +0.3%
hits_91.vortex 1.0 vortex-compact 60.68 MB 60.85 MB +179.33 KB +0.3%
hits_21.vortex 1.0 vortex-compact 51.31 MB 51.46 MB +151.12 KB +0.3%
hits_18.vortex 1.0 vortex-file-compressed 125.20 MB 125.53 MB +337.34 KB +0.3%
hits_32.vortex 1.0 vortex-file-compressed 76.12 MB 76.32 MB +203.45 KB +0.3%
hits_97.vortex 1.0 vortex-file-compressed 129.62 MB 129.85 MB +233.43 KB +0.2%
hits_96.vortex 1.0 vortex-file-compressed 179.48 MB 179.77 MB +300.95 KB +0.2%
hits_10.vortex 1.0 vortex-file-compressed 81.05 MB 81.18 MB +132.66 KB +0.2%
hits_57.vortex 1.0 vortex-compact 83.30 MB 83.42 MB +128.44 KB +0.2%
hits_48.vortex 1.0 vortex-file-compressed 28.11 MB 28.15 MB +42.63 KB +0.1%
hits_62.vortex 1.0 vortex-compact 74.04 MB 74.14 MB +109.48 KB +0.1%
hits_68.vortex 1.0 vortex-compact 75.68 MB 75.79 MB +110.93 KB +0.1%
hits_36.vortex 1.0 vortex-file-compressed 79.48 MB 79.59 MB +108.43 KB +0.1%
hits_80.vortex 1.0 vortex-file-compressed 122.75 MB 122.91 MB +166.64 KB +0.1%
hits_54.vortex 1.0 vortex-file-compressed 360.62 MB 360.98 MB +360.13 KB +0.1%
hits_39.vortex 1.0 vortex-compact 49.56 MB 49.61 MB +48.15 KB +0.1%
hits_70.vortex 1.0 vortex-compact 61.06 MB 61.12 MB +57.94 KB +0.1%
hits_20.vortex 1.0 vortex-compact 37.88 MB 37.91 MB +35.46 KB +0.1%
hits_7.vortex 1.0 vortex-file-compressed 122.77 MB 122.87 MB +104.88 KB +0.1%
hits_13.vortex 1.0 vortex-file-compressed 121.63 MB 121.73 MB +103.63 KB +0.1%
hits_65.vortex 1.0 vortex-compact 129.63 MB 129.73 MB +107.56 KB +0.1%
hits_8.vortex 1.0 vortex-file-compressed 121.89 MB 121.99 MB +99.90 KB +0.1%
hits_96.vortex 1.0 vortex-compact 90.83 MB 90.90 MB +67.59 KB +0.1%
hits_51.vortex 1.0 vortex-file-compressed 426.74 MB 427.01 MB +279.96 KB +0.1%
hits_25.vortex 1.0 vortex-compact 72.87 MB 72.90 MB +32.21 KB +0.0%
hits_45.vortex 1.0 vortex-compact 75.70 MB 75.74 MB +33.09 KB +0.0%
hits_72.vortex 1.0 vortex-compact 51.54 MB 51.56 MB +21.88 KB +0.0%
hits_87.vortex 1.0 vortex-compact 118.73 MB 118.77 MB +39.42 KB +0.0%
hits_12.vortex 1.0 vortex-compact 69.04 MB 69.06 MB +19.74 KB +0.0%
hits_83.vortex 1.0 vortex-compact 52.30 MB 52.30 MB +2.52 KB +0.0%
hits_55.vortex 1.0 vortex-file-compressed 250.46 MB 250.47 MB +8.18 KB +0.0%
hits_86.vortex 1.0 vortex-file-compressed 80.62 MB 80.62 MB +2.08 KB +0.0%
hits_82.vortex 1.0 vortex-compact 66.59 MB 66.58 MB 4.57 KB -0.0%
hits_28.vortex 1.0 vortex-compact 70.05 MB 70.04 MB 5.45 KB -0.0%
hits_15.vortex 1.0 vortex-compact 47.88 MB 47.87 MB 4.91 KB -0.0%
hits_63.vortex 1.0 vortex-compact 45.88 MB 45.87 MB 5.61 KB -0.0%
hits_67.vortex 1.0 vortex-compact 113.75 MB 113.73 MB 13.95 KB -0.0%
hits_93.vortex 1.0 vortex-compact 58.65 MB 58.64 MB 7.55 KB -0.0%
hits_17.vortex 1.0 vortex-file-compressed 102.70 MB 102.69 MB 13.57 KB -0.0%
hits_99.vortex 1.0 vortex-compact 77.04 MB 77.03 MB 10.42 KB -0.0%
hits_5.vortex 1.0 vortex-file-compressed 121.66 MB 121.64 MB 16.51 KB -0.0%
hits_3.vortex 1.0 vortex-file-compressed 191.80 MB 191.77 MB 29.87 KB -0.0%
hits_97.vortex 1.0 vortex-compact 68.91 MB 68.89 MB 12.46 KB -0.0%
hits_51.vortex 1.0 vortex-compact 167.28 MB 167.23 MB 52.45 KB -0.0%
hits_71.vortex 1.0 vortex-compact 69.03 MB 69.01 MB 23.89 KB -0.0%
hits_54.vortex 1.0 vortex-compact 117.25 MB 117.20 MB 47.20 KB -0.0%
hits_6.vortex 1.0 vortex-file-compressed 121.89 MB 121.84 MB 50.78 KB -0.0%
hits_33.vortex 1.0 vortex-compact 35.72 MB 35.70 MB 16.43 KB -0.0%
hits_19.vortex 1.0 vortex-compact 44.56 MB 44.54 MB 23.34 KB -0.1%
hits_55.vortex 1.0 vortex-compact 93.45 MB 93.40 MB 52.62 KB -0.1%
hits_0.vortex 1.0 vortex-compact 58.39 MB 58.36 MB 33.31 KB -0.1%
hits_2.vortex 1.0 vortex-compact 129.05 MB 128.97 MB 77.57 KB -0.1%
hits_58.vortex 1.0 vortex-compact 60.19 MB 60.15 MB 40.27 KB -0.1%
hits_38.vortex 1.0 vortex-compact 62.85 MB 62.80 MB 44.70 KB -0.1%
hits_73.vortex 1.0 vortex-compact 69.77 MB 69.72 MB 51.90 KB -0.1%
hits_27.vortex 1.0 vortex-file-compressed 173.50 MB 173.36 MB 142.23 KB -0.1%
hits_13.vortex 1.0 vortex-compact 67.72 MB 67.67 MB 56.73 KB -0.1%
hits_23.vortex 1.0 vortex-file-compressed 78.38 MB 78.31 MB 68.02 KB -0.1%
hits_5.vortex 1.0 vortex-compact 62.68 MB 62.62 MB 57.33 KB -0.1%
hits_81.vortex 1.0 vortex-compact 65.21 MB 65.15 MB 63.48 KB -0.1%
hits_7.vortex 1.0 vortex-compact 63.58 MB 63.52 MB 63.99 KB -0.1%
hits_89.vortex 1.0 vortex-compact 112.45 MB 112.34 MB 113.21 KB -0.1%
hits_94.vortex 1.0 vortex-compact 90.36 MB 90.26 MB 102.84 KB -0.1%
hits_52.vortex 1.0 vortex-compact 63.44 MB 63.37 MB 73.95 KB -0.1%
hits_11.vortex 1.0 vortex-compact 54.10 MB 54.04 MB 63.40 KB -0.1%
hits_8.vortex 1.0 vortex-compact 62.67 MB 62.59 MB 78.55 KB -0.1%
hits_53.vortex 1.0 vortex-compact 58.85 MB 58.78 MB 75.27 KB -0.1%
hits_92.vortex 1.0 vortex-compact 94.00 MB 93.87 MB 129.19 KB -0.1%
hits_6.vortex 1.0 vortex-compact 62.94 MB 62.85 MB 87.73 KB -0.1%
hits_23.vortex 1.0 vortex-compact 43.94 MB 43.88 MB 64.66 KB -0.1%
hits_59.vortex 1.0 vortex-compact 65.96 MB 65.86 MB 97.44 KB -0.1%
hits_18.vortex 1.0 vortex-compact 64.03 MB 63.93 MB 97.30 KB -0.1%
hits_53.vortex 1.0 vortex-file-compressed 96.77 MB 96.62 MB 148.20 KB -0.1%
hits_90.vortex 1.0 vortex-compact 81.59 MB 81.46 MB 128.25 KB -0.2%
hits_22.vortex 1.0 vortex-compact 44.48 MB 44.41 MB 70.25 KB -0.2%
hits_27.vortex 1.0 vortex-compact 69.68 MB 69.57 MB 113.00 KB -0.2%
hits_69.vortex 1.0 vortex-compact 80.76 MB 80.62 MB 137.29 KB -0.2%
hits_84.vortex 1.0 vortex-compact 72.85 MB 72.73 MB 124.89 KB -0.2%
hits_3.vortex 1.0 vortex-compact 93.91 MB 93.75 MB 161.09 KB -0.2%
hits_56.vortex 1.0 vortex-file-compressed 162.66 MB 162.38 MB 290.06 KB -0.2%
hits_46.vortex 1.0 vortex-compact 41.67 MB 41.60 MB 74.84 KB -0.2%
hits_24.vortex 1.0 vortex-compact 43.39 MB 43.31 MB 79.84 KB -0.2%
hits_22.vortex 1.0 vortex-file-compressed 78.94 MB 78.80 MB 149.56 KB -0.2%
hits_43.vortex 1.0 vortex-file-compressed 303.02 MB 302.46 MB 577.04 KB -0.2%
hits_60.vortex 1.0 vortex-compact 64.06 MB 63.94 MB 128.38 KB -0.2%
hits_30.vortex 1.0 vortex-compact 58.46 MB 58.35 MB 120.37 KB -0.2%
hits_17.vortex 1.0 vortex-compact 58.08 MB 57.97 MB 120.07 KB -0.2%
hits_50.vortex 1.0 vortex-compact 112.75 MB 112.52 MB 233.27 KB -0.2%
hits_1.vortex 1.0 vortex-compact 90.07 MB 89.89 MB 186.80 KB -0.2%
hits_86.vortex 1.0 vortex-compact 48.01 MB 47.91 MB 102.53 KB -0.2%
hits_42.vortex 1.0 vortex-file-compressed 296.11 MB 295.48 MB 642.84 KB -0.2%
hits_4.vortex 1.0 vortex-compact 71.55 MB 71.39 MB 156.50 KB -0.2%
hits_41.vortex 1.0 vortex-file-compressed 297.76 MB 297.12 MB 656.99 KB -0.2%
hits_56.vortex 1.0 vortex-compact 77.69 MB 77.50 MB 188.92 KB -0.2%
hits_10.vortex 1.0 vortex-compact 48.67 MB 48.55 MB 119.83 KB -0.2%
hits_16.vortex 1.0 vortex-compact 48.10 MB 47.96 MB 138.58 KB -0.3%
hits_75.vortex 1.0 vortex-file-compressed 73.40 MB 73.19 MB 218.19 KB -0.3%
hits_79.vortex 1.0 vortex-compact 85.36 MB 85.11 MB 256.05 KB -0.3%
hits_80.vortex 1.0 vortex-compact 67.81 MB 67.61 MB 205.13 KB -0.3%
hits_0.vortex 1.0 vortex-file-compressed 111.46 MB 111.13 MB 342.00 KB -0.3%
hits_37.vortex 1.0 vortex-compact 53.61 MB 53.45 MB 166.78 KB -0.3%
hits_34.vortex 1.0 vortex-compact 58.01 MB 57.83 MB 184.67 KB -0.3%
hits_76.vortex 1.0 vortex-compact 76.12 MB 75.87 MB 251.04 KB -0.3%
hits_64.vortex 1.0 vortex-compact 53.69 MB 53.51 MB 178.11 KB -0.3%
hits_75.vortex 1.0 vortex-compact 43.41 MB 43.27 MB 152.33 KB -0.3%
hits_24.vortex 1.0 vortex-file-compressed 77.97 MB 77.70 MB 274.88 KB -0.3%
hits_36.vortex 1.0 vortex-compact 48.75 MB 48.58 MB 174.04 KB -0.3%
hits_49.vortex 1.0 vortex-compact 50.27 MB 50.09 MB 180.31 KB -0.4%
hits_32.vortex 1.0 vortex-compact 43.89 MB 43.73 MB 164.06 KB -0.4%
hits_4.vortex 1.0 vortex-file-compressed 137.68 MB 137.15 MB 546.49 KB -0.4%
hits_77.vortex 1.0 vortex-compact 117.87 MB 117.39 MB 489.31 KB -0.4%
hits_43.vortex 1.0 vortex-compact 168.57 MB 167.89 MB 702.77 KB -0.4%
hits_29.vortex 1.0 vortex-compact 36.38 MB 36.23 MB 155.46 KB -0.4%
hits_41.vortex 1.0 vortex-compact 165.44 MB 164.75 MB 712.11 KB -0.4%
hits_44.vortex 1.0 vortex-compact 132.13 MB 131.57 MB 570.59 KB -0.4%
hits_26.vortex 1.0 vortex-file-compressed 142.56 MB 141.96 MB 616.63 KB -0.4%
hits_14.vortex 1.0 vortex-compact 73.52 MB 73.21 MB 318.96 KB -0.4%
hits_42.vortex 1.0 vortex-compact 163.89 MB 163.20 MB 713.77 KB -0.4%
hits_31.vortex 1.0 vortex-compact 55.28 MB 55.04 MB 243.87 KB -0.4%
hits_9.vortex 1.0 vortex-compact 65.45 MB 65.14 MB 317.77 KB -0.5%
hits_98.vortex 1.0 vortex-compact 72.46 MB 72.09 MB 381.70 KB -0.5%
hits_50.vortex 1.0 vortex-file-compressed 253.80 MB 252.38 MB 1.42 MB -0.6%
hits_40.vortex 1.0 vortex-compact 75.65 MB 75.23 MB 434.70 KB -0.6%
hits_78.vortex 1.0 vortex-compact 97.53 MB 96.98 MB 564.73 KB -0.6%
hits_16.vortex 1.0 vortex-file-compressed 86.38 MB 85.87 MB 520.15 KB -0.6%
hits_48.vortex 1.0 vortex-compact 17.12 MB 17.01 MB 105.52 KB -0.6%
hits_63.vortex 1.0 vortex-file-compressed 79.72 MB 79.24 MB 491.87 KB -0.6%
hits_47.vortex 1.0 vortex-compact 18.06 MB 17.95 MB 116.74 KB -0.6%
hits_79.vortex 1.0 vortex-file-compressed 202.78 MB 201.35 MB 1.42 MB -0.7%
hits_95.vortex 1.0 vortex-compact 57.47 MB 57.06 MB 421.02 KB -0.7%
hits_1.vortex 1.0 vortex-file-compressed 180.21 MB 178.84 MB 1.37 MB -0.8%
hits_66.vortex 1.0 vortex-compact 53.26 MB 52.80 MB 473.23 KB -0.9%
hits_26.vortex 1.0 vortex-compact 70.65 MB 70.03 MB 630.12 KB -0.9%
hits_98.vortex 1.0 vortex-file-compressed 149.39 MB 148.05 MB 1.34 MB -0.9%
hits_40.vortex 1.0 vortex-file-compressed 141.59 MB 140.26 MB 1.33 MB -0.9%
hits_88.vortex 1.0 vortex-compact 73.07 MB 72.34 MB 748.70 KB -1.0%
hits_35.vortex 1.0 vortex-file-compressed 137.56 MB 135.61 MB 1.95 MB -1.4%
hits_49.vortex 1.0 vortex-file-compressed 87.66 MB 86.32 MB 1.34 MB -1.5%
hits_64.vortex 1.0 vortex-file-compressed 94.21 MB 92.77 MB 1.44 MB -1.5%
hits_47.vortex 1.0 vortex-file-compressed 41.47 MB 40.84 MB 649.80 KB -1.5%
hits_30.vortex 1.0 vortex-file-compressed 102.83 MB 101.23 MB 1.59 MB -1.6%
hits_35.vortex 1.0 vortex-compact 74.79 MB 73.63 MB 1.17 MB -1.6%
hits_29.vortex 1.0 vortex-file-compressed 64.72 MB 63.40 MB 1.31 MB -2.0%
hits_37.vortex 1.0 vortex-file-compressed 96.35 MB 94.28 MB 2.06 MB -2.1%
hits_34.vortex 1.0 vortex-file-compressed 110.35 MB 107.80 MB 2.55 MB -2.3%
hits_95.vortex 1.0 vortex-file-compressed 113.14 MB 108.20 MB 4.94 MB -4.4%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.03 GB → 7.02 GB (-0.2%)
  • vortex-file-compressed: 13.88 GB → 13.96 GB (+0.5%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.000x ➖
Parquet (geomean): 0.996x ➖


unknown / unknown (0.994x ➖, 5↑ 6↓)
name PR 333c48f (ns) base bff43dc (ns) ratio (PR/base)
compress time/Arade 1178708248 1181266540 1.00
compress time/Bimbo 6930168520 7164032219 0.97
compress time/CMSprovider 3111991610 2928582510 1.06
compress time/Euro2016 433192133 439025168 0.99
compress time/Food 376131340 362928857 1.04
compress time/HashTags 791480173 805345560 0.98
compress time/TPC-H l_comment canonical 1311817043 1289776301 1.02
compress time/TPC-H l_comment chunked 1335830370 1295781206 1.03
compress time/taxi 724664090 726141010 1.00
compress time/wide table cols=100 chunks=1 rows=1000 12758663 13198889 0.97
compress time/wide table cols=100 chunks=50 rows=1000 🚀 12567512 15361168 0.82
compress time/wide table cols=1000 chunks=1 rows=1000 141035202 144078797 0.98
compress time/wide table cols=1000 chunks=50 rows=1000 137587553 144029333 0.96
compress time/wide table cols=10000 chunks=1 rows=1000 1403925813 1458681992 0.96
compress time/wide table cols=10000 chunks=50 rows=1000 1420204274 1420878208 1.00
decompress time/Arade 32349011 32991949 0.98
decompress time/Bimbo 108041109 104607833 1.03
decompress time/CMSprovider 🚨 99643670 89501601 1.11
decompress time/Euro2016 19360151 20332247 0.95
decompress time/Food 🚨 11672310 9763949 1.20
decompress time/HashTags 84809023 80430387 1.05
decompress time/TPC-H l_comment canonical 41596175 41140868 1.01
decompress time/TPC-H l_comment chunked 41533748 41083689 1.01
decompress time/taxi 🚨 25525844 22677047 1.13
decompress time/wide table cols=100 chunks=1 rows=1000 🚀 2561222 2865351 0.89
decompress time/wide table cols=100 chunks=50 rows=1000 🚀 2670523 3276454 0.82
decompress time/wide table cols=1000 chunks=1 rows=1000 23879715 24532249 0.97
decompress time/wide table cols=1000 chunks=50 rows=1000 24736313 25601247 0.97
decompress time/wide table cols=10000 chunks=1 rows=1000 251299596 261019646 0.96
decompress time/wide table cols=10000 chunks=50 rows=1000 247978895 253770425 0.98
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3007800722 3026050010 0.99
parquet_rs-zstd compress time/Bimbo 17292562407 17127615138 1.01
parquet_rs-zstd compress time/CMSprovider 7641590504 7797382457 0.98
parquet_rs-zstd compress time/Euro2016 1358780413 1353850762 1.00
parquet_rs-zstd compress time/Food 926706393 936307644 0.99
parquet_rs-zstd compress time/HashTags 2454710211 2499616814 0.98
parquet_rs-zstd compress time/TPC-H l_comment canonical 3080648240 3116906510 0.99
parquet_rs-zstd compress time/TPC-H l_comment chunked 3074155661 3082526233 1.00
parquet_rs-zstd compress time/taxi 1501325207 1510342625 0.99
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6771660 6655281 1.02
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚀 6793144 8071720 0.84
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 83121176 85470857 0.97
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 83022260 87383186 0.95
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 875735017 862603366 1.02
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 855710031 900276599 0.95
parquet_rs-zstd decompress time/Arade 643041989 646164162 1.00
parquet_rs-zstd decompress time/Bimbo 1737040534 1755392793 0.99
parquet_rs-zstd decompress time/CMSprovider 1923656961 1924037364 1.00
parquet_rs-zstd decompress time/Euro2016 390228812 392536557 0.99
parquet_rs-zstd decompress time/Food 218675887 222718013 0.98
parquet_rs-zstd decompress time/HashTags 625029177 634232191 0.99
parquet_rs-zstd decompress time/TPC-H l_comment canonical 557884195 561179041 0.99
parquet_rs-zstd decompress time/TPC-H l_comment chunked 564535891 563477382 1.00
parquet_rs-zstd decompress time/taxi 243794733 243047395 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2673693 2732997 0.98
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 🚀 2776669 3099353 0.90
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 30980133 31778827 0.97
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 32064407 32299755 0.99
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 371197046 371343994 1.00
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 366758347 370771865 0.99
vortex-file-compressed size/Arade 144638828 145363828 1.00
vortex-file-compressed size/Bimbo 439592044 468763364 0.94
vortex-file-compressed size/CMSprovider 414216044 417907844 0.99
vortex-file-compressed size/Euro2016 163795204 163394356 1.00
vortex-file-compressed size/Food 41481384 41926968 0.99
vortex-file-compressed size/HashTags 191056396 195647860 0.98
vortex-file-compressed size/TPC-H l_comment canonical 177927288 179087392 0.99
vortex-file-compressed size/TPC-H l_comment chunked 177927288 179087392 0.99
vortex-file-compressed size/taxi 51647156 52363980 0.99
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930880 930880 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930880 930880 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293680 9293680 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293680 9293680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957680 92957680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957680 92957680 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.00
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.96
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.08
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.98
vortex:parquet-zstd ratio compress time/Food 0 0 1.05
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.00
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.03
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.03
vortex:parquet-zstd ratio compress time/taxi 0 0 1.00
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 0.95
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 0.97
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.95
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.05
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.99
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.04
vortex:parquet-zstd ratio decompress time/CMSprovider 🚨 0 0 1.11
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.96
vortex:parquet-zstd ratio decompress time/Food 🚨 0 0 1.22
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.07
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.02
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.01
vortex:parquet-zstd ratio decompress time/taxi 🚨 0 0 1.12
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 1 0.91
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 1 0.91
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.99
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 0.94
vortex:parquet-zstd size/CMSprovider 1 1 0.99
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 0.99
vortex:parquet-zstd size/HashTags 1 1 0.98
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 0.99
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 0.99
vortex:parquet-zstd size/taxi 0 0 0.99
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.3%
Vortex (geomean): 0.986x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.7%


datafusion / vortex-file-compressed (0.963x ➖, 1↑ 0↓)
name PR 333c48f (ns) base bff43dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 674450394 681921591 0.99
tpch_q02/datafusion:vortex-file-compressed 717551782 918664157 0.78
tpch_q03/datafusion:vortex-file-compressed 1095951359 873348931 1.25
tpch_q04/datafusion:vortex-file-compressed 744907770 628976974 1.18
tpch_q05/datafusion:vortex-file-compressed 1124691527 1028451390 1.09
tpch_q06/datafusion:vortex-file-compressed 614482687 689685533 0.89
tpch_q07/datafusion:vortex-file-compressed 1113200869 1102916232 1.01
tpch_q08/datafusion:vortex-file-compressed 1339534651 1212721985 1.10
tpch_q09/datafusion:vortex-file-compressed 1432314949 1357014879 1.06
tpch_q10/datafusion:vortex-file-compressed 1036908346 957306002 1.08
tpch_q11/datafusion:vortex-file-compressed 499851207 498504546 1.00
tpch_q12/datafusion:vortex-file-compressed 1044756640 1150451116 0.91
tpch_q13/datafusion:vortex-file-compressed 549743827 470655452 1.17
tpch_q14/datafusion:vortex-file-compressed 702278693 618230921 1.14
tpch_q15/datafusion:vortex-file-compressed 1240670063 1259696529 0.98
tpch_q16/datafusion:vortex-file-compressed 338747347 474963381 0.71
tpch_q17/datafusion:vortex-file-compressed 1214310241 1199047573 1.01
tpch_q18/datafusion:vortex-file-compressed 1337575640 1300299007 1.03
tpch_q19/datafusion:vortex-file-compressed 782084552 774311886 1.01
tpch_q20/datafusion:vortex-file-compressed 915825048 1025936084 0.89
tpch_q21/datafusion:vortex-file-compressed 1639481642 1838504549 0.89
tpch_q22/datafusion:vortex-file-compressed 🚀 338975624 788570182 0.43
datafusion / vortex-compact (0.946x ➖, 1↑ 1↓)
name PR 333c48f (ns) base bff43dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 690953949 924976635 0.75
tpch_q02/datafusion:vortex-compact 🚀 598956865 1153539417 0.52
tpch_q03/datafusion:vortex-compact 747191542 900324911 0.83
tpch_q04/datafusion:vortex-compact 534817237 580293468 0.92
tpch_q05/datafusion:vortex-compact 989451765 907555134 1.09
tpch_q06/datafusion:vortex-compact 526015796 633130262 0.83
tpch_q07/datafusion:vortex-compact 1102538238 1011526402 1.09
tpch_q08/datafusion:vortex-compact 1309859101 1096718587 1.19
tpch_q09/datafusion:vortex-compact 1263562512 1569236843 0.81
tpch_q10/datafusion:vortex-compact 999863736 989116024 1.01
tpch_q11/datafusion:vortex-compact 444929210 457591080 0.97
tpch_q12/datafusion:vortex-compact 961850390 1071218580 0.90
tpch_q13/datafusion:vortex-compact 449300123 458793593 0.98
tpch_q14/datafusion:vortex-compact 663009472 585110805 1.13
tpch_q15/datafusion:vortex-compact 1146400042 1018870553 1.13
tpch_q16/datafusion:vortex-compact 🚨 448364745 331383294 1.35
tpch_q17/datafusion:vortex-compact 1283099989 1208521606 1.06
tpch_q18/datafusion:vortex-compact 1188545396 1129634581 1.05
tpch_q19/datafusion:vortex-compact 724062130 843038509 0.86
tpch_q20/datafusion:vortex-compact 859969218 1107500983 0.78
tpch_q21/datafusion:vortex-compact 1459452954 1714092786 0.85
tpch_q22/datafusion:vortex-compact 383558421 346602041 1.11
datafusion / parquet (1.009x ➖, 0↑ 1↓)
name PR 333c48f (ns) base bff43dc (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 799741173 824746462 0.97
tpch_q02/datafusion:parquet 706321137 695574163 1.02
tpch_q03/datafusion:parquet 1050613924 973952853 1.08
tpch_q04/datafusion:parquet 🚨 601660410 455494885 1.32
tpch_q05/datafusion:parquet 1337954019 1244446958 1.08
tpch_q06/datafusion:parquet 538696701 504535331 1.07
tpch_q07/datafusion:parquet 1466656486 1460110736 1.00
tpch_q08/datafusion:parquet 1786199411 1653897152 1.08
tpch_q09/datafusion:parquet 1729227604 1866560537 0.93
tpch_q10/datafusion:parquet 1959583412 2326645046 0.84
tpch_q11/datafusion:parquet 623875251 538526571 1.16
tpch_q12/datafusion:parquet 727294479 665235928 1.09
tpch_q13/datafusion:parquet 741437975 712494460 1.04
tpch_q14/datafusion:parquet 765684804 812375481 0.94
tpch_q15/datafusion:parquet 1229773927 1273714742 0.97
tpch_q16/datafusion:parquet 403526147 455430796 0.89
tpch_q17/datafusion:parquet 1348303875 1471472018 0.92
tpch_q18/datafusion:parquet 1509804375 1542609166 0.98
tpch_q19/datafusion:parquet 1022848849 991825158 1.03
tpch_q20/datafusion:parquet 1215047395 1194281706 1.02
tpch_q21/datafusion:parquet 1657715168 1769145264 0.94
tpch_q22/datafusion:parquet 845484170 880561560 0.96
duckdb / vortex-file-compressed (1.021x ➖, 0↑ 1↓)
name PR 333c48f (ns) base bff43dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 645197113 677805869 0.95
tpch_q02/duckdb:vortex-file-compressed 1201446692 1151626613 1.04
tpch_q03/duckdb:vortex-file-compressed 1002129756 1017858655 0.98
tpch_q04/duckdb:vortex-file-compressed 730375186 747058312 0.98
tpch_q05/duckdb:vortex-file-compressed 1164908923 1129222784 1.03
tpch_q06/duckdb:vortex-file-compressed 832115515 829942074 1.00
tpch_q07/duckdb:vortex-file-compressed 1253585398 1177821547 1.06
tpch_q08/duckdb:vortex-file-compressed 1493876136 1501471905 0.99
tpch_q09/duckdb:vortex-file-compressed 1518959083 1521173164 1.00
tpch_q10/duckdb:vortex-file-compressed 1210388117 1226107291 0.99
tpch_q11/duckdb:vortex-file-compressed 617915466 643862399 0.96
tpch_q12/duckdb:vortex-file-compressed 692569867 694230282 1.00
tpch_q13/duckdb:vortex-file-compressed 🚨 1269508084 916208849 1.39
tpch_q14/duckdb:vortex-file-compressed 862397971 841915344 1.02
tpch_q15/duckdb:vortex-file-compressed 618230089 554585882 1.11
tpch_q16/duckdb:vortex-file-compressed 503232423 555447968 0.91
tpch_q17/duckdb:vortex-file-compressed 1013450815 978918474 1.04
tpch_q18/duckdb:vortex-file-compressed 1046860178 1075167141 0.97
tpch_q19/duckdb:vortex-file-compressed 858930336 772397507 1.11
tpch_q20/duckdb:vortex-file-compressed 1280859820 1242654998 1.03
tpch_q21/duckdb:vortex-file-compressed 2087317989 2031622136 1.03
tpch_q22/duckdb:vortex-file-compressed 653283056 688616099 0.95
duckdb / vortex-compact (1.015x ➖, 0↑ 0↓)
name PR 333c48f (ns) base bff43dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 572185380 619392743 0.92
tpch_q02/duckdb:vortex-compact 1137120282 1107778898 1.03
tpch_q03/duckdb:vortex-compact 867731072 908337112 0.96
tpch_q04/duckdb:vortex-compact 588004369 548228326 1.07
tpch_q05/duckdb:vortex-compact 1111316516 1102502381 1.01
tpch_q06/duckdb:vortex-compact 660628147 702607436 0.94
tpch_q07/duckdb:vortex-compact 1114972189 1059991893 1.05
tpch_q08/duckdb:vortex-compact 1363368970 1387199024 0.98
tpch_q09/duckdb:vortex-compact 1401238539 1423614237 0.98
tpch_q10/duckdb:vortex-compact 1284586552 1157426672 1.11
tpch_q11/duckdb:vortex-compact 668498128 715428123 0.93
tpch_q12/duckdb:vortex-compact 674737097 688422710 0.98
tpch_q13/duckdb:vortex-compact 1024069017 893047978 1.15
tpch_q14/duckdb:vortex-compact 855082595 867861838 0.99
tpch_q15/duckdb:vortex-compact 543079716 551014170 0.99
tpch_q16/duckdb:vortex-compact 512964529 454942853 1.13
tpch_q17/duckdb:vortex-compact 993046948 894320783 1.11
tpch_q18/duckdb:vortex-compact 705685971 825644439 0.85
tpch_q19/duckdb:vortex-compact 783504724 724972584 1.08
tpch_q20/duckdb:vortex-compact 1234388506 1223726705 1.01
tpch_q21/duckdb:vortex-compact 1770570018 1732902002 1.02
tpch_q22/duckdb:vortex-compact 640358661 589442582 1.09
duckdb / parquet (0.988x ➖, 0↑ 0↓)
name PR 333c48f (ns) base bff43dc (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 974701596 933565149 1.04
tpch_q02/duckdb:parquet 1628275443 1631373050 1.00
tpch_q03/duckdb:parquet 1810218666 1805594387 1.00
tpch_q04/duckdb:parquet 1215217935 1192015432 1.02
tpch_q05/duckdb:parquet 2250343250 2249910131 1.00
tpch_q06/duckdb:parquet 731745829 706637298 1.04
tpch_q07/duckdb:parquet 1806475358 2053703966 0.88
tpch_q08/duckdb:parquet 2540428497 2472301734 1.03
tpch_q09/duckdb:parquet 2379135792 2426129752 0.98
tpch_q10/duckdb:parquet 3125784597 3047282484 1.03
tpch_q11/duckdb:parquet 921351026 1007035967 0.91
tpch_q12/duckdb:parquet 1049147073 1051154605 1.00
tpch_q13/duckdb:parquet 1233253624 1216834734 1.01
tpch_q14/duckdb:parquet 1290726719 1255195824 1.03
tpch_q15/duckdb:parquet 842994451 888371834 0.95
tpch_q16/duckdb:parquet 800641763 870132595 0.92
tpch_q17/duckdb:parquet 1281323025 1326760433 0.97
tpch_q18/duckdb:parquet 1490635963 1405997600 1.06
tpch_q19/duckdb:parquet 1517459216 1499778761 1.01
tpch_q20/duckdb:parquet 1832887093 1815134196 1.01
tpch_q21/duckdb:parquet 1803806976 2014594558 0.90
tpch_q22/duckdb:parquet 1056188320 1072314228 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -25.3% +0.6% -25.8% +41.8% ➖ noise
1 datafusion:vortex-file-compressed -1.1% +0.6% -1.7% +49.1% ➖ noise
1 duckdb:vortex-compact -7.6% +0.6% -8.2% +31.7% ➖ noise
1 duckdb:vortex-file-compressed -4.8% +0.6% -5.4% +30.0% ➖ noise
2 datafusion:vortex-compact -48.1% +0.7% -48.4% +36.7% ✅ faster
2 datafusion:vortex-file-compressed -21.9% +0.7% -22.4% +46.9% ➖ noise
2 duckdb:vortex-compact +2.6% +0.7% +2.0% +31.3% ➖ noise
2 duckdb:vortex-file-compressed +4.3% +0.7% +3.6% +30.0% ➖ noise
3 datafusion:vortex-compact -17.0% +4.0% -20.2% +46.8% ➖ noise
3 datafusion:vortex-file-compressed +25.5% +4.0% +20.7% +44.7% ➖ noise
3 duckdb:vortex-compact -4.5% +4.0% -8.1% +38.2% ➖ noise
3 duckdb:vortex-file-compressed -1.5% +4.0% -5.3% +38.4% ➖ noise
4 datafusion:vortex-compact -7.8% +16.0% -20.6% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +18.4% +16.0% +2.1% +30.0% ➖ noise
4 duckdb:vortex-compact +7.3% +16.0% -7.6% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -2.2% +16.0% -15.7% +32.8% ➖ noise
5 datafusion:vortex-compact +9.0% +3.7% +5.1% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +9.4% +3.7% +5.5% +30.0% ➖ noise
5 duckdb:vortex-compact +0.8% +3.7% -2.8% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +3.2% +3.7% -0.5% +30.0% ➖ noise
6 datafusion:vortex-compact -16.9% +5.1% -21.0% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -10.9% +5.1% -15.3% +30.0% ➖ noise
6 duckdb:vortex-compact -6.0% +5.1% -10.6% +32.3% ➖ noise
6 duckdb:vortex-file-compressed +0.3% +5.1% -4.6% +30.0% ➖ noise
7 datafusion:vortex-compact +9.0% -6.0% +16.0% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +0.9% -6.0% +7.4% +30.0% ➖ noise
7 duckdb:vortex-compact +5.2% -6.0% +11.9% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +6.4% -6.0% +13.2% +30.0% ➖ noise
8 datafusion:vortex-compact +19.4% +5.3% +13.4% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +10.5% +5.3% +4.9% +30.0% ➖ noise
8 duckdb:vortex-compact -1.7% +5.3% -6.7% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -0.5% +5.3% -5.6% +30.0% ➖ noise
9 datafusion:vortex-compact -19.5% -4.7% -15.5% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +5.5% -4.7% +10.7% +30.0% ➖ noise
9 duckdb:vortex-compact -1.6% -4.7% +3.3% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -0.1% -4.7% +4.8% +30.0% ➖ noise
10 datafusion:vortex-compact +1.1% -7.1% +8.8% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +8.3% -7.1% +16.5% +30.0% ➖ noise
10 duckdb:vortex-compact +11.0% -7.1% +19.4% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -1.3% -7.1% +6.2% +30.0% ➖ noise
11 datafusion:vortex-compact -2.8% +3.0% -5.6% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +0.3% +3.0% -2.6% +30.0% ➖ noise
11 duckdb:vortex-compact -6.6% +3.0% -9.2% +36.2% ➖ noise
11 duckdb:vortex-file-compressed -4.0% +3.0% -6.8% +30.0% ➖ noise
12 datafusion:vortex-compact -10.2% +4.5% -14.0% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -9.2% +4.5% -13.1% +30.0% ➖ noise
12 duckdb:vortex-compact -2.0% +4.5% -6.2% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -0.2% +4.5% -4.5% +30.0% ➖ noise
13 datafusion:vortex-compact -2.1% +2.7% -4.6% +31.2% ➖ noise
13 datafusion:vortex-file-compressed +16.8% +2.7% +13.7% +30.0% ➖ noise
13 duckdb:vortex-compact +14.7% +2.7% +11.7% +44.8% ➖ noise
13 duckdb:vortex-file-compressed +38.6% +2.7% +34.9% +55.1% ➖ noise
14 datafusion:vortex-compact +13.3% -1.6% +15.1% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +13.6% -1.6% +15.4% +30.0% ➖ noise
14 duckdb:vortex-compact -1.5% -1.6% +0.1% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +2.4% -1.6% +4.0% +30.0% ➖ noise
15 datafusion:vortex-compact +12.5% -4.3% +17.6% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -1.5% -4.3% +2.9% +30.0% ➖ noise
15 duckdb:vortex-compact -1.4% -4.3% +3.0% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +11.5% -4.3% +16.5% +30.0% ➖ noise
16 datafusion:vortex-compact +35.3% -9.7% +49.8% +30.0% 🚨 regression
16 datafusion:vortex-file-compressed -28.7% -9.7% -21.0% +30.0% ➖ noise
16 duckdb:vortex-compact +12.8% -9.7% +24.9% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -9.4% -9.7% +0.3% +30.0% ➖ noise
17 datafusion:vortex-compact +6.2% -5.9% +12.9% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +1.3% -5.9% +7.7% +30.0% ➖ noise
17 duckdb:vortex-compact +11.0% -5.9% +18.0% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +3.5% -5.9% +10.1% +30.0% ➖ noise
18 datafusion:vortex-compact +5.2% +1.9% +3.3% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +2.9% +1.9% +1.0% +30.0% ➖ noise
18 duckdb:vortex-compact -14.5% +1.9% -16.1% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -2.6% +1.9% -4.4% +36.8% ➖ noise
19 datafusion:vortex-compact -14.1% +2.1% -15.9% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +1.0% +2.1% -1.1% +30.0% ➖ noise
19 duckdb:vortex-compact +8.1% +2.1% +5.8% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +11.2% +2.1% +8.9% +30.0% ➖ noise
20 datafusion:vortex-compact -22.4% +1.4% -23.4% +30.0% ✅ faster
20 datafusion:vortex-file-compressed -10.7% +1.4% -11.9% +30.0% ➖ noise
20 duckdb:vortex-compact +0.9% +1.4% -0.5% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +3.1% +1.4% +1.7% +30.0% ➖ noise
21 datafusion:vortex-compact -14.9% -8.4% -7.0% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -10.8% -8.4% -2.6% +30.0% ➖ noise
21 duckdb:vortex-compact +2.2% -8.4% +11.5% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +2.7% -8.4% +12.2% +30.0% ➖ noise
22 datafusion:vortex-compact +10.7% -2.8% +13.8% +30.0% ➖ noise
22 datafusion:vortex-file-compressed -57.0% -2.8% -55.8% +30.0% ✅ faster
22 duckdb:vortex-compact +8.6% -2.8% +11.7% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -5.1% -2.8% -2.4% +32.3% ➖ noise

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants