Skip to content

Remove ScalarFnConstantRule#7575

Merged
robert3005 merged 6 commits intodevelopfrom
rk/between
Apr 20, 2026
Merged

Remove ScalarFnConstantRule#7575
robert3005 merged 6 commits intodevelopfrom
rk/between

Conversation

@robert3005
Copy link
Copy Markdown
Contributor

This reduction rule does execution and prevents any parent reduce rules from
triggering

Signed-off-by: Robert Kruszewski <github@robertk.io>
Signed-off-by: Robert Kruszewski <github@robertk.io>
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Apr 20, 2026

Merging this PR will improve performance by 33.35%

⚡ 57 improved benchmarks
✅ 1106 untouched benchmarks
⏩ 1462 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation bench_compare_primitive[(10000, 2)] 118.7 µs 105.6 µs +12.41%
Simulation bench_compare_primitive[(10000, 128)] 119.7 µs 107.1 µs +11.79%
Simulation bench_compare_primitive[(10000, 4)] 118 µs 105.7 µs +11.61%
Simulation bench_compare_primitive[(10000, 512)] 128.2 µs 115.7 µs +10.81%
Simulation bench_compare_primitive[(10000, 8)] 118.1 µs 106 µs +11.36%
Simulation bench_compare_sliced_dict_primitive[(1000, 10000)] 92.8 µs 82.3 µs +12.78%
Simulation bench_compare_primitive[(10000, 32)] 118.4 µs 106.1 µs +11.67%
Simulation bench_compare_sliced_dict_primitive[(2000, 10000)] 97.9 µs 87.4 µs +12.1%
Simulation bench_compare_sliced_dict_primitive[(2500, 10000)] 100.7 µs 89.8 µs +12.2%
Simulation bench_compare_sliced_dict_primitive[(3333, 10000)] 105.4 µs 94.4 µs +11.63%
Simulation bench_compare_sliced_dict_primitive[(5000, 10000)] 114 µs 102.8 µs +10.88%
Simulation bench_compare_varbin[(10000, 2)] 125.6 µs 114.2 µs +10.01%
Simulation bench_compare_varbinview[(10000, 2)] 125.2 µs 113.6 µs +10.22%
Simulation bench_compare_varbinview[(10000, 8)] 125.5 µs 113.6 µs +10.51%
Simulation bench_compare_varbinview[(10000, 128)] 128.3 µs 116.1 µs +10.44%
Simulation bench_compare_varbinview[(10000, 32)] 125.8 µs 114 µs +10.32%
Simulation case_when_nary_10_conditions[1000] 305.3 µs 259.4 µs +17.68%
Simulation case_when_all_false[1000] 105.9 µs 92.9 µs +13.94%
Simulation case_when_all_true[1000] 87.5 µs 75.2 µs +16.32%
Simulation case_when_nary_early_dominant[1000] 158.4 µs 138.7 µs +14.23%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing rk/between (5b07f05) with develop (be2a14b)

Open in CodSpeed

Footnotes

  1. 1462 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005 robert3005 added the action/benchmark Trigger full benchmarks to run on this PR label Apr 20, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 20, 2026
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005 robert3005 added the changelog/performance A performance improvement label Apr 20, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 20, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 9019c38 2 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done 9019c38 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.009x ➖


datafusion / vortex-file-compressed (1.009x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 118420667 129389931 0.92
polarsignals_q01/datafusion:vortex-file-compressed 362039777 373778449 0.97
polarsignals_q02/datafusion:vortex-file-compressed 23694809 22740175 1.04
polarsignals_q03/datafusion:vortex-file-compressed 376059039 362942323 1.04
polarsignals_q04/datafusion:vortex-file-compressed 11142390 10522814 1.06
polarsignals_q05/datafusion:vortex-file-compressed 14979528 15146450 0.99
polarsignals_q06/datafusion:vortex-file-compressed 18033196 18469737 0.98
polarsignals_q07/datafusion:vortex-file-compressed 13539876 12679485 1.07
polarsignals_q08/datafusion:vortex-file-compressed 445947836 447128869 1.00
polarsignals_q09/datafusion:vortex-file-compressed 10464097 10017428 1.04

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 689.41 MB 689.41 MB +32 B +0.0%

Totals:

  • vortex-file-compressed: 689.41 MB → 689.41 MB (+0.0%)

Signed-off-by: Robert Kruszewski <github@robertk.io>
@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.7%
Vortex (geomean): 1.041x ➖
Parquet (geomean): 1.069x ➖
Shifts: Parquet (control) +6.9% · Median polish +1.0%


datafusion / vortex-file-compressed (1.085x ➖, 0↑ 1↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 63249098 42153637 1.50
fineweb_q01/datafusion:vortex-file-compressed 655230941 516174976 1.27
fineweb_q02/datafusion:vortex-file-compressed 513528654 566770052 0.91
fineweb_q03/datafusion:vortex-file-compressed 1434943440 1388888756 1.03
fineweb_q04/datafusion:vortex-file-compressed 1377472021 1370293553 1.01
fineweb_q05/datafusion:vortex-file-compressed 1367656547 1343875383 1.02
fineweb_q06/datafusion:vortex-file-compressed 1638300250 1466575024 1.12
fineweb_q07/datafusion:vortex-file-compressed 1369264067 1334578432 1.03
fineweb_q08/datafusion:vortex-file-compressed 532650045 534299064 1.00
datafusion / vortex-compact (1.123x ➖, 0↑ 1↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 36263440 37064585 0.98
fineweb_q01/datafusion:vortex-compact 🚨 743695748 556287361 1.34
fineweb_q02/datafusion:vortex-compact 775907229 668326912 1.16
fineweb_q03/datafusion:vortex-compact 1871413266 1875034918 1.00
fineweb_q04/datafusion:vortex-compact 2238749277 2347254122 0.95
fineweb_q05/datafusion:vortex-compact 2062370978 1748786037 1.18
fineweb_q06/datafusion:vortex-compact 2015146443 1596362927 1.26
fineweb_q07/datafusion:vortex-compact 1351551572 1306374414 1.03
fineweb_q08/datafusion:vortex-compact 495766886 388465742 1.28
datafusion / parquet (1.133x ➖, 0↑ 2↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 1744327569 1135673638 1.54
fineweb_q01/datafusion:parquet 🚨 2403863158 1812318191 1.33
fineweb_q02/datafusion:parquet 2161925982 1935192801 1.12
fineweb_q03/datafusion:parquet 1878419386 1794958960 1.05
fineweb_q04/datafusion:parquet 1765399248 1839929075 0.96
fineweb_q05/datafusion:parquet 1974671466 1669499718 1.18
fineweb_q06/datafusion:parquet 1925704858 1797102517 1.07
fineweb_q07/datafusion:parquet 1840242792 1864601697 0.99
fineweb_q08/datafusion:parquet 1963408777 1819929835 1.08
duckdb / vortex-file-compressed (0.954x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 89037952 89300769 1.00
fineweb_q01/duckdb:vortex-file-compressed 673928056 631900868 1.07
fineweb_q02/duckdb:vortex-file-compressed 444218518 616784040 0.72
fineweb_q03/duckdb:vortex-file-compressed 1634402034 1649359249 0.99
fineweb_q04/duckdb:vortex-file-compressed 1528924717 1631797451 0.94
fineweb_q05/duckdb:vortex-file-compressed 1442736497 1501505701 0.96
fineweb_q06/duckdb:vortex-file-compressed 1630742252 1631863243 1.00
fineweb_q07/duckdb:vortex-file-compressed 1440542400 1428813554 1.01
fineweb_q08/duckdb:vortex-file-compressed 630551846 664835505 0.95
duckdb / vortex-compact (1.009x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 79539432 84895647 0.94
fineweb_q01/duckdb:vortex-compact 619349950 574664981 1.08
fineweb_q02/duckdb:vortex-compact 665869707 552826321 1.20
fineweb_q03/duckdb:vortex-compact 1649710593 1779703771 0.93
fineweb_q04/duckdb:vortex-compact 1794593489 1860532139 0.96
fineweb_q05/duckdb:vortex-compact 1566546907 1649003541 0.95
fineweb_q06/duckdb:vortex-compact 1600291341 1599527207 1.00
fineweb_q07/duckdb:vortex-compact 1459670255 1405369076 1.04
fineweb_q08/duckdb:vortex-compact 511257301 507451747 1.01
duckdb / parquet (1.009x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1143357348 1170521637 0.98
fineweb_q01/duckdb:parquet 1387656944 1354152117 1.02
fineweb_q02/duckdb:parquet 1326416051 1401577016 0.95
fineweb_q03/duckdb:parquet 4026442675 3678428964 1.09
fineweb_q04/duckdb:parquet 1869649706 1900536198 0.98
fineweb_q05/duckdb:parquet 2355270032 2255433523 1.04
fineweb_q06/duckdb:parquet 4634217373 4403337186 1.05
fineweb_q07/duckdb:parquet 2659302036 2672081011 1.00
fineweb_q08/duckdb:parquet 1158806448 1192978642 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -2.2% +22.5% -20.1% +196.4% ➖ noise
0 datafusion:vortex-file-compressed +50.0% +22.5% +22.5% +141.5% ➖ noise
0 duckdb:vortex-compact -6.3% +22.5% -23.5% +32.4% ➖ noise
0 duckdb:vortex-file-compressed -0.3% +22.5% -18.6% +42.0% ➖ noise
1 datafusion:vortex-compact +33.7% +16.6% +14.7% +84.9% ➖ noise
1 datafusion:vortex-file-compressed +26.9% +16.6% +8.9% +100.1% ➖ noise
1 duckdb:vortex-compact +7.8% +16.6% -7.6% +45.6% ➖ noise
1 duckdb:vortex-file-compressed +6.7% +16.6% -8.5% +48.3% ➖ noise
2 datafusion:vortex-compact +16.1% +2.8% +12.9% +39.6% ➖ noise
2 datafusion:vortex-file-compressed -9.4% +2.8% -11.9% +30.0% ➖ noise
2 duckdb:vortex-compact +20.4% +2.8% +17.1% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -28.0% +2.8% -30.0% +37.1% ✅ faster
3 datafusion:vortex-compact -0.2% +7.0% -6.7% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +3.3% +7.0% -3.5% +30.0% ➖ noise
3 duckdb:vortex-compact -7.3% +7.0% -13.4% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -0.9% +7.0% -7.4% +30.0% ➖ noise
4 datafusion:vortex-compact -4.6% -2.8% -1.8% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +0.5% -2.8% +3.5% +30.0% ➖ noise
4 duckdb:vortex-compact -3.5% -2.8% -0.7% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -6.3% -2.8% -3.6% +30.0% ➖ noise
5 datafusion:vortex-compact +17.9% +11.1% +6.1% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +1.8% +11.1% -8.4% +30.0% ➖ noise
5 duckdb:vortex-compact -5.0% +11.1% -14.5% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -3.9% +11.1% -13.5% +30.0% ➖ noise
6 datafusion:vortex-compact +26.2% +6.2% +18.9% +45.4% ➖ noise
6 datafusion:vortex-file-compressed +11.7% +6.2% +5.2% +30.0% ➖ noise
6 duckdb:vortex-compact +0.0% +6.2% -5.8% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -0.1% +6.2% -5.9% +30.0% ➖ noise
7 datafusion:vortex-compact +3.5% -0.9% +4.4% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +2.6% -0.9% +3.5% +30.0% ➖ noise
7 duckdb:vortex-compact +3.9% -0.9% +4.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +0.8% -0.9% +1.7% +30.0% ➖ noise
8 datafusion:vortex-compact +27.6% +2.4% +24.7% +65.3% ➖ noise
8 datafusion:vortex-file-compressed -0.3% +2.4% -2.6% +30.0% ➖ noise
8 duckdb:vortex-compact +0.7% +2.4% -1.6% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -5.2% +2.4% -7.4% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Vortex (geomean): 1.001x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.5%


datafusion / vortex-file-compressed (0.987x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 380086080 395172391 0.96
tpch_q02/datafusion:vortex-file-compressed 104745633 106420609 0.98
tpch_q03/datafusion:vortex-file-compressed 206677307 206646711 1.00
tpch_q04/datafusion:vortex-file-compressed 107386066 107044648 1.00
tpch_q05/datafusion:vortex-file-compressed 364011451 363021192 1.00
tpch_q06/datafusion:vortex-file-compressed 42220083 43175155 0.98
tpch_q07/datafusion:vortex-file-compressed 535948475 544187125 0.98
tpch_q08/datafusion:vortex-file-compressed 343924418 349055304 0.99
tpch_q09/datafusion:vortex-file-compressed 625822332 632731008 0.99
tpch_q10/datafusion:vortex-file-compressed 239508118 243058532 0.99
tpch_q11/datafusion:vortex-file-compressed 77793504 78879192 0.99
tpch_q12/datafusion:vortex-file-compressed 114142364 116185929 0.98
tpch_q13/datafusion:vortex-file-compressed 207378606 212807332 0.97
tpch_q14/datafusion:vortex-file-compressed 54136616 55593959 0.97
tpch_q15/datafusion:vortex-file-compressed 101873128 103362520 0.99
tpch_q16/datafusion:vortex-file-compressed 72256839 71306370 1.01
tpch_q17/datafusion:vortex-file-compressed 611659047 619048535 0.99
tpch_q18/datafusion:vortex-file-compressed 814513654 819605255 0.99
tpch_q19/datafusion:vortex-file-compressed 89031002 89822285 0.99
tpch_q20/datafusion:vortex-file-compressed 162536410 164694221 0.99
tpch_q21/datafusion:vortex-file-compressed 652422171 658419117 0.99
tpch_q22/datafusion:vortex-file-compressed 55220797 56877702 0.97
datafusion / vortex-compact (1.022x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 435251509 438948961 0.99
tpch_q02/datafusion:vortex-compact 111173990 114744916 0.97
tpch_q03/datafusion:vortex-compact 212992815 211035487 1.01
tpch_q04/datafusion:vortex-compact 119488072 119250914 1.00
tpch_q05/datafusion:vortex-compact 378045907 368960430 1.02
tpch_q06/datafusion:vortex-compact 64581273 63148813 1.02
tpch_q07/datafusion:vortex-compact 566387987 561356503 1.01
tpch_q08/datafusion:vortex-compact 376091805 351452202 1.07
tpch_q09/datafusion:vortex-compact 676229826 638652354 1.06
tpch_q10/datafusion:vortex-compact 280324017 269273708 1.04
tpch_q11/datafusion:vortex-compact 88677359 82658900 1.07
tpch_q12/datafusion:vortex-compact 169340858 167343217 1.01
tpch_q13/datafusion:vortex-compact 272795675 265468123 1.03
tpch_q14/datafusion:vortex-compact 75995819 72379831 1.05
tpch_q15/datafusion:vortex-compact 164488299 160535892 1.02
tpch_q16/datafusion:vortex-compact 78295376 78672220 1.00
tpch_q17/datafusion:vortex-compact 634102443 617330700 1.03
tpch_q18/datafusion:vortex-compact 827081521 822156078 1.01
tpch_q19/datafusion:vortex-compact 131250946 129342753 1.01
tpch_q20/datafusion:vortex-compact 190598871 192454954 0.99
tpch_q21/datafusion:vortex-compact 697003362 671608570 1.04
tpch_q22/datafusion:vortex-compact 71280852 68859802 1.04
datafusion / parquet (0.995x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 480881263 457648250 1.05
tpch_q02/datafusion:parquet 173918301 172319729 1.01
tpch_q03/datafusion:parquet 286844402 285871580 1.00
tpch_q04/datafusion:parquet 130445892 131429436 0.99
tpch_q05/datafusion:parquet 436123171 437453058 1.00
tpch_q06/datafusion:parquet 127474527 126493116 1.01
tpch_q07/datafusion:parquet 601107776 613181032 0.98
tpch_q08/datafusion:parquet 466627110 465621856 1.00
tpch_q09/datafusion:parquet 735422434 743189329 0.99
tpch_q10/datafusion:parquet 500039143 504861408 0.99
tpch_q11/datafusion:parquet 118566209 123790520 0.96
tpch_q12/datafusion:parquet 209888909 211494284 0.99
tpch_q13/datafusion:parquet 337741508 332221606 1.02
tpch_q14/datafusion:parquet 161690774 161108430 1.00
tpch_q15/datafusion:parquet 250823036 260836720 0.96
tpch_q16/datafusion:parquet 124231469 126344262 0.98
tpch_q17/datafusion:parquet 670720800 681913220 0.98
tpch_q18/datafusion:parquet 857784332 868713461 0.99
tpch_q19/datafusion:parquet 281856401 277217860 1.02
tpch_q20/datafusion:parquet 293632228 296342929 0.99
tpch_q21/datafusion:parquet 690791451 699518887 0.99
tpch_q22/datafusion:parquet 209507071 212969026 0.98
datafusion / arrow (0.995x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 597766929 599878710 1.00
tpch_q02/datafusion:arrow 164937244 160098982 1.03
tpch_q03/datafusion:arrow 463676070 462914981 1.00
tpch_q04/datafusion:arrow 340033606 330948513 1.03
tpch_q05/datafusion:arrow 910424306 896828675 1.02
tpch_q06/datafusion:arrow 275829002 284340806 0.97
tpch_q07/datafusion:arrow 1116646212 1155533693 0.97
tpch_q08/datafusion:arrow 1089079328 1120280185 0.97
tpch_q09/datafusion:arrow 1305749559 1321648859 0.99
tpch_q10/datafusion:arrow 586690455 595875841 0.98
tpch_q11/datafusion:arrow 137096885 134760308 1.02
tpch_q12/datafusion:arrow 770189079 783137329 0.98
tpch_q13/datafusion:arrow 501863535 509070670 0.99
tpch_q14/datafusion:arrow 306185508 308971250 0.99
tpch_q15/datafusion:arrow 664916730 675572175 0.98
tpch_q16/datafusion:arrow 102224496 101803438 1.00
tpch_q17/datafusion:arrow 1291164399 1293827062 1.00
tpch_q18/datafusion:arrow 1857968842 1859427457 1.00
tpch_q19/datafusion:arrow 487489172 488485317 1.00
tpch_q20/datafusion:arrow 475391675 479877855 0.99
tpch_q21/datafusion:arrow 2944278996 2975679444 0.99
tpch_q22/datafusion:arrow 126795518 126436181 1.00
duckdb / vortex-file-compressed (0.999x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 170554250 169259959 1.01
tpch_q02/duckdb:vortex-file-compressed 52592078 51526210 1.02
tpch_q03/duckdb:vortex-file-compressed 125758679 126397785 0.99
tpch_q04/duckdb:vortex-file-compressed 152447022 155513309 0.98
tpch_q05/duckdb:vortex-file-compressed 128159749 127885035 1.00
tpch_q06/duckdb:vortex-file-compressed 47780139 47481854 1.01
tpch_q07/duckdb:vortex-file-compressed 146183090 146337728 1.00
tpch_q08/duckdb:vortex-file-compressed 168153927 169681446 0.99
tpch_q09/duckdb:vortex-file-compressed 319698611 325409079 0.98
tpch_q10/duckdb:vortex-file-compressed 144630600 145083541 1.00
tpch_q11/duckdb:vortex-file-compressed 33086047 32763016 1.01
tpch_q12/duckdb:vortex-file-compressed 94149185 94043452 1.00
tpch_q13/duckdb:vortex-file-compressed 225501877 228806257 0.99
tpch_q14/duckdb:vortex-file-compressed 66798280 65318944 1.02
tpch_q15/duckdb:vortex-file-compressed 85646568 86669509 0.99
tpch_q16/duckdb:vortex-file-compressed 77451823 78839739 0.98
tpch_q17/duckdb:vortex-file-compressed 98283621 99038670 0.99
tpch_q18/duckdb:vortex-file-compressed 290729046 281806761 1.03
tpch_q19/duckdb:vortex-file-compressed 83480386 83829586 1.00
tpch_q20/duckdb:vortex-file-compressed 157370083 158843687 0.99
tpch_q21/duckdb:vortex-file-compressed 570245135 564296619 1.01
tpch_q22/duckdb:vortex-file-compressed 70564136 71411520 0.99
duckdb / vortex-compact (0.996x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 228957445 227540287 1.01
tpch_q02/duckdb:vortex-compact 55578829 56655679 0.98
tpch_q03/duckdb:vortex-compact 137849744 139233753 0.99
tpch_q04/duckdb:vortex-compact 171222210 170679719 1.00
tpch_q05/duckdb:vortex-compact 143706959 143366256 1.00
tpch_q06/duckdb:vortex-compact 82814764 84609150 0.98
tpch_q07/duckdb:vortex-compact 198540776 196538012 1.01
tpch_q08/duckdb:vortex-compact 184170595 184008851 1.00
tpch_q09/duckdb:vortex-compact 349923996 353046479 0.99
tpch_q10/duckdb:vortex-compact 176163792 175661948 1.00
tpch_q11/duckdb:vortex-compact 39717288 40360318 0.98
tpch_q12/duckdb:vortex-compact 202108297 200958767 1.01
tpch_q13/duckdb:vortex-compact 276335147 276366696 1.00
tpch_q14/duckdb:vortex-compact 101131367 100225067 1.01
tpch_q15/duckdb:vortex-compact 110889762 111886659 0.99
tpch_q16/duckdb:vortex-compact 81914050 82753592 0.99
tpch_q17/duckdb:vortex-compact 111891545 113646951 0.98
tpch_q18/duckdb:vortex-compact 288195146 287540165 1.00
tpch_q19/duckdb:vortex-compact 106368778 108122581 0.98
tpch_q20/duckdb:vortex-compact 201127747 204064244 0.99
tpch_q21/duckdb:vortex-compact 609033367 606360826 1.00
tpch_q22/duckdb:vortex-compact 83860550 83916626 1.00
duckdb / parquet (1.000x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 257149460 258933028 0.99
tpch_q02/duckdb:parquet 95494901 93811930 1.02
tpch_q03/duckdb:parquet 212701201 206251783 1.03
tpch_q04/duckdb:parquet 134307013 130529509 1.03
tpch_q05/duckdb:parquet 216900407 214894439 1.01
tpch_q06/duckdb:parquet 66802321 64909514 1.03
tpch_q07/duckdb:parquet 177761206 179471161 0.99
tpch_q08/duckdb:parquet 250405077 253992248 0.99
tpch_q09/duckdb:parquet 482346168 497411898 0.97
tpch_q10/duckdb:parquet 605669907 611335836 0.99
tpch_q11/duckdb:parquet 58007925 58689000 0.99
tpch_q12/duckdb:parquet 124518595 123250240 1.01
tpch_q13/duckdb:parquet 437104919 445981892 0.98
tpch_q14/duckdb:parquet 172929032 177279444 0.98
tpch_q15/duckdb:parquet 95734002 94137148 1.02
tpch_q16/duckdb:parquet 157882078 162594224 0.97
tpch_q17/duckdb:parquet 176240242 177432500 0.99
tpch_q18/duckdb:parquet 353455401 351309114 1.01
tpch_q19/duckdb:parquet 284421966 284134857 1.00
tpch_q20/duckdb:parquet 232595634 230934520 1.01
tpch_q21/duckdb:parquet 553430788 551312592 1.00
tpch_q22/duckdb:parquet 289480554 289586839 1.00
duckdb / duckdb (0.985x ➖, 1↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116172878 117139206 0.99
tpch_q02/duckdb:duckdb 🚀 43185765 48884857 0.88
tpch_q03/duckdb:duckdb 96342902 96490962 1.00
tpch_q04/duckdb:duckdb 129510212 132082786 0.98
tpch_q05/duckdb:duckdb 109158404 108868461 1.00
tpch_q06/duckdb:duckdb 36917028 37195833 0.99
tpch_q07/duckdb:duckdb 86662465 86382655 1.00
tpch_q08/duckdb:duckdb 108900954 110444043 0.99
tpch_q09/duckdb:duckdb 276558932 276798578 1.00
tpch_q10/duckdb:duckdb 202365772 204571418 0.99
tpch_q11/duckdb:duckdb 15652015 15598532 1.00
tpch_q12/duckdb:duckdb 84142367 85070583 0.99
tpch_q13/duckdb:duckdb 219056132 221580475 0.99
tpch_q14/duckdb:duckdb 69600814 70338200 0.99
tpch_q15/duckdb:duckdb 76540755 78490365 0.98
tpch_q16/duckdb:duckdb 72778679 72866138 1.00
tpch_q17/duckdb:duckdb 84466929 84384519 1.00
tpch_q18/duckdb:duckdb 211181140 211359651 1.00
tpch_q19/duckdb:duckdb 115235074 115627369 1.00
tpch_q20/duckdb:duckdb 111082359 112337718 0.99
tpch_q21/duckdb:duckdb 290574259 297134181 0.98
tpch_q22/duckdb:duckdb 66264299 70974088 0.93
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -0.4% +2.2% -2.5% +10.0% ➖ noise
1 datafusion:vortex-compact -0.8% +2.2% -2.9% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -3.8% +2.2% -5.8% +10.0% ➖ noise
1 duckdb:duckdb -0.8% +2.2% -2.9% +10.0% ➖ noise
1 duckdb:vortex-compact +0.6% +2.2% -1.5% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +0.8% +2.2% -1.4% +10.0% ➖ noise
2 datafusion:arrow +3.0% +1.4% +1.6% +10.0% ➖ noise
2 datafusion:vortex-compact -3.1% +1.4% -4.4% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -1.6% +1.4% -2.9% +10.0% ➖ noise
2 duckdb:duckdb -11.7% +1.4% -12.8% +10.0% ✅ faster
2 duckdb:vortex-compact -1.9% +1.4% -3.2% +13.7% ➖ noise
2 duckdb:vortex-file-compressed +2.1% +1.4% +0.7% +10.0% ➖ noise
3 datafusion:arrow +0.2% +1.7% -1.5% +10.0% ➖ noise
3 datafusion:vortex-compact +0.9% +1.7% -0.8% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +0.0% +1.7% -1.7% +10.0% ➖ noise
3 duckdb:duckdb -0.2% +1.7% -1.8% +10.0% ➖ noise
3 duckdb:vortex-compact -1.0% +1.7% -2.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.5% +1.7% -2.2% +10.0% ➖ noise
4 datafusion:arrow +2.7% +1.1% +1.7% +10.0% ➖ noise
4 datafusion:vortex-compact +0.2% +1.1% -0.8% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +0.3% +1.1% -0.7% +10.0% ➖ noise
4 duckdb:duckdb -1.9% +1.1% -3.0% +10.0% ➖ noise
4 duckdb:vortex-compact +0.3% +1.1% -0.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -2.0% +1.1% -3.0% +10.0% ➖ noise
5 datafusion:arrow +1.5% +0.3% +1.2% +10.0% ➖ noise
5 datafusion:vortex-compact +2.5% +0.3% +2.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.3% +0.3% -0.0% +10.0% ➖ noise
5 duckdb:duckdb +0.3% +0.3% -0.0% +10.0% ➖ noise
5 duckdb:vortex-compact +0.2% +0.3% -0.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.2% +0.3% -0.1% +10.0% ➖ noise
6 datafusion:arrow -3.0% +1.8% -4.7% +10.0% ➖ noise
6 datafusion:vortex-compact +2.3% +1.8% +0.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -2.2% +1.8% -4.0% +10.0% ➖ noise
6 duckdb:duckdb -0.7% +1.8% -2.5% +10.7% ➖ noise
6 duckdb:vortex-compact -2.1% +1.8% -3.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.6% +1.8% -1.2% +10.0% ➖ noise
7 datafusion:arrow -3.4% -1.5% -1.9% +10.0% ➖ noise
7 datafusion:vortex-compact +0.9% -1.5% +2.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -1.5% -1.5% -0.1% +10.0% ➖ noise
7 duckdb:duckdb +0.3% -1.5% +1.8% +10.0% ➖ noise
7 duckdb:vortex-compact +1.0% -1.5% +2.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.1% -1.5% +1.4% +10.0% ➖ noise
8 datafusion:arrow -2.8% -0.6% -2.2% +10.0% ➖ noise
8 datafusion:vortex-compact +7.0% -0.6% +7.7% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -1.5% -0.6% -0.9% +10.0% ➖ noise
8 duckdb:duckdb -1.4% -0.6% -0.8% +10.0% ➖ noise
8 duckdb:vortex-compact +0.1% -0.6% +0.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.9% -0.6% -0.3% +10.0% ➖ noise
9 datafusion:arrow -1.2% -2.0% +0.9% +10.0% ➖ noise
9 datafusion:vortex-compact +5.9% -2.0% +8.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -1.1% -2.0% +1.0% +10.0% ➖ noise
9 duckdb:duckdb -0.1% -2.0% +2.0% +10.0% ➖ noise
9 duckdb:vortex-compact -0.9% -2.0% +1.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.8% -2.0% +0.3% +10.0% ➖ noise
10 datafusion:arrow -1.5% -0.9% -0.6% +10.0% ➖ noise
10 datafusion:vortex-compact +4.1% -0.9% +5.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -1.5% -0.9% -0.5% +10.0% ➖ noise
10 duckdb:duckdb -1.1% -0.9% -0.1% +10.0% ➖ noise
10 duckdb:vortex-compact +0.3% -0.9% +1.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.3% -0.9% +0.6% +10.0% ➖ noise
11 datafusion:arrow +1.7% -2.7% +4.6% +10.0% ➖ noise
11 datafusion:vortex-compact +7.3% -2.7% +10.3% +10.0% 🚨 regression
11 datafusion:vortex-file-compressed -1.4% -2.7% +1.4% +10.0% ➖ noise
11 duckdb:duckdb +0.3% -2.7% +3.1% +10.3% ➖ noise
11 duckdb:vortex-compact -1.6% -2.7% +1.1% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +1.0% -2.7% +3.8% +10.8% ➖ noise
12 datafusion:arrow -1.7% +0.1% -1.8% +33.1% ➖ noise
12 datafusion:vortex-compact +1.2% +0.1% +1.1% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -1.8% +0.1% -1.9% +10.0% ➖ noise
12 duckdb:duckdb -1.1% +0.1% -1.2% +10.0% ➖ noise
12 duckdb:vortex-compact +0.6% +0.1% +0.4% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +0.1% +0.1% -0.0% +10.0% ➖ noise
13 datafusion:arrow -1.4% -0.2% -1.2% +10.0% ➖ noise
13 datafusion:vortex-compact +2.8% -0.2% +2.9% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -2.6% -0.2% -2.4% +10.0% ➖ noise
13 duckdb:duckdb -1.1% -0.2% -1.0% +10.0% ➖ noise
13 duckdb:vortex-compact -0.0% -0.2% +0.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -1.4% -0.2% -1.3% +10.0% ➖ noise
14 datafusion:arrow -0.9% -1.1% +0.2% +10.0% ➖ noise
14 datafusion:vortex-compact +5.0% -1.1% +6.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -2.6% -1.1% -1.6% +10.0% ➖ noise
14 duckdb:duckdb -1.0% -1.1% +0.0% +10.0% ➖ noise
14 duckdb:vortex-compact +0.9% -1.1% +2.0% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +2.3% -1.1% +3.4% +10.0% ➖ noise
15 datafusion:arrow -1.6% -1.1% -0.5% +10.0% ➖ noise
15 datafusion:vortex-compact +2.5% -1.1% +3.6% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -1.4% -1.1% -0.3% +10.0% ➖ noise
15 duckdb:duckdb -2.5% -1.1% -1.4% +10.0% ➖ noise
15 duckdb:vortex-compact -0.9% -1.1% +0.2% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -1.2% -1.1% -0.1% +10.0% ➖ noise
16 datafusion:arrow +0.4% -2.3% +2.8% +10.0% ➖ noise
16 datafusion:vortex-compact -0.5% -2.3% +1.9% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.3% -2.3% +3.7% +10.0% ➖ noise
16 duckdb:duckdb -0.1% -2.3% +2.2% +10.0% ➖ noise
16 duckdb:vortex-compact -1.0% -2.3% +1.3% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -1.8% -2.3% +0.5% +10.0% ➖ noise
17 datafusion:arrow -0.2% -1.2% +1.0% +10.0% ➖ noise
17 datafusion:vortex-compact +2.7% -1.2% +3.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -1.2% -1.2% -0.0% +10.0% ➖ noise
17 duckdb:duckdb +0.1% -1.2% +1.3% +10.0% ➖ noise
17 duckdb:vortex-compact -1.5% -1.2% -0.4% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -0.8% -1.2% +0.4% +10.0% ➖ noise
18 datafusion:arrow -0.1% -0.3% +0.3% +10.0% ➖ noise
18 datafusion:vortex-compact +0.6% -0.3% +0.9% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.6% -0.3% -0.3% +10.0% ➖ noise
18 duckdb:duckdb -0.1% -0.3% +0.2% +10.0% ➖ noise
18 duckdb:vortex-compact +0.2% -0.3% +0.6% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +3.2% -0.3% +3.5% +10.0% ➖ noise
19 datafusion:arrow -0.2% +0.9% -1.1% +10.0% ➖ noise
19 datafusion:vortex-compact +1.5% +0.9% +0.6% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -0.9% +0.9% -1.7% +10.0% ➖ noise
19 duckdb:duckdb -0.3% +0.9% -1.2% +10.0% ➖ noise
19 duckdb:vortex-compact -1.6% +0.9% -2.5% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -0.4% +0.9% -1.3% +10.0% ➖ noise
20 datafusion:arrow -0.9% -0.1% -0.8% +10.0% ➖ noise
20 datafusion:vortex-compact -1.0% -0.1% -0.9% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -1.3% -0.1% -1.2% +10.0% ➖ noise
20 duckdb:duckdb -1.1% -0.1% -1.0% +10.0% ➖ noise
20 duckdb:vortex-compact -1.4% -0.1% -1.3% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -0.9% -0.1% -0.8% +10.0% ➖ noise
21 datafusion:arrow -1.1% -0.4% -0.6% +10.0% ➖ noise
21 datafusion:vortex-compact +3.8% -0.4% +4.2% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -0.9% -0.4% -0.5% +10.0% ➖ noise
21 duckdb:duckdb -2.2% -0.4% -1.8% +10.0% ➖ noise
21 duckdb:vortex-compact +0.4% -0.4% +0.9% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +1.1% -0.4% +1.5% +10.0% ➖ noise
22 datafusion:arrow +0.3% -0.8% +1.1% +10.0% ➖ noise
22 datafusion:vortex-compact +3.5% -0.8% +4.4% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -2.9% -0.8% -2.1% +10.0% ➖ noise
22 duckdb:duckdb -6.6% -0.8% -5.9% +10.0% ➖ noise
22 duckdb:vortex-compact -0.1% -0.8% +0.8% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -1.2% -0.8% -0.4% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

File Size Changes (48 files changed, +0.0% overall, 48↑ 0↓)
File Scale Format Base HEAD Change %
region_0.vortex 10.0 vortex-compact 5.82 KB 5.86 KB +32 B +0.5%
region_0.vortex 10.0 vortex-file-compressed 6.13 KB 6.16 KB +32 B +0.5%
nation_0.vortex 10.0 vortex-compact 8.31 KB 8.34 KB +32 B +0.4%
nation_0.vortex 10.0 vortex-file-compressed 10.97 KB 11.00 KB +32 B +0.3%
supplier_0.vortex 10.0 vortex-compact 4.73 MB 4.73 MB +32 B +0.0%
supplier_0.vortex 10.0 vortex-file-compressed 6.69 MB 6.69 MB +32 B +0.0%
part_0.vortex 10.0 vortex-compact 18.11 MB 18.11 MB +32 B +0.0%
part_1.vortex 10.0 vortex-compact 18.11 MB 18.11 MB +32 B +0.0%
part_1.vortex 10.0 vortex-file-compressed 26.99 MB 26.99 MB +32 B +0.0%
part_0.vortex 10.0 vortex-file-compressed 27.02 MB 27.02 MB +32 B +0.0%
customer_0.vortex 10.0 vortex-compact 74.12 MB 74.12 MB +32 B +0.0%
lineitem_9.vortex 10.0 vortex-compact 100.46 MB 100.46 MB +32 B +0.0%
lineitem_11.vortex 10.0 vortex-compact 100.53 MB 100.53 MB +32 B +0.0%
lineitem_4.vortex 10.0 vortex-compact 100.56 MB 100.56 MB +32 B +0.0%
lineitem_7.vortex 10.0 vortex-compact 100.58 MB 100.58 MB +32 B +0.0%
lineitem_2.vortex 10.0 vortex-compact 100.59 MB 100.59 MB +32 B +0.0%
lineitem_8.vortex 10.0 vortex-compact 100.59 MB 100.59 MB +32 B +0.0%
lineitem_0.vortex 10.0 vortex-compact 100.59 MB 100.59 MB +32 B +0.0%
lineitem_3.vortex 10.0 vortex-compact 100.62 MB 100.62 MB +32 B +0.0%
lineitem_10.vortex 10.0 vortex-compact 100.62 MB 100.62 MB +32 B +0.0%
lineitem_12.vortex 10.0 vortex-compact 100.62 MB 100.62 MB +32 B +0.0%
lineitem_1.vortex 10.0 vortex-compact 100.64 MB 100.64 MB +32 B +0.0%
lineitem_6.vortex 10.0 vortex-compact 100.68 MB 100.68 MB +32 B +0.0%
lineitem_5.vortex 10.0 vortex-compact 100.70 MB 100.70 MB +32 B +0.0%
customer_0.vortex 10.0 vortex-file-compressed 104.73 MB 104.73 MB +32 B +0.0%
orders_1.vortex 10.0 vortex-compact 114.76 MB 114.76 MB +32 B +0.0%
orders_2.vortex 10.0 vortex-compact 114.78 MB 114.78 MB +32 B +0.0%
orders_0.vortex 10.0 vortex-compact 114.79 MB 114.79 MB +32 B +0.0%
partsupp_1.vortex 10.0 vortex-compact 126.74 MB 126.74 MB +32 B +0.0%
partsupp_0.vortex 10.0 vortex-compact 126.76 MB 126.76 MB +32 B +0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 133.23 MB 133.23 MB +32 B +0.0%
lineitem_3.vortex 10.0 vortex-file-compressed 133.74 MB 133.74 MB +32 B +0.0%
lineitem_5.vortex 10.0 vortex-file-compressed 133.86 MB 133.86 MB +32 B +0.0%
lineitem_7.vortex 10.0 vortex-file-compressed 134.01 MB 134.01 MB +32 B +0.0%
lineitem_8.vortex 10.0 vortex-file-compressed 134.06 MB 134.06 MB +32 B +0.0%
lineitem_1.vortex 10.0 vortex-file-compressed 134.27 MB 134.27 MB +32 B +0.0%
lineitem_2.vortex 10.0 vortex-file-compressed 134.38 MB 134.38 MB +32 B +0.0%
lineitem_4.vortex 10.0 vortex-file-compressed 134.43 MB 134.43 MB +32 B +0.0%
lineitem_10.vortex 10.0 vortex-file-compressed 134.51 MB 134.51 MB +32 B +0.0%
lineitem_12.vortex 10.0 vortex-file-compressed 134.52 MB 134.52 MB +32 B +0.0%
lineitem_9.vortex 10.0 vortex-file-compressed 134.65 MB 134.65 MB +32 B +0.0%
lineitem_0.vortex 10.0 vortex-file-compressed 134.65 MB 134.65 MB +32 B +0.0%
lineitem_11.vortex 10.0 vortex-file-compressed 134.87 MB 134.87 MB +32 B +0.0%
orders_0.vortex 10.0 vortex-file-compressed 163.92 MB 163.92 MB +32 B +0.0%
orders_2.vortex 10.0 vortex-file-compressed 164.00 MB 164.00 MB +32 B +0.0%
orders_1.vortex 10.0 vortex-file-compressed 164.15 MB 164.15 MB +32 B +0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 180.47 MB 180.47 MB +32 B +0.0%
partsupp_1.vortex 10.0 vortex-file-compressed 180.65 MB 180.65 MB +32 B +0.0%

Totals:

  • vortex-compact: 1.97 GB → 1.97 GB (+0.0%)
  • vortex-file-compressed: 2.70 GB → 2.70 GB (+0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.0%
Vortex (geomean): 1.030x ➖
Parquet (geomean): 1.020x ➖
Shifts: Parquet (control) +2.0% · Median polish +2.1%


duckdb / vortex-file-compressed (1.047x ➖, 0↑ 1↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11876228 11496577 1.03
statpopgen_q01/duckdb:vortex-file-compressed 🚨 27611047 20069328 1.38
statpopgen_q02/duckdb:vortex-file-compressed 1414487720 1385801473 1.02
statpopgen_q03/duckdb:vortex-file-compressed 3196324707 3107478287 1.03
statpopgen_q04/duckdb:vortex-file-compressed 3182760028 3144238586 1.01
statpopgen_q05/duckdb:vortex-file-compressed 1481958934 1451459637 1.02
statpopgen_q06/duckdb:vortex-file-compressed 2156238925 2164200182 1.00
statpopgen_q07/duckdb:vortex-file-compressed 239380774 229344233 1.04
statpopgen_q08/duckdb:vortex-file-compressed 272055781 270769384 1.00
statpopgen_q09/duckdb:vortex-file-compressed 3004570324 2914633659 1.03
statpopgen_q10/duckdb:vortex-file-compressed 4755478128 4746101889 1.00
duckdb / vortex-compact (1.014x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11208272 11250839 1.00
statpopgen_q01/duckdb:vortex-compact 166451278 165297096 1.01
statpopgen_q02/duckdb:vortex-compact 1842307561 1807284266 1.02
statpopgen_q03/duckdb:vortex-compact 3614418736 3457034620 1.05
statpopgen_q04/duckdb:vortex-compact 3538786731 3483738041 1.02
statpopgen_q05/duckdb:vortex-compact 1874831469 1815687533 1.03
statpopgen_q06/duckdb:vortex-compact 2692098229 2682594064 1.00
statpopgen_q07/duckdb:vortex-compact 913204845 900820732 1.01
statpopgen_q08/duckdb:vortex-compact 947245309 936875824 1.01
statpopgen_q09/duckdb:vortex-compact 3319576232 3307421876 1.00
statpopgen_q10/duckdb:vortex-compact 5430371864 5407040717 1.00
duckdb / parquet (1.020x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 333005761 325736109 1.02
statpopgen_q01/duckdb:parquet 419133036 403737965 1.04
statpopgen_q02/duckdb:parquet 1009040327 978805646 1.03
statpopgen_q03/duckdb:parquet 1535338008 1480194489 1.04
statpopgen_q04/duckdb:parquet 1530933982 1499743111 1.02
statpopgen_q05/duckdb:parquet 1019810535 1002747861 1.02
statpopgen_q06/duckdb:parquet 1492201682 1485841566 1.00
statpopgen_q07/duckdb:parquet 1335663624 1306816826 1.02
statpopgen_q08/duckdb:parquet 1341664043 1299736378 1.03
statpopgen_q09/duckdb:parquet 1381232945 1392696409 0.99
statpopgen_q10/duckdb:parquet 2669881612 2650531192 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -0.4% +2.2% -2.6% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +3.3% +2.2% +1.0% +12.7% ➖ noise
1 duckdb:vortex-compact +0.7% +3.8% -3.0% +25.2% ➖ noise
1 duckdb:vortex-file-compressed +37.6% +3.8% +32.5% +200.9% ➖ noise
2 duckdb:vortex-compact +1.9% +3.1% -1.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +2.1% +3.1% -1.0% +10.0% ➖ noise
3 duckdb:vortex-compact +4.6% +3.7% +0.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +2.9% +3.7% -0.8% +10.0% ➖ noise
4 duckdb:vortex-compact +1.6% +2.1% -0.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.2% +2.1% -0.8% +10.0% ➖ noise
5 duckdb:vortex-compact +3.3% +1.7% +1.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.1% +1.7% +0.4% +10.0% ➖ noise
6 duckdb:vortex-compact +0.4% +0.4% -0.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.4% +0.4% -0.8% +10.0% ➖ noise
7 duckdb:vortex-compact +1.4% +2.2% -0.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +4.4% +2.2% +2.1% +10.2% ➖ noise
8 duckdb:vortex-compact +1.1% +3.2% -2.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.5% +3.2% -2.7% +10.0% ➖ noise
9 duckdb:vortex-compact +0.4% -0.8% +1.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +3.1% -0.8% +3.9% +10.0% ➖ noise
10 duckdb:vortex-compact +0.4% +0.7% -0.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.2% +0.7% -0.5% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

File Size Changes (2 files changed, +0.0% overall, 2↑ 0↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 959.35 MB 959.35 MB +32 B +0.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.97 GB 1.97 GB +32 B +0.0%

Totals:

  • vortex-compact: 959.62 MB → 959.62 MB (+0.0%)
  • vortex-file-compressed: 1.97 GB → 1.97 GB (+0.0%)

Signed-off-by: Robert Kruszewski <github@robertk.io>
@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Vortex (geomean): 0.980x ➖
Parquet (geomean): 0.991x ➖
Shifts: Parquet (control) -0.9% · Median polish -1.0%


datafusion / vortex-file-compressed (0.971x ➖, 1↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 49235865 55050434 0.89
tpch_q02/datafusion:vortex-file-compressed 29174635 28627685 1.02
tpch_q03/datafusion:vortex-file-compressed 25565477 26306139 0.97
tpch_q04/datafusion:vortex-file-compressed 18880026 18910057 1.00
tpch_q05/datafusion:vortex-file-compressed 47639159 51773902 0.92
tpch_q06/datafusion:vortex-file-compressed 10562882 10529065 1.00
tpch_q07/datafusion:vortex-file-compressed 59115458 61609666 0.96
tpch_q08/datafusion:vortex-file-compressed 39268791 39771584 0.99
tpch_q09/datafusion:vortex-file-compressed 52820574 54579985 0.97
tpch_q10/datafusion:vortex-file-compressed 41418083 43695669 0.95
tpch_q11/datafusion:vortex-file-compressed 15208714 15186775 1.00
tpch_q12/datafusion:vortex-file-compressed 23566063 24003948 0.98
tpch_q13/datafusion:vortex-file-compressed 25623832 26829004 0.96
tpch_q14/datafusion:vortex-file-compressed 15711986 15541068 1.01
tpch_q15/datafusion:vortex-file-compressed 23551292 23293070 1.01
tpch_q16/datafusion:vortex-file-compressed 21234825 21700276 0.98
tpch_q17/datafusion:vortex-file-compressed 62125511 66727452 0.93
tpch_q18/datafusion:vortex-file-compressed 78056940 81422410 0.96
tpch_q19/datafusion:vortex-file-compressed 22413283 22737042 0.99
tpch_q20/datafusion:vortex-file-compressed 28314419 29302991 0.97
tpch_q21/datafusion:vortex-file-compressed 69527185 72164331 0.96
tpch_q22/datafusion:vortex-file-compressed 13670445 14289201 0.96
datafusion / vortex-compact (0.957x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 57737725 61040124 0.95
tpch_q02/datafusion:vortex-compact 31797268 33588084 0.95
tpch_q03/datafusion:vortex-compact 28622022 30687813 0.93
tpch_q04/datafusion:vortex-compact 22409131 23444971 0.96
tpch_q05/datafusion:vortex-compact 53496162 56336457 0.95
tpch_q06/datafusion:vortex-compact 14012807 14996487 0.93
tpch_q07/datafusion:vortex-compact 65238736 70715797 0.92
tpch_q08/datafusion:vortex-compact 45044924 47675120 0.94
tpch_q09/datafusion:vortex-compact 60120480 61737526 0.97
tpch_q10/datafusion:vortex-compact 48940111 52452718 0.93
tpch_q11/datafusion:vortex-compact 17241335 17639695 0.98
tpch_q12/datafusion:vortex-compact 32686143 34428347 0.95
tpch_q13/datafusion:vortex-compact 35108476 35275873 1.00
tpch_q14/datafusion:vortex-compact 20057307 20982371 0.96
tpch_q15/datafusion:vortex-compact 33192700 33562621 0.99
tpch_q16/datafusion:vortex-compact 25649548 26413306 0.97
tpch_q17/datafusion:vortex-compact 64756337 69162462 0.94
tpch_q18/datafusion:vortex-compact 85369356 87350251 0.98
tpch_q19/datafusion:vortex-compact 32925288 34272552 0.96
tpch_q20/datafusion:vortex-compact 36335817 37315652 0.97
tpch_q21/datafusion:vortex-compact 80853169 84515415 0.96
tpch_q22/datafusion:vortex-compact 14894466 15378011 0.97
datafusion / parquet (1.009x ➖, 0↑ 1↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 131601330 92369616 1.42
tpch_q02/datafusion:parquet 62575496 63677128 0.98
tpch_q03/datafusion:parquet 76575898 74593445 1.03
tpch_q04/datafusion:parquet 45583444 46298092 0.98
tpch_q05/datafusion:parquet 95816391 96892170 0.99
tpch_q06/datafusion:parquet 43175518 42376211 1.02
tpch_q07/datafusion:parquet 106955410 108117861 0.99
tpch_q08/datafusion:parquet 91988475 100554772 0.91
tpch_q09/datafusion:parquet 131502694 132915204 0.99
tpch_q10/datafusion:parquet 112486610 113781352 0.99
tpch_q11/datafusion:parquet 42966808 42438902 1.01
tpch_q12/datafusion:parquet 89917132 88814707 1.01
tpch_q13/datafusion:parquet 192446016 198686471 0.97
tpch_q14/datafusion:parquet 42193881 45068105 0.94
tpch_q15/datafusion:parquet 65008738 61928303 1.05
tpch_q16/datafusion:parquet 46878122 45871043 1.02
tpch_q17/datafusion:parquet 140961080 129543888 1.09
tpch_q18/datafusion:parquet 157268757 167057861 0.94
tpch_q19/datafusion:parquet 86289945 81911098 1.05
tpch_q20/datafusion:parquet 68972305 72105005 0.96
tpch_q21/datafusion:parquet 133760043 139219482 0.96
tpch_q22/datafusion:parquet 31477677 32075541 0.98
datafusion / arrow (1.014x ➖, 0↑ 1↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 52177182 49983632 1.04
tpch_q02/datafusion:arrow 18146629 18829690 0.96
tpch_q03/datafusion:arrow 29824330 29702665 1.00
tpch_q04/datafusion:arrow 25162793 24580182 1.02
tpch_q05/datafusion:arrow 74905911 72777094 1.03
tpch_q06/datafusion:arrow 🚨 21835209 19410798 1.12
tpch_q07/datafusion:arrow 103835370 97263587 1.07
tpch_q08/datafusion:arrow 42256464 39406278 1.07
tpch_q09/datafusion:arrow 59933003 60562570 0.99
tpch_q10/datafusion:arrow 46428477 51090797 0.91
tpch_q11/datafusion:arrow 9037403 8874544 1.02
tpch_q12/datafusion:arrow 53173887 53253982 1.00
tpch_q13/datafusion:arrow 47072001 47066407 1.00
tpch_q14/datafusion:arrow 21530904 21894685 0.98
tpch_q15/datafusion:arrow 42369404 42146728 1.01
tpch_q16/datafusion:arrow 18565987 18661782 0.99
tpch_q17/datafusion:arrow 69849772 66655685 1.05
tpch_q18/datafusion:arrow 135356965 132822595 1.02
tpch_q19/datafusion:arrow 36490514 34266306 1.06
tpch_q20/datafusion:arrow 34183195 34229544 1.00
tpch_q21/datafusion:arrow 148622652 150530493 0.99
tpch_q22/datafusion:arrow 17161767 17546028 0.98
duckdb / vortex-file-compressed (0.994x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31739727 31267788 1.02
tpch_q02/duckdb:vortex-file-compressed 24981558 25414303 0.98
tpch_q03/duckdb:vortex-file-compressed 29955829 30433592 0.98
tpch_q04/duckdb:vortex-file-compressed 30080636 30074257 1.00
tpch_q05/duckdb:vortex-file-compressed 34373567 33857353 1.02
tpch_q06/duckdb:vortex-file-compressed 10488057 10994252 0.95
tpch_q07/duckdb:vortex-file-compressed 37338545 37503443 1.00
tpch_q08/duckdb:vortex-file-compressed 39649459 41466838 0.96
tpch_q09/duckdb:vortex-file-compressed 74114703 79734255 0.93
tpch_q10/duckdb:vortex-file-compressed 35458629 37495194 0.95
tpch_q11/duckdb:vortex-file-compressed 15294318 14796578 1.03
tpch_q12/duckdb:vortex-file-compressed 22596952 21905065 1.03
tpch_q13/duckdb:vortex-file-compressed 35828895 35814451 1.00
tpch_q14/duckdb:vortex-file-compressed 22285496 20851665 1.07
tpch_q15/duckdb:vortex-file-compressed 16580633 16918778 0.98
tpch_q16/duckdb:vortex-file-compressed 29860619 29374589 1.02
tpch_q17/duckdb:vortex-file-compressed 25326569 25686458 0.99
tpch_q18/duckdb:vortex-file-compressed 51601234 51673842 1.00
tpch_q19/duckdb:vortex-file-compressed 30508863 29993946 1.02
tpch_q20/duckdb:vortex-file-compressed 35095270 35682452 0.98
tpch_q21/duckdb:vortex-file-compressed 106982624 108346485 0.99
tpch_q22/duckdb:vortex-file-compressed 17859215 17933460 1.00
duckdb / vortex-compact (0.999x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39003430 39375111 0.99
tpch_q02/duckdb:vortex-compact 35095814 35808903 0.98
tpch_q03/duckdb:vortex-compact 32983834 32760862 1.01
tpch_q04/duckdb:vortex-compact 34808692 35114577 0.99
tpch_q05/duckdb:vortex-compact 38519968 38703064 1.00
tpch_q06/duckdb:vortex-compact 14696080 15617538 0.94
tpch_q07/duckdb:vortex-compact 43874614 42910877 1.02
tpch_q08/duckdb:vortex-compact 45042470 44245566 1.02
tpch_q09/duckdb:vortex-compact 85550983 87588917 0.98
tpch_q10/duckdb:vortex-compact 40543478 40902600 0.99
tpch_q11/duckdb:vortex-compact 19067226 19845128 0.96
tpch_q12/duckdb:vortex-compact 35793082 35502991 1.01
tpch_q13/duckdb:vortex-compact 44038850 45540223 0.97
tpch_q14/duckdb:vortex-compact 30117596 29605587 1.02
tpch_q15/duckdb:vortex-compact 19487760 19166980 1.02
tpch_q16/duckdb:vortex-compact 35882480 35707116 1.00
tpch_q17/duckdb:vortex-compact 31204851 30536894 1.02
tpch_q18/duckdb:vortex-compact 51321257 50830799 1.01
tpch_q19/duckdb:vortex-compact 35437976 33940987 1.04
tpch_q20/duckdb:vortex-compact 43054080 43062891 1.00
tpch_q21/duckdb:vortex-compact 114193548 113698503 1.00
tpch_q22/duckdb:vortex-compact 20771299 20534227 1.01
duckdb / parquet (0.973x ➖, 2↑ 1↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚀 76092041 88460902 0.86
tpch_q02/duckdb:parquet 38927805 39692456 0.98
tpch_q03/duckdb:parquet 69556512 69686206 1.00
tpch_q04/duckdb:parquet 46518755 46216223 1.01
tpch_q05/duckdb:parquet 66440195 66594177 1.00
tpch_q06/duckdb:parquet 20275060 20150867 1.01
tpch_q07/duckdb:parquet 67477959 68877098 0.98
tpch_q08/duckdb:parquet 85694211 93529452 0.92
tpch_q09/duckdb:parquet 133538265 139156423 0.96
tpch_q10/duckdb:parquet 116177207 116785352 0.99
tpch_q11/duckdb:parquet 22482901 22618665 0.99
tpch_q12/duckdb:parquet 🚨 56680427 46083734 1.23
tpch_q13/duckdb:parquet 250098071 260599136 0.96
tpch_q14/duckdb:parquet 48876310 49261425 0.99
tpch_q15/duckdb:parquet 25098170 26583230 0.94
tpch_q16/duckdb:parquet 55507256 57574241 0.96
tpch_q17/duckdb:parquet 52777413 53672485 0.98
tpch_q18/duckdb:parquet 114104190 122963901 0.93
tpch_q19/duckdb:parquet 🚀 65062013 73518585 0.88
tpch_q20/duckdb:parquet 62778516 63798111 0.98
tpch_q21/duckdb:parquet 160069096 177591989 0.90
tpch_q22/duckdb:parquet 51920097 52690366 0.99
duckdb / duckdb (0.992x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16488017 15925484 1.04
tpch_q02/duckdb:duckdb 12605526 12997845 0.97
tpch_q03/duckdb:duckdb 19217530 19816279 0.97
tpch_q04/duckdb:duckdb 19440472 19418328 1.00
tpch_q05/duckdb:duckdb 19357865 20334413 0.95
tpch_q06/duckdb:duckdb 5400723 5403832 1.00
tpch_q07/duckdb:duckdb 22592637 21812049 1.04
tpch_q08/duckdb:duckdb 21031777 21988974 0.96
tpch_q09/duckdb:duckdb 54568012 57250584 0.95
tpch_q10/duckdb:duckdb 45696934 44898400 1.02
tpch_q11/duckdb:duckdb 5968353 6048643 0.99
tpch_q12/duckdb:duckdb 13945978 14329173 0.97
tpch_q13/duckdb:duckdb 39957352 37877549 1.05
tpch_q14/duckdb:duckdb 17350482 17498795 0.99
tpch_q15/duckdb:duckdb 11862503 12509862 0.95
tpch_q16/duckdb:duckdb 23680941 23305491 1.02
tpch_q17/duckdb:duckdb 13747868 13776277 1.00
tpch_q18/duckdb:duckdb 38262830 39228026 0.98
tpch_q19/duckdb:duckdb 27502157 27815356 0.99
tpch_q20/duckdb:duckdb 23052303 22998996 1.00
tpch_q21/duckdb:duckdb 57202614 56272704 1.02
tpch_q22/duckdb:duckdb 24638883 24603476 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +4.4% +10.7% -5.7% +22.5% ➖ noise
1 datafusion:vortex-compact -5.4% +10.7% -14.6% +17.8% ➖ noise
1 datafusion:vortex-file-compressed -10.6% +10.7% -19.2% +18.9% ✅ faster
1 duckdb:duckdb +3.5% +10.7% -6.5% +17.8% ➖ noise
1 duckdb:vortex-compact -0.9% +10.7% -10.5% +17.8% ➖ noise
1 duckdb:vortex-file-compressed +1.5% +10.7% -8.3% +20.6% ➖ noise
2 datafusion:arrow -3.6% -1.8% -1.8% +12.8% ➖ noise
2 datafusion:vortex-compact -5.3% -1.8% -3.6% +12.8% ➖ noise
2 datafusion:vortex-file-compressed +1.9% -1.8% +3.8% +12.8% ➖ noise
2 duckdb:duckdb -3.0% -1.8% -1.2% +12.8% ➖ noise
2 duckdb:vortex-compact -2.0% -1.8% -0.2% +12.8% ➖ noise
2 duckdb:vortex-file-compressed -1.7% -1.8% +0.1% +12.8% ➖ noise
3 datafusion:arrow +0.4% +1.2% -0.8% +12.8% ➖ noise
3 datafusion:vortex-compact -6.7% +1.2% -7.9% +12.8% ➖ noise
3 datafusion:vortex-file-compressed -2.8% +1.2% -4.0% +12.8% ➖ noise
3 duckdb:duckdb -3.0% +1.2% -4.2% +13.0% ➖ noise
3 duckdb:vortex-compact +0.7% +1.2% -0.5% +12.8% ➖ noise
3 duckdb:vortex-file-compressed -1.6% +1.2% -2.8% +13.1% ➖ noise
4 datafusion:arrow +2.4% -0.5% +2.8% +12.8% ➖ noise
4 datafusion:vortex-compact -4.4% -0.5% -4.0% +12.8% ➖ noise
4 datafusion:vortex-file-compressed -0.2% -0.5% +0.3% +12.8% ➖ noise
4 duckdb:duckdb +0.1% -0.5% +0.6% +12.8% ➖ noise
4 duckdb:vortex-compact -0.9% -0.5% -0.4% +12.8% ➖ noise
4 duckdb:vortex-file-compressed +0.0% -0.5% +0.5% +12.8% ➖ noise
5 datafusion:arrow +2.9% -0.7% +3.6% +12.8% ➖ noise
5 datafusion:vortex-compact -5.0% -0.7% -4.4% +12.8% ➖ noise
5 datafusion:vortex-file-compressed -8.0% -0.7% -7.4% +12.8% ➖ noise
5 duckdb:duckdb -4.8% -0.7% -4.2% +12.8% ➖ noise
5 duckdb:vortex-compact -0.5% -0.7% +0.2% +12.8% ➖ noise
5 duckdb:vortex-file-compressed +1.5% -0.7% +2.2% +12.8% ➖ noise
6 datafusion:arrow +12.5% +1.2% +11.1% +17.5% ➖ noise
6 datafusion:vortex-compact -6.6% +1.2% -7.7% +16.6% ➖ noise
6 datafusion:vortex-file-compressed +0.3% +1.2% -0.9% +20.0% ➖ noise
6 duckdb:duckdb -0.1% +1.2% -1.3% +15.3% ➖ noise
6 duckdb:vortex-compact -5.9% +1.2% -7.1% +14.6% ➖ noise
6 duckdb:vortex-file-compressed -4.6% +1.2% -5.8% +14.0% ➖ noise
7 datafusion:arrow +6.8% -1.6% +8.4% +12.8% ➖ noise
7 datafusion:vortex-compact -7.7% -1.6% -6.3% +12.8% ➖ noise
7 datafusion:vortex-file-compressed -4.0% -1.6% -2.5% +12.8% ➖ noise
7 duckdb:duckdb +3.6% -1.6% +5.2% +12.8% ➖ noise
7 duckdb:vortex-compact +2.2% -1.6% +3.9% +12.8% ➖ noise
7 duckdb:vortex-file-compressed -0.4% -1.6% +1.1% +12.8% ➖ noise
8 datafusion:arrow +7.2% -8.4% +17.1% +12.8% 🚨 regression
8 datafusion:vortex-compact -5.5% -8.4% +3.2% +12.8% ➖ noise
8 datafusion:vortex-file-compressed -1.3% -8.4% +7.8% +12.8% ➖ noise
8 duckdb:duckdb -4.4% -8.4% +4.5% +12.8% ➖ noise
8 duckdb:vortex-compact +1.8% -8.4% +11.2% +12.8% ➖ noise
8 duckdb:vortex-file-compressed -4.4% -8.4% +4.4% +12.8% ➖ noise
9 datafusion:arrow -1.0% -2.6% +1.6% +12.8% ➖ noise
9 datafusion:vortex-compact -2.6% -2.6% -0.1% +12.8% ➖ noise
9 datafusion:vortex-file-compressed -3.2% -2.6% -0.7% +12.8% ➖ noise
9 duckdb:duckdb -4.7% -2.6% -2.2% +12.8% ➖ noise
9 duckdb:vortex-compact -2.3% -2.6% +0.2% +12.8% ➖ noise
9 duckdb:vortex-file-compressed -7.0% -2.6% -4.6% +12.8% ➖ noise
10 datafusion:arrow -9.1% -0.8% -8.4% +12.8% ➖ noise
10 datafusion:vortex-compact -6.7% -0.8% -5.9% +12.8% ➖ noise
10 datafusion:vortex-file-compressed -5.2% -0.8% -4.4% +12.8% ➖ noise
10 duckdb:duckdb +1.8% -0.8% +2.6% +12.8% ➖ noise
10 duckdb:vortex-compact -0.9% -0.8% -0.0% +12.8% ➖ noise
10 duckdb:vortex-file-compressed -5.4% -0.8% -4.6% +13.9% ➖ noise
11 datafusion:arrow +1.8% +0.3% +1.5% +12.8% ➖ noise
11 datafusion:vortex-compact -2.3% +0.3% -2.6% +12.8% ➖ noise
11 datafusion:vortex-file-compressed +0.1% +0.3% -0.2% +12.8% ➖ noise
11 duckdb:duckdb -1.3% +0.3% -1.6% +12.8% ➖ noise
11 duckdb:vortex-compact -3.9% +0.3% -4.2% +12.8% ➖ noise
11 duckdb:vortex-file-compressed +3.4% +0.3% +3.0% +12.8% ➖ noise
12 datafusion:arrow -0.2% +11.6% -10.5% +18.9% ➖ noise
12 datafusion:vortex-compact -5.1% +11.6% -14.9% +12.8% ✅ faster
12 datafusion:vortex-file-compressed -1.8% +11.6% -12.0% +12.8% ✅ faster
12 duckdb:duckdb -2.7% +11.6% -12.8% +12.8% ✅ faster
12 duckdb:vortex-compact +0.8% +11.6% -9.7% +12.8% ➖ noise
12 duckdb:vortex-file-compressed +3.2% +11.6% -7.6% +12.8% ➖ noise
13 datafusion:arrow +0.0% -3.6% +3.7% +12.8% ➖ noise
13 datafusion:vortex-compact -0.5% -3.6% +3.2% +12.8% ➖ noise
13 datafusion:vortex-file-compressed -4.5% -3.6% -0.9% +12.8% ➖ noise
13 duckdb:duckdb +5.5% -3.6% +9.4% +12.8% ➖ noise
13 duckdb:vortex-compact -3.3% -3.6% +0.3% +12.8% ➖ noise
13 duckdb:vortex-file-compressed +0.0% -3.6% +3.8% +12.8% ➖ noise
14 datafusion:arrow -1.7% -3.6% +2.0% +12.8% ➖ noise
14 datafusion:vortex-compact -4.4% -3.6% -0.8% +12.8% ➖ noise
14 datafusion:vortex-file-compressed +1.1% -3.6% +4.9% +13.4% ➖ noise
14 duckdb:duckdb -0.8% -3.6% +2.9% +16.3% ➖ noise
14 duckdb:vortex-compact +1.7% -3.6% +5.6% +12.8% ➖ noise
14 duckdb:vortex-file-compressed +6.9% -3.6% +10.9% +12.8% ➖ noise
15 datafusion:arrow +0.5% -0.4% +1.0% +12.8% ➖ noise
15 datafusion:vortex-compact -1.1% -0.4% -0.7% +12.8% ➖ noise
15 datafusion:vortex-file-compressed +1.1% -0.4% +1.6% +12.8% ➖ noise
15 duckdb:duckdb -5.2% -0.4% -4.7% +20.0% ➖ noise
15 duckdb:vortex-compact +1.7% -0.4% +2.1% +12.8% ➖ noise
15 duckdb:vortex-file-compressed -2.0% -0.4% -1.6% +13.4% ➖ noise
16 datafusion:arrow -0.5% -0.7% +0.2% +12.8% ➖ noise
16 datafusion:vortex-compact -2.9% -0.7% -2.2% +12.8% ➖ noise
16 datafusion:vortex-file-compressed -2.1% -0.7% -1.4% +12.8% ➖ noise
16 duckdb:duckdb +1.6% -0.7% +2.4% +12.8% ➖ noise
16 duckdb:vortex-compact +0.5% -0.7% +1.2% +12.8% ➖ noise
16 duckdb:vortex-file-compressed +1.7% -0.7% +2.4% +12.8% ➖ noise
17 datafusion:arrow +4.8% +3.4% +1.3% +12.8% ➖ noise
17 datafusion:vortex-compact -6.4% +3.4% -9.5% +12.8% ➖ noise
17 datafusion:vortex-file-compressed -6.9% +3.4% -10.0% +12.8% ➖ noise
17 duckdb:duckdb -0.2% +3.4% -3.5% +12.8% ➖ noise
17 duckdb:vortex-compact +2.2% +3.4% -1.2% +12.8% ➖ noise
17 duckdb:vortex-file-compressed -1.4% +3.4% -4.7% +12.8% ➖ noise
18 datafusion:arrow +1.9% -6.5% +9.0% +12.8% ➖ noise
18 datafusion:vortex-compact -2.3% -6.5% +4.6% +12.8% ➖ noise
18 datafusion:vortex-file-compressed -4.1% -6.5% +2.6% +12.8% ➖ noise
18 duckdb:duckdb -2.5% -6.5% +4.4% +12.8% ➖ noise
18 duckdb:vortex-compact +1.0% -6.5% +8.0% +12.8% ➖ noise
18 duckdb:vortex-file-compressed -0.1% -6.5% +6.8% +12.8% ➖ noise
19 datafusion:arrow +6.5% -3.4% +10.3% +13.8% ➖ noise
19 datafusion:vortex-compact -3.9% -3.4% -0.5% +14.5% ➖ noise
19 datafusion:vortex-file-compressed -1.4% -3.4% +2.1% +14.4% ➖ noise
19 duckdb:duckdb -1.1% -3.4% +2.4% +16.5% ➖ noise
19 duckdb:vortex-compact +4.4% -3.4% +8.1% +14.6% ➖ noise
19 duckdb:vortex-file-compressed +1.7% -3.4% +5.3% +14.3% ➖ noise
20 datafusion:arrow -0.1% -3.0% +2.9% +12.8% ➖ noise
20 datafusion:vortex-compact -2.6% -3.0% +0.4% +12.8% ➖ noise
20 datafusion:vortex-file-compressed -3.4% -3.0% -0.4% +12.8% ➖ noise
20 duckdb:duckdb +0.2% -3.0% +3.3% +12.8% ➖ noise
20 duckdb:vortex-compact -0.0% -3.0% +3.1% +12.8% ➖ noise
20 duckdb:vortex-file-compressed -1.6% -3.0% +1.4% +12.8% ➖ noise
21 datafusion:arrow -1.3% -6.9% +6.1% +12.8% ➖ noise
21 datafusion:vortex-compact -4.3% -6.9% +2.8% +12.8% ➖ noise
21 datafusion:vortex-file-compressed -3.7% -6.9% +3.5% +12.8% ➖ noise
21 duckdb:duckdb +1.7% -6.9% +9.2% +12.8% ➖ noise
21 duckdb:vortex-compact +0.4% -6.9% +7.9% +12.8% ➖ noise
21 duckdb:vortex-file-compressed -1.3% -6.9% +6.1% +12.8% ➖ noise
22 datafusion:arrow -2.2% -1.7% -0.5% +12.8% ➖ noise
22 datafusion:vortex-compact -3.1% -1.7% -1.5% +12.8% ➖ noise
22 datafusion:vortex-file-compressed -4.3% -1.7% -2.7% +12.8% ➖ noise
22 duckdb:duckdb +0.1% -1.7% +1.8% +12.8% ➖ noise
22 duckdb:vortex-compact +1.2% -1.7% +2.9% +12.8% ➖ noise
22 duckdb:vortex-file-compressed -0.4% -1.7% +1.3% +12.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

File Size Changes (18 files changed, +0.0% overall, 18↑ 0↓)
File Scale Format Base HEAD Change %
region_0.vortex 1.0 vortex-compact 5.82 KB 5.86 KB +32 B +0.5%
region_0.vortex 1.0 vortex-file-compressed 6.13 KB 6.16 KB +32 B +0.5%
nation_0.vortex 1.0 vortex-compact 8.31 KB 8.34 KB +32 B +0.4%
nation_0.vortex 1.0 vortex-file-compressed 10.97 KB 11.00 KB +32 B +0.3%
supplier_0.vortex 1.0 vortex-compact 496.69 KB 496.72 KB +32 B +0.0%
supplier_0.vortex 1.0 vortex-file-compressed 706.31 KB 706.34 KB +32 B +0.0%
part_0.vortex 1.0 vortex-compact 3.64 MB 3.64 MB +32 B +0.0%
part_0.vortex 1.0 vortex-file-compressed 5.44 MB 5.44 MB +32 B +0.0%
customer_0.vortex 1.0 vortex-compact 7.43 MB 7.43 MB +32 B +0.0%
customer_0.vortex 1.0 vortex-file-compressed 10.50 MB 10.50 MB +32 B +0.0%
partsupp_0.vortex 1.0 vortex-compact 25.23 MB 25.23 MB +32 B +0.0%
orders_0.vortex 1.0 vortex-compact 31.73 MB 31.73 MB +32 B +0.0%
partsupp_0.vortex 1.0 vortex-file-compressed 35.94 MB 35.94 MB +32 B +0.0%
orders_0.vortex 1.0 vortex-file-compressed 43.43 MB 43.43 MB +32 B +0.0%
lineitem_0.vortex 1.0 vortex-compact 63.00 MB 63.00 MB +32 B +0.0%
lineitem_1.vortex 1.0 vortex-compact 63.03 MB 63.03 MB +32 B +0.0%
lineitem_1.vortex 1.0 vortex-file-compressed 84.90 MB 84.90 MB +32 B +0.0%
lineitem_0.vortex 1.0 vortex-file-compressed 85.42 MB 85.42 MB +32 B +0.0%

Totals:

  • vortex-compact: 194.82 MB → 194.82 MB (+0.0%)
  • vortex-file-compressed: 266.60 MB → 266.61 MB (+0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.2%
Vortex (geomean): 1.033x ➖
Parquet (geomean): 1.067x ➖
Shifts: Parquet (control) +6.7% · Median polish +5.3%


datafusion / vortex-file-compressed (1.026x ➖, 0↑ 1↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 4784643 4016406 1.19
fineweb_q01/datafusion:vortex-file-compressed 23509861 22255940 1.06
fineweb_q02/datafusion:vortex-file-compressed 21077874 22885896 0.92
fineweb_q03/datafusion:vortex-file-compressed 72522439 77485411 0.94
fineweb_q04/datafusion:vortex-file-compressed 236402391 227466815 1.04
fineweb_q05/datafusion:vortex-file-compressed 218744807 214176261 1.02
fineweb_q06/datafusion:vortex-file-compressed 57094028 53770615 1.06
fineweb_q07/datafusion:vortex-file-compressed 63919257 58667554 1.09
fineweb_q08/datafusion:vortex-file-compressed 21191432 22500367 0.94
datafusion / vortex-compact (1.061x ➖, 0↑ 1↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 4845943 4254563 1.14
fineweb_q01/datafusion:vortex-compact 161480951 159197007 1.01
fineweb_q02/datafusion:vortex-compact 165590500 162276410 1.02
fineweb_q03/datafusion:vortex-compact 1577861076 1470870537 1.07
fineweb_q04/datafusion:vortex-compact 1693694688 1605664090 1.05
fineweb_q05/datafusion:vortex-compact 1334617405 1254630087 1.06
fineweb_q06/datafusion:vortex-compact 738940054 692380170 1.07
fineweb_q07/datafusion:vortex-compact 775468243 731389732 1.06
fineweb_q08/datafusion:vortex-compact 18885051 17873356 1.06
datafusion / parquet (1.050x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6341619 6507168 0.97
fineweb_q01/datafusion:parquet 295217600 287826399 1.03
fineweb_q02/datafusion:parquet 300868459 288870054 1.04
fineweb_q03/datafusion:parquet 305597641 277848990 1.10
fineweb_q04/datafusion:parquet 319384568 294831386 1.08
fineweb_q05/datafusion:parquet 313390265 294013211 1.07
fineweb_q06/datafusion:parquet 304388956 292579710 1.04
fineweb_q07/datafusion:parquet 298307809 283818100 1.05
fineweb_q08/datafusion:parquet 299694647 279401630 1.07
duckdb / vortex-file-compressed (0.997x ➖, 1↑ 1↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 3670694 3128342 1.17
fineweb_q01/duckdb:vortex-file-compressed 24283057 22769230 1.07
fineweb_q02/duckdb:vortex-file-compressed 23927757 23558013 1.02
fineweb_q03/duckdb:vortex-file-compressed 🚀 117649156 160565267 0.73
fineweb_q04/duckdb:vortex-file-compressed 216152098 225317917 0.96
fineweb_q05/duckdb:vortex-file-compressed 214484691 211550023 1.01
fineweb_q06/duckdb:vortex-file-compressed 54614021 51156980 1.07
fineweb_q07/duckdb:vortex-file-compressed 56576407 55584753 1.02
fineweb_q08/duckdb:vortex-file-compressed 23913640 24269353 0.99
duckdb / vortex-compact (1.050x ➖, 0↑ 1↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 4380618 3849799 1.14
fineweb_q01/duckdb:vortex-compact 98824163 100421285 0.98
fineweb_q02/duckdb:vortex-compact 116032198 114128235 1.02
fineweb_q03/duckdb:vortex-compact 890006803 861009511 1.03
fineweb_q04/duckdb:vortex-compact 953050784 901033013 1.06
fineweb_q05/duckdb:vortex-compact 848706045 804596417 1.05
fineweb_q06/duckdb:vortex-compact 474184172 458625927 1.03
fineweb_q07/duckdb:vortex-compact 507575170 480983643 1.06
fineweb_q08/duckdb:vortex-compact 21257525 19665756 1.08
duckdb / parquet (1.085x ➖, 0↑ 2↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚨 30882549 26689104 1.16
fineweb_q01/duckdb:parquet 86771122 81394094 1.07
fineweb_q02/duckdb:parquet 88900667 83222997 1.07
fineweb_q03/duckdb:parquet 330542638 306295031 1.08
fineweb_q04/duckdb:parquet 459487418 440054790 1.04
fineweb_q05/duckdb:parquet 426725106 409317164 1.04
fineweb_q06/duckdb:parquet 208961503 197326725 1.06
fineweb_q07/duckdb:parquet 217951014 206936334 1.05
fineweb_q08/duckdb:parquet 🚨 34277759 28455984 1.20
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +13.9% +6.2% +7.3% +54.2% ➖ noise
0 datafusion:vortex-file-compressed +19.1% +6.2% +12.2% +54.2% ➖ noise
0 duckdb:vortex-compact +13.8% +6.2% +7.2% +51.3% ➖ noise
0 duckdb:vortex-file-compressed +17.3% +6.2% +10.5% +85.2% ➖ noise
1 datafusion:vortex-compact +1.4% +4.6% -3.0% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +5.6% +4.6% +1.0% +24.1% ➖ noise
1 duckdb:vortex-compact -1.6% +4.6% -5.9% +15.7% ➖ noise
1 duckdb:vortex-file-compressed +6.6% +4.6% +2.0% +58.6% ➖ noise
2 datafusion:vortex-compact +2.0% +5.5% -3.3% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -7.9% +5.5% -12.7% +12.3% ✅ faster
2 duckdb:vortex-compact +1.7% +5.5% -3.6% +14.2% ➖ noise
2 duckdb:vortex-file-compressed +1.6% +5.5% -3.7% +10.0% ➖ noise
3 datafusion:vortex-compact +7.3% +8.9% -1.5% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -6.4% +8.9% -14.1% +48.6% ➖ noise
3 duckdb:vortex-compact +3.4% +8.9% -5.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -26.7% +8.9% -32.7% +21.9% ✅ faster
4 datafusion:vortex-compact +5.5% +6.4% -0.8% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +3.9% +6.4% -2.3% +10.0% ➖ noise
4 duckdb:vortex-compact +5.8% +6.4% -0.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -4.1% +6.4% -9.8% +10.0% ✅ faster
5 datafusion:vortex-compact +6.4% +5.4% +0.9% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.1% +5.4% -3.1% +10.0% ➖ noise
5 duckdb:vortex-compact +5.5% +5.4% +0.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.4% +5.4% -3.8% +10.0% ➖ noise
6 datafusion:vortex-compact +6.7% +5.0% +1.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +6.2% +5.0% +1.2% +10.9% ➖ noise
6 duckdb:vortex-compact +3.4% +5.0% -1.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +6.8% +5.0% +1.7% +10.0% ➖ noise
7 datafusion:vortex-compact +6.0% +5.2% +0.8% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +9.0% +5.2% +3.6% +17.9% ➖ noise
7 duckdb:vortex-compact +5.5% +5.2% +0.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.8% +5.2% -3.3% +10.0% ➖ noise
8 datafusion:vortex-compact +5.7% +13.7% -7.0% +14.0% ➖ noise
8 datafusion:vortex-file-compressed -5.8% +13.7% -17.1% +19.0% ✅ faster
8 duckdb:vortex-compact +8.1% +13.7% -4.9% +32.8% ➖ noise
8 duckdb:vortex-file-compressed -1.5% +13.7% -13.3% +48.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

File Size Changes (2 files changed, +0.0% overall, 2↑ 0↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-compact 1.23 GB 1.23 GB +32 B +0.0%
sample.vortex 1.0 vortex-file-compressed 1.79 GB 1.79 GB +32 B +0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (+0.0%)
  • vortex-file-compressed: 1.79 GB → 1.79 GB (+0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Vortex (geomean): 0.936x ➖
Parquet (geomean): 0.943x ➖
Shifts: Parquet (control) -5.7% · Median polish -6.3%


datafusion / vortex-file-compressed (0.933x ➖, 14↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 21215471 22772552 0.93
tpcds_q02/datafusion:vortex-file-compressed 50234302 51140990 0.98
tpcds_q03/datafusion:vortex-file-compressed 16705121 17442840 0.96
tpcds_q04/datafusion:vortex-file-compressed 🚀 258862891 288498425 0.90
tpcds_q05/datafusion:vortex-file-compressed 44395673 48622165 0.91
tpcds_q06/datafusion:vortex-file-compressed 45328299 45672788 0.99
tpcds_q07/datafusion:vortex-file-compressed 45620311 48626469 0.94
tpcds_q08/datafusion:vortex-file-compressed 28867523 31909897 0.90
tpcds_q09/datafusion:vortex-file-compressed 47040536 49232601 0.96
tpcds_q10/datafusion:vortex-file-compressed 35806306 38458111 0.93
tpcds_q11/datafusion:vortex-file-compressed 149746350 164360395 0.91
tpcds_q12/datafusion:vortex-file-compressed 19277008 20469878 0.94
tpcds_q13/datafusion:vortex-file-compressed 50130358 50425791 0.99
tpcds_q14/datafusion:vortex-file-compressed 171460568 185333927 0.93
tpcds_q15/datafusion:vortex-file-compressed 31731154 32053770 0.99
tpcds_q16/datafusion:vortex-file-compressed 24548436 25459557 0.96
tpcds_q17/datafusion:vortex-file-compressed 59117384 63442562 0.93
tpcds_q18/datafusion:vortex-file-compressed 66036811 70106562 0.94
tpcds_q19/datafusion:vortex-file-compressed 26184065 25609388 1.02
tpcds_q20/datafusion:vortex-file-compressed 🚀 22042346 24492383 0.90
tpcds_q21/datafusion:vortex-file-compressed 127514430 140892059 0.91
tpcds_q22/datafusion:vortex-file-compressed 54068318 58031574 0.93
tpcds_q23/datafusion:vortex-file-compressed 130825604 139569557 0.94
tpcds_q24/datafusion:vortex-file-compressed 100116966 111225335 0.90
tpcds_q25/datafusion:vortex-file-compressed 60639773 65551916 0.93
tpcds_q26/datafusion:vortex-file-compressed 32208062 34855945 0.92
tpcds_q27/datafusion:vortex-file-compressed 🚀 105137564 119719376 0.88
tpcds_q28/datafusion:vortex-file-compressed 44182357 45186750 0.98
tpcds_q29/datafusion:vortex-file-compressed 59159542 63666989 0.93
tpcds_q30/datafusion:vortex-file-compressed 24340437 25649050 0.95
tpcds_q31/datafusion:vortex-file-compressed 🚀 80565780 90538213 0.89
tpcds_q32/datafusion:vortex-file-compressed 17889573 19160802 0.93
tpcds_q33/datafusion:vortex-file-compressed 28590081 29621460 0.97
tpcds_q34/datafusion:vortex-file-compressed 26658129 28602275 0.93
tpcds_q35/datafusion:vortex-file-compressed 46641442 46997037 0.99
tpcds_q36/datafusion:vortex-file-compressed 62584918 66303972 0.94
tpcds_q37/datafusion:vortex-file-compressed 🚀 29688706 33634730 0.88
tpcds_q38/datafusion:vortex-file-compressed 43312447 47929278 0.90
tpcds_q39/datafusion:vortex-file-compressed 140151567 142625457 0.98
tpcds_q40/datafusion:vortex-file-compressed 47708749 51264650 0.93
tpcds_q41/datafusion:vortex-file-compressed 16973444 18399008 0.92
tpcds_q42/datafusion:vortex-file-compressed 15088122 15407894 0.98
tpcds_q43/datafusion:vortex-file-compressed 🚀 28776423 32235605 0.89
tpcds_q44/datafusion:vortex-file-compressed 34166484 35939598 0.95
tpcds_q45/datafusion:vortex-file-compressed 29356958 31556297 0.93
tpcds_q46/datafusion:vortex-file-compressed 40672458 43866685 0.93
tpcds_q47/datafusion:vortex-file-compressed 188400607 209117598 0.90
tpcds_q48/datafusion:vortex-file-compressed 39930976 43224696 0.92
tpcds_q49/datafusion:vortex-file-compressed 60442054 65776969 0.92
tpcds_q50/datafusion:vortex-file-compressed 39058413 41033276 0.95
tpcds_q51/datafusion:vortex-file-compressed 82319874 89860997 0.92
tpcds_q52/datafusion:vortex-file-compressed 🚀 15160859 16865315 0.90
tpcds_q53/datafusion:vortex-file-compressed 20247985 22059850 0.92
tpcds_q54/datafusion:vortex-file-compressed 35915603 37193280 0.97
tpcds_q55/datafusion:vortex-file-compressed 🚀 14594881 16638071 0.88
tpcds_q56/datafusion:vortex-file-compressed 30022140 33065870 0.91
tpcds_q57/datafusion:vortex-file-compressed 119405968 124545153 0.96
tpcds_q58/datafusion:vortex-file-compressed 60753878 66045991 0.92
tpcds_q59/datafusion:vortex-file-compressed 63623972 68964797 0.92
tpcds_q60/datafusion:vortex-file-compressed 31423331 33044266 0.95
tpcds_q61/datafusion:vortex-file-compressed 🚀 38727350 43481478 0.89
tpcds_q62/datafusion:vortex-file-compressed 29197080 30383328 0.96
tpcds_q63/datafusion:vortex-file-compressed 20269223 21481805 0.94
tpcds_q64/datafusion:vortex-file-compressed 429238755 451709375 0.95
tpcds_q65/datafusion:vortex-file-compressed 40882592 44341379 0.92
tpcds_q66/datafusion:vortex-file-compressed 🚀 83054798 93253396 0.89
tpcds_q67/datafusion:vortex-file-compressed 110558370 117823370 0.94
tpcds_q68/datafusion:vortex-file-compressed 38828582 41592301 0.93
tpcds_q69/datafusion:vortex-file-compressed 32927022 35663396 0.92
tpcds_q70/datafusion:vortex-file-compressed 104826709 104763954 1.00
tpcds_q71/datafusion:vortex-file-compressed 25985996 27874130 0.93
tpcds_q72/datafusion:vortex-file-compressed 2415388571 2671400296 0.90
tpcds_q73/datafusion:vortex-file-compressed 25734206 27744974 0.93
tpcds_q74/datafusion:vortex-file-compressed 104670092 108271818 0.97
tpcds_q75/datafusion:vortex-file-compressed 102375148 111542545 0.92
tpcds_q76/datafusion:vortex-file-compressed 28054230 30750901 0.91
tpcds_q77/datafusion:vortex-file-compressed 42139518 42052962 1.00
tpcds_q78/datafusion:vortex-file-compressed 116477924 124254563 0.94
tpcds_q79/datafusion:vortex-file-compressed 31879334 33461954 0.95
tpcds_q80/datafusion:vortex-file-compressed 97281972 101068039 0.96
tpcds_q81/datafusion:vortex-file-compressed 🚀 26780402 29940776 0.89
tpcds_q82/datafusion:vortex-file-compressed 🚀 30152545 34706358 0.87
tpcds_q83/datafusion:vortex-file-compressed 39088504 41346922 0.95
tpcds_q84/datafusion:vortex-file-compressed 11990267 13110136 0.91
tpcds_q85/datafusion:vortex-file-compressed 89357822 93740237 0.95
tpcds_q86/datafusion:vortex-file-compressed 16372811 17397088 0.94
tpcds_q87/datafusion:vortex-file-compressed 45932255 50315956 0.91
tpcds_q88/datafusion:vortex-file-compressed 56581486 60840474 0.93
tpcds_q89/datafusion:vortex-file-compressed 32804493 33743295 0.97
tpcds_q90/datafusion:vortex-file-compressed 14501100 14990097 0.97
tpcds_q91/datafusion:vortex-file-compressed 🚀 20967591 23604030 0.89
tpcds_q92/datafusion:vortex-file-compressed 15555241 16927519 0.92
tpcds_q93/datafusion:vortex-file-compressed 🚀 29715731 33187077 0.90
tpcds_q94/datafusion:vortex-file-compressed 20117969 21598000 0.93
tpcds_q95/datafusion:vortex-file-compressed 53622224 55247461 0.97
tpcds_q96/datafusion:vortex-file-compressed 12391153 13392110 0.93
tpcds_q97/datafusion:vortex-file-compressed 26526738 28266096 0.94
tpcds_q98/datafusion:vortex-file-compressed 28495126 30705510 0.93
tpcds_q99/datafusion:vortex-file-compressed 41644046 45970435 0.91
datafusion / vortex-compact (0.932x ➖, 16↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚀 26239700 30315200 0.87
tpcds_q02/datafusion:vortex-compact 55442297 60735544 0.91
tpcds_q03/datafusion:vortex-compact 23590041 25977779 0.91
tpcds_q04/datafusion:vortex-compact 302715893 323194892 0.94
tpcds_q05/datafusion:vortex-compact 55535296 59641903 0.93
tpcds_q06/datafusion:vortex-compact 51239912 56845376 0.90
tpcds_q07/datafusion:vortex-compact 57853838 64260293 0.90
tpcds_q08/datafusion:vortex-compact 39574789 40137315 0.99
tpcds_q09/datafusion:vortex-compact 63373760 66192660 0.96
tpcds_q10/datafusion:vortex-compact 58560204 63156500 0.93
tpcds_q11/datafusion:vortex-compact 🚀 173398699 194629771 0.89
tpcds_q12/datafusion:vortex-compact 🚀 23110489 26651883 0.87
tpcds_q13/datafusion:vortex-compact 118836713 114884008 1.03
tpcds_q14/datafusion:vortex-compact 228851369 253013739 0.90
tpcds_q15/datafusion:vortex-compact 33900332 36333647 0.93
tpcds_q16/datafusion:vortex-compact 34006134 36768885 0.92
tpcds_q17/datafusion:vortex-compact 83621840 92046716 0.91
tpcds_q18/datafusion:vortex-compact 81326035 84834779 0.96
tpcds_q19/datafusion:vortex-compact 38012102 41041247 0.93
tpcds_q20/datafusion:vortex-compact 25365515 28172023 0.90
tpcds_q21/datafusion:vortex-compact 🚀 129193701 147942803 0.87
tpcds_q22/datafusion:vortex-compact 🚀 58931768 65992195 0.89
tpcds_q23/datafusion:vortex-compact 163258324 179217809 0.91
tpcds_q24/datafusion:vortex-compact 128657454 137943290 0.93
tpcds_q25/datafusion:vortex-compact 89940897 94501710 0.95
tpcds_q26/datafusion:vortex-compact 42532895 46398938 0.92
tpcds_q27/datafusion:vortex-compact 🚀 142266496 160618638 0.89
tpcds_q28/datafusion:vortex-compact 84353080 85141561 0.99
tpcds_q29/datafusion:vortex-compact 86683032 93196255 0.93
tpcds_q30/datafusion:vortex-compact 🚀 28250571 31862297 0.89
tpcds_q31/datafusion:vortex-compact 125707916 131905571 0.95
tpcds_q32/datafusion:vortex-compact 23312587 25818436 0.90
tpcds_q33/datafusion:vortex-compact 45498549 49097900 0.93
tpcds_q34/datafusion:vortex-compact 45979638 48236291 0.95
tpcds_q35/datafusion:vortex-compact 64109795 65995125 0.97
tpcds_q36/datafusion:vortex-compact 88844911 96253158 0.92
tpcds_q37/datafusion:vortex-compact 45377314 47791588 0.95
tpcds_q38/datafusion:vortex-compact 65980061 68716257 0.96
tpcds_q39/datafusion:vortex-compact 147993027 144166045 1.03
tpcds_q40/datafusion:vortex-compact 53656286 55421121 0.97
tpcds_q41/datafusion:vortex-compact 🚀 18217425 20918603 0.87
tpcds_q42/datafusion:vortex-compact 21456661 23483323 0.91
tpcds_q43/datafusion:vortex-compact 35316779 36791645 0.96
tpcds_q44/datafusion:vortex-compact 66159183 70053902 0.94
tpcds_q45/datafusion:vortex-compact 34368862 37081012 0.93
tpcds_q46/datafusion:vortex-compact 63739122 68888265 0.93
tpcds_q47/datafusion:vortex-compact 214576701 232581948 0.92
tpcds_q48/datafusion:vortex-compact 86582561 86223542 1.00
tpcds_q49/datafusion:vortex-compact 80326715 84476146 0.95
tpcds_q50/datafusion:vortex-compact 🚀 57259356 64050660 0.89
tpcds_q51/datafusion:vortex-compact 🚀 95341142 107934237 0.88
tpcds_q52/datafusion:vortex-compact 21813108 23433937 0.93
tpcds_q53/datafusion:vortex-compact 33735511 33542842 1.01
tpcds_q54/datafusion:vortex-compact 51538917 55681680 0.93
tpcds_q55/datafusion:vortex-compact 🚀 20472288 23223720 0.88
tpcds_q56/datafusion:vortex-compact 48263107 50967991 0.95
tpcds_q57/datafusion:vortex-compact 133149089 142237527 0.94
tpcds_q58/datafusion:vortex-compact 🚀 71434045 80040838 0.89
tpcds_q59/datafusion:vortex-compact 78437501 82081833 0.96
tpcds_q60/datafusion:vortex-compact 47346217 52225631 0.91
tpcds_q61/datafusion:vortex-compact 65950869 69374544 0.95
tpcds_q62/datafusion:vortex-compact 30879418 33668063 0.92
tpcds_q63/datafusion:vortex-compact 32158161 32824722 0.98
tpcds_q64/datafusion:vortex-compact 499509289 530404341 0.94
tpcds_q65/datafusion:vortex-compact 63548162 66493408 0.96
tpcds_q66/datafusion:vortex-compact 🚀 90153930 101961344 0.88
tpcds_q67/datafusion:vortex-compact 116350384 117654533 0.99
tpcds_q68/datafusion:vortex-compact 63936052 70691588 0.90
tpcds_q69/datafusion:vortex-compact 56660624 58948920 0.96
tpcds_q70/datafusion:vortex-compact 114713469 123461119 0.93
tpcds_q71/datafusion:vortex-compact 42191042 44367293 0.95
tpcds_q72/datafusion:vortex-compact 2433968063 2584948953 0.94
tpcds_q73/datafusion:vortex-compact 44905700 48519866 0.93
tpcds_q74/datafusion:vortex-compact 128132780 130307822 0.98
tpcds_q75/datafusion:vortex-compact 147899276 150874169 0.98
tpcds_q76/datafusion:vortex-compact 44489640 49291386 0.90
tpcds_q77/datafusion:vortex-compact 56645539 61951493 0.91
tpcds_q78/datafusion:vortex-compact 141040199 151353468 0.93
tpcds_q79/datafusion:vortex-compact 55562620 58965029 0.94
tpcds_q80/datafusion:vortex-compact 🚀 117554588 131712627 0.89
tpcds_q81/datafusion:vortex-compact 34624503 37082538 0.93
tpcds_q82/datafusion:vortex-compact 44570810 46932383 0.95
tpcds_q83/datafusion:vortex-compact 45468217 48950369 0.93
tpcds_q84/datafusion:vortex-compact 15348598 16769018 0.92
tpcds_q85/datafusion:vortex-compact 116322913 119240266 0.98
tpcds_q86/datafusion:vortex-compact 20184090 21633088 0.93
tpcds_q87/datafusion:vortex-compact 64569654 70264545 0.92
tpcds_q88/datafusion:vortex-compact 129535507 133041542 0.97
tpcds_q89/datafusion:vortex-compact 🚀 41437446 46242846 0.90
tpcds_q90/datafusion:vortex-compact 20105813 21821911 0.92
tpcds_q91/datafusion:vortex-compact 35616785 36886166 0.97
tpcds_q92/datafusion:vortex-compact 22445318 23989311 0.94
tpcds_q93/datafusion:vortex-compact 41382677 43614814 0.95
tpcds_q94/datafusion:vortex-compact 26557292 28520694 0.93
tpcds_q95/datafusion:vortex-compact 63902310 66128990 0.97
tpcds_q96/datafusion:vortex-compact 23781400 25730899 0.92
tpcds_q97/datafusion:vortex-compact 38108529 40865208 0.93
tpcds_q98/datafusion:vortex-compact 33488212 36608031 0.91
tpcds_q99/datafusion:vortex-compact 🚀 45218111 50925779 0.89
datafusion / parquet (0.931x ➖, 20↑ 1↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 30535002 31620424 0.97
tpcds_q02/datafusion:parquet 41546965 42864233 0.97
tpcds_q03/datafusion:parquet 🚀 13257970 15374217 0.86
tpcds_q04/datafusion:parquet 281136800 284751377 0.99
tpcds_q05/datafusion:parquet 41034273 43898175 0.93
tpcds_q06/datafusion:parquet 59954213 61332599 0.98
tpcds_q07/datafusion:parquet 77518910 84402963 0.92
tpcds_q08/datafusion:parquet 27708362 28014889 0.99
tpcds_q09/datafusion:parquet 45047678 45348099 0.99
tpcds_q10/datafusion:parquet 75749986 77433357 0.98
tpcds_q11/datafusion:parquet 151894747 165667454 0.92
tpcds_q12/datafusion:parquet 18105347 18593380 0.97
tpcds_q13/datafusion:parquet 74583945 78247625 0.95
tpcds_q14/datafusion:parquet 162658319 178285887 0.91
tpcds_q15/datafusion:parquet 20870619 22619112 0.92
tpcds_q16/datafusion:parquet 23954382 26527453 0.90
tpcds_q17/datafusion:parquet 63715808 68598683 0.93
tpcds_q18/datafusion:parquet 113732396 121163378 0.94
tpcds_q19/datafusion:parquet 23958813 23227553 1.03
tpcds_q20/datafusion:parquet 16337556 17586786 0.93
tpcds_q21/datafusion:parquet 18830507 20293407 0.93
tpcds_q22/datafusion:parquet 143614721 153749091 0.93
tpcds_q23/datafusion:parquet 146410123 157586206 0.93
tpcds_q24/datafusion:parquet 90657403 97520927 0.93
tpcds_q25/datafusion:parquet 🚀 64039308 74006582 0.87
tpcds_q26/datafusion:parquet 65439672 71488516 0.92
tpcds_q27/datafusion:parquet 147698346 161240726 0.92
tpcds_q28/datafusion:parquet 45992301 48616472 0.95
tpcds_q29/datafusion:parquet 67053241 69738305 0.96
tpcds_q30/datafusion:parquet 35153333 37505264 0.94
tpcds_q31/datafusion:parquet 🚀 63424896 72652263 0.87
tpcds_q32/datafusion:parquet 18516665 19776999 0.94
tpcds_q33/datafusion:parquet 27319444 28978372 0.94
tpcds_q34/datafusion:parquet 🚀 20757483 23804023 0.87
tpcds_q35/datafusion:parquet 🚀 69982311 77946423 0.90
tpcds_q36/datafusion:parquet 56537842 60674847 0.93
tpcds_q37/datafusion:parquet 19918297 20707608 0.96
tpcds_q38/datafusion:parquet 43098315 45433467 0.95
tpcds_q39/datafusion:parquet 🚀 72165082 86709889 0.83
tpcds_q40/datafusion:parquet 🚀 23598057 28101029 0.84
tpcds_q41/datafusion:parquet 🚀 13321941 15506373 0.86
tpcds_q42/datafusion:parquet 12114192 12759919 0.95
tpcds_q43/datafusion:parquet 🚀 16678744 18547718 0.90
tpcds_q44/datafusion:parquet 🚀 33455757 37952903 0.88
tpcds_q45/datafusion:parquet 🚀 27908135 31432420 0.89
tpcds_q46/datafusion:parquet 🚀 31700289 35489171 0.89
tpcds_q47/datafusion:parquet 🚀 126191151 140699307 0.90
tpcds_q48/datafusion:parquet 70684630 77525135 0.91
tpcds_q49/datafusion:parquet 55333633 61045821 0.91
tpcds_q50/datafusion:parquet 43100860 46307757 0.93
tpcds_q51/datafusion:parquet 85031057 91962908 0.92
tpcds_q52/datafusion:parquet 12444279 13647141 0.91
tpcds_q53/datafusion:parquet 18056326 19245143 0.94
tpcds_q54/datafusion:parquet 34181377 37325892 0.92
tpcds_q55/datafusion:parquet 🚀 11088009 12377101 0.90
tpcds_q56/datafusion:parquet 27765686 30430349 0.91
tpcds_q57/datafusion:parquet 97135408 104323850 0.93
tpcds_q58/datafusion:parquet 50389452 53059181 0.95
tpcds_q59/datafusion:parquet 52233320 57687701 0.91
tpcds_q60/datafusion:parquet 27533432 29480166 0.93
tpcds_q61/datafusion:parquet 🚀 42556671 47803079 0.89
tpcds_q62/datafusion:parquet 🚨 25133891 21221294 1.18
tpcds_q63/datafusion:parquet 18334613 18812298 0.97
tpcds_q64/datafusion:parquet 520220500 554111679 0.94
tpcds_q65/datafusion:parquet 36838631 40302525 0.91
tpcds_q66/datafusion:parquet 66073982 73384401 0.90
tpcds_q67/datafusion:parquet 144171702 153567793 0.94
tpcds_q68/datafusion:parquet 31870012 34023478 0.94
tpcds_q69/datafusion:parquet 69025435 74951965 0.92
tpcds_q70/datafusion:parquet 89301526 86520327 1.03
tpcds_q71/datafusion:parquet 22833957 23940218 0.95
tpcds_q72/datafusion:parquet 608017713 640678405 0.95
tpcds_q73/datafusion:parquet 🚀 21055381 23504644 0.90
tpcds_q74/datafusion:parquet 84631116 88523197 0.96
tpcds_q75/datafusion:parquet 99578591 104161719 0.96
tpcds_q76/datafusion:parquet 30546751 32094526 0.95
tpcds_q77/datafusion:parquet 40032031 41262767 0.97
tpcds_q78/datafusion:parquet 112458516 124191632 0.91
tpcds_q79/datafusion:parquet 26264752 29074041 0.90
tpcds_q80/datafusion:parquet 81979826 86423090 0.95
tpcds_q81/datafusion:parquet 31887560 34932083 0.91
tpcds_q82/datafusion:parquet 19711725 20941401 0.94
tpcds_q83/datafusion:parquet 35879011 39389454 0.91
tpcds_q84/datafusion:parquet 39103415 41394412 0.94
tpcds_q85/datafusion:parquet 149889263 161007659 0.93
tpcds_q86/datafusion:parquet 🚀 15275703 17065554 0.90
tpcds_q87/datafusion:parquet 41467460 45454522 0.91
tpcds_q88/datafusion:parquet 60863133 62549820 0.97
tpcds_q89/datafusion:parquet 21438157 22507393 0.95
tpcds_q90/datafusion:parquet 🚀 14772836 16848598 0.88
tpcds_q91/datafusion:parquet 60811902 64447877 0.94
tpcds_q92/datafusion:parquet 18786213 19497554 0.96
tpcds_q93/datafusion:parquet 🚀 31319943 35094326 0.89
tpcds_q94/datafusion:parquet 21609326 21420302 1.01
tpcds_q95/datafusion:parquet 58286910 60865119 0.96
tpcds_q96/datafusion:parquet 🚀 11630714 13014401 0.89
tpcds_q97/datafusion:parquet 29831269 32707625 0.91
tpcds_q98/datafusion:parquet 21373704 22032811 0.97
tpcds_q99/datafusion:parquet 25795793 27339128 0.94
duckdb / vortex-file-compressed (0.929x ➖, 23↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 22399666 23027755 0.97
tpcds_q02/duckdb:vortex-file-compressed 33775943 35418017 0.95
tpcds_q03/duckdb:vortex-file-compressed 31375775 34090450 0.92
tpcds_q04/duckdb:vortex-file-compressed 101470944 109367108 0.93
tpcds_q05/duckdb:vortex-file-compressed 37130406 38756723 0.96
tpcds_q06/duckdb:vortex-file-compressed 🚀 32889554 37310011 0.88
tpcds_q07/duckdb:vortex-file-compressed 🚀 19430827 24447269 0.79
tpcds_q08/duckdb:vortex-file-compressed 🚀 27579641 31141385 0.89
tpcds_q09/duckdb:vortex-file-compressed 38474645 41265750 0.93
tpcds_q10/duckdb:vortex-file-compressed 🚀 40707408 45709845 0.89
tpcds_q11/duckdb:vortex-file-compressed 61606215 66011624 0.93
tpcds_q12/duckdb:vortex-file-compressed 🚀 14517941 16412745 0.88
tpcds_q13/duckdb:vortex-file-compressed 33490083 34711219 0.96
tpcds_q14/duckdb:vortex-file-compressed 106093287 109340019 0.97
tpcds_q15/duckdb:vortex-file-compressed 27063005 29851064 0.91
tpcds_q16/duckdb:vortex-file-compressed 🚀 26707848 30032787 0.89
tpcds_q17/duckdb:vortex-file-compressed 43021286 46609581 0.92
tpcds_q18/duckdb:vortex-file-compressed 48074912 51534315 0.93
tpcds_q19/duckdb:vortex-file-compressed 33353159 35940680 0.93
tpcds_q20/duckdb:vortex-file-compressed 🚀 15795659 18347782 0.86
tpcds_q21/duckdb:vortex-file-compressed 16961336 18677828 0.91
tpcds_q22/duckdb:vortex-file-compressed 71494482 77742301 0.92
tpcds_q23/duckdb:vortex-file-compressed 113689346 107824540 1.05
tpcds_q24/duckdb:vortex-file-compressed 🚀 49975086 55857858 0.89
tpcds_q25/duckdb:vortex-file-compressed 50180202 54310329 0.92
tpcds_q26/duckdb:vortex-file-compressed 41739817 43382628 0.96
tpcds_q27/duckdb:vortex-file-compressed 49345673 52048192 0.95
tpcds_q28/duckdb:vortex-file-compressed 36056172 38460816 0.94
tpcds_q29/duckdb:vortex-file-compressed 42284035 44789152 0.94
tpcds_q30/duckdb:vortex-file-compressed 25547902 25391220 1.01
tpcds_q31/duckdb:vortex-file-compressed 35446191 39301248 0.90
tpcds_q32/duckdb:vortex-file-compressed 🚀 13983536 16457852 0.85
tpcds_q33/duckdb:vortex-file-compressed 25288943 27131086 0.93
tpcds_q34/duckdb:vortex-file-compressed 24156776 24594821 0.98
tpcds_q35/duckdb:vortex-file-compressed 🚀 63240103 72755830 0.87
tpcds_q36/duckdb:vortex-file-compressed 25033202 26969698 0.93
tpcds_q37/duckdb:vortex-file-compressed 🚀 16212966 18187389 0.89
tpcds_q38/duckdb:vortex-file-compressed 36659678 40050167 0.92
tpcds_q39/duckdb:vortex-file-compressed 35057517 36173639 0.97
tpcds_q40/duckdb:vortex-file-compressed 🚀 19194760 22363853 0.86
tpcds_q41/duckdb:vortex-file-compressed 🚀 13559084 15191452 0.89
tpcds_q42/duckdb:vortex-file-compressed 13479492 14975403 0.90
tpcds_q43/duckdb:vortex-file-compressed 23966074 23521253 1.02
tpcds_q44/duckdb:vortex-file-compressed 21295424 23063617 0.92
tpcds_q45/duckdb:vortex-file-compressed 29898042 32003943 0.93
tpcds_q46/duckdb:vortex-file-compressed 50715523 54489862 0.93
tpcds_q47/duckdb:vortex-file-compressed 🚀 46607326 52163630 0.89
tpcds_q48/duckdb:vortex-file-compressed 31843492 33991469 0.94
tpcds_q49/duckdb:vortex-file-compressed 33984595 36028631 0.94
tpcds_q50/duckdb:vortex-file-compressed 33940314 35912637 0.95
tpcds_q51/duckdb:vortex-file-compressed 101362978 104820683 0.97
tpcds_q52/duckdb:vortex-file-compressed 13402898 14692726 0.91
tpcds_q53/duckdb:vortex-file-compressed 🚀 23123156 27712484 0.83
tpcds_q54/duckdb:vortex-file-compressed 29583040 32287770 0.92
tpcds_q55/duckdb:vortex-file-compressed 13414321 14493525 0.93
tpcds_q56/duckdb:vortex-file-compressed 26264737 26607196 0.99
tpcds_q57/duckdb:vortex-file-compressed 39435161 40846940 0.97
tpcds_q58/duckdb:vortex-file-compressed 30291556 31302939 0.97
tpcds_q59/duckdb:vortex-file-compressed 67902169 68099876 1.00
tpcds_q60/duckdb:vortex-file-compressed 26695353 29539775 0.90
tpcds_q61/duckdb:vortex-file-compressed 36787897 36780651 1.00
tpcds_q62/duckdb:vortex-file-compressed 🚀 17302017 20141927 0.86
tpcds_q63/duckdb:vortex-file-compressed 21444059 23205215 0.92
tpcds_q64/duckdb:vortex-file-compressed 85325901 90877670 0.94
tpcds_q65/duckdb:vortex-file-compressed 22874118 22877018 1.00
tpcds_q66/duckdb:vortex-file-compressed 30054666 32242133 0.93
tpcds_q67/duckdb:vortex-file-compressed 137975540 146868816 0.94
tpcds_q68/duckdb:vortex-file-compressed 41043993 45227119 0.91
tpcds_q69/duckdb:vortex-file-compressed 41918167 45701483 0.92
tpcds_q70/duckdb:vortex-file-compressed 25614403 27525067 0.93
tpcds_q71/duckdb:vortex-file-compressed 🚀 21651449 24273358 0.89
tpcds_q72/duckdb:vortex-file-compressed 170838380 175076393 0.98
tpcds_q73/duckdb:vortex-file-compressed 24751812 25582724 0.97
tpcds_q74/duckdb:vortex-file-compressed 76766047 75190421 1.02
tpcds_q75/duckdb:vortex-file-compressed 59091632 63186241 0.94
tpcds_q76/duckdb:vortex-file-compressed 19288675 19762154 0.98
tpcds_q77/duckdb:vortex-file-compressed 26184564 27547428 0.95
tpcds_q78/duckdb:vortex-file-compressed 78385193 78507877 1.00
tpcds_q79/duckdb:vortex-file-compressed 33582468 35453296 0.95
tpcds_q80/duckdb:vortex-file-compressed 🚀 46820946 53485439 0.88
tpcds_q81/duckdb:vortex-file-compressed 🚀 29393783 33320303 0.88
tpcds_q82/duckdb:vortex-file-compressed 17756059 19372097 0.92
tpcds_q83/duckdb:vortex-file-compressed 25004303 27302537 0.92
tpcds_q84/duckdb:vortex-file-compressed 20277433 21476526 0.94
tpcds_q85/duckdb:vortex-file-compressed 45226175 50097427 0.90
tpcds_q86/duckdb:vortex-file-compressed 17898003 18139467 0.99
tpcds_q87/duckdb:vortex-file-compressed 41655591 43496821 0.96
tpcds_q88/duckdb:vortex-file-compressed 34188711 37503161 0.91
tpcds_q89/duckdb:vortex-file-compressed 🚀 22113763 25752999 0.86
tpcds_q90/duckdb:vortex-file-compressed 12986725 14371232 0.90
tpcds_q91/duckdb:vortex-file-compressed 🚀 31372412 35530473 0.88
tpcds_q92/duckdb:vortex-file-compressed 22944540 23879439 0.96
tpcds_q93/duckdb:vortex-file-compressed 🚀 27834211 31241089 0.89
tpcds_q94/duckdb:vortex-file-compressed 🚀 23337425 26292284 0.89
tpcds_q95/duckdb:vortex-file-compressed 155076481 161076586 0.96
tpcds_q96/duckdb:vortex-file-compressed 13219917 14652537 0.90
tpcds_q97/duckdb:vortex-file-compressed 38595681 38252033 1.01
tpcds_q98/duckdb:vortex-file-compressed 19095462 19395955 0.98
tpcds_q99/duckdb:vortex-file-compressed 27899630 29592804 0.94
duckdb / vortex-compact (0.949x ➖, 12↑ 1↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 23683577 25221513 0.94
tpcds_q02/duckdb:vortex-compact 40408018 40327731 1.00
tpcds_q03/duckdb:vortex-compact 58336830 59878538 0.97
tpcds_q04/duckdb:vortex-compact 120047321 120704278 0.99
tpcds_q05/duckdb:vortex-compact 54850174 54762324 1.00
tpcds_q06/duckdb:vortex-compact 40488333 43880162 0.92
tpcds_q07/duckdb:vortex-compact 33292122 35224807 0.95
tpcds_q08/duckdb:vortex-compact 48123864 49678946 0.97
tpcds_q09/duckdb:vortex-compact 59086219 61447811 0.96
tpcds_q10/duckdb:vortex-compact 63228299 67838444 0.93
tpcds_q11/duckdb:vortex-compact 70810951 75069008 0.94
tpcds_q12/duckdb:vortex-compact 22733809 24856924 0.91
tpcds_q13/duckdb:vortex-compact 60428177 64531230 0.94
tpcds_q14/duckdb:vortex-compact 130361593 141350569 0.92
tpcds_q15/duckdb:vortex-compact 33770263 35065339 0.96
tpcds_q16/duckdb:vortex-compact 32227775 35215329 0.92
tpcds_q17/duckdb:vortex-compact 55151671 59411654 0.93
tpcds_q18/duckdb:vortex-compact 59340707 64384701 0.92
tpcds_q19/duckdb:vortex-compact 53737991 55804984 0.96
tpcds_q20/duckdb:vortex-compact 20941474 22963517 0.91
tpcds_q21/duckdb:vortex-compact 21122644 20648557 1.02
tpcds_q22/duckdb:vortex-compact 76213036 79706585 0.96
tpcds_q23/duckdb:vortex-compact 122046296 129596941 0.94
tpcds_q24/duckdb:vortex-compact 63298435 68930705 0.92
tpcds_q25/duckdb:vortex-compact 80735060 82256189 0.98
tpcds_q26/duckdb:vortex-compact 51747931 55647172 0.93
tpcds_q27/duckdb:vortex-compact 71579409 74167763 0.97
tpcds_q28/duckdb:vortex-compact 88448067 88075498 1.00
tpcds_q29/duckdb:vortex-compact 53497658 56228424 0.95
tpcds_q30/duckdb:vortex-compact 30438520 32470403 0.94
tpcds_q31/duckdb:vortex-compact 47119978 51040717 0.92
tpcds_q32/duckdb:vortex-compact 🚀 22794691 26226672 0.87
tpcds_q33/duckdb:vortex-compact 37764285 37779380 1.00
tpcds_q34/duckdb:vortex-compact 40062796 42279917 0.95
tpcds_q35/duckdb:vortex-compact 82345227 89100006 0.92
tpcds_q36/duckdb:vortex-compact 41667963 43524828 0.96
tpcds_q37/duckdb:vortex-compact 🚀 24581326 27384108 0.90
tpcds_q38/duckdb:vortex-compact 50627688 52554891 0.96
tpcds_q39/duckdb:vortex-compact 36093499 39350309 0.92
tpcds_q40/duckdb:vortex-compact 🚀 25279207 29792213 0.85
tpcds_q41/duckdb:vortex-compact 🚀 15465699 18443224 0.84
tpcds_q42/duckdb:vortex-compact 23169838 23567894 0.98
tpcds_q43/duckdb:vortex-compact 37702267 38502416 0.98
tpcds_q44/duckdb:vortex-compact 31153636 32112769 0.97
tpcds_q45/duckdb:vortex-compact 39320995 42504334 0.93
tpcds_q46/duckdb:vortex-compact 72962485 77213159 0.94
tpcds_q47/duckdb:vortex-compact 63013331 67393845 0.94
tpcds_q48/duckdb:vortex-compact 53724818 53257620 1.01
tpcds_q49/duckdb:vortex-compact 57906397 59982073 0.97
tpcds_q50/duckdb:vortex-compact 48623099 48426293 1.00
tpcds_q51/duckdb:vortex-compact 108237593 110441171 0.98
tpcds_q52/duckdb:vortex-compact 24031948 23433522 1.03
tpcds_q53/duckdb:vortex-compact 39546348 40997241 0.96
tpcds_q54/duckdb:vortex-compact 🚀 40360238 46527762 0.87
tpcds_q55/duckdb:vortex-compact 22371112 24069226 0.93
tpcds_q56/duckdb:vortex-compact 37604815 38359088 0.98
tpcds_q57/duckdb:vortex-compact 🚀 44909141 51971923 0.86
tpcds_q58/duckdb:vortex-compact 🚀 40379950 45171418 0.89
tpcds_q59/duckdb:vortex-compact 88957325 88250425 1.01
tpcds_q60/duckdb:vortex-compact 39678738 42865224 0.93
tpcds_q61/duckdb:vortex-compact 67030618 64885628 1.03
tpcds_q62/duckdb:vortex-compact 26652558 27298771 0.98
tpcds_q63/duckdb:vortex-compact 38148987 38948087 0.98
tpcds_q64/duckdb:vortex-compact 118300361 125149298 0.95
tpcds_q65/duckdb:vortex-compact 33659713 34870903 0.97
tpcds_q66/duckdb:vortex-compact 40990904 43921569 0.93
tpcds_q67/duckdb:vortex-compact 155152949 168209893 0.92
tpcds_q68/duckdb:vortex-compact 🚀 62627448 69744852 0.90
tpcds_q69/duckdb:vortex-compact 63941016 69473008 0.92
tpcds_q70/duckdb:vortex-compact 38775402 40045967 0.97
tpcds_q71/duckdb:vortex-compact 35029615 38502754 0.91
tpcds_q72/duckdb:vortex-compact 193369960 200680048 0.96
tpcds_q73/duckdb:vortex-compact 38863777 42140957 0.92
tpcds_q74/duckdb:vortex-compact 🚨 105695099 88824955 1.19
tpcds_q75/duckdb:vortex-compact 75745058 77282187 0.98
tpcds_q76/duckdb:vortex-compact 36393186 37138543 0.98
tpcds_q77/duckdb:vortex-compact 43676588 45320452 0.96
tpcds_q78/duckdb:vortex-compact 🚀 86987557 99381547 0.88
tpcds_q79/duckdb:vortex-compact 53270017 56954898 0.94
tpcds_q80/duckdb:vortex-compact 86385843 88685905 0.97
tpcds_q81/duckdb:vortex-compact 33092339 36031589 0.92
tpcds_q82/duckdb:vortex-compact 🚀 25444533 28340176 0.90
tpcds_q83/duckdb:vortex-compact 🚀 32297469 36561359 0.88
tpcds_q84/duckdb:vortex-compact 27471427 29982662 0.92
tpcds_q85/duckdb:vortex-compact 58362915 63558580 0.92
tpcds_q86/duckdb:vortex-compact 24840415 25885275 0.96
tpcds_q87/duckdb:vortex-compact 51611505 53769310 0.96
tpcds_q88/duckdb:vortex-compact 42487205 43650524 0.97
tpcds_q89/duckdb:vortex-compact 39119934 41217744 0.95
tpcds_q90/duckdb:vortex-compact 15825438 16674704 0.95
tpcds_q91/duckdb:vortex-compact 51782990 54474579 0.95
tpcds_q92/duckdb:vortex-compact 51524406 54106093 0.95
tpcds_q93/duckdb:vortex-compact 32020647 30770583 1.04
tpcds_q94/duckdb:vortex-compact 32000738 33874527 0.94
tpcds_q95/duckdb:vortex-compact 🚀 149937546 168989427 0.89
tpcds_q96/duckdb:vortex-compact 19286489 19010502 1.01
tpcds_q97/duckdb:vortex-compact 44934242 46295823 0.97
tpcds_q98/duckdb:vortex-compact 29517870 30689100 0.96
tpcds_q99/duckdb:vortex-compact 31421212 33162672 0.95
duckdb / parquet (0.956x ➖, 9↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 27402033 28348598 0.97
tpcds_q02/duckdb:parquet 23004139 22384632 1.03
tpcds_q03/duckdb:parquet 11248498 11867438 0.95
tpcds_q04/duckdb:parquet 167640439 172969994 0.97
tpcds_q05/duckdb:parquet 30454834 33168480 0.92
tpcds_q06/duckdb:parquet 🚀 26503034 29535949 0.90
tpcds_q07/duckdb:parquet 20739302 21815145 0.95
tpcds_q08/duckdb:parquet 26571743 28030908 0.95
tpcds_q09/duckdb:parquet 39131669 40381289 0.97
tpcds_q10/duckdb:parquet 32610104 35093263 0.93
tpcds_q11/duckdb:parquet 84574483 87909605 0.96
tpcds_q12/duckdb:parquet 14665424 15039736 0.98
tpcds_q13/duckdb:parquet 32796162 33230775 0.99
tpcds_q14/duckdb:parquet 98727159 103533353 0.95
tpcds_q15/duckdb:parquet 29473558 32052030 0.92
tpcds_q16/duckdb:parquet 21883199 22458579 0.97
tpcds_q17/duckdb:parquet 36360698 39857885 0.91
tpcds_q18/duckdb:parquet 45499987 47247227 0.96
tpcds_q19/duckdb:parquet 29172935 29576343 0.99
tpcds_q20/duckdb:parquet 15564751 15146036 1.03
tpcds_q21/duckdb:parquet 🚀 9922942 11079009 0.90
tpcds_q22/duckdb:parquet 67469121 70135328 0.96
tpcds_q23/duckdb:parquet 78947081 81505973 0.97
tpcds_q24/duckdb:parquet 45323347 45943950 0.99
tpcds_q25/duckdb:parquet 32083143 33554547 0.96
tpcds_q26/duckdb:parquet 35330549 37293802 0.95
tpcds_q27/duckdb:parquet 48607894 51376959 0.95
tpcds_q28/duckdb:parquet 37178905 39084846 0.95
tpcds_q29/duckdb:parquet 34876151 38476380 0.91
tpcds_q30/duckdb:parquet 34516190 36386505 0.95
tpcds_q31/duckdb:parquet 22953474 24148155 0.95
tpcds_q32/duckdb:parquet 🚀 10507217 11958114 0.88
tpcds_q33/duckdb:parquet 20893515 20904320 1.00
tpcds_q34/duckdb:parquet 19955875 20776417 0.96
tpcds_q35/duckdb:parquet 56353453 58463200 0.96
tpcds_q36/duckdb:parquet 19601745 20299789 0.97
tpcds_q37/duckdb:parquet 12879996 13363964 0.96
tpcds_q38/duckdb:parquet 🚀 33161555 39534855 0.84
tpcds_q39/duckdb:parquet 32271459 29541381 1.09
tpcds_q40/duckdb:parquet 17117089 17810651 0.96
tpcds_q41/duckdb:parquet 7578118 7652131 0.99
tpcds_q42/duckdb:parquet 9542783 10116146 0.94
tpcds_q43/duckdb:parquet 14925466 15994036 0.93
tpcds_q44/duckdb:parquet 22278471 23322796 0.96
tpcds_q45/duckdb:parquet 🚀 24841666 28728983 0.86
tpcds_q46/duckdb:parquet 🚀 43346665 49082251 0.88
tpcds_q47/duckdb:parquet 44540759 46646050 0.95
tpcds_q48/duckdb:parquet 29107472 31599495 0.92
tpcds_q49/duckdb:parquet 24450243 26657211 0.92
tpcds_q50/duckdb:parquet 24186275 26172310 0.92
tpcds_q51/duckdb:parquet 95566696 99004667 0.97
tpcds_q52/duckdb:parquet 10092485 10811929 0.93
tpcds_q53/duckdb:parquet 15545102 15400833 1.01
tpcds_q54/duckdb:parquet 25048783 25850828 0.97
tpcds_q55/duckdb:parquet 10716341 10633985 1.01
tpcds_q56/duckdb:parquet 21232158 21394430 0.99
tpcds_q57/duckdb:parquet 34292253 35522843 0.97
tpcds_q58/duckdb:parquet 22102228 22775645 0.97
tpcds_q59/duckdb:parquet 35449096 35254088 1.01
tpcds_q60/duckdb:parquet 21449858 22659382 0.95
tpcds_q61/duckdb:parquet 29705270 31625899 0.94
tpcds_q62/duckdb:parquet 🚀 11229034 12855776 0.87
tpcds_q63/duckdb:parquet 13789473 14760034 0.93
tpcds_q64/duckdb:parquet 72131845 79904073 0.90
tpcds_q65/duckdb:parquet 20534654 20571176 1.00
tpcds_q66/duckdb:parquet 29996518 31933712 0.94
tpcds_q67/duckdb:parquet 134657939 141849471 0.95
tpcds_q68/duckdb:parquet 36273172 38007194 0.95
tpcds_q69/duckdb:parquet 35939771 36257926 0.99
tpcds_q70/duckdb:parquet 19228525 19935765 0.96
tpcds_q71/duckdb:parquet 🚀 18169515 20231801 0.90
tpcds_q72/duckdb:parquet 164399435 167420376 0.98
tpcds_q73/duckdb:parquet 17452482 18136235 0.96
tpcds_q74/duckdb:parquet 128954806 133451317 0.97
tpcds_q75/duckdb:parquet 53130217 54972257 0.97
tpcds_q76/duckdb:parquet 20503044 20708210 0.99
tpcds_q77/duckdb:parquet 21193433 22678511 0.93
tpcds_q78/duckdb:parquet 71985366 76751538 0.94
tpcds_q79/duckdb:parquet 26785253 28770351 0.93
tpcds_q80/duckdb:parquet 40596562 43620465 0.93
tpcds_q81/duckdb:parquet 30830093 32070429 0.96
tpcds_q82/duckdb:parquet 13780399 13350886 1.03
tpcds_q83/duckdb:parquet 16362637 16704691 0.98
tpcds_q84/duckdb:parquet 18806652 19703524 0.95
tpcds_q85/duckdb:parquet 40058878 38500626 1.04
tpcds_q86/duckdb:parquet 12165606 12177661 1.00
tpcds_q87/duckdb:parquet 35383839 38829709 0.91
tpcds_q88/duckdb:parquet 47775687 49549965 0.96
tpcds_q89/duckdb:parquet 16545978 17004861 0.97
tpcds_q90/duckdb:parquet 🚀 7316061 8284727 0.88
tpcds_q91/duckdb:parquet 22449011 22694269 0.99
tpcds_q92/duckdb:parquet 11492100 12035607 0.95
tpcds_q93/duckdb:parquet 30244972 30286896 1.00
tpcds_q94/duckdb:parquet 16852205 17627631 0.96
tpcds_q95/duckdb:parquet 140581028 134565823 1.04
tpcds_q96/duckdb:parquet 8553730 9051492 0.95
tpcds_q97/duckdb:parquet 34312923 36501039 0.94
tpcds_q98/duckdb:parquet 17199866 17412419 0.99
tpcds_q99/duckdb:parquet 19351114 20525338 0.94
duckdb / duckdb (0.932x ➖, 18↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 🚀 20245413 22602318 0.90
tpcds_q02/duckdb:duckdb 18597355 19583680 0.95
tpcds_q03/duckdb:duckdb 9016325 9722127 0.93
tpcds_q04/duckdb:duckdb 175985560 181149036 0.97
tpcds_q05/duckdb:duckdb 20092357 20021004 1.00
tpcds_q06/duckdb:duckdb 22702025 24760914 0.92
tpcds_q07/duckdb:duckdb 39709723 41921871 0.95
tpcds_q08/duckdb:duckdb 121080642 122180025 0.99
tpcds_q09/duckdb:duckdb 20025177 20769145 0.96
tpcds_q10/duckdb:duckdb 23378228 24889939 0.94
tpcds_q11/duckdb:duckdb 🚀 86126684 98098240 0.88
tpcds_q12/duckdb:duckdb 11404992 11879457 0.96
tpcds_q13/duckdb:duckdb 23693051 25884704 0.92
tpcds_q14/duckdb:duckdb 91159497 95105760 0.96
tpcds_q15/duckdb:duckdb 25013791 26529305 0.94
tpcds_q16/duckdb:duckdb 🚀 16946694 19058913 0.89
tpcds_q17/duckdb:duckdb 21485759 23088331 0.93
tpcds_q18/duckdb:duckdb 45940039 48670402 0.94
tpcds_q19/duckdb:duckdb 🚀 16775028 18671565 0.90
tpcds_q20/duckdb:duckdb 12235777 13143961 0.93
tpcds_q21/duckdb:duckdb 6806985 7066165 0.96
tpcds_q22/duckdb:duckdb 🚀 60606890 70352994 0.86
tpcds_q23/duckdb:duckdb 81186641 74988096 1.08
tpcds_q24/duckdb:duckdb 24733141 25921129 0.95
tpcds_q25/duckdb:duckdb 17027278 18171808 0.94
tpcds_q26/duckdb:duckdb 26784465 29293350 0.91
tpcds_q27/duckdb:duckdb 🚀 36322788 41092359 0.88
tpcds_q28/duckdb:duckdb 22300929 22210940 1.00
tpcds_q29/duckdb:duckdb 🚀 20502759 22932520 0.89
tpcds_q30/duckdb:duckdb 28409888 30694225 0.93
tpcds_q31/duckdb:duckdb 50385052 53510033 0.94
tpcds_q32/duckdb:duckdb 7483086 7797662 0.96
tpcds_q33/duckdb:duckdb 13013476 14414106 0.90
tpcds_q34/duckdb:duckdb 15797518 16703065 0.95
tpcds_q35/duckdb:duckdb 32465878 35464169 0.92
tpcds_q36/duckdb:duckdb 69230300 75298161 0.92
tpcds_q37/duckdb:duckdb 8132895 8460654 0.96
tpcds_q38/duckdb:duckdb 31237344 31883814 0.98
tpcds_q39/duckdb:duckdb 25141692 27401973 0.92
tpcds_q40/duckdb:duckdb 🚀 13131620 15073884 0.87
tpcds_q41/duckdb:duckdb 🚀 8120561 9339495 0.87
tpcds_q42/duckdb:duckdb 6553087 7113621 0.92
tpcds_q43/duckdb:duckdb 11915062 11963642 1.00
tpcds_q44/duckdb:duckdb 13027980 14320171 0.91
tpcds_q45/duckdb:duckdb 17014971 18609896 0.91
tpcds_q46/duckdb:duckdb 37332406 41030444 0.91
tpcds_q47/duckdb:duckdb 40094695 42966497 0.93
tpcds_q48/duckdb:duckdb 23254447 23486614 0.99
tpcds_q49/duckdb:duckdb 🚀 16195266 18010980 0.90
tpcds_q50/duckdb:duckdb 14734805 15527206 0.95
tpcds_q51/duckdb:duckdb 89896976 94529396 0.95
tpcds_q52/duckdb:duckdb 7236150 7898193 0.92
tpcds_q53/duckdb:duckdb 13217732 14396031 0.92
tpcds_q54/duckdb:duckdb 🚀 16023521 18663494 0.86
tpcds_q55/duckdb:duckdb 7213814 7723601 0.93
tpcds_q56/duckdb:duckdb 13380868 14571727 0.92
tpcds_q57/duckdb:duckdb 33792777 33998290 0.99
tpcds_q58/duckdb:duckdb 13212842 13291277 0.99
tpcds_q59/duckdb:duckdb 35116880 37092224 0.95
tpcds_q60/duckdb:duckdb 14899799 15869247 0.94
tpcds_q61/duckdb:duckdb 14885388 15589573 0.95
tpcds_q62/duckdb:duckdb 9809097 10324558 0.95
tpcds_q63/duckdb:duckdb 12210763 13171551 0.93
tpcds_q64/duckdb:duckdb 52630247 58228306 0.90
tpcds_q65/duckdb:duckdb 🚀 31455582 37485727 0.84
tpcds_q66/duckdb:duckdb 25769252 27666347 0.93
tpcds_q67/duckdb:duckdb 129467154 137926766 0.94
tpcds_q68/duckdb:duckdb 25096787 27284236 0.92
tpcds_q69/duckdb:duckdb 24968577 26934481 0.93
tpcds_q70/duckdb:duckdb 14860732 16428684 0.90
tpcds_q71/duckdb:duckdb 12551446 13470671 0.93
tpcds_q72/duckdb:duckdb 42525198 43342507 0.98
tpcds_q73/duckdb:duckdb 11051029 11642084 0.95
tpcds_q74/duckdb:duckdb 141412786 150420965 0.94
tpcds_q75/duckdb:duckdb 42101165 45564342 0.92
tpcds_q76/duckdb:duckdb 🚀 11675071 13917800 0.84
tpcds_q77/duckdb:duckdb 12831300 13048872 0.98
tpcds_q78/duckdb:duckdb 62650609 66998363 0.94
tpcds_q79/duckdb:duckdb 18872088 19835810 0.95
tpcds_q80/duckdb:duckdb 27335917 30307833 0.90
tpcds_q81/duckdb:duckdb 38175878 41258349 0.93
tpcds_q82/duckdb:duckdb 8760705 9102714 0.96
tpcds_q83/duckdb:duckdb 🚀 8988625 10204830 0.88
tpcds_q84/duckdb:duckdb 13989854 14369897 0.97
tpcds_q85/duckdb:duckdb 🚀 22716782 26359545 0.86
tpcds_q86/duckdb:duckdb 11016441 11548327 0.95
tpcds_q87/duckdb:duckdb 33186262 34878095 0.95
tpcds_q88/duckdb:duckdb 25782828 27471001 0.94
tpcds_q89/duckdb:duckdb 14630867 15026334 0.97
tpcds_q90/duckdb:duckdb 5479442 6042329 0.91
tpcds_q91/duckdb:duckdb 🚀 12170764 15097598 0.81
tpcds_q92/duckdb:duckdb 9336945 9838919 0.95
tpcds_q93/duckdb:duckdb 22192751 24608889 0.90
tpcds_q94/duckdb:duckdb 🚀 12481773 13868986 0.90
tpcds_q95/duckdb:duckdb 130786395 119326147 1.10
tpcds_q96/duckdb:duckdb 🚀 4671807 5359925 0.87
tpcds_q97/duckdb:duckdb 30032352 30751564 0.98
tpcds_q98/duckdb:duckdb 13801192 14438542 0.96
tpcds_q99/duckdb:duckdb 16427978 17529793 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -13.4% -3.4% -10.4% +22.0% ➖ noise
1 datafusion:vortex-file-compressed -6.8% -3.4% -3.6% +24.1% ➖ noise
1 duckdb:duckdb -10.4% -3.4% -7.3% +23.5% ➖ noise
1 duckdb:vortex-compact -6.1% -3.4% -2.8% +20.0% ➖ noise
1 duckdb:vortex-file-compressed -2.7% -3.4% +0.7% +34.6% ➖ noise
2 datafusion:vortex-compact -8.7% -0.2% -8.5% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -1.8% -0.2% -1.6% +10.0% ➖ noise
2 duckdb:duckdb -5.0% -0.2% -4.9% +10.6% ➖ noise
2 duckdb:vortex-compact +0.2% -0.2% +0.4% +27.3% ➖ noise
2 duckdb:vortex-file-compressed -4.6% -0.2% -4.4% +18.7% ➖ noise
3 datafusion:vortex-compact -9.2% -9.6% +0.4% +14.7% ➖ noise
3 datafusion:vortex-file-compressed -4.2% -9.6% +5.9% +12.2% ➖ noise
3 duckdb:duckdb -7.3% -9.6% +2.6% +14.6% ➖ noise
3 duckdb:vortex-compact -2.6% -9.6% +7.8% +11.6% ➖ noise
3 duckdb:vortex-file-compressed -8.0% -9.6% +1.8% +10.0% ➖ noise
4 datafusion:vortex-compact -6.3% -2.2% -4.2% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -10.3% -2.2% -8.3% +10.0% ➖ noise
4 duckdb:duckdb -2.9% -2.2% -0.7% +10.0% ➖ noise
4 duckdb:vortex-compact -0.5% -2.2% +1.7% +13.1% ➖ noise
4 duckdb:vortex-file-compressed -7.2% -2.2% -5.2% +10.0% ➖ noise
5 datafusion:vortex-compact -6.9% -7.4% +0.5% +13.8% ➖ noise
5 datafusion:vortex-file-compressed -8.7% -7.4% -1.4% +10.0% ➖ noise
5 duckdb:duckdb +0.4% -7.4% +8.3% +10.4% ➖ noise
5 duckdb:vortex-compact +0.2% -7.4% +8.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -4.2% -7.4% +3.4% +10.0% ➖ noise
6 datafusion:vortex-compact -9.9% -6.3% -3.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -0.8% -6.3% +6.0% +12.7% ➖ noise
6 duckdb:duckdb -8.3% -6.3% -2.1% +10.3% ➖ noise
6 duckdb:vortex-compact -7.7% -6.3% -1.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -11.8% -6.3% -5.9% +10.0% ➖ noise
7 datafusion:vortex-compact -10.0% -6.6% -3.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -6.2% -6.6% +0.4% +10.0% ➖ noise
7 duckdb:duckdb -5.3% -6.6% +1.4% +20.5% ➖ noise
7 duckdb:vortex-compact -5.5% -6.6% +1.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -20.5% -6.6% -14.9% +26.4% ➖ noise
8 datafusion:vortex-compact -1.4% -3.2% +1.8% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -9.5% -3.2% -6.6% +10.0% ➖ noise
8 duckdb:duckdb -0.9% -3.2% +2.3% +10.0% ➖ noise
8 duckdb:vortex-compact -3.1% -3.2% +0.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -11.4% -3.2% -8.5% +10.0% ➖ noise
9 datafusion:vortex-compact -4.3% -1.9% -2.4% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -4.5% -1.9% -2.6% +10.0% ➖ noise
9 duckdb:duckdb -3.6% -1.9% -1.7% +10.0% ➖ noise
9 duckdb:vortex-compact -3.8% -1.9% -2.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -6.8% -1.9% -5.0% +10.7% ➖ noise
10 datafusion:vortex-compact -7.3% -4.7% -2.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -6.9% -4.7% -2.3% +13.2% ➖ noise
10 duckdb:duckdb -6.1% -4.7% -1.5% +10.2% ➖ noise
10 duckdb:vortex-compact -6.8% -4.7% -2.2% +12.5% ➖ noise
10 duckdb:vortex-file-compressed -10.9% -4.7% -6.6% +10.0% ➖ noise
11 datafusion:vortex-compact -10.9% -6.1% -5.1% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -8.9% -6.1% -3.0% +10.0% ➖ noise
11 duckdb:duckdb -12.2% -6.1% -6.5% +12.3% ➖ noise
11 duckdb:vortex-compact -5.7% -6.1% +0.4% +11.0% ➖ noise
11 duckdb:vortex-file-compressed -6.7% -6.1% -0.6% +10.0% ➖ noise
12 datafusion:vortex-compact -13.3% -2.6% -11.0% +10.0% ✅ faster
12 datafusion:vortex-file-compressed -5.8% -2.6% -3.4% +10.0% ➖ noise
12 duckdb:duckdb -4.0% -2.6% -1.5% +10.6% ➖ noise
12 duckdb:vortex-compact -8.5% -2.6% -6.1% +11.4% ➖ noise
12 duckdb:vortex-file-compressed -11.5% -2.6% -9.2% +11.0% ➖ noise
13 datafusion:vortex-compact +3.4% -3.0% +6.7% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -0.6% -3.0% +2.5% +10.0% ➖ noise
13 duckdb:duckdb -8.5% -3.0% -5.6% +10.0% ➖ noise
13 duckdb:vortex-compact -6.4% -3.0% -3.5% +10.7% ➖ noise
13 duckdb:vortex-file-compressed -3.5% -3.0% -0.5% +10.0% ➖ noise
14 datafusion:vortex-compact -9.5% -6.7% -3.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -7.5% -6.7% -0.8% +10.0% ➖ noise
14 duckdb:duckdb -4.1% -6.7% +2.8% +10.0% ➖ noise
14 duckdb:vortex-compact -7.8% -6.7% -1.1% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -3.0% -6.7% +4.0% +10.0% ➖ noise
15 datafusion:vortex-compact -6.7% -7.9% +1.3% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -1.0% -7.9% +7.5% +10.0% ➖ noise
15 duckdb:duckdb -5.7% -7.9% +2.4% +11.3% ➖ noise
15 duckdb:vortex-compact -3.7% -7.9% +4.6% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -9.3% -7.9% -1.6% +10.0% ➖ noise
16 datafusion:vortex-compact -7.5% -6.2% -1.4% +11.5% ➖ noise
16 datafusion:vortex-file-compressed -3.6% -6.2% +2.8% +10.0% ➖ noise
16 duckdb:duckdb -11.1% -6.2% -5.2% +14.3% ➖ noise
16 duckdb:vortex-compact -8.5% -6.2% -2.4% +17.5% ➖ noise
16 duckdb:vortex-file-compressed -11.1% -6.2% -5.2% +21.5% ➖ noise
17 datafusion:vortex-compact -9.2% -7.9% -1.3% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -6.8% -7.9% +1.2% +10.0% ➖ noise
17 duckdb:duckdb -6.9% -7.9% +1.1% +10.7% ➖ noise
17 duckdb:vortex-compact -7.2% -7.9% +0.8% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -7.7% -7.9% +0.3% +10.0% ➖ noise
18 datafusion:vortex-compact -4.1% -4.9% +0.8% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -5.8% -4.9% -0.9% +10.0% ➖ noise
18 duckdb:duckdb -5.6% -4.9% -0.7% +10.0% ➖ noise
18 duckdb:vortex-compact -7.8% -4.9% -3.1% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -6.7% -4.9% -1.9% +11.9% ➖ noise
19 datafusion:vortex-compact -7.4% +0.9% -8.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +2.2% +0.9% +1.4% +10.0% ➖ noise
19 duckdb:duckdb -10.2% +0.9% -10.9% +10.0% ✅ faster
19 duckdb:vortex-compact -3.7% +0.9% -4.5% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -7.2% +0.9% -8.0% +11.3% ➖ noise
20 datafusion:vortex-compact -10.0% -2.3% -7.8% +10.6% ➖ noise
20 datafusion:vortex-file-compressed -10.0% -2.3% -7.9% +10.0% ➖ noise
20 duckdb:duckdb -6.9% -2.3% -4.7% +11.4% ➖ noise
20 duckdb:vortex-compact -8.8% -2.3% -6.7% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -13.9% -2.3% -11.9% +12.6% ✅ faster
21 datafusion:vortex-compact -12.7% -8.8% -4.2% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -9.5% -8.8% -0.7% +11.0% ➖ noise
21 duckdb:duckdb -3.7% -8.8% +5.7% +16.3% ➖ noise
21 duckdb:vortex-compact +2.3% -8.8% +12.2% +17.2% ➖ noise
21 duckdb:vortex-file-compressed -9.2% -8.8% -0.4% +10.0% ➖ noise
22 datafusion:vortex-compact -10.7% -5.2% -5.8% +15.5% ➖ noise
22 datafusion:vortex-file-compressed -6.8% -5.2% -1.7% +18.9% ➖ noise
22 duckdb:duckdb -13.9% -5.2% -9.1% +14.6% ➖ noise
22 duckdb:vortex-compact -4.4% -5.2% +0.9% +13.4% ➖ noise
22 duckdb:vortex-file-compressed -8.0% -5.2% -3.0% +13.1% ➖ noise
23 datafusion:vortex-compact -8.9% -5.1% -4.0% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -6.3% -5.1% -1.2% +10.0% ➖ noise
23 duckdb:duckdb +8.3% -5.1% +14.1% +16.0% ➖ noise
23 duckdb:vortex-compact -5.8% -5.1% -0.7% +11.8% ➖ noise
23 duckdb:vortex-file-compressed +5.4% -5.1% +11.1% +16.0% ➖ noise
24 datafusion:vortex-compact -6.7% -4.2% -2.6% +11.5% ➖ noise
24 datafusion:vortex-file-compressed -10.0% -4.2% -6.0% +13.6% ➖ noise
24 duckdb:duckdb -4.6% -4.2% -0.4% +12.9% ➖ noise
24 duckdb:vortex-compact -8.2% -4.2% -4.1% +14.6% ➖ noise
24 duckdb:vortex-file-compressed -10.5% -4.2% -6.6% +14.6% ➖ noise
25 datafusion:vortex-compact -4.8% -9.0% +4.6% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -7.5% -9.0% +1.7% +10.0% ➖ noise
25 duckdb:duckdb -6.3% -9.0% +3.0% +12.0% ➖ noise
25 duckdb:vortex-compact -1.8% -9.0% +7.9% +11.1% ➖ noise
25 duckdb:vortex-file-compressed -7.6% -9.0% +1.6% +10.0% ➖ noise
26 datafusion:vortex-compact -8.3% -6.9% -1.6% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -7.6% -6.9% -0.8% +10.0% ➖ noise
26 duckdb:duckdb -8.6% -6.9% -1.8% +14.1% ➖ noise
26 duckdb:vortex-compact -7.0% -6.9% -0.1% +10.0% ➖ noise
26 duckdb:vortex-file-compressed -3.8% -6.9% +3.3% +10.8% ➖ noise
27 datafusion:vortex-compact -11.4% -6.9% -4.9% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -12.2% -6.9% -5.7% +11.5% ➖ noise
27 duckdb:duckdb -11.6% -6.9% -5.0% +18.4% ➖ noise
27 duckdb:vortex-compact -3.5% -6.9% +3.7% +10.9% ➖ noise
27 duckdb:vortex-file-compressed -5.2% -6.9% +1.8% +14.1% ➖ noise
28 datafusion:vortex-compact -0.9% -5.1% +4.4% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -2.2% -5.1% +3.1% +10.0% ➖ noise
28 duckdb:duckdb +0.4% -5.1% +5.8% +10.0% ➖ noise
28 duckdb:vortex-compact +0.4% -5.1% +5.9% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -6.3% -5.1% -1.2% +10.0% ➖ noise
29 datafusion:vortex-compact -7.0% -6.6% -0.4% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -7.1% -6.6% -0.5% +10.0% ➖ noise
29 duckdb:duckdb -10.6% -6.6% -4.2% +10.0% ➖ noise
29 duckdb:vortex-compact -4.9% -6.6% +1.9% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -5.6% -6.6% +1.1% +10.0% ➖ noise
30 datafusion:vortex-compact -11.3% -5.7% -6.0% +10.8% ➖ noise
30 datafusion:vortex-file-compressed -5.1% -5.7% +0.6% +13.0% ➖ noise
30 duckdb:duckdb -7.4% -5.7% -1.8% +10.0% ➖ noise
30 duckdb:vortex-compact -6.3% -5.7% -0.6% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +0.6% -5.7% +6.7% +14.5% ➖ noise
31 datafusion:vortex-compact -4.7% -8.9% +4.6% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -11.0% -8.9% -2.3% +10.0% ➖ noise
31 duckdb:duckdb -5.8% -8.9% +3.4% +12.2% ➖ noise
31 duckdb:vortex-compact -7.7% -8.9% +1.3% +12.1% ➖ noise
31 duckdb:vortex-file-compressed -9.8% -8.9% -1.0% +13.7% ➖ noise
32 datafusion:vortex-compact -9.7% -9.3% -0.4% +16.3% ➖ noise
32 datafusion:vortex-file-compressed -6.6% -9.3% +2.9% +10.0% ➖ noise
32 duckdb:duckdb -4.0% -9.3% +5.8% +13.3% ➖ noise
32 duckdb:vortex-compact -13.1% -9.3% -4.2% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -15.0% -9.3% -6.3% +10.2% ➖ noise
33 datafusion:vortex-compact -7.3% -2.9% -4.5% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -3.5% -2.9% -0.6% +10.0% ➖ noise
33 duckdb:duckdb -9.7% -2.9% -7.0% +10.0% ➖ noise
33 duckdb:vortex-compact -0.0% -2.9% +3.0% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -6.8% -2.9% -4.0% +10.0% ➖ noise
34 datafusion:vortex-compact -4.7% -8.5% +4.2% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -6.8% -8.5% +1.8% +10.0% ➖ noise
34 duckdb:duckdb -5.4% -8.5% +3.3% +40.4% ➖ noise
34 duckdb:vortex-compact -5.2% -8.5% +3.5% +15.4% ➖ noise
34 duckdb:vortex-file-compressed -1.8% -8.5% +7.3% +10.0% ➖ noise
35 datafusion:vortex-compact -2.9% -7.0% +4.4% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -0.8% -7.0% +6.7% +12.8% ➖ noise
35 duckdb:duckdb -8.5% -7.0% -1.6% +12.0% ➖ noise
35 duckdb:vortex-compact -7.6% -7.0% -0.7% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -13.1% -7.0% -6.6% +10.9% ➖ noise
36 datafusion:vortex-compact -7.7% -5.1% -2.7% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -5.6% -5.1% -0.5% +10.0% ➖ noise
36 duckdb:duckdb -8.1% -5.1% -3.1% +10.0% ➖ noise
36 duckdb:vortex-compact -4.3% -5.1% +0.9% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -7.2% -5.1% -2.1% +10.0% ➖ noise
37 datafusion:vortex-compact -5.1% -3.7% -1.4% +12.4% ➖ noise
37 datafusion:vortex-file-compressed -11.7% -3.7% -8.3% +10.0% ➖ noise
37 duckdb:duckdb -3.9% -3.7% -0.2% +11.7% ➖ noise
37 duckdb:vortex-compact -10.2% -3.7% -6.8% +13.2% ➖ noise
37 duckdb:vortex-file-compressed -10.9% -3.7% -7.4% +10.0% ➖ noise
38 datafusion:vortex-compact -4.0% -10.8% +7.6% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -9.6% -10.8% +1.3% +10.0% ➖ noise
38 duckdb:duckdb -2.0% -10.8% +9.8% +14.9% ➖ noise
38 duckdb:vortex-compact -3.7% -10.8% +8.0% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -8.5% -10.8% +2.6% +10.0% ➖ noise
39 datafusion:vortex-compact +2.7% -4.6% +7.7% +16.2% ➖ noise
39 datafusion:vortex-file-compressed -1.7% -4.6% +3.1% +15.3% ➖ noise
39 duckdb:duckdb -8.2% -4.6% -3.8% +15.2% ➖ noise
39 duckdb:vortex-compact -8.3% -4.6% -3.8% +14.0% ➖ noise
39 duckdb:vortex-file-compressed -3.1% -4.6% +1.6% +20.8% ➖ noise
40 datafusion:vortex-compact -3.2% -10.2% +7.8% +10.9% ➖ noise
40 datafusion:vortex-file-compressed -6.9% -10.2% +3.6% +10.0% ➖ noise
40 duckdb:duckdb -12.9% -10.2% -3.0% +12.0% ➖ noise
40 duckdb:vortex-compact -15.1% -10.2% -5.5% +17.4% ➖ noise
40 duckdb:vortex-file-compressed -14.2% -10.2% -4.5% +14.8% ➖ noise
41 datafusion:vortex-compact -12.9% -7.8% -5.6% +10.0% ➖ noise
41 datafusion:vortex-file-compressed -7.7% -7.8% +0.0% +10.0% ➖ noise
41 duckdb:duckdb -13.1% -7.8% -5.7% +10.0% ➖ noise
41 duckdb:vortex-compact -16.1% -7.8% -9.1% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -10.7% -7.8% -3.2% +10.0% ➖ noise
42 datafusion:vortex-compact -8.6% -5.4% -3.5% +15.5% ➖ noise
42 datafusion:vortex-file-compressed -2.1% -5.4% +3.5% +10.0% ➖ noise
42 duckdb:duckdb -7.9% -5.4% -2.7% +13.4% ➖ noise
42 duckdb:vortex-compact -1.7% -5.4% +3.9% +10.4% ➖ noise
42 duckdb:vortex-file-compressed -10.0% -5.4% -4.9% +13.3% ➖ noise
43 datafusion:vortex-compact -4.0% -8.4% +4.8% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -10.7% -8.4% -2.6% +17.6% ➖ noise
43 duckdb:duckdb -0.4% -8.4% +8.7% +13.5% ➖ noise
43 duckdb:vortex-compact -2.1% -8.4% +6.9% +10.0% ➖ noise
43 duckdb:vortex-file-compressed +1.9% -8.4% +11.2% +11.0% 🚨 regression
44 datafusion:vortex-compact -5.6% -8.2% +2.9% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -4.9% -8.2% +3.6% +10.0% ➖ noise
44 duckdb:duckdb -9.0% -8.2% -0.9% +10.9% ➖ noise
44 duckdb:vortex-compact -3.0% -8.2% +5.7% +10.3% ➖ noise
44 duckdb:vortex-file-compressed -7.7% -8.2% +0.6% +11.9% ➖ noise
45 datafusion:vortex-compact -7.3% -12.4% +5.8% +10.4% ➖ noise
45 datafusion:vortex-file-compressed -7.0% -12.4% +6.2% +10.0% ➖ noise
45 duckdb:duckdb -8.6% -12.4% +4.3% +11.8% ➖ noise
45 duckdb:vortex-compact -7.5% -12.4% +5.6% +10.0% ➖ noise
45 duckdb:vortex-file-compressed -6.6% -12.4% +6.6% +10.0% ➖ noise
46 datafusion:vortex-compact -7.5% -11.2% +4.2% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -7.3% -11.2% +4.4% +10.0% ➖ noise
46 duckdb:duckdb -9.0% -11.2% +2.4% +11.9% ➖ noise
46 duckdb:vortex-compact -5.5% -11.2% +6.4% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -6.9% -11.2% +4.8% +10.0% ➖ noise
47 datafusion:vortex-compact -7.7% -7.5% -0.3% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -9.9% -7.5% -2.6% +10.0% ➖ noise
47 duckdb:duckdb -6.7% -7.5% +0.8% +10.0% ➖ noise
47 duckdb:vortex-compact -6.5% -7.5% +1.0% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -10.7% -7.5% -3.5% +10.0% ➖ noise
48 datafusion:vortex-compact +0.4% -8.4% +9.6% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -7.6% -8.4% +0.8% +10.0% ➖ noise
48 duckdb:duckdb -1.0% -8.4% +8.0% +10.0% ➖ noise
48 duckdb:vortex-compact +0.9% -8.4% +10.1% +10.0% 🚨 regression
48 duckdb:vortex-file-compressed -6.3% -8.4% +2.2% +13.4% ➖ noise
49 datafusion:vortex-compact -4.9% -8.8% +4.3% +10.0% ➖ noise
49 datafusion:vortex-file-compressed -8.1% -8.8% +0.8% +11.5% ➖ noise
49 duckdb:duckdb -10.1% -8.8% -1.4% +10.6% ➖ noise
49 duckdb:vortex-compact -3.5% -8.8% +5.9% +11.3% ➖ noise
49 duckdb:vortex-file-compressed -5.7% -8.8% +3.5% +12.2% ➖ noise
50 datafusion:vortex-compact -10.6% -7.3% -3.6% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -4.8% -7.3% +2.6% +10.0% ➖ noise
50 duckdb:duckdb -5.1% -7.3% +2.3% +10.0% ➖ noise
50 duckdb:vortex-compact +0.4% -7.3% +8.3% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -5.5% -7.3% +1.9% +10.0% ➖ noise
51 datafusion:vortex-compact -11.7% -5.5% -6.5% +10.0% ➖ noise
51 datafusion:vortex-file-compressed -8.4% -5.5% -3.0% +10.0% ➖ noise
51 duckdb:duckdb -4.9% -5.5% +0.7% +13.8% ➖ noise
51 duckdb:vortex-compact -2.0% -5.5% +3.7% +18.5% ➖ noise
51 duckdb:vortex-file-compressed -3.3% -5.5% +2.4% +14.6% ➖ noise
52 datafusion:vortex-compact -6.9% -7.7% +0.9% +10.0% ➖ noise
52 datafusion:vortex-file-compressed -10.1% -7.7% -2.6% +18.3% ➖ noise
52 duckdb:duckdb -8.4% -7.7% -0.7% +15.8% ➖ noise
52 duckdb:vortex-compact +2.6% -7.7% +11.2% +15.1% ➖ noise
52 duckdb:vortex-file-compressed -8.8% -7.7% -1.1% +12.6% ➖ noise
53 datafusion:vortex-compact +0.6% -2.7% +3.3% +14.0% ➖ noise
53 datafusion:vortex-file-compressed -8.2% -2.7% -5.7% +10.0% ➖ noise
53 duckdb:duckdb -8.2% -2.7% -5.7% +13.3% ➖ noise
53 duckdb:vortex-compact -3.5% -2.7% -0.9% +10.4% ➖ noise
53 duckdb:vortex-file-compressed -16.6% -2.7% -14.3% +20.1% ➖ noise
54 datafusion:vortex-compact -7.4% -5.8% -1.7% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -3.4% -5.8% +2.5% +10.0% ➖ noise
54 duckdb:duckdb -14.1% -5.8% -8.9% +11.2% ➖ noise
54 duckdb:vortex-compact -13.3% -5.8% -7.9% +15.0% ➖ noise
54 duckdb:vortex-file-compressed -8.4% -5.8% -2.7% +11.1% ➖ noise
55 datafusion:vortex-compact -11.8% -5.0% -7.2% +11.1% ➖ noise
55 datafusion:vortex-file-compressed -12.3% -5.0% -7.7% +10.0% ➖ noise
55 duckdb:duckdb -6.6% -5.0% -1.7% +13.0% ➖ noise
55 duckdb:vortex-compact -7.1% -5.0% -2.2% +10.0% ➖ noise
55 duckdb:vortex-file-compressed -7.4% -5.0% -2.6% +18.3% ➖ noise
56 datafusion:vortex-compact -5.3% -4.8% -0.5% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -9.2% -4.8% -4.6% +10.0% ➖ noise
56 duckdb:duckdb -8.2% -4.8% -3.5% +10.0% ➖ noise
56 duckdb:vortex-compact -2.0% -4.8% +3.0% +18.4% ➖ noise
56 duckdb:vortex-file-compressed -1.3% -4.8% +3.7% +10.0% ➖ noise
57 datafusion:vortex-compact -6.4% -5.2% -1.3% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -4.1% -5.2% +1.1% +10.0% ➖ noise
57 duckdb:duckdb -0.6% -5.2% +4.8% +18.2% ➖ noise
57 duckdb:vortex-compact -13.6% -5.2% -8.9% +13.6% ➖ noise
57 duckdb:vortex-file-compressed -3.5% -5.2% +1.8% +10.0% ➖ noise
58 datafusion:vortex-compact -10.8% -4.0% -7.0% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -8.0% -4.0% -4.2% +10.0% ➖ noise
58 duckdb:duckdb -0.6% -4.0% +3.6% +10.6% ➖ noise
58 duckdb:vortex-compact -10.6% -4.0% -6.9% +14.6% ➖ noise
58 duckdb:vortex-file-compressed -3.2% -4.0% +0.8% +11.9% ➖ noise
59 datafusion:vortex-compact -4.4% -4.6% +0.1% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -7.7% -4.6% -3.3% +10.0% ➖ noise
59 duckdb:duckdb -5.3% -4.6% -0.8% +10.0% ➖ noise
59 duckdb:vortex-compact +0.8% -4.6% +5.6% +15.1% ➖ noise
59 duckdb:vortex-file-compressed -0.3% -4.6% +4.5% +19.2% ➖ noise
60 datafusion:vortex-compact -9.3% -6.0% -3.6% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -4.9% -6.0% +1.1% +12.7% ➖ noise
60 duckdb:duckdb -6.1% -6.0% -0.1% +11.2% ➖ noise
60 duckdb:vortex-compact -7.4% -6.0% -1.6% +11.7% ➖ noise
60 duckdb:vortex-file-compressed -9.6% -6.0% -3.9% +10.0% ➖ noise
61 datafusion:vortex-compact -4.9% -8.6% +4.0% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -10.9% -8.6% -2.6% +10.0% ➖ noise
61 duckdb:duckdb -4.5% -8.6% +4.4% +10.0% ➖ noise
61 duckdb:vortex-compact +3.3% -8.6% +13.0% +12.2% 🚨 regression
61 duckdb:vortex-file-compressed +0.0% -8.6% +9.4% +12.2% ➖ noise
62 datafusion:vortex-compact -8.3% +1.7% -9.8% +15.5% ➖ noise
62 datafusion:vortex-file-compressed -3.9% +1.7% -5.5% +13.1% ➖ noise
62 duckdb:duckdb -5.0% +1.7% -6.6% +23.1% ➖ noise
62 duckdb:vortex-compact -2.4% +1.7% -4.0% +22.0% ➖ noise
62 duckdb:vortex-file-compressed -14.1% +1.7% -15.5% +14.9% ✅ faster
63 datafusion:vortex-compact -2.0% -4.6% +2.7% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -5.6% -4.6% -1.1% +10.0% ➖ noise
63 duckdb:duckdb -7.3% -4.6% -2.8% +10.0% ➖ noise
63 duckdb:vortex-compact -2.1% -4.6% +2.6% +10.6% ➖ noise
63 duckdb:vortex-file-compressed -7.6% -4.6% -3.2% +21.2% ➖ noise
64 datafusion:vortex-compact -5.8% -7.9% +2.3% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -5.0% -7.9% +3.2% +10.0% ➖ noise
64 duckdb:duckdb -9.6% -7.9% -1.8% +10.0% ➖ noise
64 duckdb:vortex-compact -5.5% -7.9% +2.7% +11.4% ➖ noise
64 duckdb:vortex-file-compressed -6.1% -7.9% +2.0% +10.0% ➖ noise
65 datafusion:vortex-compact -4.4% -4.5% +0.1% +12.3% ➖ noise
65 datafusion:vortex-file-compressed -7.8% -4.5% -3.5% +15.4% ➖ noise
65 duckdb:duckdb -16.1% -4.5% -12.2% +14.7% ➖ noise
65 duckdb:vortex-compact -3.5% -4.5% +1.1% +10.0% ➖ noise
65 duckdb:vortex-file-compressed -0.0% -4.5% +4.7% +21.1% ➖ noise
66 datafusion:vortex-compact -11.6% -8.0% -3.9% +11.1% ➖ noise
66 datafusion:vortex-file-compressed -10.9% -8.0% -3.2% +10.6% ➖ noise
66 duckdb:duckdb -6.9% -8.0% +1.3% +10.0% ➖ noise
66 duckdb:vortex-compact -6.7% -8.0% +1.5% +12.1% ➖ noise
66 duckdb:vortex-file-compressed -6.8% -8.0% +1.4% +10.0% ➖ noise
67 datafusion:vortex-compact -1.1% -5.6% +4.8% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -6.2% -5.6% -0.6% +10.0% ➖ noise
67 duckdb:duckdb -6.1% -5.6% -0.6% +10.0% ➖ noise
67 duckdb:vortex-compact -7.8% -5.6% -2.3% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -6.1% -5.6% -0.5% +10.0% ➖ noise
68 datafusion:vortex-compact -9.6% -5.4% -4.3% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -6.6% -5.4% -1.3% +10.0% ➖ noise
68 duckdb:duckdb -8.0% -5.4% -2.7% +10.0% ➖ noise
68 duckdb:vortex-compact -10.2% -5.4% -5.0% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -9.2% -5.4% -4.0% +13.0% ➖ noise
69 datafusion:vortex-compact -3.9% -4.5% +0.6% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -7.7% -4.5% -3.4% +10.0% ➖ noise
69 duckdb:duckdb -7.3% -4.5% -3.0% +10.0% ➖ noise
69 duckdb:vortex-compact -8.0% -4.5% -3.7% +10.0% ➖ noise
69 duckdb:vortex-file-compressed -8.3% -4.5% -4.0% +10.0% ➖ noise
70 datafusion:vortex-compact -7.1% -0.2% -6.9% +12.1% ➖ noise
70 datafusion:vortex-file-compressed +0.1% -0.2% +0.3% +13.1% ➖ noise
70 duckdb:duckdb -9.5% -0.2% -9.3% +16.3% ➖ noise
70 duckdb:vortex-compact -3.2% -0.2% -3.0% +11.6% ➖ noise
70 duckdb:vortex-file-compressed -6.9% -0.2% -6.7% +10.7% ➖ noise
71 datafusion:vortex-compact -4.9% -7.4% +2.7% +10.0% ➖ noise
71 datafusion:vortex-file-compressed -6.8% -7.4% +0.7% +10.0% ➖ noise
71 duckdb:duckdb -6.8% -7.4% +0.7% +13.9% ➖ noise
71 duckdb:vortex-compact -9.0% -7.4% -1.7% +12.8% ➖ noise
71 duckdb:vortex-file-compressed -10.8% -7.4% -3.6% +32.6% ➖ noise
72 datafusion:vortex-compact -5.8% -3.5% -2.5% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -9.6% -3.5% -6.3% +10.0% ➖ noise
72 duckdb:duckdb -1.9% -3.5% +1.6% +10.7% ➖ noise
72 duckdb:vortex-compact -3.6% -3.5% -0.2% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -2.4% -3.5% +1.1% +10.0% ➖ noise
73 datafusion:vortex-compact -7.4% -7.2% -0.3% +17.3% ➖ noise
73 datafusion:vortex-file-compressed -7.2% -7.2% -0.1% +21.1% ➖ noise
73 duckdb:duckdb -5.1% -7.2% +2.2% +11.6% ➖ noise
73 duckdb:vortex-compact -7.8% -7.2% -0.7% +11.5% ➖ noise
73 duckdb:vortex-file-compressed -3.2% -7.2% +4.2% +12.7% ➖ noise
74 datafusion:vortex-compact -1.7% -3.9% +2.3% +10.0% ➖ noise
74 datafusion:vortex-file-compressed -3.3% -3.9% +0.6% +12.8% ➖ noise
74 duckdb:duckdb -6.0% -3.9% -2.2% +10.0% ➖ noise
74 duckdb:vortex-compact +19.0% -3.9% +23.8% +26.1% ➖ noise
74 duckdb:vortex-file-compressed +2.1% -3.9% +6.2% +20.2% ➖ noise
75 datafusion:vortex-compact -2.0% -3.9% +2.0% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -8.2% -3.9% -4.5% +10.0% ➖ noise
75 duckdb:duckdb -7.6% -3.9% -3.9% +10.0% ➖ noise
75 duckdb:vortex-compact -2.0% -3.9% +2.0% +10.0% ➖ noise
75 duckdb:vortex-file-compressed -6.5% -3.9% -2.7% +10.0% ➖ noise
76 datafusion:vortex-compact -9.7% -2.9% -7.0% +10.0% ➖ noise
76 datafusion:vortex-file-compressed -8.8% -2.9% -6.0% +30.2% ➖ noise
76 duckdb:duckdb -16.1% -2.9% -13.6% +30.0% ➖ noise
76 duckdb:vortex-compact -2.0% -2.9% +0.9% +19.4% ➖ noise
76 duckdb:vortex-file-compressed -2.4% -2.9% +0.5% +11.9% ➖ noise
77 datafusion:vortex-compact -8.6% -4.8% -4.0% +10.0% ➖ noise
77 datafusion:vortex-file-compressed +0.2% -4.8% +5.2% +10.0% ➖ noise
77 duckdb:duckdb -1.7% -4.8% +3.3% +14.3% ➖ noise
77 duckdb:vortex-compact -3.6% -4.8% +1.2% +10.0% ➖ noise
77 duckdb:vortex-file-compressed -4.9% -4.8% -0.2% +13.6% ➖ noise
78 datafusion:vortex-compact -6.8% -7.8% +1.1% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -6.3% -7.8% +1.7% +10.0% ➖ noise
78 duckdb:duckdb -6.5% -7.8% +1.5% +10.0% ➖ noise
78 duckdb:vortex-compact -12.5% -7.8% -5.0% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -0.2% -7.8% +8.3% +10.0% ➖ noise
79 datafusion:vortex-compact -5.8% -8.3% +2.7% +10.1% ➖ noise
79 datafusion:vortex-file-compressed -4.7% -8.3% +3.9% +11.3% ➖ noise
79 duckdb:duckdb -4.9% -8.3% +3.7% +13.4% ➖ noise
79 duckdb:vortex-compact -6.5% -8.3% +2.0% +10.0% ➖ noise
79 duckdb:vortex-file-compressed -5.3% -8.3% +3.3% +10.0% ➖ noise
80 datafusion:vortex-compact -10.7% -6.0% -5.0% +10.8% ➖ noise
80 datafusion:vortex-file-compressed -3.7% -6.0% +2.4% +10.0% ➖ noise
80 duckdb:duckdb -9.8% -6.0% -4.0% +13.3% ➖ noise
80 duckdb:vortex-compact -2.6% -6.0% +3.7% +12.4% ➖ noise
80 duckdb:vortex-file-compressed -12.5% -6.0% -6.8% +15.9% ➖ noise
81 datafusion:vortex-compact -6.6% -6.3% -0.3% +10.5% ➖ noise
81 datafusion:vortex-file-compressed -10.6% -6.3% -4.5% +11.3% ➖ noise
81 duckdb:duckdb -7.5% -6.3% -1.2% +11.9% ➖ noise
81 duckdb:vortex-compact -8.2% -6.3% -2.0% +17.5% ➖ noise
81 duckdb:vortex-file-compressed -11.8% -6.3% -5.8% +14.0% ➖ noise
82 datafusion:vortex-compact -5.0% -1.4% -3.7% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -13.1% -1.4% -11.9% +14.6% ➖ noise
82 duckdb:duckdb -3.8% -1.4% -2.4% +15.7% ➖ noise
82 duckdb:vortex-compact -10.2% -1.4% -8.9% +11.3% ➖ noise
82 duckdb:vortex-file-compressed -8.3% -1.4% -7.0% +13.8% ➖ noise
83 datafusion:vortex-compact -7.1% -5.5% -1.7% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -5.5% -5.5% +0.1% +10.0% ➖ noise
83 duckdb:duckdb -11.9% -5.5% -6.7% +19.2% ➖ noise
83 duckdb:vortex-compact -11.7% -5.5% -6.5% +17.7% ➖ noise
83 duckdb:vortex-file-compressed -8.4% -5.5% -3.0% +10.0% ➖ noise
84 datafusion:vortex-compact -8.5% -5.0% -3.6% +13.5% ➖ noise
84 datafusion:vortex-file-compressed -8.5% -5.0% -3.7% +10.0% ➖ noise
84 duckdb:duckdb -2.6% -5.0% +2.5% +10.0% ➖ noise
84 duckdb:vortex-compact -8.4% -5.0% -3.5% +12.4% ➖ noise
84 duckdb:vortex-file-compressed -5.6% -5.0% -0.6% +10.0% ➖ noise
85 datafusion:vortex-compact -2.4% -1.6% -0.9% +10.0% ➖ noise
85 datafusion:vortex-file-compressed -4.7% -1.6% -3.1% +10.0% ➖ noise
85 duckdb:duckdb -13.8% -1.6% -12.4% +10.0% ✅ faster
85 duckdb:vortex-compact -8.2% -1.6% -6.7% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -9.7% -1.6% -8.3% +10.0% ➖ noise
86 datafusion:vortex-compact -6.7% -5.4% -1.3% +11.9% ➖ noise
86 datafusion:vortex-file-compressed -5.9% -5.4% -0.5% +10.0% ➖ noise
86 duckdb:duckdb -4.6% -5.4% +0.9% +12.4% ➖ noise
86 duckdb:vortex-compact -4.0% -5.4% +1.5% +12.8% ➖ noise
86 duckdb:vortex-file-compressed -1.3% -5.4% +4.3% +12.1% ➖ noise
87 datafusion:vortex-compact -8.1% -8.8% +0.8% +12.4% ➖ noise
87 datafusion:vortex-file-compressed -8.7% -8.8% +0.1% +10.0% ➖ noise
87 duckdb:duckdb -4.9% -8.8% +4.4% +10.0% ➖ noise
87 duckdb:vortex-compact -4.0% -8.8% +5.3% +10.0% ➖ noise
87 duckdb:vortex-file-compressed -4.2% -8.8% +5.0% +14.2% ➖ noise
88 datafusion:vortex-compact -2.6% -3.1% +0.5% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -7.0% -3.1% -4.0% +10.0% ➖ noise
88 duckdb:duckdb -6.1% -3.1% -3.1% +10.0% ➖ noise
88 duckdb:vortex-compact -2.7% -3.1% +0.5% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -8.8% -3.1% -5.9% +10.0% ➖ noise
89 datafusion:vortex-compact -10.4% -3.7% -6.9% +13.4% ➖ noise
89 datafusion:vortex-file-compressed -2.8% -3.7% +1.0% +12.3% ➖ noise
89 duckdb:duckdb -2.6% -3.7% +1.1% +14.6% ➖ noise
89 duckdb:vortex-compact -5.1% -3.7% -1.4% +10.0% ➖ noise
89 duckdb:vortex-file-compressed -14.1% -3.7% -10.8% +10.0% ✅ faster
90 datafusion:vortex-compact -7.9% -12.0% +4.7% +11.6% ➖ noise
90 datafusion:vortex-file-compressed -3.3% -12.0% +9.9% +10.0% ➖ noise
90 duckdb:duckdb -9.3% -12.0% +3.1% +10.2% ➖ noise
90 duckdb:vortex-compact -5.1% -12.0% +7.9% +10.0% ➖ noise
90 duckdb:vortex-file-compressed -9.6% -12.0% +2.7% +10.0% ➖ noise
91 datafusion:vortex-compact -3.4% -3.4% -0.1% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -11.2% -3.4% -8.1% +10.0% ➖ noise
91 duckdb:duckdb -19.4% -3.4% -16.6% +16.8% ✅ faster
91 duckdb:vortex-compact -4.9% -3.4% -1.6% +10.0% ➖ noise
91 duckdb:vortex-file-compressed -11.7% -3.4% -8.6% +22.4% ➖ noise
92 datafusion:vortex-compact -6.4% -4.1% -2.5% +10.0% ➖ noise
92 datafusion:vortex-file-compressed -8.1% -4.1% -4.2% +11.5% ➖ noise
92 duckdb:duckdb -5.1% -4.1% -1.1% +17.3% ➖ noise
92 duckdb:vortex-compact -4.8% -4.1% -0.7% +25.6% ➖ noise
92 duckdb:vortex-file-compressed -3.9% -4.1% +0.2% +13.6% ➖ noise
93 datafusion:vortex-compact -5.1% -5.6% +0.5% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -10.5% -5.6% -5.2% +10.0% ➖ noise
93 duckdb:duckdb -9.8% -5.6% -4.5% +15.9% ➖ noise
93 duckdb:vortex-compact +4.1% -5.6% +10.2% +13.0% ➖ noise
93 duckdb:vortex-file-compressed -10.9% -5.6% -5.6% +14.8% ➖ noise
94 datafusion:vortex-compact -6.9% -1.8% -5.2% +10.0% ➖ noise
94 datafusion:vortex-file-compressed -6.9% -1.8% -5.2% +11.7% ➖ noise
94 duckdb:duckdb -10.0% -1.8% -8.4% +12.2% ➖ noise
94 duckdb:vortex-compact -5.5% -1.8% -3.8% +14.2% ➖ noise
94 duckdb:vortex-file-compressed -11.2% -1.8% -9.6% +10.8% ➖ noise
95 datafusion:vortex-compact -3.4% +0.0% -3.4% +13.4% ➖ noise
95 datafusion:vortex-file-compressed -2.9% +0.0% -3.0% +12.0% ➖ noise
95 duckdb:duckdb +9.6% +0.0% +9.6% +15.2% ➖ noise
95 duckdb:vortex-compact -11.3% +0.0% -11.3% +14.4% ➖ noise
95 duckdb:vortex-file-compressed -3.7% +0.0% -3.7% +19.2% ➖ noise
96 datafusion:vortex-compact -7.6% -8.1% +0.6% +10.0% ➖ noise
96 datafusion:vortex-file-compressed -7.5% -8.1% +0.7% +10.2% ➖ noise
96 duckdb:duckdb -12.8% -8.1% -5.2% +13.2% ➖ noise
96 duckdb:vortex-compact +1.5% -8.1% +10.4% +10.5% ➖ noise
96 duckdb:vortex-file-compressed -9.8% -8.1% -1.8% +15.2% ➖ noise
97 datafusion:vortex-compact -6.7% -7.4% +0.7% +10.5% ➖ noise
97 datafusion:vortex-file-compressed -6.2% -7.4% +1.4% +10.2% ➖ noise
97 duckdb:duckdb -2.3% -7.4% +5.5% +11.1% ➖ noise
97 duckdb:vortex-compact -2.9% -7.4% +4.8% +11.5% ➖ noise
97 duckdb:vortex-file-compressed +0.9% -7.4% +9.0% +10.5% ➖ noise
98 datafusion:vortex-compact -8.5% -2.1% -6.6% +10.0% ➖ noise
98 datafusion:vortex-file-compressed -7.2% -2.1% -5.2% +10.0% ➖ noise
98 duckdb:duckdb -4.4% -2.1% -2.4% +14.4% ➖ noise
98 duckdb:vortex-compact -3.8% -2.1% -1.7% +10.0% ➖ noise
98 duckdb:vortex-file-compressed -1.5% -2.1% +0.6% +16.7% ➖ noise
99 datafusion:vortex-compact -11.2% -5.7% -5.9% +16.1% ➖ noise
99 datafusion:vortex-file-compressed -9.4% -5.7% -4.0% +15.3% ➖ noise
99 duckdb:duckdb -6.3% -5.7% -0.6% +10.9% ➖ noise
99 duckdb:vortex-compact -5.3% -5.7% +0.5% +12.3% ➖ noise
99 duckdb:vortex-file-compressed -5.7% -5.7% -0.0% +21.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

File Size Changes (48 files changed, +0.0% overall, 48↑ 0↓)
File Scale Format Base HEAD Change %
reason.vortex 1.0 vortex-compact 5.94 KB 5.97 KB +32 B +0.5%
income_band.vortex 1.0 vortex-compact 5.95 KB 5.98 KB +32 B +0.5%
income_band.vortex 1.0 vortex-file-compressed 6.16 KB 6.19 KB +32 B +0.5%
reason.vortex 1.0 vortex-file-compressed 7.20 KB 7.23 KB +32 B +0.4%
household_demographics.vortex 1.0 vortex-compact 10.76 KB 10.79 KB +32 B +0.3%
ship_mode.vortex 1.0 vortex-compact 10.92 KB 10.95 KB +32 B +0.3%
ship_mode.vortex 1.0 vortex-file-compressed 13.09 KB 13.12 KB +32 B +0.2%
household_demographics.vortex 1.0 vortex-file-compressed 17.02 KB 17.05 KB +32 B +0.2%
warehouse.vortex 1.0 vortex-compact 22.20 KB 22.23 KB +32 B +0.1%
warehouse.vortex 1.0 vortex-file-compressed 23.80 KB 23.83 KB +32 B +0.1%
web_page.vortex 1.0 vortex-compact 27.80 KB 27.84 KB +32 B +0.1%
web_page.vortex 1.0 vortex-file-compressed 31.89 KB 31.92 KB +32 B +0.1%
web_site.vortex 1.0 vortex-compact 45.28 KB 45.31 KB +32 B +0.1%
store.vortex 1.0 vortex-compact 45.73 KB 45.76 KB +32 B +0.1%
store.vortex 1.0 vortex-file-compressed 49.46 KB 49.49 KB +32 B +0.1%
call_center.vortex 1.0 vortex-compact 50.11 KB 50.14 KB +32 B +0.1%
promotion.vortex 1.0 vortex-compact 51.48 KB 51.51 KB +32 B +0.1%
web_site.vortex 1.0 vortex-file-compressed 54.05 KB 54.08 KB +32 B +0.1%
call_center.vortex 1.0 vortex-file-compressed 54.91 KB 54.94 KB +32 B +0.1%
promotion.vortex 1.0 vortex-file-compressed 60.16 KB 60.19 KB +32 B +0.1%
time_dim.vortex 1.0 vortex-compact 97.32 KB 97.35 KB +32 B +0.0%
date_dim.vortex 1.0 vortex-compact 153.96 KB 154.00 KB +32 B +0.0%
catalog_page.vortex 1.0 vortex-compact 362.64 KB 362.67 KB +32 B +0.0%
customer_address.vortex 1.0 vortex-compact 558.59 KB 558.62 KB +32 B +0.0%
catalog_page.vortex 1.0 vortex-file-compressed 611.54 KB 611.57 KB +32 B +0.0%
customer_demographics.vortex 1.0 vortex-compact 649.58 KB 649.61 KB +32 B +0.0%
time_dim.vortex 1.0 vortex-file-compressed 687.27 KB 687.30 KB +32 B +0.0%
item.vortex 1.0 vortex-compact 994.18 KB 994.21 KB +32 B +0.0%
customer_address.vortex 1.0 vortex-file-compressed 1012.93 KB 1012.96 KB +32 B +0.0%
date_dim.vortex 1.0 vortex-file-compressed 1.03 MB 1.03 MB +32 B +0.0%
customer_demographics.vortex 1.0 vortex-file-compressed 1.49 MB 1.49 MB +32 B +0.0%
item.vortex 1.0 vortex-file-compressed 1.75 MB 1.75 MB +32 B +0.0%
web_returns.vortex 1.0 vortex-compact 2.99 MB 2.99 MB +32 B +0.0%
customer.vortex 1.0 vortex-compact 3.29 MB 3.29 MB +32 B +0.0%
web_returns.vortex 1.0 vortex-file-compressed 3.55 MB 3.55 MB +32 B +0.0%
customer.vortex 1.0 vortex-file-compressed 4.52 MB 4.52 MB +32 B +0.0%
catalog_returns.vortex 1.0 vortex-compact 6.02 MB 6.02 MB +32 B +0.0%
catalog_returns.vortex 1.0 vortex-file-compressed 7.43 MB 7.43 MB +32 B +0.0%
store_returns.vortex 1.0 vortex-compact 9.31 MB 9.31 MB +32 B +0.0%
store_returns.vortex 1.0 vortex-file-compressed 11.39 MB 11.39 MB +32 B +0.0%
inventory.vortex 1.0 vortex-compact 16.07 MB 16.07 MB +32 B +0.0%
web_sales.vortex 1.0 vortex-compact 29.35 MB 29.35 MB +32 B +0.0%
web_sales.vortex 1.0 vortex-file-compressed 34.27 MB 34.27 MB +32 B +0.0%
inventory.vortex 1.0 vortex-file-compressed 36.64 MB 36.64 MB +32 B +0.0%
catalog_sales.vortex 1.0 vortex-compact 59.31 MB 59.31 MB +32 B +0.0%
catalog_sales.vortex 1.0 vortex-file-compressed 70.78 MB 70.78 MB +32 B +0.0%
store_sales.vortex 1.0 vortex-compact 77.87 MB 77.87 MB +32 B +0.0%
store_sales.vortex 1.0 vortex-file-compressed 97.04 MB 97.04 MB +32 B +0.0%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (+0.0%)
  • vortex-file-compressed: 272.70 MB → 272.70 MB (+0.0%)

@robert3005 robert3005 merged commit 91f1c2f into develop Apr 20, 2026
58 checks passed
@robert3005 robert3005 deleted the rk/between branch April 20, 2026 19:36
@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.955x ➖
Parquet (geomean): 0.998x ➖


unknown / unknown (0.979x ➖, 3↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 1741328 1942202 0.90
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1079835 1076073 1.00
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8300659132 8476903982 0.98
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8389005966 8435145468 0.99
random-access/feature-vectors/correlated/vortex-tokio-local-disk 8054257 8409094 0.96
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6942802 7589394 0.91
random-access/feature-vectors/uniform/lance-tokio-local-disk 1349656 1332709 1.01
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2039498 2035880 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8402972421 8391445319 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8459171313 8503837185 0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk 13076184 13337415 0.98
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 12829252 13179136 0.97
random-access/lance-tokio-local-disk 692886 702521 0.99
random-access/lance-tokio-local-disk-footer 1191427 1218345 0.98
random-access/nested-lists/correlated/lance-tokio-local-disk 257616 254577 1.01
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 628554 632626 0.99
random-access/nested-lists/correlated/parquet-tokio-local-disk 130882717 127798166 1.02
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 131023125 127833432 1.02
random-access/nested-lists/correlated/vortex-tokio-local-disk 587409 630692 0.93
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 586637 614854 0.95
random-access/nested-lists/uniform/lance-tokio-local-disk 1097123 1093318 1.00
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1497689 1498457 1.00
random-access/nested-lists/uniform/parquet-tokio-local-disk 130860650 128043156 1.02
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 130928332 127930794 1.02
random-access/nested-lists/uniform/vortex-tokio-local-disk 2120688 2122932 1.00
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2111554 2116702 1.00
random-access/nested-structs/correlated/lance-tokio-local-disk 402524 403018 1.00
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 594876 597893 0.99
random-access/nested-structs/correlated/parquet-tokio-local-disk 24528983 25179651 0.97
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 24498403 25232243 0.97
random-access/nested-structs/correlated/vortex-tokio-local-disk 771631 789896 0.98
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 770002 793737 0.97
random-access/nested-structs/uniform/lance-tokio-local-disk 2727191 2725107 1.00
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2936292 2955918 0.99
random-access/nested-structs/uniform/parquet-tokio-local-disk 24613572 25113745 0.98
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 24662979 25113799 0.98
random-access/nested-structs/uniform/vortex-tokio-local-disk 1650738 1666470 0.99
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1647778 1629625 1.01
random-access/parquet-tokio-local-disk 174680243 176772161 0.99
random-access/parquet-tokio-local-disk-footer 174717650 173567173 1.01
random-access/taxi/correlated/lance-tokio-local-disk 904248 928381 0.97
random-access/taxi/correlated/lance-tokio-local-disk-footer 1476712 1524314 0.97
random-access/taxi/correlated/parquet-tokio-local-disk 261217553 259880061 1.01
random-access/taxi/correlated/parquet-tokio-local-disk-footer 260454226 261104479 1.00
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1586208 1831887 0.87
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1740144 1846545 0.94
random-access/taxi/uniform/lance-tokio-local-disk 8251990 8385157 0.98
random-access/taxi/uniform/lance-tokio-local-disk-footer 8852229 9412742 0.94
random-access/taxi/uniform/parquet-tokio-local-disk 274820568 274492337 1.00
random-access/taxi/uniform/parquet-tokio-local-disk-footer 275838513 274422088 1.01
random-access/taxi/uniform/vortex-tokio-local-disk 4415570 4609232 0.96
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4423197 4572367 0.97
random-access/vortex-tokio-local-disk 🚀 1195249 1339303 0.89
random-access/vortex-tokio-local-disk-footer 1214583 1315280 0.92

@github-actions
Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-H SF=10 on S3 failed! Check the workflow run for details.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +5.8%
Vortex (geomean): 1.066x ➖
Parquet (geomean): 1.007x ➖
Shifts: Parquet (control) +0.7% · Median polish +2.8%


datafusion / vortex-file-compressed (1.187x ➖, 0↑ 6↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 237776073 208857685 1.14
tpch_q02/datafusion:vortex-file-compressed 530063592 490187735 1.08
tpch_q03/datafusion:vortex-file-compressed 404142370 426536944 0.95
tpch_q04/datafusion:vortex-file-compressed 🚨 314153638 193650507 1.62
tpch_q05/datafusion:vortex-file-compressed 524867845 415756746 1.26
tpch_q06/datafusion:vortex-file-compressed 🚨 423584848 265980971 1.59
tpch_q07/datafusion:vortex-file-compressed 🚨 532976785 404668076 1.32
tpch_q08/datafusion:vortex-file-compressed 🚨 890975788 521044256 1.71
tpch_q09/datafusion:vortex-file-compressed 🚨 487851213 359170617 1.36
tpch_q10/datafusion:vortex-file-compressed 505841269 390024402 1.30
tpch_q11/datafusion:vortex-file-compressed 354183668 291546109 1.21
tpch_q12/datafusion:vortex-file-compressed 406859620 357952282 1.14
tpch_q13/datafusion:vortex-file-compressed 199293781 216888921 0.92
tpch_q14/datafusion:vortex-file-compressed 255277369 218671482 1.17
tpch_q15/datafusion:vortex-file-compressed 368145209 447596553 0.82
tpch_q16/datafusion:vortex-file-compressed 263761312 217555389 1.21
tpch_q17/datafusion:vortex-file-compressed 372561567 373688372 1.00
tpch_q18/datafusion:vortex-file-compressed 379801412 385495796 0.99
tpch_q19/datafusion:vortex-file-compressed 478610727 433507168 1.10
tpch_q20/datafusion:vortex-file-compressed 487140366 411550059 1.18
tpch_q21/datafusion:vortex-file-compressed 607812429 550921667 1.10
tpch_q22/datafusion:vortex-file-compressed 🚨 199005690 143571127 1.39
datafusion / vortex-compact (1.088x ➖, 0↑ 2↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 276739312 283184468 0.98
tpch_q02/datafusion:vortex-compact 503024702 471867410 1.07
tpch_q03/datafusion:vortex-compact 463867042 442173412 1.05
tpch_q04/datafusion:vortex-compact 263604502 227520114 1.16
tpch_q05/datafusion:vortex-compact 365257701 410168153 0.89
tpch_q06/datafusion:vortex-compact 374028420 315182285 1.19
tpch_q07/datafusion:vortex-compact 431758502 430567599 1.00
tpch_q08/datafusion:vortex-compact 672381614 523705110 1.28
tpch_q09/datafusion:vortex-compact 453375560 418545781 1.08
tpch_q10/datafusion:vortex-compact 442164247 453186963 0.98
tpch_q11/datafusion:vortex-compact 285182818 265875253 1.07
tpch_q12/datafusion:vortex-compact 🚨 663950952 485915703 1.37
tpch_q13/datafusion:vortex-compact 181981229 143642454 1.27
tpch_q14/datafusion:vortex-compact 352107178 291247149 1.21
tpch_q15/datafusion:vortex-compact 547676115 507764676 1.08
tpch_q16/datafusion:vortex-compact 207996742 218933014 0.95
tpch_q17/datafusion:vortex-compact 396528834 412195869 0.96
tpch_q18/datafusion:vortex-compact 344977774 363226244 0.95
tpch_q19/datafusion:vortex-compact 497472317 494738617 1.01
tpch_q20/datafusion:vortex-compact 592629674 486906837 1.22
tpch_q21/datafusion:vortex-compact 🚨 864777765 585856340 1.48
tpch_q22/datafusion:vortex-compact 192115925 207935696 0.92
datafusion / parquet (1.031x ➖, 0↑ 1↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 229555692 222978886 1.03
tpch_q02/datafusion:parquet 453777413 459219337 0.99
tpch_q03/datafusion:parquet 323941048 349312277 0.93
tpch_q04/datafusion:parquet 185699442 180495594 1.03
tpch_q05/datafusion:parquet 494411763 492377107 1.00
tpch_q06/datafusion:parquet 136224894 178595847 0.76
tpch_q07/datafusion:parquet 544475668 575536656 0.95
tpch_q08/datafusion:parquet 613669021 569403193 1.08
tpch_q09/datafusion:parquet 499628502 528559254 0.95
tpch_q10/datafusion:parquet 596003124 559834476 1.06
tpch_q11/datafusion:parquet 336608075 380377181 0.88
tpch_q12/datafusion:parquet 298274771 277979900 1.07
tpch_q13/datafusion:parquet 435948877 433491116 1.01
tpch_q14/datafusion:parquet 235801902 201280000 1.17
tpch_q15/datafusion:parquet 342663252 299752445 1.14
tpch_q16/datafusion:parquet 193509669 180850779 1.07
tpch_q17/datafusion:parquet 458766617 390362256 1.18
tpch_q18/datafusion:parquet 🚨 637948406 488959709 1.30
tpch_q19/datafusion:parquet 453718449 425522737 1.07
tpch_q20/datafusion:parquet 386614397 423091154 0.91
tpch_q21/datafusion:parquet 749009515 629137126 1.19
tpch_q22/datafusion:parquet 141049493 134467690 1.05
duckdb / vortex-file-compressed (0.971x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 263271058 256848786 1.03
tpch_q02/duckdb:vortex-file-compressed 983398765 904753920 1.09
tpch_q03/duckdb:vortex-file-compressed 721912865 655465707 1.10
tpch_q04/duckdb:vortex-file-compressed 373288639 398432083 0.94
tpch_q05/duckdb:vortex-file-compressed 876979911 934116071 0.94
tpch_q06/duckdb:vortex-file-compressed 396738783 441699280 0.90
tpch_q07/duckdb:vortex-file-compressed 798851118 829266179 0.96
tpch_q08/duckdb:vortex-file-compressed 1005566278 1074656141 0.94
tpch_q09/duckdb:vortex-file-compressed 841997882 922903869 0.91
tpch_q10/duckdb:vortex-file-compressed 822920849 802646448 1.03
tpch_q11/duckdb:vortex-file-compressed 484642381 537594289 0.90
tpch_q12/duckdb:vortex-file-compressed 446367768 488544477 0.91
tpch_q13/duckdb:vortex-file-compressed 471531734 490922244 0.96
tpch_q14/duckdb:vortex-file-compressed 484821437 526197134 0.92
tpch_q15/duckdb:vortex-file-compressed 243287976 289925528 0.84
tpch_q16/duckdb:vortex-file-compressed 380456300 372214377 1.02
tpch_q17/duckdb:vortex-file-compressed 689335669 689901120 1.00
tpch_q18/duckdb:vortex-file-compressed 559691840 558893053 1.00
tpch_q19/duckdb:vortex-file-compressed 440543864 467719026 0.94
tpch_q20/duckdb:vortex-file-compressed 800416129 801123280 1.00
tpch_q21/duckdb:vortex-file-compressed 1087772851 1047212152 1.04
tpch_q22/duckdb:vortex-file-compressed 375625373 360533390 1.04
duckdb / vortex-compact (1.029x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 265149452 276975529 0.96
tpch_q02/duckdb:vortex-compact 956895954 963310263 0.99
tpch_q03/duckdb:vortex-compact 686656905 673619234 1.02
tpch_q04/duckdb:vortex-compact 384081074 319976517 1.20
tpch_q05/duckdb:vortex-compact 840265807 900133397 0.93
tpch_q06/duckdb:vortex-compact 413135851 399718447 1.03
tpch_q07/duckdb:vortex-compact 764490892 766618162 1.00
tpch_q08/duckdb:vortex-compact 954698831 945442671 1.01
tpch_q09/duckdb:vortex-compact 938154245 866649709 1.08
tpch_q10/duckdb:vortex-compact 668456646 690317203 0.97
tpch_q11/duckdb:vortex-compact 484420476 487598757 0.99
tpch_q12/duckdb:vortex-compact 464706011 449203238 1.03
tpch_q13/duckdb:vortex-compact 450043066 446823633 1.01
tpch_q14/duckdb:vortex-compact 500298954 516497866 0.97
tpch_q15/duckdb:vortex-compact 328397407 289772889 1.13
tpch_q16/duckdb:vortex-compact 356320326 337692372 1.06
tpch_q17/duckdb:vortex-compact 733813617 726510106 1.01
tpch_q18/duckdb:vortex-compact 504131219 482303550 1.05
tpch_q19/duckdb:vortex-compact 445920795 416736232 1.07
tpch_q20/duckdb:vortex-compact 784946166 791968028 0.99
tpch_q21/duckdb:vortex-compact 1047373070 1031070688 1.02
tpch_q22/duckdb:vortex-compact 388807116 336843400 1.15
duckdb / parquet (0.984x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 451824302 541804668 0.83
tpch_q02/duckdb:parquet 1306458213 1222281592 1.07
tpch_q03/duckdb:parquet 1038238448 1047251897 0.99
tpch_q04/duckdb:parquet 668159204 637650260 1.05
tpch_q05/duckdb:parquet 1506259517 1472870720 1.02
tpch_q06/duckdb:parquet 443022324 443956856 1.00
tpch_q07/duckdb:parquet 1288664602 1406551597 0.92
tpch_q08/duckdb:parquet 1763877164 1795068274 0.98
tpch_q09/duckdb:parquet 1356159450 1455073958 0.93
tpch_q10/duckdb:parquet 1301465403 1304557956 1.00
tpch_q11/duckdb:parquet 907036651 876642343 1.03
tpch_q12/duckdb:parquet 750525133 726274644 1.03
tpch_q13/duckdb:parquet 905911284 941630210 0.96
tpch_q14/duckdb:parquet 700519831 644231933 1.09
tpch_q15/duckdb:parquet 551688952 490892937 1.12
tpch_q16/duckdb:parquet 562747117 628963426 0.89
tpch_q17/duckdb:parquet 758958059 780611478 0.97
tpch_q18/duckdb:parquet 822543741 879377018 0.94
tpch_q19/duckdb:parquet 777584010 848205290 0.92
tpch_q20/duckdb:parquet 1102553167 1109476563 0.99
tpch_q21/duckdb:parquet 1068185278 1114577382 0.96
tpch_q22/duckdb:parquet 579437252 579241154 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -2.3% -7.3% +5.5% +76.6% ➖ noise
1 datafusion:vortex-file-compressed +13.8% -7.3% +22.9% +80.8% ➖ noise
1 duckdb:vortex-compact -4.3% -7.3% +3.3% +41.1% ➖ noise
1 duckdb:vortex-file-compressed +2.5% -7.3% +10.6% +62.4% ➖ noise
2 datafusion:vortex-compact +6.6% +2.8% +3.7% +31.4% ➖ noise
2 datafusion:vortex-file-compressed +8.1% +2.8% +5.2% +35.6% ➖ noise
2 duckdb:vortex-compact -0.7% +2.8% -3.3% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +8.7% +2.8% +5.8% +30.0% ➖ noise
3 datafusion:vortex-compact +4.9% -4.1% +9.4% +40.7% ➖ noise
3 datafusion:vortex-file-compressed -5.3% -4.1% -1.2% +76.6% ➖ noise
3 duckdb:vortex-compact +1.9% -4.1% +6.3% +30.5% ➖ noise
3 duckdb:vortex-file-compressed +10.1% -4.1% +14.9% +30.8% ➖ noise
4 datafusion:vortex-compact +15.9% +3.8% +11.6% +47.6% ➖ noise
4 datafusion:vortex-file-compressed +62.2% +3.8% +56.2% +34.1% 🚨 regression
4 duckdb:vortex-compact +20.0% +3.8% +15.6% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -6.3% +3.8% -9.8% +33.1% ➖ noise
5 datafusion:vortex-compact -10.9% +1.3% -12.1% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +26.2% +1.3% +24.6% +30.0% ➖ noise
5 duckdb:vortex-compact -6.7% +1.3% -7.9% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -6.1% +1.3% -7.4% +30.0% ➖ noise
6 datafusion:vortex-compact +18.7% -12.8% +36.0% +30.1% 🚨 regression
6 datafusion:vortex-file-compressed +59.3% -12.8% +82.5% +30.0% 🚨 regression
6 duckdb:vortex-compact +3.4% -12.8% +18.5% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -10.2% -12.8% +3.0% +30.0% ➖ noise
7 datafusion:vortex-compact +0.3% -6.9% +7.7% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +31.7% -6.9% +41.5% +30.9% 🚨 regression
7 duckdb:vortex-compact -0.3% -6.9% +7.1% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -3.7% -6.9% +3.5% +30.0% ➖ noise
8 datafusion:vortex-compact +28.4% +2.9% +24.8% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +71.0% +2.9% +66.2% +30.0% 🚨 regression
8 duckdb:vortex-compact +1.0% +2.9% -1.9% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -6.4% +2.9% -9.1% +30.0% ➖ noise
9 datafusion:vortex-compact +8.3% -6.1% +15.4% +31.1% ➖ noise
9 datafusion:vortex-file-compressed +35.8% -6.1% +44.7% +30.9% 🚨 regression
9 duckdb:vortex-compact +8.3% -6.1% +15.3% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -8.8% -6.1% -2.8% +30.0% ➖ noise
10 datafusion:vortex-compact -2.4% +3.1% -5.3% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +29.7% +3.1% +25.8% +30.0% ➖ noise
10 duckdb:vortex-compact -3.2% +3.1% -6.0% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +2.5% +3.1% -0.5% +30.0% ➖ noise
11 datafusion:vortex-compact +7.3% -4.3% +12.1% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +21.5% -4.3% +27.0% +30.0% ➖ noise
11 duckdb:vortex-compact -0.7% -4.3% +3.8% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -9.8% -4.3% -5.8% +30.0% ➖ noise
12 datafusion:vortex-compact +36.6% +5.3% +29.8% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +13.7% +5.3% +7.9% +30.0% ➖ noise
12 duckdb:vortex-compact +3.5% +5.3% -1.8% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -8.6% +5.3% -13.2% +30.0% ➖ noise
13 datafusion:vortex-compact +26.7% -1.6% +28.8% +59.1% ➖ noise
13 datafusion:vortex-file-compressed -8.1% -1.6% -6.6% +48.1% ➖ noise
13 duckdb:vortex-compact +0.7% -1.6% +2.4% +30.0% ➖ noise
13 duckdb:vortex-file-compressed -3.9% -1.6% -2.4% +30.0% ➖ noise
14 datafusion:vortex-compact +20.9% +12.9% +7.1% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +16.7% +12.9% +3.4% +41.8% ➖ noise
14 duckdb:vortex-compact -3.1% +12.9% -14.2% +33.8% ➖ noise
14 duckdb:vortex-file-compressed -7.9% +12.9% -18.4% +30.0% ➖ noise
15 datafusion:vortex-compact +7.9% +13.3% -4.8% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -17.8% +13.3% -27.4% +30.0% ✅ faster
15 duckdb:vortex-compact +13.3% +13.3% -0.0% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -16.1% +13.3% -26.0% +30.0% ✅ faster
16 datafusion:vortex-compact -5.0% -2.2% -2.9% +30.0% ➖ noise
16 datafusion:vortex-file-compressed +21.2% -2.2% +23.9% +30.0% ➖ noise
16 duckdb:vortex-compact +5.5% -2.2% +7.8% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +2.2% -2.2% +4.5% +30.0% ➖ noise
17 datafusion:vortex-compact -3.8% +6.9% -10.0% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -0.3% +6.9% -6.7% +34.3% ➖ noise
17 duckdb:vortex-compact +1.0% +6.9% -5.5% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -0.1% +6.9% -6.5% +30.0% ➖ noise
18 datafusion:vortex-compact -5.0% +10.5% -14.0% +37.1% ➖ noise
18 datafusion:vortex-file-compressed -1.5% +10.5% -10.8% +40.2% ➖ noise
18 duckdb:vortex-compact +4.5% +10.5% -5.4% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +0.1% +10.5% -9.3% +30.0% ➖ noise
19 datafusion:vortex-compact +0.6% -1.1% +1.7% +55.0% ➖ noise
19 datafusion:vortex-file-compressed +10.4% -1.1% +11.7% +30.0% ➖ noise
19 duckdb:vortex-compact +7.0% -1.1% +8.2% +32.6% ➖ noise
19 duckdb:vortex-file-compressed -5.8% -1.1% -4.7% +35.0% ➖ noise
20 datafusion:vortex-compact +21.7% -4.7% +27.7% +32.3% ➖ noise
20 datafusion:vortex-file-compressed +18.4% -4.7% +24.2% +30.0% ➖ noise
20 duckdb:vortex-compact -0.9% -4.7% +4.0% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -0.1% -4.7% +4.8% +30.0% ➖ noise
21 datafusion:vortex-compact +47.6% +6.8% +38.2% +30.0% 🚨 regression
21 datafusion:vortex-file-compressed +10.3% +6.8% +3.3% +30.8% ➖ noise
21 duckdb:vortex-compact +1.6% +6.8% -4.9% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +3.9% +6.8% -2.8% +30.0% ➖ noise
22 datafusion:vortex-compact -7.6% +2.4% -9.8% +51.8% ➖ noise
22 datafusion:vortex-file-compressed +38.6% +2.4% +35.3% +32.8% 🚨 regression
22 duckdb:vortex-compact +15.4% +2.4% +12.7% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +4.2% +2.4% +1.7% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.5%
Vortex (geomean): 0.996x ➖
Parquet (geomean): 1.012x ➖
Shifts: Parquet (control) +1.2% · Median polish +0.5%


datafusion / vortex-file-compressed (1.020x ➖, 0↑ 2↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚨 1899459 1664264 1.14
clickbench_q01/datafusion:vortex-file-compressed 13321216 13070600 1.02
clickbench_q02/datafusion:vortex-file-compressed 33112998 30623885 1.08
clickbench_q03/datafusion:vortex-file-compressed 🚨 38699445 35162731 1.10
clickbench_q04/datafusion:vortex-file-compressed 297503571 273046079 1.09
clickbench_q05/datafusion:vortex-file-compressed 303781192 290595467 1.05
clickbench_q06/datafusion:vortex-file-compressed 1662313 1631648 1.02
clickbench_q07/datafusion:vortex-file-compressed 16576194 16097320 1.03
clickbench_q08/datafusion:vortex-file-compressed 367205935 341752070 1.07
clickbench_q09/datafusion:vortex-file-compressed 565809051 548104154 1.03
clickbench_q10/datafusion:vortex-file-compressed 70534158 67821427 1.04
clickbench_q11/datafusion:vortex-file-compressed 83075292 82551044 1.01
clickbench_q12/datafusion:vortex-file-compressed 265930257 257172091 1.03
clickbench_q13/datafusion:vortex-file-compressed 414102726 400772978 1.03
clickbench_q14/datafusion:vortex-file-compressed 250995279 245126303 1.02
clickbench_q15/datafusion:vortex-file-compressed 319242565 317294424 1.01
clickbench_q16/datafusion:vortex-file-compressed 639535611 632335481 1.01
clickbench_q17/datafusion:vortex-file-compressed 626105726 629385199 0.99
clickbench_q18/datafusion:vortex-file-compressed 1285342414 1257105563 1.02
clickbench_q19/datafusion:vortex-file-compressed 23529318 25176685 0.93
clickbench_q20/datafusion:vortex-file-compressed 331351159 335234773 0.99
clickbench_q21/datafusion:vortex-file-compressed 369991161 369710705 1.00
clickbench_q22/datafusion:vortex-file-compressed 445810776 444456574 1.00
clickbench_q23/datafusion:vortex-file-compressed 708858299 647795603 1.09
clickbench_q24/datafusion:vortex-file-compressed 43260782 42985119 1.01
clickbench_q25/datafusion:vortex-file-compressed 67257994 66099277 1.02
clickbench_q26/datafusion:vortex-file-compressed 43389084 44142384 0.98
clickbench_q27/datafusion:vortex-file-compressed 737310144 710710754 1.04
clickbench_q28/datafusion:vortex-file-compressed 6712709278 6590394166 1.02
clickbench_q29/datafusion:vortex-file-compressed 230896987 232821440 0.99
clickbench_q30/datafusion:vortex-file-compressed 215287531 214213568 1.01
clickbench_q31/datafusion:vortex-file-compressed 250163895 248718441 1.01
clickbench_q32/datafusion:vortex-file-compressed 1073749649 1085715876 0.99
clickbench_q33/datafusion:vortex-file-compressed 1278302072 1263904791 1.01
clickbench_q34/datafusion:vortex-file-compressed 1264773321 1262559887 1.00
clickbench_q35/datafusion:vortex-file-compressed 469089935 468758887 1.00
clickbench_q36/datafusion:vortex-file-compressed 69303623 68334308 1.01
clickbench_q37/datafusion:vortex-file-compressed 34286512 34830494 0.98
clickbench_q38/datafusion:vortex-file-compressed 18700532 19388799 0.96
clickbench_q39/datafusion:vortex-file-compressed 129359408 128922879 1.00
clickbench_q40/datafusion:vortex-file-compressed 16644613 16029209 1.04
clickbench_q41/datafusion:vortex-file-compressed 14625337 14628517 1.00
clickbench_q42/datafusion:vortex-file-compressed 17058019 17251663 0.99
datafusion / parquet (1.027x ➖, 0↑ 6↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1542529 1542277 1.00
clickbench_q01/datafusion:parquet 19347984 18981187 1.02
clickbench_q02/datafusion:parquet 46900895 50440538 0.93
clickbench_q03/datafusion:parquet 37161124 38017389 0.98
clickbench_q04/datafusion:parquet 291500628 296401955 0.98
clickbench_q05/datafusion:parquet 354711196 341723962 1.04
clickbench_q06/datafusion:parquet 1495270 1572344 0.95
clickbench_q07/datafusion:parquet 23606369 21997938 1.07
clickbench_q08/datafusion:parquet 372117939 367736118 1.01
clickbench_q09/datafusion:parquet 597467886 613746530 0.97
clickbench_q10/datafusion:parquet 110610152 108233846 1.02
clickbench_q11/datafusion:parquet 133955128 132755537 1.01
clickbench_q12/datafusion:parquet 353696518 341136931 1.04
clickbench_q13/datafusion:parquet 485957094 492000553 0.99
clickbench_q14/datafusion:parquet 342041534 339510288 1.01
clickbench_q15/datafusion:parquet 332368581 331536250 1.00
clickbench_q16/datafusion:parquet 651687819 652177051 1.00
clickbench_q17/datafusion:parquet 642788535 633858210 1.01
clickbench_q18/datafusion:parquet 1308755718 1288573536 1.02
clickbench_q19/datafusion:parquet 29884235 28573168 1.05
clickbench_q20/datafusion:parquet 597939824 609551176 0.98
clickbench_q21/datafusion:parquet 673041794 668720316 1.01
clickbench_q22/datafusion:parquet 988918887 976252189 1.01
clickbench_q23/datafusion:parquet 3715942018 3722641217 1.00
clickbench_q24/datafusion:parquet 86789241 84958280 1.02
clickbench_q25/datafusion:parquet 139459265 137012007 1.02
clickbench_q26/datafusion:parquet 81998836 84259075 0.97
clickbench_q27/datafusion:parquet 1035015049 1036836765 1.00
clickbench_q28/datafusion:parquet 6432125825 6530685288 0.98
clickbench_q29/datafusion:parquet 234718812 237868952 0.99
clickbench_q30/datafusion:parquet 335422301 326048514 1.03
clickbench_q31/datafusion:parquet 361017013 363398692 0.99
clickbench_q32/datafusion:parquet 1197016291 1249772864 0.96
clickbench_q33/datafusion:parquet 1541551231 1450310253 1.06
clickbench_q34/datafusion:parquet 🚨 1652081846 1479616719 1.12
clickbench_q35/datafusion:parquet 🚨 545810882 475435205 1.15
clickbench_q36/datafusion:parquet 🚨 162157362 140989183 1.15
clickbench_q37/datafusion:parquet 🚨 65424601 57195720 1.14
clickbench_q38/datafusion:parquet 🚨 94552181 82523096 1.15
clickbench_q39/datafusion:parquet 274926310 254997020 1.08
clickbench_q40/datafusion:parquet 32400436 29608988 1.09
clickbench_q41/datafusion:parquet 28120367 26949556 1.04
clickbench_q42/datafusion:parquet 🚨 33527661 28422805 1.18
duckdb / vortex-file-compressed (0.972x ➖, 9↑ 2↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 5992622 6092707 0.98
clickbench_q01/duckdb:vortex-file-compressed 13757911 13815068 1.00
clickbench_q02/duckdb:vortex-file-compressed 25574026 25958447 0.99
clickbench_q03/duckdb:vortex-file-compressed 29198501 29132809 1.00
clickbench_q04/duckdb:vortex-file-compressed 181257582 177834390 1.02
clickbench_q05/duckdb:vortex-file-compressed 170962331 175917831 0.97
clickbench_q06/duckdb:vortex-file-compressed 18283550 18715985 0.98
clickbench_q07/duckdb:vortex-file-compressed 🚨 17327913 15134789 1.14
clickbench_q08/duckdb:vortex-file-compressed 257186861 253554990 1.01
clickbench_q09/duckdb:vortex-file-compressed 330366426 330120281 1.00
clickbench_q10/duckdb:vortex-file-compressed 67477306 66506412 1.01
clickbench_q11/duckdb:vortex-file-compressed 77263298 76236970 1.01
clickbench_q12/duckdb:vortex-file-compressed 193263800 199979030 0.97
clickbench_q13/duckdb:vortex-file-compressed 394139681 389910722 1.01
clickbench_q14/duckdb:vortex-file-compressed 228768957 229809364 1.00
clickbench_q15/duckdb:vortex-file-compressed 239598300 233024447 1.03
clickbench_q16/duckdb:vortex-file-compressed 578765274 562694129 1.03
clickbench_q17/duckdb:vortex-file-compressed 453341094 456305837 0.99
clickbench_q18/duckdb:vortex-file-compressed 973753165 958474118 1.02
clickbench_q19/duckdb:vortex-file-compressed 22787009 20872013 1.09
clickbench_q20/duckdb:vortex-file-compressed 336212383 347674640 0.97
clickbench_q21/duckdb:vortex-file-compressed 362488638 367360672 0.99
clickbench_q22/duckdb:vortex-file-compressed 🚀 483717399 580819127 0.83
clickbench_q23/duckdb:vortex-file-compressed 🚨 1265318394 659651978 1.92
clickbench_q24/duckdb:vortex-file-compressed 40097289 42858500 0.94
clickbench_q25/duckdb:vortex-file-compressed 74621461 72924674 1.02
clickbench_q26/duckdb:vortex-file-compressed 🚀 44633966 52390969 0.85
clickbench_q27/duckdb:vortex-file-compressed 476103972 468569991 1.02
clickbench_q28/duckdb:vortex-file-compressed 2964620714 2950208608 1.00
clickbench_q29/duckdb:vortex-file-compressed 28365100 30483169 0.93
clickbench_q30/duckdb:vortex-file-compressed 188925951 190107774 0.99
clickbench_q31/duckdb:vortex-file-compressed 275207770 274619420 1.00
clickbench_q32/duckdb:vortex-file-compressed 1215605205 1214613634 1.00
clickbench_q33/duckdb:vortex-file-compressed 1194009338 1159112508 1.03
clickbench_q34/duckdb:vortex-file-compressed 1207729679 1214662284 0.99
clickbench_q35/duckdb:vortex-file-compressed 382462455 376204045 1.02
clickbench_q36/duckdb:vortex-file-compressed 🚀 26530694 32504956 0.82
clickbench_q37/duckdb:vortex-file-compressed 🚀 19030932 25144515 0.76
clickbench_q38/duckdb:vortex-file-compressed 🚀 20361579 25837458 0.79
clickbench_q39/duckdb:vortex-file-compressed 🚀 38308882 45174951 0.85
clickbench_q40/duckdb:vortex-file-compressed 🚀 18288841 25094975 0.73
clickbench_q41/duckdb:vortex-file-compressed 🚀 18004034 23263805 0.77
clickbench_q42/duckdb:vortex-file-compressed 🚀 20377837 24484309 0.83
duckdb / parquet (0.997x ➖, 2↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚀 25335025 28552013 0.89
clickbench_q01/duckdb:parquet 27099917 28397639 0.95
clickbench_q02/duckdb:parquet 48700178 48188371 1.01
clickbench_q03/duckdb:parquet 37157025 37707653 0.99
clickbench_q04/duckdb:parquet 197753297 201983096 0.98
clickbench_q05/duckdb:parquet 268064549 259996373 1.03
clickbench_q06/duckdb:parquet 46354306 45639690 1.02
clickbench_q07/duckdb:parquet 29690289 29351985 1.01
clickbench_q08/duckdb:parquet 264925785 265510481 1.00
clickbench_q09/duckdb:parquet 396833577 393813738 1.01
clickbench_q10/duckdb:parquet 81233039 80960270 1.00
clickbench_q11/duckdb:parquet 97602339 97982786 1.00
clickbench_q12/duckdb:parquet 289759483 287135837 1.01
clickbench_q13/duckdb:parquet 480669117 473601141 1.01
clickbench_q14/duckdb:parquet 324058150 323978007 1.00
clickbench_q15/duckdb:parquet 260351225 257315795 1.01
clickbench_q16/duckdb:parquet 651881563 642736251 1.01
clickbench_q17/duckdb:parquet 538667562 538298099 1.00
clickbench_q18/duckdb:parquet 1070116906 1055346444 1.01
clickbench_q19/duckdb:parquet 25983741 25142261 1.03
clickbench_q20/duckdb:parquet 426572259 418157160 1.02
clickbench_q21/duckdb:parquet 538433847 548094227 0.98
clickbench_q22/duckdb:parquet 922076170 930796346 0.99
clickbench_q23/duckdb:parquet 310513514 310341104 1.00
clickbench_q24/duckdb:parquet 68650543 67372368 1.02
clickbench_q25/duckdb:parquet 156535530 156094117 1.00
clickbench_q26/duckdb:parquet 🚀 47793698 53131313 0.90
clickbench_q27/duckdb:parquet 632973343 638552840 0.99
clickbench_q28/duckdb:parquet 4824181519 4830006358 1.00
clickbench_q29/duckdb:parquet 40567082 41170413 0.99
clickbench_q30/duckdb:parquet 297689587 299451354 0.99
clickbench_q31/duckdb:parquet 361954228 356452318 1.02
clickbench_q32/duckdb:parquet 1160867842 1156891468 1.00
clickbench_q33/duckdb:parquet 1247621762 1244531076 1.00
clickbench_q34/duckdb:parquet 1284926676 1297279182 0.99
clickbench_q35/duckdb:parquet 365222970 362949878 1.01
clickbench_q36/duckdb:parquet 45158923 45097355 1.00
clickbench_q37/duckdb:parquet 33406075 31704564 1.05
clickbench_q38/duckdb:parquet 32122573 34129518 0.94
clickbench_q39/duckdb:parquet 80103094 79595824 1.01
clickbench_q40/duckdb:parquet 18037578 16784787 1.07
clickbench_q41/duckdb:parquet 17258437 17450361 0.99
clickbench_q42/duckdb:parquet 21117493 21892379 0.96
duckdb / duckdb (0.998x ➖, 0↑ 0↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 16825019 17553084 0.96
clickbench_q01/duckdb:duckdb 32621478 33098086 0.99
clickbench_q02/duckdb:duckdb 44640232 44668384 1.00
clickbench_q03/duckdb:duckdb 46207998 47272839 0.98
clickbench_q04/duckdb:duckdb 189019845 195851019 0.97
clickbench_q05/duckdb:duckdb 266752476 261808377 1.02
clickbench_q06/duckdb:duckdb 28764425 28143185 1.02
clickbench_q07/duckdb:duckdb 35539796 35581767 1.00
clickbench_q08/duckdb:duckdb 247975564 244512876 1.01
clickbench_q09/duckdb:duckdb 367479856 366562093 1.00
clickbench_q10/duckdb:duckdb 97674364 96850050 1.01
clickbench_q11/duckdb:duckdb 106619351 105727429 1.01
clickbench_q12/duckdb:duckdb 234752320 238876966 0.98
clickbench_q13/duckdb:duckdb 497709284 473718307 1.05
clickbench_q14/duckdb:duckdb 271568814 278809715 0.97
clickbench_q15/duckdb:duckdb 218346993 218138717 1.00
clickbench_q16/duckdb:duckdb 655958389 658450719 1.00
clickbench_q17/duckdb:duckdb 614705934 575387066 1.07
clickbench_q18/duckdb:duckdb 1270209371 1263864732 1.01
clickbench_q19/duckdb:duckdb 33835368 34345563 0.99
clickbench_q20/duckdb:duckdb 1114903340 1035698362 1.08
clickbench_q21/duckdb:duckdb 1153172801 1056261192 1.09
clickbench_q22/duckdb:duckdb 1151747743 1183275017 0.97
clickbench_q23/duckdb:duckdb 255043352 254294929 1.00
clickbench_q24/duckdb:duckdb 61398590 61159241 1.00
clickbench_q25/duckdb:duckdb 139857590 141790655 0.99
clickbench_q26/duckdb:duckdb 60127551 56062756 1.07
clickbench_q27/duckdb:duckdb 1161036978 1232515316 0.94
clickbench_q28/duckdb:duckdb 4650523356 4630798984 1.00
clickbench_q29/duckdb:duckdb 47422114 47654190 1.00
clickbench_q30/duckdb:duckdb 263245288 261799846 1.01
clickbench_q31/duckdb:duckdb 432676169 406889098 1.06
clickbench_q32/duckdb:duckdb 1517124602 1609210337 0.94
clickbench_q33/duckdb:duckdb 1999250143 2122578534 0.94
clickbench_q34/duckdb:duckdb 2074606677 2243406218 0.92
clickbench_q35/duckdb:duckdb 280122715 280677543 1.00
clickbench_q36/duckdb:duckdb 40932202 41675939 0.98
clickbench_q37/duckdb:duckdb 31345995 29545861 1.06
clickbench_q38/duckdb:duckdb 30751716 32208766 0.95
clickbench_q39/duckdb:duckdb 64457964 65740012 0.98
clickbench_q40/duckdb:duckdb 31108443 31534186 0.99
clickbench_q41/duckdb:duckdb 29908555 31417277 0.95
clickbench_q42/duckdb:duckdb 30896707 31014244 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +14.1% -5.8% +21.2% +741.3% ➖ noise
0 duckdb:duckdb -4.1% -5.8% +1.7% +286.8% ➖ noise
0 duckdb:vortex-file-compressed -1.6% -5.8% +4.4% +470.4% ➖ noise
1 datafusion:vortex-file-compressed +1.9% -1.4% +3.3% +24.7% ➖ noise
1 duckdb:duckdb -1.4% -1.4% -0.1% +50.7% ➖ noise
1 duckdb:vortex-file-compressed -0.4% -1.4% +1.0% +22.5% ➖ noise
2 datafusion:vortex-file-compressed +8.1% -3.1% +11.5% +15.8% ➖ noise
2 duckdb:duckdb -0.1% -3.1% +3.1% +16.2% ➖ noise
2 duckdb:vortex-file-compressed -1.5% -3.1% +1.6% +11.7% ➖ noise
3 datafusion:vortex-file-compressed +10.1% -1.9% +12.1% +164.7% ➖ noise
3 duckdb:duckdb -2.3% -1.9% -0.4% +32.4% ➖ noise
3 duckdb:vortex-file-compressed +0.2% -1.9% +2.1% +115.4% ➖ noise
4 datafusion:vortex-file-compressed +9.0% -1.9% +11.0% +10.0% 🚨 regression
4 duckdb:duckdb -3.5% -1.9% -1.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.9% -1.9% +3.9% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +4.5% +3.5% +1.0% +10.0% ➖ noise
5 duckdb:duckdb +1.9% +3.5% -1.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -2.8% +3.5% -6.1% +10.2% ➖ noise
6 datafusion:vortex-file-compressed +1.9% -1.7% +3.7% +83.0% ➖ noise
6 duckdb:duckdb +2.2% -1.7% +4.0% +28.6% ➖ noise
6 duckdb:vortex-file-compressed -2.3% -1.7% -0.6% +18.8% ➖ noise
7 datafusion:vortex-file-compressed +3.0% +4.2% -1.2% +15.8% ➖ noise
7 duckdb:duckdb -0.1% +4.2% -4.1% +10.5% ➖ noise
7 duckdb:vortex-file-compressed +14.5% +4.2% +9.9% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +7.4% +0.5% +6.9% +10.0% ➖ noise
8 duckdb:duckdb +1.4% +0.5% +0.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +1.4% +0.5% +0.9% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +3.2% -1.0% +4.2% +10.0% ➖ noise
9 duckdb:duckdb +0.3% -1.0% +1.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.1% -1.0% +1.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +4.0% +1.3% +2.7% +10.0% ➖ noise
10 duckdb:duckdb +0.9% +1.3% -0.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +1.5% +1.3% +0.2% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +0.6% +0.3% +0.4% +10.0% ➖ noise
11 duckdb:duckdb +0.8% +0.3% +0.6% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +1.3% +0.3% +1.1% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +3.4% +2.3% +1.1% +10.0% ➖ noise
12 duckdb:duckdb -1.7% +2.3% -3.9% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -3.4% +2.3% -5.5% +10.3% ➖ noise
13 datafusion:vortex-file-compressed +3.3% +0.1% +3.2% +10.0% ➖ noise
13 duckdb:duckdb +5.1% +0.1% +4.9% +10.6% ➖ noise
13 duckdb:vortex-file-compressed +1.1% +0.1% +1.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +2.4% +0.4% +2.0% +10.0% ➖ noise
14 duckdb:duckdb -2.6% +0.4% -3.0% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.5% +0.4% -0.8% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.6% +0.7% -0.1% +10.0% ➖ noise
15 duckdb:duckdb +0.1% +0.7% -0.6% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +2.8% +0.7% +2.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.1% +0.7% +0.5% +10.0% ➖ noise
16 duckdb:duckdb -0.4% +0.7% -1.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +2.9% +0.7% +2.2% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -0.5% +0.7% -1.2% +10.0% ➖ noise
17 duckdb:duckdb +6.8% +0.7% +6.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -0.6% +0.7% -1.4% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +2.2% +1.5% +0.8% +10.0% ➖ noise
18 duckdb:duckdb +0.5% +1.5% -1.0% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +1.6% +1.5% +0.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -6.5% +4.0% -10.1% +23.7% ➖ noise
19 duckdb:duckdb -1.5% +4.0% -5.2% +15.6% ➖ noise
19 duckdb:vortex-file-compressed +9.2% +4.0% +5.0% +17.1% ➖ noise
20 datafusion:vortex-file-compressed -1.2% +0.0% -1.2% +212.9% ➖ noise
20 duckdb:duckdb +7.6% +0.0% +7.6% +17.4% ➖ noise
20 duckdb:vortex-file-compressed -3.3% +0.0% -3.3% +107.0% ➖ noise
21 datafusion:vortex-file-compressed +0.1% -0.6% +0.6% +10.0% ➖ noise
21 duckdb:duckdb +9.2% -0.6% +9.8% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -1.3% -0.6% -0.8% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +0.3% +0.2% +0.1% +15.1% ➖ noise
22 duckdb:duckdb -2.7% +0.2% -2.8% +14.5% ➖ noise
22 duckdb:vortex-file-compressed -16.7% +0.2% -16.9% +14.4% ✅ faster
23 datafusion:vortex-file-compressed +9.4% -0.1% +9.5% +51.1% ➖ noise
23 duckdb:duckdb +0.3% -0.1% +0.4% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +91.8% -0.1% +91.9% +51.8% 🚨 regression
24 datafusion:vortex-file-compressed +0.6% +2.0% -1.4% +10.0% ➖ noise
24 duckdb:duckdb +0.4% +2.0% -1.6% +10.7% ➖ noise
24 duckdb:vortex-file-compressed -6.4% +2.0% -8.3% +26.4% ➖ noise
25 datafusion:vortex-file-compressed +1.8% +1.0% +0.7% +10.0% ➖ noise
25 duckdb:duckdb -1.4% +1.0% -2.4% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +2.3% +1.0% +1.3% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -1.7% -6.4% +5.1% +10.0% ➖ noise
26 duckdb:duckdb +7.3% -6.4% +14.6% +13.3% 🚨 regression
26 duckdb:vortex-file-compressed -14.8% -6.4% -8.9% +22.5% ➖ noise
27 datafusion:vortex-file-compressed +3.7% -0.5% +4.3% +10.0% ➖ noise
27 duckdb:duckdb -5.8% -0.5% -5.3% +10.8% ➖ noise
27 duckdb:vortex-file-compressed +1.6% -0.5% +2.1% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +1.9% -0.8% +2.7% +10.0% ➖ noise
28 duckdb:duckdb +0.4% -0.8% +1.3% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.5% -0.8% +1.3% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -0.8% -1.4% +0.6% +10.0% ➖ noise
29 duckdb:duckdb -0.5% -1.4% +0.9% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -6.9% -1.4% -5.6% +13.6% ➖ noise
30 datafusion:vortex-file-compressed +0.5% +1.1% -0.6% +10.0% ➖ noise
30 duckdb:duckdb +0.6% +1.1% -0.6% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -0.6% +1.1% -1.7% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +0.6% +0.4% +0.1% +10.0% ➖ noise
31 duckdb:duckdb +6.3% +0.4% +5.9% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +0.2% +0.4% -0.2% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -1.1% -2.0% +0.9% +10.0% ➖ noise
32 duckdb:duckdb -5.7% -2.0% -3.8% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +0.1% -2.0% +2.1% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +1.1% +3.2% -2.0% +10.0% ➖ noise
33 duckdb:duckdb -5.8% +3.2% -8.8% +11.8% ➖ noise
33 duckdb:vortex-file-compressed +3.0% +3.2% -0.2% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +0.2% +5.2% -4.7% +10.0% ➖ noise
34 duckdb:duckdb -7.5% +5.2% -12.1% +10.0% ✅ faster
34 duckdb:vortex-file-compressed -0.6% +5.2% -5.5% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +0.1% +7.5% -6.9% +10.0% ➖ noise
35 duckdb:duckdb -0.2% +7.5% -7.1% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +1.7% +7.5% -5.4% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +1.4% +7.3% -5.5% +10.0% ➖ noise
36 duckdb:duckdb -1.8% +7.3% -8.5% +12.4% ➖ noise
36 duckdb:vortex-file-compressed -18.4% +7.3% -23.9% +10.0% ✅ faster
37 datafusion:vortex-file-compressed -1.6% +9.8% -10.3% +10.0% ✅ faster
37 duckdb:duckdb +6.1% +9.8% -3.4% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -24.3% +9.8% -31.1% +10.0% ✅ faster
38 datafusion:vortex-file-compressed -3.5% +3.8% -7.1% +10.0% ➖ noise
38 duckdb:duckdb -4.5% +3.8% -8.1% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -21.2% +3.8% -24.1% +10.0% ✅ faster
39 datafusion:vortex-file-compressed +0.3% +4.2% -3.7% +10.5% ➖ noise
39 duckdb:duckdb -2.0% +4.2% -5.9% +11.6% ➖ noise
39 duckdb:vortex-file-compressed -15.2% +4.2% -18.6% +13.1% ✅ faster
40 datafusion:vortex-file-compressed +3.8% +8.4% -4.2% +10.6% ➖ noise
40 duckdb:duckdb -1.4% +8.4% -9.0% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -27.1% +8.4% -32.8% +12.7% ✅ faster
41 datafusion:vortex-file-compressed -0.0% +1.6% -1.6% +10.0% ➖ noise
41 duckdb:duckdb -4.8% +1.6% -6.3% +11.9% ➖ noise
41 duckdb:vortex-file-compressed -22.6% +1.6% -23.8% +10.0% ✅ faster
42 datafusion:vortex-file-compressed -1.1% +6.7% -7.3% +10.0% ➖ noise
42 duckdb:duckdb -0.4% +6.7% -6.6% +10.0% ➖ noise
42 duckdb:vortex-file-compressed -16.8% +6.7% -22.0% +12.2% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (201 files changed, -0.0% overall, 200↑ 1↓)
File Scale Format Base HEAD Change %
hits_48.vortex 1.0 vortex-compact 17.32 MB 17.32 MB +32 B +0.0%
hits_47.vortex 1.0 vortex-compact 18.25 MB 18.25 MB +32 B +0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.53 MB 28.53 MB +32 B +0.0%
hits_33.vortex 1.0 vortex-compact 35.95 MB 35.95 MB +32 B +0.0%
hits_29.vortex 1.0 vortex-compact 36.61 MB 36.61 MB +32 B +0.0%
hits_20.vortex 1.0 vortex-compact 38.14 MB 38.14 MB +32 B +0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.86 MB 41.86 MB +32 B +0.0%
hits_46.vortex 1.0 vortex-compact 41.92 MB 41.92 MB +32 B +0.0%
hits_75.vortex 1.0 vortex-compact 43.63 MB 43.63 MB +32 B +0.0%
hits_24.vortex 1.0 vortex-compact 43.63 MB 43.63 MB +32 B +0.0%
hits_32.vortex 1.0 vortex-compact 44.13 MB 44.13 MB +32 B +0.0%
hits_23.vortex 1.0 vortex-compact 44.17 MB 44.17 MB +32 B +0.0%
hits_22.vortex 1.0 vortex-compact 44.74 MB 44.74 MB +32 B +0.0%
hits_19.vortex 1.0 vortex-compact 44.88 MB 44.88 MB +32 B +0.0%
hits_63.vortex 1.0 vortex-compact 46.10 MB 46.10 MB +32 B +0.0%
hits_15.vortex 1.0 vortex-compact 48.14 MB 48.14 MB +32 B +0.0%
hits_86.vortex 1.0 vortex-compact 48.25 MB 48.25 MB +32 B +0.0%
hits_16.vortex 1.0 vortex-compact 48.30 MB 48.30 MB +32 B +0.0%
hits_10.vortex 1.0 vortex-compact 48.86 MB 48.86 MB +32 B +0.0%
hits_36.vortex 1.0 vortex-compact 48.99 MB 48.99 MB +32 B +0.0%
hits_39.vortex 1.0 vortex-compact 49.82 MB 49.82 MB +32 B +0.0%
hits_49.vortex 1.0 vortex-compact 50.53 MB 50.53 MB +32 B +0.0%
hits_21.vortex 1.0 vortex-compact 51.60 MB 51.60 MB +32 B +0.0%
hits_72.vortex 1.0 vortex-compact 51.79 MB 51.79 MB +32 B +0.0%
hits_83.vortex 1.0 vortex-compact 52.57 MB 52.57 MB +32 B +0.0%
hits_85.vortex 1.0 vortex-compact 52.73 MB 52.73 MB +32 B +0.0%
hits_66.vortex 1.0 vortex-compact 53.49 MB 53.49 MB +32 B +0.0%
hits_37.vortex 1.0 vortex-compact 53.83 MB 53.83 MB +32 B +0.0%
hits_64.vortex 1.0 vortex-compact 53.91 MB 53.91 MB +32 B +0.0%
hits_11.vortex 1.0 vortex-compact 54.35 MB 54.35 MB +32 B +0.0%
hits_31.vortex 1.0 vortex-compact 55.56 MB 55.56 MB +32 B +0.0%
hits_61.vortex 1.0 vortex-compact 57.66 MB 57.66 MB +32 B +0.0%
hits_95.vortex 1.0 vortex-compact 57.75 MB 57.75 MB +32 B +0.0%
hits_34.vortex 1.0 vortex-compact 58.26 MB 58.26 MB +32 B +0.0%
hits_17.vortex 1.0 vortex-compact 58.32 MB 58.32 MB +32 B +0.0%
hits_0.vortex 1.0 vortex-compact 58.66 MB 58.66 MB +32 B +0.0%
hits_30.vortex 1.0 vortex-compact 58.69 MB 58.69 MB +32 B +0.0%
hits_93.vortex 1.0 vortex-compact 58.90 MB 58.90 MB +32 B +0.0%
hits_53.vortex 1.0 vortex-compact 59.09 MB 59.09 MB +32 B +0.0%
hits_58.vortex 1.0 vortex-compact 60.41 MB 60.41 MB +32 B +0.0%
hits_91.vortex 1.0 vortex-compact 60.94 MB 60.94 MB +32 B +0.0%
hits_70.vortex 1.0 vortex-compact 61.29 MB 61.29 MB +32 B +0.0%
hits_8.vortex 1.0 vortex-compact 62.89 MB 62.89 MB +32 B +0.0%
hits_5.vortex 1.0 vortex-compact 62.90 MB 62.90 MB +32 B +0.0%
hits_33.vortex 1.0 vortex-file-compressed 62.97 MB 62.97 MB +32 B +0.0%
hits_38.vortex 1.0 vortex-compact 63.10 MB 63.10 MB +32 B +0.0%
hits_6.vortex 1.0 vortex-compact 63.16 MB 63.16 MB +32 B +0.0%
hits_52.vortex 1.0 vortex-compact 63.73 MB 63.73 MB +32 B +0.0%
hits_7.vortex 1.0 vortex-compact 63.80 MB 63.80 MB +32 B +0.0%
hits_18.vortex 1.0 vortex-compact 64.28 MB 64.28 MB +32 B +0.0%
hits_60.vortex 1.0 vortex-compact 64.33 MB 64.33 MB +32 B +0.0%
hits_81.vortex 1.0 vortex-compact 65.45 MB 65.45 MB +32 B +0.0%
hits_29.vortex 1.0 vortex-file-compressed 65.47 MB 65.47 MB +32 B +0.0%
hits_9.vortex 1.0 vortex-compact 65.67 MB 65.67 MB +32 B +0.0%
hits_59.vortex 1.0 vortex-compact 66.30 MB 66.30 MB +32 B +0.0%
hits_82.vortex 1.0 vortex-compact 66.89 MB 66.89 MB +32 B +0.0%
hits_20.vortex 1.0 vortex-file-compressed 67.53 MB 67.53 MB +32 B +0.0%
hits_13.vortex 1.0 vortex-compact 67.96 MB 67.96 MB +32 B +0.0%
hits_80.vortex 1.0 vortex-compact 68.07 MB 68.07 MB +32 B +0.0%
hits_97.vortex 1.0 vortex-compact 69.16 MB 69.16 MB +32 B +0.0%
hits_12.vortex 1.0 vortex-compact 69.27 MB 69.27 MB +32 B +0.0%
hits_71.vortex 1.0 vortex-compact 69.29 MB 69.29 MB +32 B +0.0%
hits_27.vortex 1.0 vortex-compact 69.88 MB 69.88 MB +32 B +0.0%
hits_73.vortex 1.0 vortex-compact 70.04 MB 70.04 MB +32 B +0.0%
hits_28.vortex 1.0 vortex-compact 70.27 MB 70.27 MB +32 B +0.0%
hits_26.vortex 1.0 vortex-compact 70.89 MB 70.89 MB +32 B +0.0%
hits_74.vortex 1.0 vortex-compact 71.62 MB 71.62 MB +32 B +0.0%
hits_4.vortex 1.0 vortex-compact 71.81 MB 71.81 MB +32 B +0.0%
hits_98.vortex 1.0 vortex-compact 72.77 MB 72.77 MB +32 B +0.0%
hits_25.vortex 1.0 vortex-compact 73.14 MB 73.14 MB +32 B +0.0%
hits_84.vortex 1.0 vortex-compact 73.14 MB 73.14 MB +32 B +0.0%
hits_88.vortex 1.0 vortex-compact 73.31 MB 73.31 MB +32 B +0.0%
hits_14.vortex 1.0 vortex-compact 73.75 MB 73.75 MB +32 B +0.0%
hits_75.vortex 1.0 vortex-file-compressed 74.18 MB 74.18 MB +32 B +0.0%
hits_62.vortex 1.0 vortex-compact 74.26 MB 74.26 MB +32 B +0.0%
hits_35.vortex 1.0 vortex-compact 75.11 MB 75.11 MB +32 B +0.0%
hits_40.vortex 1.0 vortex-compact 75.92 MB 75.92 MB +32 B +0.0%
hits_68.vortex 1.0 vortex-compact 75.99 MB 75.99 MB +32 B +0.0%
hits_45.vortex 1.0 vortex-compact 76.07 MB 76.07 MB +32 B +0.0%
hits_76.vortex 1.0 vortex-compact 76.44 MB 76.44 MB +32 B +0.0%
hits_32.vortex 1.0 vortex-file-compressed 77.12 MB 77.12 MB +32 B +0.0%
hits_99.vortex 1.0 vortex-compact 77.31 MB 77.31 MB +32 B +0.0%
hits_56.vortex 1.0 vortex-compact 77.87 MB 77.87 MB +32 B +0.0%
hits_24.vortex 1.0 vortex-file-compressed 79.71 MB 79.71 MB +32 B +0.0%
hits_36.vortex 1.0 vortex-file-compressed 80.27 MB 80.27 MB +32 B +0.0%
hits_46.vortex 1.0 vortex-file-compressed 80.32 MB 80.32 MB +32 B +0.0%
hits_23.vortex 1.0 vortex-file-compressed 80.37 MB 80.37 MB +32 B +0.0%
hits_63.vortex 1.0 vortex-file-compressed 80.62 MB 80.62 MB +32 B +0.0%
hits_69.vortex 1.0 vortex-compact 81.02 MB 81.02 MB +32 B +0.0%
hits_22.vortex 1.0 vortex-file-compressed 81.17 MB 81.17 MB +32 B +0.0%
hits_86.vortex 1.0 vortex-file-compressed 81.40 MB 81.40 MB +32 B +0.0%
hits_10.vortex 1.0 vortex-file-compressed 81.76 MB 81.76 MB +32 B +0.0%
hits_90.vortex 1.0 vortex-compact 81.86 MB 81.86 MB +32 B +0.0%
hits_19.vortex 1.0 vortex-file-compressed 82.10 MB 82.10 MB +32 B +0.0%
hits_57.vortex 1.0 vortex-compact 83.54 MB 83.54 MB +32 B +0.0%
hits_79.vortex 1.0 vortex-compact 85.70 MB 85.70 MB +32 B +0.0%
hits_16.vortex 1.0 vortex-file-compressed 87.59 MB 87.59 MB +32 B +0.0%
hits_49.vortex 1.0 vortex-file-compressed 88.67 MB 88.67 MB +32 B +0.0%
hits_1.vortex 1.0 vortex-compact 90.34 MB 90.34 MB +32 B +0.0%
hits_94.vortex 1.0 vortex-compact 90.63 MB 90.63 MB +32 B +0.0%
hits_96.vortex 1.0 vortex-compact 91.08 MB 91.08 MB +32 B +0.0%
hits_55.vortex 1.0 vortex-compact 93.77 MB 93.77 MB +32 B +0.0%
hits_39.vortex 1.0 vortex-file-compressed 94.06 MB 94.06 MB +32 B +0.0%
hits_3.vortex 1.0 vortex-compact 94.23 MB 94.23 MB +32 B +0.0%
hits_92.vortex 1.0 vortex-compact 94.27 MB 94.27 MB +32 B +0.0%
hits_64.vortex 1.0 vortex-file-compressed 95.27 MB 95.27 MB +32 B +0.0%
hits_11.vortex 1.0 vortex-file-compressed 96.07 MB 96.07 MB +32 B +0.0%
hits_72.vortex 1.0 vortex-file-compressed 96.27 MB 96.27 MB +32 B +0.0%
hits_15.vortex 1.0 vortex-file-compressed 97.01 MB 97.01 MB +32 B +0.0%
hits_37.vortex 1.0 vortex-file-compressed 97.54 MB 97.54 MB +32 B +0.0%
hits_78.vortex 1.0 vortex-compact 97.87 MB 97.87 MB +32 B +0.0%
hits_53.vortex 1.0 vortex-file-compressed 98.26 MB 98.26 MB +32 B +0.0%
hits_21.vortex 1.0 vortex-file-compressed 101.28 MB 101.28 MB +32 B +0.0%
hits_17.vortex 1.0 vortex-file-compressed 103.64 MB 103.64 MB +32 B +0.0%
hits_83.vortex 1.0 vortex-file-compressed 103.72 MB 103.72 MB +32 B +0.0%
hits_30.vortex 1.0 vortex-file-compressed 104.00 MB 104.00 MB +32 B +0.0%
hits_31.vortex 1.0 vortex-file-compressed 104.39 MB 104.39 MB +32 B +0.0%
hits_66.vortex 1.0 vortex-file-compressed 105.34 MB 105.34 MB +32 B +0.0%
hits_85.vortex 1.0 vortex-file-compressed 106.37 MB 106.37 MB +32 B +0.0%
hits_93.vortex 1.0 vortex-file-compressed 107.66 MB 107.66 MB +32 B +0.0%
hits_34.vortex 1.0 vortex-file-compressed 111.68 MB 111.68 MB +32 B +0.0%
hits_0.vortex 1.0 vortex-file-compressed 112.17 MB 112.17 MB +32 B +0.0%
hits_89.vortex 1.0 vortex-compact 112.82 MB 112.82 MB +32 B +0.0%
hits_50.vortex 1.0 vortex-compact 113.12 MB 113.12 MB +32 B +0.0%
hits_58.vortex 1.0 vortex-file-compressed 113.78 MB 113.78 MB +32 B +0.0%
hits_67.vortex 1.0 vortex-compact 114.05 MB 114.05 MB +32 B +0.0%
hits_95.vortex 1.0 vortex-file-compressed 114.33 MB 114.33 MB +32 B +0.0%
hits_61.vortex 1.0 vortex-file-compressed 114.43 MB 114.43 MB +32 B +0.0%
hits_70.vortex 1.0 vortex-file-compressed 115.14 MB 115.14 MB +32 B +0.0%
hits_91.vortex 1.0 vortex-file-compressed 116.23 MB 116.23 MB +32 B +0.0%
hits_54.vortex 1.0 vortex-compact 117.66 MB 117.66 MB +32 B +0.0%
hits_77.vortex 1.0 vortex-compact 118.11 MB 118.11 MB +32 B +0.0%
hits_38.vortex 1.0 vortex-file-compressed 118.43 MB 118.43 MB +32 B +0.0%
hits_87.vortex 1.0 vortex-compact 119.04 MB 119.04 MB +32 B +0.0%
hits_52.vortex 1.0 vortex-file-compressed 120.78 MB 120.78 MB +32 B +0.0%
hits_60.vortex 1.0 vortex-file-compressed 121.19 MB 121.19 MB +32 B +0.0%
hits_59.vortex 1.0 vortex-file-compressed 121.84 MB 121.84 MB +32 B +0.0%
hits_5.vortex 1.0 vortex-file-compressed 122.64 MB 122.64 MB +32 B +0.0%
hits_82.vortex 1.0 vortex-file-compressed 122.77 MB 122.77 MB +32 B +0.0%
hits_8.vortex 1.0 vortex-file-compressed 122.86 MB 122.86 MB +32 B +0.0%
hits_6.vortex 1.0 vortex-file-compressed 122.86 MB 122.86 MB +32 B +0.0%
hits_13.vortex 1.0 vortex-file-compressed 123.20 MB 123.20 MB +32 B +0.0%
hits_7.vortex 1.0 vortex-file-compressed 123.82 MB 123.82 MB +32 B +0.0%
hits_9.vortex 1.0 vortex-file-compressed 124.22 MB 124.22 MB +32 B +0.0%
hits_80.vortex 1.0 vortex-file-compressed 124.24 MB 124.24 MB +32 B +0.0%
hits_12.vortex 1.0 vortex-file-compressed 125.34 MB 125.34 MB +32 B +0.0%
hits_18.vortex 1.0 vortex-file-compressed 126.06 MB 126.06 MB +32 B +0.0%
hits_71.vortex 1.0 vortex-file-compressed 126.41 MB 126.41 MB +32 B +0.0%
hits_81.vortex 1.0 vortex-file-compressed 126.55 MB 126.55 MB +32 B +0.0%
hits_2.vortex 1.0 vortex-compact 129.36 MB 129.36 MB +32 B +0.0%
hits_65.vortex 1.0 vortex-compact 129.95 MB 129.95 MB +32 B +0.0%
hits_97.vortex 1.0 vortex-file-compressed 130.96 MB 130.96 MB +32 B +0.0%
hits_73.vortex 1.0 vortex-file-compressed 131.83 MB 131.83 MB +32 B +0.0%
hits_44.vortex 1.0 vortex-compact 132.46 MB 132.46 MB +32 B +0.0%
hits_14.vortex 1.0 vortex-file-compressed 135.14 MB 135.14 MB +32 B +0.0%
hits_25.vortex 1.0 vortex-file-compressed 137.01 MB 137.01 MB +32 B +0.0%
hits_88.vortex 1.0 vortex-file-compressed 137.34 MB 137.34 MB +32 B +0.0%
hits_35.vortex 1.0 vortex-file-compressed 138.81 MB 138.81 MB +32 B +0.0%
hits_4.vortex 1.0 vortex-file-compressed 138.86 MB 138.86 MB +32 B +0.0%
hits_76.vortex 1.0 vortex-file-compressed 140.05 MB 140.05 MB +32 B +0.0%
hits_40.vortex 1.0 vortex-file-compressed 142.99 MB 142.99 MB +32 B +0.0%
hits_26.vortex 1.0 vortex-file-compressed 144.05 MB 144.05 MB +32 B +0.0%
hits_84.vortex 1.0 vortex-file-compressed 145.05 MB 145.05 MB +32 B +0.0%
hits_45.vortex 1.0 vortex-file-compressed 145.48 MB 145.48 MB +32 B +0.0%
hits_69.vortex 1.0 vortex-file-compressed 147.61 MB 147.61 MB +32 B +0.0%
hits_62.vortex 1.0 vortex-file-compressed 148.36 MB 148.36 MB +32 B +0.0%
hits_98.vortex 1.0 vortex-file-compressed 150.55 MB 150.55 MB +32 B +0.0%
hits_74.vortex 1.0 vortex-file-compressed 152.12 MB 152.12 MB +32 B +0.0%
hits_57.vortex 1.0 vortex-file-compressed 158.37 MB 158.37 MB +32 B +0.0%
hits_99.vortex 1.0 vortex-file-compressed 158.88 MB 158.88 MB +32 B +0.0%
hits_56.vortex 1.0 vortex-file-compressed 163.76 MB 163.76 MB +32 B +0.0%
hits_42.vortex 1.0 vortex-compact 164.22 MB 164.22 MB +32 B +0.0%
hits_41.vortex 1.0 vortex-compact 165.78 MB 165.78 MB +32 B +0.0%
hits_28.vortex 1.0 vortex-file-compressed 167.55 MB 167.55 MB +32 B +0.0%
hits_51.vortex 1.0 vortex-compact 167.81 MB 167.81 MB +32 B +0.0%
hits_43.vortex 1.0 vortex-compact 168.91 MB 168.91 MB +32 B +0.0%
hits_68.vortex 1.0 vortex-file-compressed 172.16 MB 172.16 MB +32 B +0.0%
hits_27.vortex 1.0 vortex-file-compressed 174.61 MB 174.61 MB +32 B +0.0%
hits_96.vortex 1.0 vortex-file-compressed 180.76 MB 180.76 MB +32 B +0.0%
hits_1.vortex 1.0 vortex-file-compressed 181.16 MB 181.16 MB +32 B +0.0%
hits_94.vortex 1.0 vortex-file-compressed 185.12 MB 185.12 MB +32 B +0.0%
hits_3.vortex 1.0 vortex-file-compressed 193.11 MB 193.11 MB +32 B +0.0%
hits_92.vortex 1.0 vortex-file-compressed 196.47 MB 196.47 MB +32 B +0.0%
hits_90.vortex 1.0 vortex-file-compressed 204.12 MB 204.12 MB +32 B +0.0%
hits_79.vortex 1.0 vortex-file-compressed 204.16 MB 204.16 MB +32 B +0.0%
hits_77.vortex 1.0 vortex-file-compressed 218.96 MB 218.96 MB +32 B +0.0%
hits_87.vortex 1.0 vortex-file-compressed 221.68 MB 221.68 MB +32 B +0.0%
hits_65.vortex 1.0 vortex-file-compressed 238.05 MB 238.05 MB +32 B +0.0%
hits_78.vortex 1.0 vortex-file-compressed 238.59 MB 238.59 MB +32 B +0.0%
hits_2.vortex 1.0 vortex-file-compressed 241.46 MB 241.46 MB +32 B +0.0%
hits_44.vortex 1.0 vortex-file-compressed 243.64 MB 243.64 MB +32 B +0.0%
hits_55.vortex 1.0 vortex-file-compressed 251.56 MB 251.56 MB +32 B +0.0%
hits_50.vortex 1.0 vortex-file-compressed 255.24 MB 255.24 MB +32 B +0.0%
hits_67.vortex 1.0 vortex-file-compressed 265.94 MB 265.94 MB +32 B +0.0%
hits_89.vortex 1.0 vortex-file-compressed 266.01 MB 266.01 MB +32 B +0.0%
hits_42.vortex 1.0 vortex-file-compressed 298.79 MB 298.79 MB +32 B +0.0%
hits_41.vortex 1.0 vortex-file-compressed 300.49 MB 300.49 MB +32 B +0.0%
hits_43.vortex 1.0 vortex-file-compressed 305.71 MB 305.71 MB +32 B +0.0%
hits_54.vortex 1.0 vortex-file-compressed 361.83 MB 361.83 MB +32 B +0.0%
hits_51.vortex 1.0 vortex-file-compressed 428.84 MB 428.84 MB +32 B +0.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (+0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.000x ➖
Parquet (geomean): 1.003x ➖


unknown / unknown (1.005x ➖, 0↑ 1↓)
name PR 9019c38 (ns) base b213af1 (ns) ratio (PR/base)
compress time/Arade 1124772484 1133164321 0.99
compress time/Bimbo 6517380819 6622864801 0.98
compress time/CMSprovider 2905452389 2887567905 1.01
compress time/Euro2016 1542846645 1547149327 1.00
compress time/Food 393308266 409742149 0.96
compress time/HashTags 1824116945 1823217765 1.00
compress time/TPC-H l_comment canonical 1625150465 1620079135 1.00
compress time/TPC-H l_comment chunked 1626814380 1624495123 1.00
compress time/taxi 811547863 808274501 1.00
compress time/wide table cols=100 chunks=1 rows=1000 17946424 17580996 1.02
compress time/wide table cols=100 chunks=50 rows=1000 17799040 17931247 0.99
compress time/wide table cols=1000 chunks=1 rows=1000 184671703 188930822 0.98
compress time/wide table cols=1000 chunks=50 rows=1000 183634052 189098198 0.97
compress time/wide table cols=10000 chunks=1 rows=1000 1977207634 2006241350 0.99
compress time/wide table cols=10000 chunks=50 rows=1000 1964398748 1991585115 0.99
decompress time/Arade 29742913 28075537 1.06
decompress time/Bimbo 92807215 92123715 1.01
decompress time/CMSprovider 🚨 91493435 82728241 1.11
decompress time/Euro2016 19331299 19519939 0.99
decompress time/Food 9868663 9232033 1.07
decompress time/HashTags 76369343 72735331 1.05
decompress time/TPC-H l_comment canonical 39901318 39586435 1.01
decompress time/TPC-H l_comment chunked 39079130 40380615 0.97
decompress time/taxi 17617917 16873782 1.04
decompress time/wide table cols=100 chunks=1 rows=1000 2640818 2478717 1.07
decompress time/wide table cols=100 chunks=50 rows=1000 2649421 2563851 1.03
decompress time/wide table cols=1000 chunks=1 rows=1000 24000233 23585239 1.02
decompress time/wide table cols=1000 chunks=50 rows=1000 23930727 23509689 1.02
decompress time/wide table cols=10000 chunks=1 rows=1000 262697957 264867039 0.99
decompress time/wide table cols=10000 chunks=50 rows=1000 261696750 256326337 1.02
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2886898900 2894260557 1.00
parquet_rs-zstd compress time/Bimbo 14619270906 14620012870 1.00
parquet_rs-zstd compress time/CMSprovider 7327344716 7332143671 1.00
parquet_rs-zstd compress time/Euro2016 1345945109 1332214594 1.01
parquet_rs-zstd compress time/Food 861125410 869383546 0.99
parquet_rs-zstd compress time/HashTags 2266674533 2254564763 1.01
parquet_rs-zstd compress time/TPC-H l_comment canonical 3064491392 3111756103 0.98
parquet_rs-zstd compress time/TPC-H l_comment chunked 3103353440 3080612303 1.01
parquet_rs-zstd compress time/taxi 1353809227 1346342874 1.01
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6631144 6538431 1.01
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6694663 6471360 1.03
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 83684270 80294959 1.04
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 83023599 80094557 1.04
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 867770915 839139380 1.03
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 879784773 869003018 1.01
parquet_rs-zstd decompress time/Arade 641180816 637911797 1.01
parquet_rs-zstd decompress time/Bimbo 1756234705 1717016301 1.02
parquet_rs-zstd decompress time/CMSprovider 1947908380 1922283900 1.01
parquet_rs-zstd decompress time/Euro2016 384365660 378538142 1.02
parquet_rs-zstd decompress time/Food 216833990 217030857 1.00
parquet_rs-zstd decompress time/HashTags 620540015 613455955 1.01
parquet_rs-zstd decompress time/TPC-H l_comment canonical 564117912 558829357 1.01
parquet_rs-zstd decompress time/TPC-H l_comment chunked 565782541 554714109 1.02
parquet_rs-zstd decompress time/taxi 248824327 247207798 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2760568 2768654 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2717872 2707094 1.00
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 31878221 31300919 1.02
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 31701618 31589406 1.00
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 340905846 332384176 1.03
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 339771920 342794467 0.99
vortex-file-compressed size/Arade 145363828 145363796 1.00
vortex-file-compressed size/Bimbo 468763364 468763332 1.00
vortex-file-compressed size/CMSprovider 417907844 417907812 1.00
vortex-file-compressed size/Euro2016 163394956 163757340 1.00
vortex-file-compressed size/Food 41926968 41926936 1.00
vortex-file-compressed size/HashTags 195647860 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087392 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087392 179087360 1.00
vortex-file-compressed size/taxi 52363980 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930880 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930880 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293680 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293680 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957680 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957680 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.00
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.98
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.01
vortex:parquet-zstd ratio compress time/Euro2016 1 1 0.99
vortex:parquet-zstd ratio compress time/Food 0 0 0.97
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.00
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.02
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.99
vortex:parquet-zstd ratio compress time/taxi 0 0 1.00
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 2 2 1.01
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2 2 0.96
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 2 2 0.94
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 2 2 0.94
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 2 2 0.95
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 2 2 0.97
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.05
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.98
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.09
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.98
vortex:parquet-zstd ratio decompress time/Food 0 0 1.07
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.04
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.00
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.95
vortex:parquet-zstd ratio decompress time/taxi 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.07
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.03
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants