Skip to content

chore: new bench machines#6953

Closed
joseph-isaacs wants to merge 2 commits into
developfrom
ji/t2
Closed

chore: new bench machines#6953
joseph-isaacs wants to merge 2 commits into
developfrom
ji/t2

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Mar 13, 2026

Copy link
Copy Markdown
Contributor

Summary

Closes: #000

Testing

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 13, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 13, 2026
@github-actions

github-actions Bot commented Mar 13, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Summary

  • Overall: 0.748x ✅
  • Vortex: 0.731x ✅
  • Parquet: 0.784x ✅

Verdict

No clear signal

  • Attributed Vortex impact: -6.8%
  • Confidence: environment too noisy
  • Environment shift: -21.6%

Statistical Summary

  • Systemic shift (parquet controls): -21.6%
  • Control sigma: +7.3%
  • Residual noise: +4.8%
  • Median polish overall: -27.0%
datafusion / vortex-file-compressed (0.806x ✅, 8↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 3814291 5235071 0.73
fineweb_q01/datafusion:vortex-file-compressed 🚀 23492868 26467242 0.89
fineweb_q02/datafusion:vortex-file-compressed 🚀 22530405 27692767 0.81
fineweb_q03/datafusion:vortex-file-compressed 🚀 71922380 86468587 0.83
fineweb_q04/datafusion:vortex-file-compressed 🚀 167562403 226432404 0.74
fineweb_q05/datafusion:vortex-file-compressed 🚀 145586175 199575697 0.73
fineweb_q06/datafusion:vortex-file-compressed 🚀 55192573 67278767 0.82
fineweb_q07/datafusion:vortex-file-compressed 🚀 52220932 66912331 0.78
fineweb_q08/datafusion:vortex-file-compressed 23462785 24733609 0.95
datafusion / vortex-compact (0.659x ✅, 9↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 3555979 4124470 0.86
fineweb_q01/datafusion:vortex-compact 🚀 107910293 161383438 0.67
fineweb_q02/datafusion:vortex-compact 🚀 104498900 162767861 0.64
fineweb_q03/datafusion:vortex-compact 🚀 887705523 1437238490 0.62
fineweb_q04/datafusion:vortex-compact 🚀 948429883 1570850402 0.60
fineweb_q05/datafusion:vortex-compact 🚀 757245949 1231855473 0.61
fineweb_q06/datafusion:vortex-compact 🚀 434766733 695590372 0.63
fineweb_q07/datafusion:vortex-compact 🚀 452326527 721951437 0.63
fineweb_q08/datafusion:vortex-compact 🚀 17125933 24331200 0.70
datafusion / parquet (0.777x ✅, 8↑ 1↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 8007936 6419543 1.25
fineweb_q01/datafusion:parquet 🚀 201742160 273340356 0.74
fineweb_q02/datafusion:parquet 🚀 198676559 274328220 0.72
fineweb_q03/datafusion:parquet 🚀 198314099 271431319 0.73
fineweb_q04/datafusion:parquet 🚀 212598438 284561641 0.75
fineweb_q05/datafusion:parquet 🚀 207706670 277413605 0.75
fineweb_q06/datafusion:parquet 🚀 202190169 285033164 0.71
fineweb_q07/datafusion:parquet 🚀 199549535 271079098 0.74
fineweb_q08/datafusion:parquet 🚀 194576906 266749448 0.73
duckdb / vortex-file-compressed (0.771x ✅, 8↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 2842940 3169900 0.90
fineweb_q01/duckdb:vortex-file-compressed 🚀 21616868 29853819 0.72
fineweb_q02/duckdb:vortex-file-compressed 23941760 26200956 0.91
fineweb_q03/duckdb:vortex-file-compressed 🚀 116092187 139056065 0.83
fineweb_q04/duckdb:vortex-file-compressed 🚀 152539039 206434401 0.74
fineweb_q05/duckdb:vortex-file-compressed 🚀 132620734 187562751 0.71
fineweb_q06/duckdb:vortex-file-compressed 🚀 54225379 72965424 0.74
fineweb_q07/duckdb:vortex-file-compressed 🚀 49735907 71181543 0.70
fineweb_q08/duckdb:vortex-file-compressed 🚀 19799592 27742938 0.71
duckdb / vortex-compact (0.697x ✅, 7↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3410206 3778694 0.90
fineweb_q01/duckdb:vortex-compact 🚀 72866472 105676754 0.69
fineweb_q02/duckdb:vortex-compact 🚀 81263638 110564273 0.73
fineweb_q03/duckdb:vortex-compact 🚀 530804906 859181485 0.62
fineweb_q04/duckdb:vortex-compact 🚀 560370369 901274181 0.62
fineweb_q05/duckdb:vortex-compact 🚀 504982936 812830552 0.62
fineweb_q06/duckdb:vortex-compact 🚀 290600502 466281359 0.62
fineweb_q07/duckdb:vortex-compact 🚀 296265854 472557011 0.63
fineweb_q08/duckdb:vortex-compact 20393233 22267148 0.92
duckdb / parquet (0.791x ✅, 9↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚀 25605419 35960784 0.71
fineweb_q01/duckdb:parquet 🚀 73256746 90525034 0.81
fineweb_q02/duckdb:parquet 🚀 76512432 94008527 0.81
fineweb_q03/duckdb:parquet 🚀 235956018 306576043 0.77
fineweb_q04/duckdb:parquet 🚀 356742209 436321340 0.82
fineweb_q05/duckdb:parquet 🚀 328320672 407583448 0.81
fineweb_q06/duckdb:parquet 🚀 155000242 197170808 0.79
fineweb_q07/duckdb:parquet 🚀 162953746 209020183 0.78
fineweb_q08/duckdb:parquet 🚀 47565696 57296910 0.83
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -13.8% -5.8% -8.5% +57.0% ➖ noise
0 datafusion:vortex-file-compressed -27.1% -5.8% -22.7% +78.3% ➖ noise
0 duckdb:vortex-compact -9.8% -5.8% -4.2% +34.6% ➖ noise
0 duckdb:vortex-file-compressed -10.3% -5.8% -4.8% +47.8% ➖ noise
1 datafusion:vortex-compact -33.1% -22.7% -13.5% +20.0% ➖ noise
1 datafusion:vortex-file-compressed -11.2% -22.7% +14.9% +20.0% ➖ noise
1 duckdb:vortex-compact -31.0% -22.7% -10.8% +21.2% ➖ noise
1 duckdb:vortex-file-compressed -27.6% -22.7% -6.3% +46.9% ➖ noise
2 datafusion:vortex-compact -35.8% -23.2% -16.4% +20.0% ➖ noise
2 datafusion:vortex-file-compressed -18.6% -23.2% +6.0% +22.2% ➖ noise
2 duckdb:vortex-compact -26.5% -23.2% -4.3% +20.0% ➖ noise
2 duckdb:vortex-file-compressed -8.6% -23.2% +19.0% +20.0% ➖ noise
3 datafusion:vortex-compact -38.2% -25.0% -17.6% +20.0% ✅ faster
3 datafusion:vortex-file-compressed -16.8% -25.0% +10.9% +37.1% ➖ noise
3 duckdb:vortex-compact -38.2% -25.0% -17.6% +20.0% ✅ faster
3 duckdb:vortex-file-compressed -16.5% -25.0% +11.3% +27.7% ➖ noise
4 datafusion:vortex-compact -39.6% -21.8% -22.7% +20.0% ✅ faster
4 datafusion:vortex-file-compressed -26.0% -21.8% -5.3% +20.0% ➖ noise
4 duckdb:vortex-compact -37.8% -21.8% -20.4% +20.0% ✅ faster
4 duckdb:vortex-file-compressed -26.1% -21.8% -5.5% +20.0% ➖ noise
5 datafusion:vortex-compact -38.5% -22.3% -20.8% +20.0% ✅ faster
5 datafusion:vortex-file-compressed -27.1% -22.3% -6.1% +20.0% ➖ noise
5 duckdb:vortex-compact -37.9% -22.3% -20.0% +20.0% ✅ faster
5 duckdb:vortex-file-compressed -29.3% -22.3% -9.0% +20.0% ➖ noise
6 datafusion:vortex-compact -37.5% -25.3% -16.3% +20.0% ➖ noise
6 datafusion:vortex-file-compressed -18.0% -25.3% +9.9% +20.0% ➖ noise
6 duckdb:vortex-compact -37.7% -25.3% -16.5% +20.0% ➖ noise
6 duckdb:vortex-file-compressed -25.7% -25.3% -0.5% +20.0% ➖ noise
7 datafusion:vortex-compact -37.3% -24.2% -17.3% +20.0% ✅ faster
7 datafusion:vortex-file-compressed -22.0% -24.2% +3.0% +20.0% ➖ noise
7 duckdb:vortex-compact -37.3% -24.2% -17.2% +20.0% ✅ faster
7 duckdb:vortex-file-compressed -30.1% -24.2% -7.8% +20.0% ➖ noise
8 datafusion:vortex-compact -29.6% -22.2% -9.5% +29.1% ➖ noise
8 datafusion:vortex-file-compressed -5.1% -22.2% +21.9% +35.1% ➖ noise
8 duckdb:vortex-compact -8.4% -22.2% +17.7% +20.0% ➖ noise
8 duckdb:vortex-file-compressed -28.6% -22.2% -8.3% +20.2% ➖ noise

@github-actions

github-actions Bot commented Mar 13, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Summary

  • Overall: 0.808x ✅
  • Vortex: 0.816x ✅
  • Parquet: 0.791x ✅

Verdict

No clear signal

  • Attributed Vortex impact: +3.1%
  • Confidence: medium
  • Environment shift: -20.9%

Statistical Summary

  • Systemic shift (parquet controls): -20.9%
  • Control sigma: +3.6%
  • Residual noise: +3.0%
  • Median polish overall: -16.9%
duckdb / vortex-file-compressed (0.794x ✅, 10↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 🚀 7871421 10834571 0.73
statpopgen_q01/duckdb:vortex-file-compressed 🚀 13555552 26907040 0.50
statpopgen_q02/duckdb:vortex-file-compressed 1233348551 1294042899 0.95
statpopgen_q03/duckdb:vortex-file-compressed 🚀 2599040726 3154086245 0.82
statpopgen_q04/duckdb:vortex-file-compressed 🚀 2639711579 3175448053 0.83
statpopgen_q05/duckdb:vortex-file-compressed 🚀 1212220097 1357259773 0.89
statpopgen_q06/duckdb:vortex-file-compressed 🚀 1786612339 2037883654 0.88
statpopgen_q07/duckdb:vortex-file-compressed 🚀 150318404 195057513 0.77
statpopgen_q08/duckdb:vortex-file-compressed 🚀 160445123 208110521 0.77
statpopgen_q09/duckdb:vortex-file-compressed 🚀 2387814362 2906689621 0.82
statpopgen_q10/duckdb:vortex-file-compressed 🚀 3990267444 4597547637 0.87
duckdb / vortex-compact (0.839x ✅, 9↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 🚀 7733862 10817917 0.71
statpopgen_q01/duckdb:vortex-compact 🚀 136779953 166076297 0.82
statpopgen_q02/duckdb:vortex-compact 🚀 1604593534 1789490518 0.90
statpopgen_q03/duckdb:vortex-compact 3133620222 3457695393 0.91
statpopgen_q04/duckdb:vortex-compact 3169461614 3431462538 0.92
statpopgen_q05/duckdb:vortex-compact 🚀 1556515033 1809401681 0.86
statpopgen_q06/duckdb:vortex-compact 🚀 2215626574 2661003749 0.83
statpopgen_q07/duckdb:vortex-compact 🚀 727381780 961147466 0.76
statpopgen_q08/duckdb:vortex-compact 🚀 763102078 1005351304 0.76
statpopgen_q09/duckdb:vortex-compact 🚀 2966259449 3299395106 0.90
statpopgen_q10/duckdb:vortex-compact 🚀 4744256947 5343826443 0.89
duckdb / parquet (0.791x ✅, 11↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 🚀 246764635 313222834 0.79
statpopgen_q01/duckdb:parquet 🚀 318729874 391906749 0.81
statpopgen_q02/duckdb:parquet 🚀 798486318 997201434 0.80
statpopgen_q03/duckdb:parquet 🚀 1170221728 1490962595 0.78
statpopgen_q04/duckdb:parquet 🚀 1165092238 1519848287 0.77
statpopgen_q05/duckdb:parquet 🚀 790222137 998995001 0.79
statpopgen_q06/duckdb:parquet 🚀 1115375822 1449084303 0.77
statpopgen_q07/duckdb:parquet 🚀 1572309065 1877668923 0.84
statpopgen_q08/duckdb:parquet 🚀 1557566487 1864925931 0.84
statpopgen_q09/duckdb:parquet 🚀 1073468354 1385494000 0.77
statpopgen_q10/duckdb:parquet 🚀 2039085394 2719915812 0.75
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -28.5% -21.2% -9.3% +10.0% ✅ faster
0 duckdb:vortex-file-compressed -27.3% -21.2% -7.8% +12.1% ➖ noise
1 duckdb:vortex-compact -17.6% -18.7% +1.3% +32.6% ➖ noise
1 duckdb:vortex-file-compressed -49.6% -18.7% -38.1% +201.5% ➖ noise
2 duckdb:vortex-compact -10.3% -19.9% +12.0% +10.0% 🚨 regression
2 duckdb:vortex-file-compressed -4.7% -19.9% +19.0% +10.0% 🚨 regression
3 duckdb:vortex-compact -9.4% -21.5% +15.5% +10.0% 🚨 regression
3 duckdb:vortex-file-compressed -17.6% -21.5% +5.0% +10.0% ➖ noise
4 duckdb:vortex-compact -7.6% -23.3% +20.5% +10.0% 🚨 regression
4 duckdb:vortex-file-compressed -16.9% -23.3% +8.4% +10.0% ➖ noise
5 duckdb:vortex-compact -14.0% -20.9% +8.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -10.7% -20.9% +12.9% +10.0% 🚨 regression
6 duckdb:vortex-compact -16.7% -23.0% +8.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -12.3% -23.0% +13.9% +10.0% 🚨 regression
7 duckdb:vortex-compact -24.3% -16.3% -9.6% +10.0% ✅ faster
7 duckdb:vortex-file-compressed -22.9% -16.3% -8.0% +10.0% ➖ noise
8 duckdb:vortex-compact -24.1% -16.5% -9.1% +10.0% ✅ faster
8 duckdb:vortex-file-compressed -22.9% -16.5% -7.7% +10.0% ➖ noise
9 duckdb:vortex-compact -10.1% -22.5% +16.0% +10.0% 🚨 regression
9 duckdb:vortex-file-compressed -17.9% -22.5% +6.0% +10.0% ➖ noise
10 duckdb:vortex-compact -11.2% -25.0% +18.4% +10.0% 🚨 regression
10 duckdb:vortex-file-compressed -13.2% -25.0% +15.8% +10.0% 🚨 regression

@github-actions

github-actions Bot commented Mar 13, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Summary

  • Overall: 0.967x ➖
  • Vortex: 0.965x ➖
  • Parquet: 0.969x ➖

Verdict

No clear signal

  • Attributed Vortex impact: -0.4%
  • Confidence: environment too noisy
  • Environment shift: -3.1%

Statistical Summary

  • Systemic shift (parquet controls): -3.1%
  • Control sigma: +14.7%
  • Residual noise: +11.7%
  • Median polish overall: -3.0%
datafusion / vortex-file-compressed (0.946x ➖, 0↑ 2↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 622766003 737703887 0.84
tpch_q02/datafusion:vortex-file-compressed 818566040 798755892 1.02
tpch_q03/datafusion:vortex-file-compressed 941740162 870067934 1.08
tpch_q04/datafusion:vortex-file-compressed 747287355 671626542 1.11
tpch_q05/datafusion:vortex-file-compressed 958971108 1164363524 0.82
tpch_q06/datafusion:vortex-file-compressed 638245553 639153839 1.00
tpch_q07/datafusion:vortex-file-compressed 953703070 1194365073 0.80
tpch_q08/datafusion:vortex-file-compressed 1039433393 1221879323 0.85
tpch_q09/datafusion:vortex-file-compressed 1178229509 1388635522 0.85
tpch_q10/datafusion:vortex-file-compressed 1009912129 1053817362 0.96
tpch_q11/datafusion:vortex-file-compressed 504663523 601692514 0.84
tpch_q12/datafusion:vortex-file-compressed 910561544 965945971 0.94
tpch_q13/datafusion:vortex-file-compressed 407995289 571996007 0.71
tpch_q14/datafusion:vortex-file-compressed 582013309 619032219 0.94
tpch_q15/datafusion:vortex-file-compressed 1101126284 1252322431 0.88
tpch_q16/datafusion:vortex-file-compressed 🚨 548945499 406927498 1.35
tpch_q17/datafusion:vortex-file-compressed 974856803 1194194571 0.82
tpch_q18/datafusion:vortex-file-compressed 1206239493 1329595772 0.91
tpch_q19/datafusion:vortex-file-compressed 773597789 708304785 1.09
tpch_q20/datafusion:vortex-file-compressed 1061670293 978621148 1.08
tpch_q21/datafusion:vortex-file-compressed 1531556655 1864181777 0.82
tpch_q22/datafusion:vortex-file-compressed 🚨 462479093 338614026 1.37
datafusion / vortex-compact (1.059x ➖, 0↑ 4↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 845483290 750304597 1.13
tpch_q02/datafusion:vortex-compact 1005715281 874912121 1.15
tpch_q03/datafusion:vortex-compact 🚨 1264894840 909898884 1.39
tpch_q04/datafusion:vortex-compact 670367767 761663398 0.88
tpch_q05/datafusion:vortex-compact 1056720204 1011573078 1.04
tpch_q06/datafusion:vortex-compact 619445994 677535081 0.91
tpch_q07/datafusion:vortex-compact 1201500791 1174251858 1.02
tpch_q08/datafusion:vortex-compact 1080904967 1231535840 0.88
tpch_q09/datafusion:vortex-compact 1254476273 1487561045 0.84
tpch_q10/datafusion:vortex-compact 1280687259 1133855445 1.13
tpch_q11/datafusion:vortex-compact 581723833 486099677 1.20
tpch_q12/datafusion:vortex-compact 🚨 1264749957 905533663 1.40
tpch_q13/datafusion:vortex-compact 451897740 465048138 0.97
tpch_q14/datafusion:vortex-compact 817051002 820686230 1.00
tpch_q15/datafusion:vortex-compact 🚨 1741354974 1337382182 1.30
tpch_q16/datafusion:vortex-compact 🚨 641169651 394947251 1.62
tpch_q17/datafusion:vortex-compact 979160653 1289695445 0.76
tpch_q18/datafusion:vortex-compact 1016080234 1250397519 0.81
tpch_q19/datafusion:vortex-compact 741448808 751585567 0.99
tpch_q20/datafusion:vortex-compact 1179907109 1023226183 1.15
tpch_q21/datafusion:vortex-compact 1441862235 1573592080 0.92
tpch_q22/datafusion:vortex-compact 473631376 381262861 1.24
datafusion / parquet (0.976x ➖, 1↑ 2↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 726655650 972521496 0.75
tpch_q02/datafusion:parquet 🚀 828681682 1231787075 0.67
tpch_q03/datafusion:parquet 1005421792 1357931726 0.74
tpch_q04/datafusion:parquet 449159757 543284659 0.83
tpch_q05/datafusion:parquet 1183384936 1287358343 0.92
tpch_q06/datafusion:parquet 469480257 533537264 0.88
tpch_q07/datafusion:parquet 1241643316 1623686690 0.76
tpch_q08/datafusion:parquet 1522700182 1588377794 0.96
tpch_q09/datafusion:parquet 1750202182 2110369237 0.83
tpch_q10/datafusion:parquet 2157451974 2204383005 0.98
tpch_q11/datafusion:parquet 787640943 687667926 1.15
tpch_q12/datafusion:parquet 685512219 752300219 0.91
tpch_q13/datafusion:parquet 894713919 740224110 1.21
tpch_q14/datafusion:parquet 909258702 817117103 1.11
tpch_q15/datafusion:parquet 1304905340 1248949614 1.04
tpch_q16/datafusion:parquet 🚨 693135894 459382458 1.51
tpch_q17/datafusion:parquet 1443395961 1419766296 1.02
tpch_q18/datafusion:parquet 1806553101 1764826015 1.02
tpch_q19/datafusion:parquet 1143374198 1085123928 1.05
tpch_q20/datafusion:parquet 1180163639 1157155995 1.02
tpch_q21/datafusion:parquet 1764472040 1920926743 0.92
tpch_q22/datafusion:parquet 🚨 1514801406 875591926 1.73
duckdb / vortex-file-compressed (0.906x ➖, 0↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 529074883 611642517 0.87
tpch_q02/duckdb:vortex-file-compressed 1316630733 1211605545 1.09
tpch_q03/duckdb:vortex-file-compressed 909619620 930597760 0.98
tpch_q04/duckdb:vortex-file-compressed 690808180 670882222 1.03
tpch_q05/duckdb:vortex-file-compressed 1089611520 1145149290 0.95
tpch_q06/duckdb:vortex-file-compressed 685447582 787123592 0.87
tpch_q07/duckdb:vortex-file-compressed 1088427015 1108797600 0.98
tpch_q08/duckdb:vortex-file-compressed 1376898483 1610297883 0.86
tpch_q09/duckdb:vortex-file-compressed 1328499124 1597253345 0.83
tpch_q10/duckdb:vortex-file-compressed 1486908985 1311008776 1.13
tpch_q11/duckdb:vortex-file-compressed 624597519 493430522 1.27
tpch_q12/duckdb:vortex-file-compressed 760314604 817970413 0.93
tpch_q13/duckdb:vortex-file-compressed 1024487046 1231174933 0.83
tpch_q14/duckdb:vortex-file-compressed 782765194 929282206 0.84
tpch_q15/duckdb:vortex-file-compressed 548929098 606963900 0.90
tpch_q16/duckdb:vortex-file-compressed 407739134 522153462 0.78
tpch_q17/duckdb:vortex-file-compressed 852130609 1072121842 0.79
tpch_q18/duckdb:vortex-file-compressed 759208685 1002864636 0.76
tpch_q19/duckdb:vortex-file-compressed 728201320 850790048 0.86
tpch_q20/duckdb:vortex-file-compressed 1146289526 1298046440 0.88
tpch_q21/duckdb:vortex-file-compressed 1746901808 2301654330 0.76
tpch_q22/duckdb:vortex-file-compressed 642146547 702753169 0.91
duckdb / vortex-compact (0.957x ➖, 1↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚀 544992004 789789871 0.69
tpch_q02/duckdb:vortex-compact 1102681322 1089582193 1.01
tpch_q03/duckdb:vortex-compact 941542643 900195172 1.05
tpch_q04/duckdb:vortex-compact 529531396 504571361 1.05
tpch_q05/duckdb:vortex-compact 984860958 1171907297 0.84
tpch_q06/duckdb:vortex-compact 713615235 820948606 0.87
tpch_q07/duckdb:vortex-compact 1057142560 1096863235 0.96
tpch_q08/duckdb:vortex-compact 1218139440 1433131375 0.85
tpch_q09/duckdb:vortex-compact 1209612761 1578132887 0.77
tpch_q10/duckdb:vortex-compact 1113204251 979980772 1.14
tpch_q11/duckdb:vortex-compact 658249403 779080466 0.84
tpch_q12/duckdb:vortex-compact 584945641 617197254 0.95
tpch_q13/duckdb:vortex-compact 840112097 838180116 1.00
tpch_q14/duckdb:vortex-compact 887449471 832498889 1.07
tpch_q15/duckdb:vortex-compact 471039324 542241334 0.87
tpch_q16/duckdb:vortex-compact 389755625 331892589 1.17
tpch_q17/duckdb:vortex-compact 825049052 871594837 0.95
tpch_q18/duckdb:vortex-compact 767157935 687140983 1.12
tpch_q19/duckdb:vortex-compact 659672772 697077883 0.95
tpch_q20/duckdb:vortex-compact 1292845924 1230963780 1.05
tpch_q21/duckdb:vortex-compact 1670959972 1641970447 1.02
tpch_q22/duckdb:vortex-compact 699858925 682775440 1.03
duckdb / parquet (0.963x ➖, 1↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 931532872 1181153110 0.79
tpch_q02/duckdb:parquet 1506263688 1745336405 0.86
tpch_q03/duckdb:parquet 1698947242 1661461461 1.02
tpch_q04/duckdb:parquet 1088723617 1197250782 0.91
tpch_q05/duckdb:parquet 1962224359 2246661240 0.87
tpch_q06/duckdb:parquet 945402202 750001990 1.26
tpch_q07/duckdb:parquet 2109071756 1736478969 1.21
tpch_q08/duckdb:parquet 2375412149 2584132957 0.92
tpch_q09/duckdb:parquet 2249956555 2406895905 0.93
tpch_q10/duckdb:parquet 3642368596 3355364604 1.09
tpch_q11/duckdb:parquet 986334972 939329630 1.05
tpch_q12/duckdb:parquet 1112780608 985998606 1.13
tpch_q13/duckdb:parquet 1304522348 1274401642 1.02
tpch_q14/duckdb:parquet 🚀 1108239740 1625540603 0.68
tpch_q15/duckdb:parquet 898784360 838534476 1.07
tpch_q16/duckdb:parquet 945215967 865014539 1.09
tpch_q17/duckdb:parquet 1192721508 1396008078 0.85
tpch_q18/duckdb:parquet 1239159519 1580234948 0.78
tpch_q19/duckdb:parquet 1367856961 1739666718 0.79
tpch_q20/duckdb:parquet 2027569995 1771593577 1.14
tpch_q21/duckdb:parquet 1970628046 1945077315 1.01
tpch_q22/duckdb:parquet 1058853228 1130852219 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +12.7% -23.2% +46.8% +80.0% ➖ noise
1 datafusion:vortex-file-compressed -15.6% -23.2% +10.0% +94.6% ➖ noise
1 duckdb:vortex-compact -31.0% -23.2% -10.1% +48.5% ➖ noise
1 duckdb:vortex-file-compressed -13.5% -23.2% +12.7% +44.2% ➖ noise
2 datafusion:vortex-compact +15.0% -23.8% +50.9% +46.1% 🚨 regression
2 datafusion:vortex-file-compressed +2.5% -23.8% +34.5% +42.4% ➖ noise
2 duckdb:vortex-compact +1.2% -23.8% +32.8% +60.6% ➖ noise
2 duckdb:vortex-file-compressed +8.7% -23.8% +42.6% +42.8% ➖ noise
3 datafusion:vortex-compact +39.0% -13.0% +59.8% +95.7% ➖ noise
3 datafusion:vortex-file-compressed +8.2% -13.0% +24.4% +92.6% ➖ noise
3 duckdb:vortex-compact +4.6% -13.0% +20.2% +68.8% ➖ noise
3 duckdb:vortex-file-compressed -2.3% -13.0% +12.3% +70.3% ➖ noise
4 datafusion:vortex-compact -12.0% -13.3% +1.5% +42.4% ➖ noise
4 datafusion:vortex-file-compressed +11.3% -13.3% +28.3% +42.4% ➖ noise
4 duckdb:vortex-compact +4.9% -13.3% +21.0% +42.4% ➖ noise
4 duckdb:vortex-file-compressed +3.0% -13.3% +18.8% +42.4% ➖ noise
5 datafusion:vortex-compact +4.5% -10.4% +16.6% +50.0% ➖ noise
5 datafusion:vortex-file-compressed -17.6% -10.4% -8.1% +42.4% ➖ noise
5 duckdb:vortex-compact -16.0% -10.4% -6.2% +42.4% ➖ noise
5 duckdb:vortex-file-compressed -4.8% -10.4% +6.2% +42.4% ➖ noise
6 datafusion:vortex-compact -8.6% +5.3% -13.2% +42.4% ➖ noise
6 datafusion:vortex-file-compressed -0.1% +5.3% -5.2% +42.4% ➖ noise
6 duckdb:vortex-compact -13.1% +5.3% -17.5% +42.4% ➖ noise
6 duckdb:vortex-file-compressed -12.9% +5.3% -17.3% +42.4% ➖ noise
7 datafusion:vortex-compact +2.3% -3.6% +6.2% +42.4% ➖ noise
7 datafusion:vortex-file-compressed -20.1% -3.6% -17.1% +42.4% ➖ noise
7 duckdb:vortex-compact -3.6% -3.6% +0.0% +42.4% ➖ noise
7 duckdb:vortex-file-compressed -1.8% -3.6% +1.9% +42.4% ➖ noise
8 datafusion:vortex-compact -12.2% -6.1% -6.5% +50.5% ➖ noise
8 datafusion:vortex-file-compressed -14.9% -6.1% -9.4% +42.4% ➖ noise
8 duckdb:vortex-compact -15.0% -6.1% -9.5% +42.4% ➖ noise
8 duckdb:vortex-file-compressed -14.5% -6.1% -8.9% +42.4% ➖ noise
9 datafusion:vortex-compact -15.7% -12.0% -4.2% +42.4% ➖ noise
9 datafusion:vortex-file-compressed -15.2% -12.0% -3.6% +42.4% ➖ noise
9 duckdb:vortex-compact -23.4% -12.0% -12.9% +42.4% ➖ noise
9 duckdb:vortex-file-compressed -16.8% -12.0% -5.5% +42.4% ➖ noise
10 datafusion:vortex-compact +12.9% +3.1% +9.6% +43.4% ➖ noise
10 datafusion:vortex-file-compressed -4.2% +3.1% -7.0% +42.5% ➖ noise
10 duckdb:vortex-compact +13.6% +3.1% +10.2% +44.7% ➖ noise
10 duckdb:vortex-file-compressed +13.4% +3.1% +10.0% +43.1% ➖ noise
11 datafusion:vortex-compact +19.7% +9.7% +9.1% +42.4% ➖ noise
11 datafusion:vortex-file-compressed -16.1% +9.7% -23.5% +42.4% ➖ noise
11 duckdb:vortex-compact -15.5% +9.7% -23.0% +42.4% ➖ noise
11 duckdb:vortex-file-compressed +26.6% +9.7% +15.4% +42.4% ➖ noise
12 datafusion:vortex-compact +39.7% +1.4% +37.7% +87.1% ➖ noise
12 datafusion:vortex-file-compressed -5.7% +1.4% -7.0% +42.4% ➖ noise
12 duckdb:vortex-compact -5.2% +1.4% -6.5% +42.4% ➖ noise
12 duckdb:vortex-file-compressed -7.0% +1.4% -8.3% +44.5% ➖ noise
13 datafusion:vortex-compact -2.8% +11.2% -12.6% +95.6% ➖ noise
13 datafusion:vortex-file-compressed -28.7% +11.2% -35.9% +68.7% ➖ noise
13 duckdb:vortex-compact +0.2% +11.2% -9.9% +108.7% ➖ noise
13 duckdb:vortex-file-compressed -16.8% +11.2% -25.2% +84.5% ➖ noise
14 datafusion:vortex-compact -0.4% -12.9% +14.3% +59.5% ➖ noise
14 datafusion:vortex-file-compressed -6.0% -12.9% +7.9% +43.3% ➖ noise
14 duckdb:vortex-compact +6.6% -12.9% +22.4% +42.9% ➖ noise
14 duckdb:vortex-file-compressed -15.8% -12.9% -3.3% +45.7% ➖ noise
15 datafusion:vortex-compact +30.2% +5.8% +23.0% +42.4% ➖ noise
15 datafusion:vortex-file-compressed -12.1% +5.8% -16.9% +42.4% ➖ noise
15 duckdb:vortex-compact -13.1% +5.8% -17.9% +42.4% ➖ noise
15 duckdb:vortex-file-compressed -9.6% +5.8% -14.5% +42.4% ➖ noise
16 datafusion:vortex-compact +62.3% +28.4% +26.4% +108.6% ➖ noise
16 datafusion:vortex-file-compressed +34.9% +28.4% +5.1% +45.2% ➖ noise
16 duckdb:vortex-compact +17.4% +28.4% -8.5% +42.4% ➖ noise
16 duckdb:vortex-file-compressed -21.9% +28.4% -39.2% +42.4% ✅ faster
17 datafusion:vortex-compact -24.1% -6.8% -18.5% +42.4% ➖ noise
17 datafusion:vortex-file-compressed -18.4% -6.8% -12.4% +42.4% ➖ noise
17 duckdb:vortex-compact -5.3% -6.8% +1.6% +42.4% ➖ noise
17 duckdb:vortex-file-compressed -20.5% -6.8% -14.7% +42.4% ➖ noise
18 datafusion:vortex-compact -18.7% -10.4% -9.3% +42.4% ➖ noise
18 datafusion:vortex-file-compressed -9.3% -10.4% +1.3% +42.4% ➖ noise
18 duckdb:vortex-compact +11.6% -10.4% +24.6% +42.4% ➖ noise
18 duckdb:vortex-file-compressed -24.3% -10.4% -15.5% +42.4% ➖ noise
19 datafusion:vortex-compact -1.3% -9.0% +8.4% +47.5% ➖ noise
19 datafusion:vortex-file-compressed +9.2% -9.0% +20.0% +42.4% ➖ noise
19 duckdb:vortex-compact -5.4% -9.0% +4.0% +42.4% ➖ noise
19 duckdb:vortex-file-compressed -14.4% -9.0% -6.0% +42.4% ➖ noise
20 datafusion:vortex-compact +15.3% +8.0% +6.7% +42.4% ➖ noise
20 datafusion:vortex-file-compressed +8.5% +8.0% +0.4% +42.4% ➖ noise
20 duckdb:vortex-compact +5.0% +8.0% -2.8% +42.4% ➖ noise
20 duckdb:vortex-file-compressed -11.7% +8.0% -18.3% +42.4% ➖ noise
21 datafusion:vortex-compact -8.4% -3.5% -5.0% +42.4% ➖ noise
21 datafusion:vortex-file-compressed -17.8% -3.5% -14.8% +42.4% ➖ noise
21 duckdb:vortex-compact +1.8% -3.5% +5.5% +42.4% ➖ noise
21 duckdb:vortex-file-compressed -24.1% -3.5% -21.3% +42.4% ➖ noise
22 datafusion:vortex-compact +24.2% +27.3% -2.4% +42.4% ➖ noise
22 datafusion:vortex-file-compressed +36.6% +27.3% +7.3% +48.7% ➖ noise
22 duckdb:vortex-compact +2.5% +27.3% -19.5% +44.0% ➖ noise
22 duckdb:vortex-file-compressed -8.6% +27.3% -28.2% +42.4% ➖ noise

@github-actions

github-actions Bot commented Mar 13, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Summary

  • Overall: 0.974x ➖
  • Vortex: 0.938x ➖
  • Parquet: 1.048x ➖

Verdict

No clear signal

  • Attributed Vortex impact: -10.5%
  • Confidence: environment too noisy
  • Environment shift: +4.8%

Statistical Summary

  • Systemic shift (parquet controls): +4.8%
  • Control sigma: +6.4%
  • Residual noise: +10.5%
  • Median polish overall: -6.9%
datafusion / vortex-file-compressed (1.104x ➖, 0↑ 2↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 74205517 33025473 2.25
fineweb_q01/datafusion:vortex-file-compressed 600522520 474699224 1.27
fineweb_q02/datafusion:vortex-file-compressed 533620024 468131410 1.14
fineweb_q03/datafusion:vortex-file-compressed 1243839575 1425490356 0.87
fineweb_q04/datafusion:vortex-file-compressed 1166001124 1427619822 0.82
fineweb_q05/datafusion:vortex-file-compressed 1157591135 1412133473 0.82
fineweb_q06/datafusion:vortex-file-compressed 1473609843 1480551045 1.00
fineweb_q07/datafusion:vortex-file-compressed 1220408345 1467022297 0.83
fineweb_q08/datafusion:vortex-file-compressed 🚨 842307013 542919442 1.55
datafusion / vortex-compact (0.885x ➖, 2↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 73788539 60418737 1.22
fineweb_q01/datafusion:vortex-compact 647073557 558676039 1.16
fineweb_q02/datafusion:vortex-compact 806324452 701263878 1.15
fineweb_q03/datafusion:vortex-compact 1518168574 1866150948 0.81
fineweb_q04/datafusion:vortex-compact 🚀 1481530462 2236141513 0.66
fineweb_q05/datafusion:vortex-compact 🚀 1143387229 1691996219 0.68
fineweb_q06/datafusion:vortex-compact 1157731790 1430567398 0.81
fineweb_q07/datafusion:vortex-compact 1030276645 1355699604 0.76
fineweb_q08/datafusion:vortex-compact 359543706 392274691 0.92
datafusion / parquet (1.101x ➖, 0↑ 1↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 1656758952 1221124382 1.36
fineweb_q01/datafusion:parquet 2088516087 1840791380 1.13
fineweb_q02/datafusion:parquet 1927200722 1782632449 1.08
fineweb_q03/datafusion:parquet 1873038690 1719073912 1.09
fineweb_q04/datafusion:parquet 1848292482 1928480767 0.96
fineweb_q05/datafusion:parquet 1896193500 1847361871 1.03
fineweb_q06/datafusion:parquet 2036656661 1907322701 1.07
fineweb_q07/datafusion:parquet 2071782416 1877241951 1.10
fineweb_q08/datafusion:parquet 2002561536 1774294120 1.13
duckdb / vortex-file-compressed (0.872x ➖, 0↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 99654607 100752614 0.99
fineweb_q01/duckdb:vortex-file-compressed 515087345 662333151 0.78
fineweb_q02/duckdb:vortex-file-compressed 480001473 515755220 0.93
fineweb_q03/duckdb:vortex-file-compressed 1384820995 1546259058 0.90
fineweb_q04/duckdb:vortex-file-compressed 1396930235 1561588752 0.89
fineweb_q05/duckdb:vortex-file-compressed 1305864772 1504149077 0.87
fineweb_q06/duckdb:vortex-file-compressed 1529065814 1668099397 0.92
fineweb_q07/duckdb:vortex-file-compressed 1263407682 1605926627 0.79
fineweb_q08/duckdb:vortex-file-compressed 521053606 644929446 0.81
duckdb / vortex-compact (0.910x ➖, 0↑ 1↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 94734228 65943962 1.44
fineweb_q01/duckdb:vortex-compact 642096463 540113935 1.19
fineweb_q02/duckdb:vortex-compact 497811207 586025634 0.85
fineweb_q03/duckdb:vortex-compact 1213164371 1577270607 0.77
fineweb_q04/duckdb:vortex-compact 1238293712 1635844354 0.76
fineweb_q05/duckdb:vortex-compact 1131427952 1496555376 0.76
fineweb_q06/duckdb:vortex-compact 1283938470 1487000986 0.86
fineweb_q07/duckdb:vortex-compact 1027743036 1332026378 0.77
fineweb_q08/duckdb:vortex-compact 508376466 507521677 1.00
duckdb / parquet (0.998x ➖, 0↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1161698658 1285249968 0.90
fineweb_q01/duckdb:parquet 1786359181 1800374040 0.99
fineweb_q02/duckdb:parquet 1763655266 1551583934 1.14
fineweb_q03/duckdb:parquet 4174548243 4105720370 1.02
fineweb_q04/duckdb:parquet 1732926931 1936367765 0.89
fineweb_q05/duckdb:parquet 2687942264 2605133838 1.03
fineweb_q06/duckdb:parquet 3333401530 3484164199 0.96
fineweb_q07/duckdb:parquet 4235615414 4499192468 0.94
fineweb_q08/duckdb:parquet 1279332398 1118608904 1.14
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +22.1% +10.7% +10.3% +141.9% ➖ noise
0 datafusion:vortex-file-compressed +124.7% +10.7% +102.9% +190.5% ➖ noise
0 duckdb:vortex-compact +43.7% +10.7% +29.7% +53.6% ➖ noise
0 duckdb:vortex-file-compressed -1.1% +10.7% -10.7% +33.5% ➖ noise
1 datafusion:vortex-compact +15.8% +6.1% +9.2% +107.1% ➖ noise
1 datafusion:vortex-file-compressed +26.5% +6.1% +19.2% +132.5% ➖ noise
1 duckdb:vortex-compact +18.9% +6.1% +12.0% +64.0% ➖ noise
1 duckdb:vortex-file-compressed -22.2% +6.1% -26.7% +30.0% ✅ faster
2 datafusion:vortex-compact +15.0% +10.9% +3.7% +49.9% ➖ noise
2 datafusion:vortex-file-compressed +14.0% +10.9% +2.8% +44.4% ➖ noise
2 duckdb:vortex-compact -15.1% +10.9% -23.4% +36.7% ➖ noise
2 duckdb:vortex-file-compressed -6.9% +10.9% -16.0% +31.0% ➖ noise
3 datafusion:vortex-compact -18.6% +5.3% -22.7% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -12.7% +5.3% -17.1% +30.0% ➖ noise
3 duckdb:vortex-compact -23.1% +5.3% -26.9% +30.0% ✅ faster
3 duckdb:vortex-file-compressed -10.4% +5.3% -14.9% +30.0% ➖ noise
4 datafusion:vortex-compact -33.7% -7.4% -28.5% +30.0% ✅ faster
4 datafusion:vortex-file-compressed -18.3% -7.4% -11.8% +30.0% ➖ noise
4 duckdb:vortex-compact -24.3% -7.4% -18.3% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -10.5% -7.4% -3.4% +30.0% ➖ noise
5 datafusion:vortex-compact -32.4% +2.9% -34.3% +30.0% ✅ faster
5 datafusion:vortex-file-compressed -18.0% +2.9% -20.3% +30.0% ➖ noise
5 duckdb:vortex-compact -24.4% +2.9% -26.5% +30.0% ✅ faster
5 duckdb:vortex-file-compressed -13.2% +2.9% -15.6% +30.0% ➖ noise
6 datafusion:vortex-compact -19.1% +1.1% -19.9% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -0.5% +1.1% -1.5% +34.2% ➖ noise
6 duckdb:vortex-compact -13.7% +1.1% -14.6% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -8.3% +1.1% -9.3% +30.0% ➖ noise
7 datafusion:vortex-compact -24.0% +1.9% -25.4% +30.0% ✅ faster
7 datafusion:vortex-file-compressed -16.8% +1.9% -18.4% +30.0% ➖ noise
7 duckdb:vortex-compact -22.8% +1.9% -24.3% +30.0% ✅ faster
7 duckdb:vortex-file-compressed -21.3% +1.9% -22.8% +30.0% ➖ noise
8 datafusion:vortex-compact -8.3% +13.6% -19.3% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +55.1% +13.6% +36.6% +32.1% 🚨 regression
8 duckdb:vortex-compact +0.2% +13.6% -11.8% +63.0% ➖ noise
8 duckdb:vortex-file-compressed -19.2% +13.6% -28.9% +30.0% ✅ faster

@github-actions

github-actions Bot commented Mar 13, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Summary

  • Overall: 0.787x ✅
  • Vortex: 0.786x ✅
  • Parquet: 0.805x ✅

Verdict

No clear signal

  • Attributed Vortex impact: -3.0%
  • Confidence: environment too noisy
  • Environment shift: -19.5%

Statistical Summary

  • Systemic shift (parquet controls): -19.5%
  • Control sigma: +6.8%
  • Residual noise: +5.5%
  • Median polish overall: -19.4%
datafusion / vortex-file-compressed (0.791x ✅, 21↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 39035491 51725530 0.75
tpch_q02/datafusion:vortex-file-compressed 🚀 43458398 50636803 0.86
tpch_q03/datafusion:vortex-file-compressed 🚀 20939315 27319634 0.77
tpch_q04/datafusion:vortex-file-compressed 🚀 14879303 19022414 0.78
tpch_q05/datafusion:vortex-file-compressed 🚀 66203566 78328562 0.85
tpch_q06/datafusion:vortex-file-compressed 🚀 7384757 10303718 0.72
tpch_q07/datafusion:vortex-file-compressed 🚀 68644923 89254809 0.77
tpch_q08/datafusion:vortex-file-compressed 🚀 56743472 64827918 0.88
tpch_q09/datafusion:vortex-file-compressed 🚀 65610253 88264355 0.74
tpch_q10/datafusion:vortex-file-compressed 🚀 65234622 78934827 0.83
tpch_q11/datafusion:vortex-file-compressed 🚀 15132350 17618085 0.86
tpch_q12/datafusion:vortex-file-compressed 🚀 27524020 34455774 0.80
tpch_q13/datafusion:vortex-file-compressed 🚀 20217009 28582143 0.71
tpch_q14/datafusion:vortex-file-compressed 25992190 27225426 0.95
tpch_q15/datafusion:vortex-file-compressed 🚀 19317083 25620447 0.75
tpch_q16/datafusion:vortex-file-compressed 🚀 28626977 34402299 0.83
tpch_q17/datafusion:vortex-file-compressed 🚀 57201883 76685557 0.75
tpch_q18/datafusion:vortex-file-compressed 🚀 76325314 103024796 0.74
tpch_q19/datafusion:vortex-file-compressed 🚀 28571661 36591259 0.78
tpch_q20/datafusion:vortex-file-compressed 🚀 41633201 49208058 0.85
tpch_q21/datafusion:vortex-file-compressed 🚀 69872455 94306768 0.74
tpch_q22/datafusion:vortex-file-compressed 🚀 11079548 14629362 0.76
datafusion / vortex-compact (0.798x ✅, 22↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚀 45363376 59159586 0.77
tpch_q02/datafusion:vortex-compact 🚀 47666175 55068180 0.87
tpch_q03/datafusion:vortex-compact 🚀 24428278 32171473 0.76
tpch_q04/datafusion:vortex-compact 🚀 19067865 22871031 0.83
tpch_q05/datafusion:vortex-compact 🚀 70631892 83048384 0.85
tpch_q06/datafusion:vortex-compact 🚀 11508258 13796537 0.83
tpch_q07/datafusion:vortex-compact 🚀 76916644 96027183 0.80
tpch_q08/datafusion:vortex-compact 🚀 66451920 74793634 0.89
tpch_q09/datafusion:vortex-compact 🚀 71824744 93080742 0.77
tpch_q10/datafusion:vortex-compact 🚀 66764818 79888276 0.84
tpch_q11/datafusion:vortex-compact 🚀 16949816 20581729 0.82
tpch_q12/datafusion:vortex-compact 🚀 35740809 43908398 0.81
tpch_q13/datafusion:vortex-compact 🚀 25168427 35858295 0.70
tpch_q14/datafusion:vortex-compact 🚀 28453122 32969758 0.86
tpch_q15/datafusion:vortex-compact 🚀 25208801 32498427 0.78
tpch_q16/datafusion:vortex-compact 🚀 34557813 41111749 0.84
tpch_q17/datafusion:vortex-compact 🚀 59628459 80828583 0.74
tpch_q18/datafusion:vortex-compact 🚀 83736122 111110347 0.75
tpch_q19/datafusion:vortex-compact 🚀 36545956 49545355 0.74
tpch_q20/datafusion:vortex-compact 🚀 43529177 54116703 0.80
tpch_q21/datafusion:vortex-compact 🚀 79360267 106139041 0.75
tpch_q22/datafusion:vortex-compact 🚀 11962978 15450046 0.77
datafusion / parquet (0.809x ✅, 22↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 83884999 149419580 0.56
tpch_q02/datafusion:parquet 🚀 65624688 80955685 0.81
tpch_q03/datafusion:parquet 🚀 59957920 87009895 0.69
tpch_q04/datafusion:parquet 🚀 43231001 53717346 0.80
tpch_q05/datafusion:parquet 🚀 144862262 163836732 0.88
tpch_q06/datafusion:parquet 🚀 28254812 38863930 0.73
tpch_q07/datafusion:parquet 🚀 161646892 180304806 0.90
tpch_q08/datafusion:parquet 🚀 143092879 166221736 0.86
tpch_q09/datafusion:parquet 🚀 187804811 209849831 0.89
tpch_q10/datafusion:parquet 🚀 166901765 189950875 0.88
tpch_q11/datafusion:parquet 🚀 51313952 58769012 0.87
tpch_q12/datafusion:parquet 🚀 99565128 117546076 0.85
tpch_q13/datafusion:parquet 🚀 162644171 198742732 0.82
tpch_q14/datafusion:parquet 🚀 71407628 80503452 0.89
tpch_q15/datafusion:parquet 🚀 49825995 65075834 0.77
tpch_q16/datafusion:parquet 🚀 46775912 54334953 0.86
tpch_q17/datafusion:parquet 🚀 120439590 180429137 0.67
tpch_q18/datafusion:parquet 🚀 197305323 228551906 0.86
tpch_q19/datafusion:parquet 🚀 80722869 105488155 0.77
tpch_q20/datafusion:parquet 🚀 105593973 118752356 0.89
tpch_q21/datafusion:parquet 🚀 155805706 180060902 0.87
tpch_q22/datafusion:parquet 🚀 32353289 40814948 0.79
datafusion / arrow (0.812x ✅, 19↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 42900262 71116265 0.60
tpch_q02/datafusion:arrow 🚀 21034934 23845015 0.88
tpch_q03/datafusion:arrow 🚀 28392711 36445121 0.78
tpch_q04/datafusion:arrow 🚀 25150715 30250876 0.83
tpch_q05/datafusion:arrow 90940887 93247956 0.98
tpch_q06/datafusion:arrow 🚀 19012008 22179913 0.86
tpch_q07/datafusion:arrow 🚀 132875819 172618719 0.77
tpch_q08/datafusion:arrow 🚀 39829101 47120528 0.85
tpch_q09/datafusion:arrow 🚀 62955701 76039215 0.83
tpch_q10/datafusion:arrow 🚀 48374357 56757736 0.85
tpch_q11/datafusion:arrow 🚀 9175973 12282426 0.75
tpch_q12/datafusion:arrow 55320470 58054839 0.95
tpch_q13/datafusion:arrow 🚀 33897246 51539769 0.66
tpch_q14/datafusion:arrow 🚀 21619303 25330460 0.85
tpch_q15/datafusion:arrow 🚀 42159552 52192824 0.81
tpch_q16/datafusion:arrow 🚀 20727966 25775878 0.80
tpch_q17/datafusion:arrow 🚀 58860667 89850108 0.66
tpch_q18/datafusion:arrow 🚀 137540691 163351330 0.84
tpch_q19/datafusion:arrow 🚀 32414431 39540789 0.82
tpch_q20/datafusion:arrow 🚀 33294520 40456937 0.82
tpch_q21/datafusion:arrow 🚀 190685692 227681622 0.84
tpch_q22/datafusion:arrow 20127132 21059186 0.96
duckdb / vortex-file-compressed (0.770x ✅, 22↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚀 20926298 32009882 0.65
tpch_q02/duckdb:vortex-file-compressed 🚀 20616682 28033320 0.74
tpch_q03/duckdb:vortex-file-compressed 🚀 22803748 30520681 0.75
tpch_q04/duckdb:vortex-file-compressed 🚀 22788700 29218805 0.78
tpch_q05/duckdb:vortex-file-compressed 🚀 26700639 34819557 0.77
tpch_q06/duckdb:vortex-file-compressed 🚀 8093036 10643312 0.76
tpch_q07/duckdb:vortex-file-compressed 🚀 27711579 36847465 0.75
tpch_q08/duckdb:vortex-file-compressed 🚀 30088002 40722240 0.74
tpch_q09/duckdb:vortex-file-compressed 🚀 64625912 78252105 0.83
tpch_q10/duckdb:vortex-file-compressed 🚀 28247652 36854499 0.77
tpch_q11/duckdb:vortex-file-compressed 🚀 11056109 15679951 0.71
tpch_q12/duckdb:vortex-file-compressed 🚀 17921331 22000776 0.81
tpch_q13/duckdb:vortex-file-compressed 🚀 28469928 37473543 0.76
tpch_q14/duckdb:vortex-file-compressed 🚀 18771837 21387528 0.88
tpch_q15/duckdb:vortex-file-compressed 🚀 11110301 15700712 0.71
tpch_q16/duckdb:vortex-file-compressed 🚀 22832481 29021929 0.79
tpch_q17/duckdb:vortex-file-compressed 🚀 17966824 24324156 0.74
tpch_q18/duckdb:vortex-file-compressed 🚀 36466181 46822320 0.78
tpch_q19/duckdb:vortex-file-compressed 🚀 27563272 32491280 0.85
tpch_q20/duckdb:vortex-file-compressed 🚀 27302983 34313588 0.80
tpch_q21/duckdb:vortex-file-compressed 🚀 87769917 103277242 0.85
tpch_q22/duckdb:vortex-file-compressed 🚀 14009671 17789460 0.79
duckdb / vortex-compact (0.786x ✅, 22↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚀 27517052 39633937 0.69
tpch_q02/duckdb:vortex-compact 🚀 29521992 37250399 0.79
tpch_q03/duckdb:vortex-compact 🚀 26960398 31935527 0.84
tpch_q04/duckdb:vortex-compact 🚀 27513189 33649372 0.82
tpch_q05/duckdb:vortex-compact 🚀 29640123 38150116 0.78
tpch_q06/duckdb:vortex-compact 🚀 11467676 15282305 0.75
tpch_q07/duckdb:vortex-compact 🚀 35054089 43579639 0.80
tpch_q08/duckdb:vortex-compact 🚀 35984364 46298723 0.78
tpch_q09/duckdb:vortex-compact 🚀 72328092 91887804 0.79
tpch_q10/duckdb:vortex-compact 🚀 32475315 40959317 0.79
tpch_q11/duckdb:vortex-compact 🚀 16013533 20084490 0.80
tpch_q12/duckdb:vortex-compact 🚀 29985374 37723128 0.79
tpch_q13/duckdb:vortex-compact 🚀 37133201 46568232 0.80
tpch_q14/duckdb:vortex-compact 🚀 23410781 30181654 0.78
tpch_q15/duckdb:vortex-compact 🚀 14257590 19581030 0.73
tpch_q16/duckdb:vortex-compact 🚀 29164573 37835662 0.77
tpch_q17/duckdb:vortex-compact 🚀 24040670 30639338 0.78
tpch_q18/duckdb:vortex-compact 🚀 41001578 51201190 0.80
tpch_q19/duckdb:vortex-compact 🚀 29782342 38626001 0.77
tpch_q20/duckdb:vortex-compact 🚀 34865554 44252653 0.79
tpch_q21/duckdb:vortex-compact 🚀 94640935 109130134 0.87
tpch_q22/duckdb:vortex-compact 🚀 16185935 20473282 0.79
duckdb / parquet (0.802x ✅, 21↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚀 60364632 80250170 0.75
tpch_q02/duckdb:parquet 🚀 30747142 38925442 0.79
tpch_q03/duckdb:parquet 🚀 58715264 68871236 0.85
tpch_q04/duckdb:parquet 🚀 39669488 55779666 0.71
tpch_q05/duckdb:parquet 🚀 56918999 66407682 0.86
tpch_q06/duckdb:parquet 🚀 16353653 20562834 0.80
tpch_q07/duckdb:parquet 🚀 57888733 75992232 0.76
tpch_q08/duckdb:parquet 🚀 69923029 80208669 0.87
tpch_q09/duckdb:parquet 🚀 122226549 154659678 0.79
tpch_q10/duckdb:parquet 🚀 107477135 126743190 0.85
tpch_q11/duckdb:parquet 🚀 16617558 22009754 0.76
tpch_q12/duckdb:parquet 🚀 35052712 49571713 0.71
tpch_q13/duckdb:parquet 🚀 215955473 260852636 0.83
tpch_q14/duckdb:parquet 🚀 40337331 48955462 0.82
tpch_q15/duckdb:parquet 🚀 19293330 24067817 0.80
tpch_q16/duckdb:parquet 🚀 42507385 54523084 0.78
tpch_q17/duckdb:parquet 44273707 48448402 0.91
tpch_q18/duckdb:parquet 🚀 100998847 122778620 0.82
tpch_q19/duckdb:parquet 🚀 55576783 68415260 0.81
tpch_q20/duckdb:parquet 🚀 58138664 76031518 0.76
tpch_q21/duckdb:parquet 🚀 150629585 177110850 0.85
tpch_q22/duckdb:parquet 🚀 41148592 52356683 0.79
duckdb / duckdb (0.732x ✅, 22↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 🚀 10439588 15934759 0.66
tpch_q02/duckdb:duckdb 🚀 9728946 11946861 0.81
tpch_q03/duckdb:duckdb 🚀 14626454 19168504 0.76
tpch_q04/duckdb:duckdb 🚀 13968696 18369837 0.76
tpch_q05/duckdb:duckdb 🚀 14113741 20638432 0.68
tpch_q06/duckdb:duckdb 🚀 3232044 5263426 0.61
tpch_q07/duckdb:duckdb 🚀 15241942 23282096 0.65
tpch_q08/duckdb:duckdb 🚀 15137042 20486829 0.74
tpch_q09/duckdb:duckdb 🚀 41194086 51908415 0.79
tpch_q10/duckdb:duckdb 🚀 30889745 42951730 0.72
tpch_q11/duckdb:duckdb 🚀 4436397 5513271 0.80
tpch_q12/duckdb:duckdb 🚀 9950353 13759020 0.72
tpch_q13/duckdb:duckdb 🚀 30745122 36412885 0.84
tpch_q14/duckdb:duckdb 🚀 11887356 17998675 0.66
tpch_q15/duckdb:duckdb 🚀 7984244 11629287 0.69
tpch_q16/duckdb:duckdb 🚀 18113877 21791761 0.83
tpch_q17/duckdb:duckdb 🚀 9907768 14044316 0.71
tpch_q18/duckdb:duckdb 🚀 27728975 37666464 0.74
tpch_q19/duckdb:duckdb 🚀 17416288 26218491 0.66
tpch_q20/duckdb:duckdb 🚀 16040214 23049141 0.70
tpch_q21/duckdb:duckdb 🚀 47469691 55420166 0.86
tpch_q22/duckdb:duckdb 🚀 18582034 24241310 0.77
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -39.7% -35.0% -7.2% +21.5% ➖ noise
1 datafusion:vortex-compact -23.3% -35.0% +18.0% +19.4% ➖ noise
1 datafusion:vortex-file-compressed -24.5% -35.0% +16.1% +19.4% ➖ noise
1 duckdb:duckdb -34.5% -35.0% +0.8% +21.0% ➖ noise
1 duckdb:vortex-compact -30.6% -35.0% +6.8% +18.3% ➖ noise
1 duckdb:vortex-file-compressed -34.6% -35.0% +0.6% +19.5% ➖ noise
2 datafusion:arrow -11.8% -20.0% +10.2% +18.3% ➖ noise
2 datafusion:vortex-compact -13.4% -20.0% +8.2% +18.3% ➖ noise
2 datafusion:vortex-file-compressed -14.2% -20.0% +7.3% +18.3% ➖ noise
2 duckdb:duckdb -18.6% -20.0% +1.8% +18.3% ➖ noise
2 duckdb:vortex-compact -20.7% -20.0% -1.0% +18.3% ➖ noise
2 duckdb:vortex-file-compressed -26.5% -20.0% -8.1% +18.3% ➖ noise
3 datafusion:arrow -22.1% -23.4% +1.6% +18.3% ➖ noise
3 datafusion:vortex-compact -24.1% -23.4% -0.9% +18.3% ➖ noise
3 datafusion:vortex-file-compressed -23.4% -23.4% -0.0% +18.3% ➖ noise
3 duckdb:duckdb -23.7% -23.4% -0.4% +20.2% ➖ noise
3 duckdb:vortex-compact -15.6% -23.4% +10.1% +18.3% ➖ noise
3 duckdb:vortex-file-compressed -25.3% -23.4% -2.5% +18.3% ➖ noise
4 datafusion:arrow -16.9% -24.3% +9.9% +18.3% ➖ noise
4 datafusion:vortex-compact -16.6% -24.3% +10.2% +18.3% ➖ noise
4 datafusion:vortex-file-compressed -21.8% -24.3% +3.4% +18.3% ➖ noise
4 duckdb:duckdb -24.0% -24.3% +0.5% +18.3% ➖ noise
4 duckdb:vortex-compact -18.2% -24.3% +8.1% +18.3% ➖ noise
4 duckdb:vortex-file-compressed -22.0% -24.3% +3.1% +18.3% ➖ noise
5 datafusion:arrow -2.5% -12.9% +12.0% +18.3% ➖ noise
5 datafusion:vortex-compact -15.0% -12.9% -2.3% +18.3% ➖ noise
5 datafusion:vortex-file-compressed -15.5% -12.9% -2.9% +18.3% ➖ noise
5 duckdb:duckdb -31.6% -12.9% -21.4% +18.3% ✅ faster
5 duckdb:vortex-compact -22.3% -12.9% -10.8% +18.3% ➖ noise
5 duckdb:vortex-file-compressed -23.3% -12.9% -11.9% +18.3% ➖ noise
6 datafusion:arrow -14.3% -24.0% +12.7% +20.9% ➖ noise
6 datafusion:vortex-compact -16.6% -24.0% +9.7% +22.3% ➖ noise
6 datafusion:vortex-file-compressed -28.3% -24.0% -5.7% +26.7% ➖ noise
6 duckdb:duckdb -38.6% -24.0% -19.2% +28.4% ➖ noise
6 duckdb:vortex-compact -25.0% -24.0% -1.3% +21.3% ➖ noise
6 duckdb:vortex-file-compressed -24.0% -24.0% -0.0% +19.3% ➖ noise
7 datafusion:arrow -23.0% -17.4% -6.9% +18.3% ➖ noise
7 datafusion:vortex-compact -19.9% -17.4% -3.1% +18.3% ➖ noise
7 datafusion:vortex-file-compressed -23.1% -17.4% -6.9% +18.3% ➖ noise
7 duckdb:duckdb -34.5% -17.4% -20.8% +19.3% ✅ faster
7 duckdb:vortex-compact -19.6% -17.4% -2.7% +18.3% ➖ noise
7 duckdb:vortex-file-compressed -24.8% -17.4% -9.0% +18.3% ➖ noise
8 datafusion:arrow -15.5% -13.4% -2.4% +18.3% ➖ noise
8 datafusion:vortex-compact -11.2% -13.4% +2.6% +18.3% ➖ noise
8 datafusion:vortex-file-compressed -12.5% -13.4% +1.0% +18.3% ➖ noise
8 duckdb:duckdb -26.1% -13.4% -14.7% +18.3% ➖ noise
8 duckdb:vortex-compact -22.3% -13.4% -10.3% +18.3% ➖ noise
8 duckdb:vortex-file-compressed -26.1% -13.4% -14.7% +18.3% ➖ noise
9 datafusion:arrow -17.2% -15.9% -1.6% +18.3% ➖ noise
9 datafusion:vortex-compact -22.8% -15.9% -8.2% +18.3% ➖ noise
9 datafusion:vortex-file-compressed -25.7% -15.9% -11.6% +18.3% ➖ noise
9 duckdb:duckdb -20.6% -15.9% -5.6% +18.3% ➖ noise
9 duckdb:vortex-compact -21.3% -15.9% -6.4% +18.3% ➖ noise
9 duckdb:vortex-file-compressed -17.4% -15.9% -1.8% +18.3% ➖ noise
10 datafusion:arrow -14.8% -13.7% -1.3% +18.3% ➖ noise
10 datafusion:vortex-compact -16.4% -13.7% -3.2% +18.3% ➖ noise
10 datafusion:vortex-file-compressed -17.4% -13.7% -4.3% +18.3% ➖ noise
10 duckdb:duckdb -28.1% -13.7% -16.7% +18.3% ✅ faster
10 duckdb:vortex-compact -20.7% -13.7% -8.1% +18.3% ➖ noise
10 duckdb:vortex-file-compressed -23.4% -13.7% -11.2% +18.3% ➖ noise
11 datafusion:arrow -25.3% -18.8% -8.0% +18.3% ➖ noise
11 datafusion:vortex-compact -17.6% -18.8% +1.4% +20.2% ➖ noise
11 datafusion:vortex-file-compressed -14.1% -18.8% +5.8% +18.3% ➖ noise
11 duckdb:duckdb -19.5% -18.8% -0.9% +18.3% ➖ noise
11 duckdb:vortex-compact -20.3% -18.8% -1.8% +18.3% ➖ noise
11 duckdb:vortex-file-compressed -29.5% -18.8% -13.2% +18.3% ➖ noise
12 datafusion:arrow -4.7% -22.6% +23.1% +18.3% 🚨 regression
12 datafusion:vortex-compact -18.6% -22.6% +5.2% +18.3% ➖ noise
12 datafusion:vortex-file-compressed -20.1% -22.6% +3.2% +18.3% ➖ noise
12 duckdb:duckdb -27.7% -22.6% -6.6% +18.3% ➖ noise
12 duckdb:vortex-compact -20.5% -22.6% +2.7% +18.3% ➖ noise
12 duckdb:vortex-file-compressed -18.5% -22.6% +5.3% +18.3% ➖ noise
13 datafusion:arrow -34.2% -17.7% -20.1% +18.3% ✅ faster
13 datafusion:vortex-compact -29.8% -17.7% -14.7% +18.3% ➖ noise
13 datafusion:vortex-file-compressed -29.3% -17.7% -14.1% +18.3% ➖ noise
13 duckdb:duckdb -15.6% -17.7% +2.6% +18.3% ➖ noise
13 duckdb:vortex-compact -20.3% -17.7% -3.1% +18.3% ➖ noise
13 duckdb:vortex-file-compressed -24.0% -17.7% -7.7% +18.3% ➖ noise
14 datafusion:arrow -14.7% -14.5% -0.2% +18.3% ➖ noise
14 datafusion:vortex-compact -13.7% -14.5% +0.9% +18.3% ➖ noise
14 datafusion:vortex-file-compressed -4.5% -14.5% +11.7% +18.3% ➖ noise
14 duckdb:duckdb -34.0% -14.5% -22.7% +26.6% ✅ faster
14 duckdb:vortex-compact -22.4% -14.5% -9.3% +18.3% ➖ noise
14 duckdb:vortex-file-compressed -12.2% -14.5% +2.7% +18.3% ➖ noise
15 datafusion:arrow -19.2% -21.7% +3.1% +18.3% ➖ noise
15 datafusion:vortex-compact -22.4% -21.7% -1.0% +18.3% ➖ noise
15 datafusion:vortex-file-compressed -24.6% -21.7% -3.8% +18.3% ➖ noise
15 duckdb:duckdb -31.3% -21.7% -12.4% +18.3% ➖ noise
15 duckdb:vortex-compact -27.2% -21.7% -7.1% +18.3% ➖ noise
15 duckdb:vortex-file-compressed -29.2% -21.7% -9.7% +18.3% ➖ noise
16 datafusion:arrow -19.6% -18.1% -1.8% +18.3% ➖ noise
16 datafusion:vortex-compact -15.9% -18.1% +2.6% +18.3% ➖ noise
16 datafusion:vortex-file-compressed -16.8% -18.1% +1.6% +18.3% ➖ noise
16 duckdb:duckdb -16.9% -18.1% +1.5% +18.3% ➖ noise
16 duckdb:vortex-compact -22.9% -18.1% -5.9% +18.3% ➖ noise
16 duckdb:vortex-file-compressed -21.3% -18.1% -4.0% +18.3% ➖ noise
17 datafusion:arrow -34.5% -21.9% -16.1% +18.3% ✅ faster
17 datafusion:vortex-compact -26.2% -21.9% -5.5% +18.3% ➖ noise
17 datafusion:vortex-file-compressed -25.4% -21.9% -4.5% +18.3% ➖ noise
17 duckdb:duckdb -29.5% -21.9% -9.7% +18.3% ➖ noise
17 duckdb:vortex-compact -21.5% -21.9% +0.5% +18.3% ➖ noise
17 duckdb:vortex-file-compressed -26.1% -21.9% -5.4% +18.3% ➖ noise
18 datafusion:arrow -15.8% -15.7% -0.1% +18.3% ➖ noise
18 datafusion:vortex-compact -24.6% -15.7% -10.6% +18.3% ➖ noise
18 datafusion:vortex-file-compressed -25.9% -15.7% -12.1% +18.3% ➖ noise
18 duckdb:duckdb -26.4% -15.7% -12.6% +18.3% ➖ noise
18 duckdb:vortex-compact -19.9% -15.7% -5.0% +18.3% ➖ noise
18 duckdb:vortex-file-compressed -22.1% -15.7% -7.6% +18.3% ➖ noise
19 datafusion:arrow -18.0% -21.2% +4.0% +18.3% ➖ noise
19 datafusion:vortex-compact -26.2% -21.2% -6.4% +18.3% ➖ noise
19 datafusion:vortex-file-compressed -21.9% -21.2% -1.0% +21.7% ➖ noise
19 duckdb:duckdb -33.6% -21.2% -15.7% +24.4% ➖ noise
19 duckdb:vortex-compact -22.9% -21.2% -2.2% +18.3% ➖ noise
19 duckdb:vortex-file-compressed -15.2% -21.2% +7.6% +18.5% ➖ noise
20 datafusion:arrow -17.7% -17.5% -0.2% +18.3% ➖ noise
20 datafusion:vortex-compact -19.6% -17.5% -2.5% +18.3% ➖ noise
20 datafusion:vortex-file-compressed -15.4% -17.5% +2.6% +18.3% ➖ noise
20 duckdb:duckdb -30.4% -17.5% -15.6% +18.3% ✅ faster
20 duckdb:vortex-compact -21.2% -17.5% -4.5% +18.3% ➖ noise
20 duckdb:vortex-file-compressed -20.4% -17.5% -3.5% +18.3% ➖ noise
21 datafusion:arrow -16.2% -14.2% -2.4% +18.3% ➖ noise
21 datafusion:vortex-compact -25.2% -14.2% -12.8% +18.3% ➖ noise
21 datafusion:vortex-file-compressed -25.9% -14.2% -13.6% +18.3% ➖ noise
21 duckdb:duckdb -14.3% -14.2% -0.2% +18.3% ➖ noise
21 duckdb:vortex-compact -13.3% -14.2% +1.1% +18.3% ➖ noise
21 duckdb:vortex-file-compressed -15.0% -14.2% -0.9% +18.3% ➖ noise
22 datafusion:arrow -4.4% -21.1% +21.1% +18.3% 🚨 regression
22 datafusion:vortex-compact -22.6% -21.1% -1.9% +18.3% ➖ noise
22 datafusion:vortex-file-compressed -24.3% -21.1% -4.0% +18.3% ➖ noise
22 duckdb:duckdb -23.3% -21.1% -2.9% +18.3% ➖ noise
22 duckdb:vortex-compact -20.9% -21.1% +0.2% +18.3% ➖ noise
22 duckdb:vortex-file-compressed -21.2% -21.1% -0.2% +18.3% ➖ noise

@github-actions

github-actions Bot commented Mar 13, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Summary

  • Overall: 0.756x ✅
  • Vortex: 0.756x ✅
datafusion / vortex-file-compressed (0.756x ✅, 9↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 🚀 74352163 115020787 0.65
polarsignals_q01/datafusion:vortex-file-compressed 🚀 210584147 350266542 0.60
polarsignals_q02/datafusion:vortex-file-compressed 🚀 19116859 21849357 0.87
polarsignals_q03/datafusion:vortex-file-compressed 🚀 210023997 354372013 0.59
polarsignals_q04/datafusion:vortex-file-compressed 🚀 9992039 11996383 0.83
polarsignals_q05/datafusion:vortex-file-compressed 🚀 13653184 15973788 0.85
polarsignals_q06/datafusion:vortex-file-compressed 🚀 14723555 19887319 0.74
polarsignals_q07/datafusion:vortex-file-compressed 12351531 12643909 0.98
polarsignals_q08/datafusion:vortex-file-compressed 🚀 301254890 428203218 0.70
polarsignals_q09/datafusion:vortex-file-compressed 🚀 8933876 10711031 0.83

@github-actions

github-actions Bot commented Mar 13, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Summary

  • Overall: 0.710x ✅
  • Vortex: 0.706x ✅
  • Parquet: 0.731x ✅

Verdict

No clear signal

  • Attributed Vortex impact: -3.9%
  • Confidence: environment too noisy
  • Environment shift: -26.9%

Statistical Summary

  • Systemic shift (parquet controls): -26.9%
  • Control sigma: +5.8%
  • Residual noise: +6.4%
  • Median polish overall: -28.8%
datafusion / vortex-file-compressed (0.717x ✅, 22↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 326715303 438053432 0.75
tpch_q02/datafusion:vortex-file-compressed 🚀 130055829 163452246 0.80
tpch_q03/datafusion:vortex-file-compressed 🚀 192963498 280872258 0.69
tpch_q04/datafusion:vortex-file-compressed 🚀 90438303 112530775 0.80
tpch_q05/datafusion:vortex-file-compressed 🚀 341168923 512624037 0.67
tpch_q06/datafusion:vortex-file-compressed 🚀 29450833 43989007 0.67
tpch_q07/datafusion:vortex-file-compressed 🚀 464987875 670942803 0.69
tpch_q08/datafusion:vortex-file-compressed 🚀 358947794 492562096 0.73
tpch_q09/datafusion:vortex-file-compressed 🚀 581104892 843409535 0.69
tpch_q10/datafusion:vortex-file-compressed 🚀 242712744 302802643 0.80
tpch_q11/datafusion:vortex-file-compressed 🚀 96782838 121852803 0.79
tpch_q12/datafusion:vortex-file-compressed 🚀 97836344 127948558 0.76
tpch_q13/datafusion:vortex-file-compressed 🚀 149940569 234276888 0.64
tpch_q14/datafusion:vortex-file-compressed 🚀 57973357 83838785 0.69
tpch_q15/datafusion:vortex-file-compressed 🚀 84089236 113757371 0.74
tpch_q16/datafusion:vortex-file-compressed 🚀 73772940 97389739 0.76
tpch_q17/datafusion:vortex-file-compressed 🚀 527656333 828943054 0.64
tpch_q18/datafusion:vortex-file-compressed 🚀 703532381 1082666864 0.65
tpch_q19/datafusion:vortex-file-compressed 🚀 90493518 132913735 0.68
tpch_q20/datafusion:vortex-file-compressed 🚀 154952406 209974028 0.74
tpch_q21/datafusion:vortex-file-compressed 🚀 552341544 835020431 0.66
tpch_q22/datafusion:vortex-file-compressed 🚀 52204623 66410495 0.79
datafusion / vortex-compact (0.719x ✅, 22↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚀 361583690 470079112 0.77
tpch_q02/datafusion:vortex-compact 🚀 137513669 160154659 0.86
tpch_q03/datafusion:vortex-compact 🚀 207315058 262368942 0.79
tpch_q04/datafusion:vortex-compact 🚀 103713434 129038467 0.80
tpch_q05/datafusion:vortex-compact 🚀 364471108 498720005 0.73
tpch_q06/datafusion:vortex-compact 🚀 49607959 64529273 0.77
tpch_q07/datafusion:vortex-compact 🚀 523368572 724411662 0.72
tpch_q08/datafusion:vortex-compact 🚀 364994381 511090666 0.71
tpch_q09/datafusion:vortex-compact 🚀 590693614 858832117 0.69
tpch_q10/datafusion:vortex-compact 🚀 250097113 375836582 0.67
tpch_q11/datafusion:vortex-compact 🚀 98332362 124102196 0.79
tpch_q12/datafusion:vortex-compact 🚀 136448516 190236583 0.72
tpch_q13/datafusion:vortex-compact 🚀 168831793 303307967 0.56
tpch_q14/datafusion:vortex-compact 🚀 69449737 95649712 0.73
tpch_q15/datafusion:vortex-compact 🚀 116740734 169571126 0.69
tpch_q16/datafusion:vortex-compact 🚀 75806591 99567081 0.76
tpch_q17/datafusion:vortex-compact 🚀 511772677 846482139 0.60
tpch_q18/datafusion:vortex-compact 🚀 698750574 1086779063 0.64
tpch_q19/datafusion:vortex-compact 🚀 153652591 235409379 0.65
tpch_q20/datafusion:vortex-compact 🚀 168907498 257177659 0.66
tpch_q21/datafusion:vortex-compact 🚀 601203838 802805233 0.75
tpch_q22/datafusion:vortex-compact 🚀 59866698 72002762 0.83
datafusion / parquet (0.742x ✅, 22↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 324781824 508486007 0.64
tpch_q02/datafusion:parquet 🚀 217074322 263837424 0.82
tpch_q03/datafusion:parquet 🚀 302837392 402917317 0.75
tpch_q04/datafusion:parquet 🚀 113889075 160523546 0.71
tpch_q05/datafusion:parquet 🚀 421440845 605487779 0.70
tpch_q06/datafusion:parquet 🚀 89930759 124112822 0.72
tpch_q07/datafusion:parquet 🚀 583824584 867315621 0.67
tpch_q08/datafusion:parquet 🚀 492270794 661107654 0.74
tpch_q09/datafusion:parquet 🚀 705344120 1051499401 0.67
tpch_q10/datafusion:parquet 🚀 492242538 628810505 0.78
tpch_q11/datafusion:parquet 🚀 174161973 195504015 0.89
tpch_q12/datafusion:parquet 🚀 190443643 245371444 0.78
tpch_q13/datafusion:parquet 🚀 227925797 364518834 0.63
tpch_q14/datafusion:parquet 🚀 156039367 200248830 0.78
tpch_q15/datafusion:parquet 🚀 183629782 274321859 0.67
tpch_q16/datafusion:parquet 🚀 147024923 178613140 0.82
tpch_q17/datafusion:parquet 🚀 603783752 832559394 0.73
tpch_q18/datafusion:parquet 🚀 813972720 1139654935 0.71
tpch_q19/datafusion:parquet 🚀 270829467 341478988 0.79
tpch_q20/datafusion:parquet 🚀 316010357 373744421 0.85
tpch_q21/datafusion:parquet 🚀 733099466 959362932 0.76
tpch_q22/datafusion:parquet 🚀 182413596 236457391 0.77
datafusion / arrow (0.677x ✅, 20↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 445624266 784337785 0.57
tpch_q02/datafusion:arrow 197640352 217588733 0.91
tpch_q03/datafusion:arrow 🚀 350787953 626635498 0.56
tpch_q04/datafusion:arrow 🚀 262836385 442336718 0.59
tpch_q05/datafusion:arrow 🚀 863981906 1196877709 0.72
tpch_q06/datafusion:arrow 🚀 191491269 346397597 0.55
tpch_q07/datafusion:arrow 🚀 865073117 1521357139 0.57
tpch_q08/datafusion:arrow 🚀 984869040 1333207863 0.74
tpch_q09/datafusion:arrow 🚀 1226921279 1710746100 0.72
tpch_q10/datafusion:arrow 🚀 432514385 777356356 0.56
tpch_q11/datafusion:arrow 177204010 196667406 0.90
tpch_q12/datafusion:arrow 🚀 574298453 832064977 0.69
tpch_q13/datafusion:arrow 🚀 355548077 573032075 0.62
tpch_q14/datafusion:arrow 🚀 219235505 366380088 0.60
tpch_q15/datafusion:arrow 🚀 427954668 746981791 0.57
tpch_q16/datafusion:arrow 🚀 110860505 125122235 0.89
tpch_q17/datafusion:arrow 🚀 1332710874 1685012757 0.79
tpch_q18/datafusion:arrow 🚀 1669094986 2361367025 0.71
tpch_q19/datafusion:arrow 🚀 379571107 656199933 0.58
tpch_q20/datafusion:arrow 🚀 373006213 646359701 0.58
tpch_q21/datafusion:arrow 🚀 4043232680 4525523129 0.89
tpch_q22/datafusion:arrow 🚀 175698786 211683774 0.83
duckdb / vortex-file-compressed (0.693x ✅, 22↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚀 111593915 180287471 0.62
tpch_q02/duckdb:vortex-file-compressed 🚀 41229239 52630444 0.78
tpch_q03/duckdb:vortex-file-compressed 🚀 96133022 134883146 0.71
tpch_q04/duckdb:vortex-file-compressed 🚀 106489533 179408206 0.59
tpch_q05/duckdb:vortex-file-compressed 🚀 101055435 132230705 0.76
tpch_q06/duckdb:vortex-file-compressed 🚀 36343362 51213542 0.71
tpch_q07/duckdb:vortex-file-compressed 🚀 100509898 153293357 0.66
tpch_q08/duckdb:vortex-file-compressed 🚀 134020330 191190859 0.70
tpch_q09/duckdb:vortex-file-compressed 🚀 275616203 351634595 0.78
tpch_q10/duckdb:vortex-file-compressed 🚀 119465115 175851276 0.68
tpch_q11/duckdb:vortex-file-compressed 🚀 25221097 37589964 0.67
tpch_q12/duckdb:vortex-file-compressed 🚀 68456444 97090379 0.71
tpch_q13/duckdb:vortex-file-compressed 🚀 175317087 258216730 0.68
tpch_q14/duckdb:vortex-file-compressed 🚀 55189593 81997681 0.67
tpch_q15/duckdb:vortex-file-compressed 🚀 59112617 99476855 0.59
tpch_q16/duckdb:vortex-file-compressed 🚀 63559296 80251185 0.79
tpch_q17/duckdb:vortex-file-compressed 🚀 71762138 104908212 0.68
tpch_q18/duckdb:vortex-file-compressed 🚀 191056515 285267904 0.67
tpch_q19/duckdb:vortex-file-compressed 🚀 68666732 97198803 0.71
tpch_q20/duckdb:vortex-file-compressed 🚀 113204954 173088115 0.65
tpch_q21/duckdb:vortex-file-compressed 🚀 437635486 576918060 0.76
tpch_q22/duckdb:vortex-file-compressed 🚀 61695728 86408932 0.71
duckdb / vortex-compact (0.697x ✅, 22↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚀 149726585 235832899 0.63
tpch_q02/duckdb:vortex-compact 🚀 45479972 59685818 0.76
tpch_q03/duckdb:vortex-compact 🚀 106703240 152707804 0.70
tpch_q04/duckdb:vortex-compact 🚀 128102185 192988177 0.66
tpch_q05/duckdb:vortex-compact 🚀 111221265 155326742 0.72
tpch_q06/duckdb:vortex-compact 🚀 60866206 93658950 0.65
tpch_q07/duckdb:vortex-compact 🚀 143072021 211710889 0.68
tpch_q08/duckdb:vortex-compact 🚀 146933080 217142134 0.68
tpch_q09/duckdb:vortex-compact 🚀 287483167 373734204 0.77
tpch_q10/duckdb:vortex-compact 🚀 143012546 185344291 0.77
tpch_q11/duckdb:vortex-compact 🚀 29813204 42543672 0.70
tpch_q12/duckdb:vortex-compact 🚀 149618597 209220272 0.72
tpch_q13/duckdb:vortex-compact 🚀 204979958 293811881 0.70
tpch_q14/duckdb:vortex-compact 🚀 76351647 112541767 0.68
tpch_q15/duckdb:vortex-compact 🚀 79955769 120907828 0.66
tpch_q16/duckdb:vortex-compact 🚀 69388044 86279262 0.80
tpch_q17/duckdb:vortex-compact 🚀 82477453 116234330 0.71
tpch_q18/duckdb:vortex-compact 🚀 197386467 291387768 0.68
tpch_q19/duckdb:vortex-compact 🚀 83165249 130212351 0.64
tpch_q20/duckdb:vortex-compact 🚀 139555765 209657922 0.67
tpch_q21/duckdb:vortex-compact 🚀 488968400 688074253 0.71
tpch_q22/duckdb:vortex-compact 🚀 70183305 101302125 0.69
duckdb / parquet (0.721x ✅, 22↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚀 165722985 259327836 0.64
tpch_q02/duckdb:parquet 🚀 80369651 106772020 0.75
tpch_q03/duckdb:parquet 🚀 157506127 214496895 0.73
tpch_q04/duckdb:parquet 🚀 103447266 143979205 0.72
tpch_q05/duckdb:parquet 🚀 163208200 222714674 0.73
tpch_q06/duckdb:parquet 🚀 46677658 69536681 0.67
tpch_q07/duckdb:parquet 🚀 130172522 191207203 0.68
tpch_q08/duckdb:parquet 🚀 188822495 263665654 0.72
tpch_q09/duckdb:parquet 🚀 358914523 473067114 0.76
tpch_q10/duckdb:parquet 🚀 500135703 630752671 0.79
tpch_q11/duckdb:parquet 🚀 30949254 45541721 0.68
tpch_q12/duckdb:parquet 🚀 89383462 128151382 0.70
tpch_q13/duckdb:parquet 🚀 347674437 415294990 0.84
tpch_q14/duckdb:parquet 🚀 137279028 183361987 0.75
tpch_q15/duckdb:parquet 🚀 70528106 99478686 0.71
tpch_q16/duckdb:parquet 🚀 122427809 168016149 0.73
tpch_q17/duckdb:parquet 🚀 125647846 184014553 0.68
tpch_q18/duckdb:parquet 🚀 241892990 362369589 0.67
tpch_q19/duckdb:parquet 🚀 201605276 296037713 0.68
tpch_q20/duckdb:parquet 🚀 169103411 225725576 0.75
tpch_q21/duckdb:parquet 🚀 456498504 619084466 0.74
tpch_q22/duckdb:parquet 🚀 231281458 301375251 0.77
duckdb / duckdb (0.714x ✅, 22↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 🚀 78437717 117795663 0.67
tpch_q02/duckdb:duckdb 🚀 37371969 50298584 0.74
tpch_q03/duckdb:duckdb 🚀 76115816 101957762 0.75
tpch_q04/duckdb:duckdb 🚀 104839244 139310608 0.75
tpch_q05/duckdb:duckdb 🚀 82768705 115528310 0.72
tpch_q06/duckdb:duckdb 🚀 26710446 38278292 0.70
tpch_q07/duckdb:duckdb 🚀 66145792 90742459 0.73
tpch_q08/duckdb:duckdb 🚀 87077442 112277622 0.78
tpch_q09/duckdb:duckdb 🚀 224259776 282950290 0.79
tpch_q10/duckdb:duckdb 🚀 154280578 209761229 0.74
tpch_q11/duckdb:duckdb 🚀 11590076 15569185 0.74
tpch_q12/duckdb:duckdb 🚀 63289367 85707331 0.74
tpch_q13/duckdb:duckdb 🚀 184647898 262724546 0.70
tpch_q14/duckdb:duckdb 🚀 50805814 71460662 0.71
tpch_q15/duckdb:duckdb 🚀 50855895 81418257 0.62
tpch_q16/duckdb:duckdb 🚀 55519802 82251395 0.68
tpch_q17/duckdb:duckdb 🚀 61313850 84960507 0.72
tpch_q18/duckdb:duckdb 🚀 147884440 221061349 0.67
tpch_q19/duckdb:duckdb 🚀 79490069 117735712 0.68
tpch_q20/duckdb:duckdb 🚀 79834191 114430606 0.70
tpch_q21/duckdb:duckdb 🚀 240449355 314373115 0.76
tpch_q22/duckdb:duckdb 🚀 49223975 74066737 0.66
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -43.2% -36.1% -11.1% +17.1% ➖ noise
1 datafusion:vortex-compact -23.1% -36.1% +20.4% +16.6% 🚨 regression
1 datafusion:vortex-file-compressed -25.4% -36.1% +16.7% +23.4% ➖ noise
1 duckdb:duckdb -33.4% -36.1% +4.2% +27.6% ➖ noise
1 duckdb:vortex-compact -36.5% -36.1% -0.6% +16.0% ➖ noise
1 duckdb:vortex-file-compressed -38.1% -36.1% -3.1% +20.4% ➖ noise
2 datafusion:arrow -9.2% -21.3% +15.4% +15.7% ➖ noise
2 datafusion:vortex-compact -14.1% -21.3% +9.1% +15.7% ➖ noise
2 datafusion:vortex-file-compressed -20.4% -21.3% +1.1% +15.7% ➖ noise
2 duckdb:duckdb -25.7% -21.3% -5.6% +15.7% ➖ noise
2 duckdb:vortex-compact -23.8% -21.3% -3.2% +15.7% ➖ noise
2 duckdb:vortex-file-compressed -21.7% -21.3% -0.5% +15.7% ➖ noise
3 datafusion:arrow -44.0% -25.7% -24.6% +15.7% ✅ faster
3 datafusion:vortex-compact -21.0% -25.7% +6.4% +15.7% ➖ noise
3 datafusion:vortex-file-compressed -31.3% -25.7% -7.5% +15.7% ➖ noise
3 duckdb:duckdb -25.3% -25.7% +0.5% +15.7% ➖ noise
3 duckdb:vortex-compact -30.1% -25.7% -5.9% +15.7% ➖ noise
3 duckdb:vortex-file-compressed -28.7% -25.7% -4.1% +15.7% ➖ noise
4 datafusion:arrow -40.6% -28.6% -16.8% +15.7% ✅ faster
4 datafusion:vortex-compact -19.6% -28.6% +12.6% +15.7% ➖ noise
4 datafusion:vortex-file-compressed -19.6% -28.6% +12.6% +15.7% ➖ noise
4 duckdb:duckdb -24.7% -28.6% +5.4% +15.7% ➖ noise
4 duckdb:vortex-compact -33.6% -28.6% -7.0% +15.7% ➖ noise
4 duckdb:vortex-file-compressed -40.6% -28.6% -16.9% +15.7% ✅ faster
5 datafusion:arrow -27.8% -28.6% +1.1% +15.7% ➖ noise
5 datafusion:vortex-compact -26.9% -28.6% +2.3% +15.7% ➖ noise
5 datafusion:vortex-file-compressed -33.4% -28.6% -6.8% +15.7% ➖ noise
5 duckdb:duckdb -28.4% -28.6% +0.3% +15.7% ➖ noise
5 duckdb:vortex-compact -28.4% -28.6% +0.3% +15.7% ➖ noise
5 duckdb:vortex-file-compressed -23.6% -28.6% +7.0% +15.7% ➖ noise
6 datafusion:arrow -44.7% -30.3% -20.7% +15.7% ✅ faster
6 datafusion:vortex-compact -23.1% -30.3% +10.2% +15.7% ➖ noise
6 datafusion:vortex-file-compressed -33.0% -30.3% -4.0% +15.7% ➖ noise
6 duckdb:duckdb -30.2% -30.3% +0.1% +19.7% ➖ noise
6 duckdb:vortex-compact -35.0% -30.3% -6.8% +15.7% ➖ noise
6 duckdb:vortex-file-compressed -29.0% -30.3% +1.8% +15.7% ➖ noise
7 datafusion:arrow -43.1% -32.3% -16.0% +15.7% ✅ faster
7 datafusion:vortex-compact -27.8% -32.3% +6.7% +15.7% ➖ noise
7 datafusion:vortex-file-compressed -30.7% -32.3% +2.4% +15.7% ➖ noise
7 duckdb:duckdb -27.1% -32.3% +7.7% +15.7% ➖ noise
7 duckdb:vortex-compact -32.4% -32.3% -0.2% +15.7% ➖ noise
7 duckdb:vortex-file-compressed -34.4% -32.3% -3.1% +17.0% ➖ noise
8 datafusion:arrow -26.1% -27.0% +1.2% +15.7% ➖ noise
8 datafusion:vortex-compact -28.6% -27.0% -2.2% +15.7% ➖ noise
8 datafusion:vortex-file-compressed -27.1% -27.0% -0.2% +15.7% ➖ noise
8 duckdb:duckdb -22.4% -27.0% +6.2% +15.7% ➖ noise
8 duckdb:vortex-compact -32.3% -27.0% -7.3% +15.7% ➖ noise
8 duckdb:vortex-file-compressed -29.9% -27.0% -4.0% +15.7% ➖ noise
9 datafusion:arrow -28.3% -28.7% +0.5% +15.7% ➖ noise
9 datafusion:vortex-compact -31.2% -28.7% -3.6% +15.7% ➖ noise
9 datafusion:vortex-file-compressed -31.1% -28.7% -3.4% +15.7% ➖ noise
9 duckdb:duckdb -20.7% -28.7% +11.1% +15.7% ➖ noise
9 duckdb:vortex-compact -23.1% -28.7% +7.8% +15.7% ➖ noise
9 duckdb:vortex-file-compressed -21.6% -28.7% +9.9% +15.7% ➖ noise
10 datafusion:arrow -44.4% -21.2% -29.4% +15.7% ✅ faster
10 datafusion:vortex-compact -33.5% -21.2% -15.5% +15.7% ✅ faster
10 datafusion:vortex-file-compressed -19.8% -21.2% +1.7% +15.7% ➖ noise
10 duckdb:duckdb -26.4% -21.2% -6.6% +15.7% ➖ noise
10 duckdb:vortex-compact -22.8% -21.2% -2.1% +15.7% ➖ noise
10 duckdb:vortex-file-compressed -32.1% -21.2% -13.8% +15.7% ✅ faster
11 datafusion:arrow -9.9% -22.2% +15.8% +15.7% 🚨 regression
11 datafusion:vortex-compact -20.8% -22.2% +1.8% +15.7% ➖ noise
11 datafusion:vortex-file-compressed -20.6% -22.2% +2.1% +15.7% ➖ noise
11 duckdb:duckdb -25.6% -22.2% -4.3% +23.5% ➖ noise
11 duckdb:vortex-compact -29.9% -22.2% -9.9% +15.7% ➖ noise
11 duckdb:vortex-file-compressed -32.9% -22.2% -13.8% +15.7% ✅ faster
12 datafusion:arrow -31.0% -26.4% -6.2% +37.3% ➖ noise
12 datafusion:vortex-compact -28.3% -26.4% -2.5% +15.7% ➖ noise
12 datafusion:vortex-file-compressed -23.5% -26.4% +3.9% +15.7% ➖ noise
12 duckdb:duckdb -26.2% -26.4% +0.4% +15.7% ➖ noise
12 duckdb:vortex-compact -28.5% -26.4% -2.8% +15.7% ➖ noise
12 duckdb:vortex-file-compressed -29.5% -26.4% -4.2% +15.7% ➖ noise
13 datafusion:arrow -38.0% -27.6% -14.2% +15.7% ✅ faster
13 datafusion:vortex-compact -44.3% -27.6% -23.1% +15.7% ✅ faster
13 datafusion:vortex-file-compressed -36.0% -27.6% -11.5% +15.7% ➖ noise
13 duckdb:duckdb -29.7% -27.6% -2.9% +15.7% ➖ noise
13 duckdb:vortex-compact -30.2% -27.6% -3.6% +15.7% ➖ noise
13 duckdb:vortex-file-compressed -32.1% -27.6% -6.2% +15.7% ➖ noise
14 datafusion:arrow -40.2% -23.6% -21.7% +15.7% ✅ faster
14 datafusion:vortex-compact -27.4% -23.6% -4.9% +15.7% ➖ noise
14 datafusion:vortex-file-compressed -30.9% -23.6% -9.5% +15.7% ➖ noise
14 duckdb:duckdb -28.9% -23.6% -6.9% +15.7% ➖ noise
14 duckdb:vortex-compact -32.2% -23.6% -11.2% +15.7% ➖ noise
14 duckdb:vortex-file-compressed -32.7% -23.6% -11.9% +15.7% ➖ noise
15 datafusion:arrow -42.7% -31.1% -16.8% +15.7% ✅ faster
15 datafusion:vortex-compact -31.2% -31.1% -0.1% +15.7% ➖ noise
15 datafusion:vortex-file-compressed -26.1% -31.1% +7.3% +15.7% ➖ noise
15 duckdb:duckdb -37.5% -31.1% -9.3% +15.7% ➖ noise
15 duckdb:vortex-compact -33.9% -31.1% -4.0% +15.7% ➖ noise
15 duckdb:vortex-file-compressed -40.6% -31.1% -13.7% +15.7% ✅ faster
16 datafusion:arrow -11.4% -22.6% +14.4% +15.7% ➖ noise
16 datafusion:vortex-compact -23.9% -22.6% -1.7% +15.7% ➖ noise
16 datafusion:vortex-file-compressed -24.2% -22.6% -2.2% +15.7% ➖ noise
16 duckdb:duckdb -32.5% -22.6% -12.8% +15.7% ➖ noise
16 duckdb:vortex-compact -19.6% -22.6% +3.8% +15.7% ➖ noise
16 duckdb:vortex-file-compressed -20.8% -22.6% +2.3% +15.7% ➖ noise
17 datafusion:arrow -20.9% -29.6% +12.4% +15.7% ➖ noise
17 datafusion:vortex-compact -39.5% -29.6% -14.1% +15.7% ✅ faster
17 datafusion:vortex-file-compressed -36.3% -29.6% -9.5% +15.7% ➖ noise
17 duckdb:duckdb -27.8% -29.6% +2.6% +15.7% ➖ noise
17 duckdb:vortex-compact -29.0% -29.6% +0.8% +15.7% ➖ noise
17 duckdb:vortex-file-compressed -31.6% -29.6% -2.8% +15.7% ➖ noise
18 datafusion:arrow -29.3% -31.0% +2.4% +16.0% ➖ noise
18 datafusion:vortex-compact -35.7% -31.0% -6.9% +15.7% ➖ noise
18 datafusion:vortex-file-compressed -35.0% -31.0% -5.9% +15.7% ➖ noise
18 duckdb:duckdb -33.1% -31.0% -3.1% +15.7% ➖ noise
18 duckdb:vortex-compact -32.3% -31.0% -1.9% +15.7% ➖ noise
18 duckdb:vortex-file-compressed -33.0% -31.0% -3.0% +15.7% ➖ noise
19 datafusion:arrow -42.2% -26.5% -21.3% +15.7% ✅ faster
19 datafusion:vortex-compact -34.7% -26.5% -11.2% +15.7% ➖ noise
19 datafusion:vortex-file-compressed -31.9% -26.5% -7.4% +15.7% ➖ noise
19 duckdb:duckdb -32.5% -26.5% -8.1% +15.7% ➖ noise
19 duckdb:vortex-compact -36.1% -26.5% -13.1% +15.7% ➖ noise
19 duckdb:vortex-file-compressed -29.4% -26.5% -3.9% +15.7% ➖ noise
20 datafusion:arrow -42.3% -20.4% -27.5% +15.7% ✅ faster
20 datafusion:vortex-compact -34.3% -20.4% -17.5% +15.7% ✅ faster
20 datafusion:vortex-file-compressed -26.2% -20.4% -7.3% +15.7% ➖ noise
20 duckdb:duckdb -30.2% -20.4% -12.3% +15.7% ➖ noise
20 duckdb:vortex-compact -33.4% -20.4% -16.4% +15.7% ✅ faster
20 duckdb:vortex-file-compressed -34.6% -20.4% -17.8% +15.7% ✅ faster
21 datafusion:arrow -10.7% -24.9% +19.0% +15.7% 🚨 regression
21 datafusion:vortex-compact -25.1% -24.9% -0.2% +15.7% ➖ noise
21 datafusion:vortex-file-compressed -33.9% -24.9% -11.9% +15.7% ➖ noise
21 duckdb:duckdb -23.5% -24.9% +1.9% +15.7% ➖ noise
21 duckdb:vortex-compact -28.9% -24.9% -5.3% +15.7% ➖ noise
21 duckdb:vortex-file-compressed -24.1% -24.9% +1.1% +15.7% ➖ noise
22 datafusion:arrow -17.0% -23.1% +7.9% +15.7% ➖ noise
22 datafusion:vortex-compact -16.9% -23.1% +8.1% +15.7% ➖ noise
22 datafusion:vortex-file-compressed -21.4% -23.1% +2.2% +15.7% ➖ noise
22 duckdb:duckdb -33.5% -23.1% -13.6% +15.7% ✅ faster
22 duckdb:vortex-compact -30.7% -23.1% -10.0% +15.7% ➖ noise
22 duckdb:vortex-file-compressed -28.6% -23.1% -7.2% +15.7% ➖ noise

@github-actions

github-actions Bot commented Mar 13, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Summary

  • Overall: 0.766x ✅
  • Vortex: 0.777x ✅
  • Parquet: 0.752x ✅

Verdict

No clear signal

  • Attributed Vortex impact: +2.6%
  • Confidence: environment too noisy
  • Environment shift: -24.8%

Statistical Summary

  • Systemic shift (parquet controls): -24.8%
  • Control sigma: +6.6%
  • Residual noise: +5.1%
  • Median polish overall: -24.5%
datafusion / vortex-file-compressed (0.823x ✅, 87↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚀 23450311 29326481 0.80
tpcds_q02/datafusion:vortex-file-compressed 🚀 64122483 75437311 0.85
tpcds_q03/datafusion:vortex-file-compressed 🚀 23359467 26860868 0.87
tpcds_q04/datafusion:vortex-file-compressed 🚀 309668971 388305670 0.80
tpcds_q05/datafusion:vortex-file-compressed 🚀 55906476 73858864 0.76
tpcds_q06/datafusion:vortex-file-compressed 🚀 59014499 76846023 0.77
tpcds_q07/datafusion:vortex-file-compressed 🚀 64310538 74300433 0.87
tpcds_q08/datafusion:vortex-file-compressed 🚀 32565340 38543851 0.84
tpcds_q09/datafusion:vortex-file-compressed 🚀 33646957 46498129 0.72
tpcds_q10/datafusion:vortex-file-compressed 🚀 35987569 49531110 0.73
tpcds_q11/datafusion:vortex-file-compressed 🚀 179609508 234456335 0.77
tpcds_q12/datafusion:vortex-file-compressed 🚀 30422730 35181694 0.86
tpcds_q13/datafusion:vortex-file-compressed 🚀 64656403 78476461 0.82
tpcds_q14/datafusion:vortex-file-compressed 🚀 153483779 207101180 0.74
tpcds_q15/datafusion:vortex-file-compressed 🚀 41755354 48288659 0.86
tpcds_q16/datafusion:vortex-file-compressed 26849601 29363371 0.91
tpcds_q17/datafusion:vortex-file-compressed 🚀 96169550 113240219 0.85
tpcds_q18/datafusion:vortex-file-compressed 96255428 100629116 0.96
tpcds_q19/datafusion:vortex-file-compressed 🚀 40950933 47411206 0.86
tpcds_q20/datafusion:vortex-file-compressed 🚀 36074110 41059106 0.88
tpcds_q21/datafusion:vortex-file-compressed 154767850 169327841 0.91
tpcds_q22/datafusion:vortex-file-compressed 🚀 53605936 72676450 0.74
tpcds_q23/datafusion:vortex-file-compressed 🚀 140230771 187346672 0.75
tpcds_q24/datafusion:vortex-file-compressed 🚀 153234938 180291870 0.85
tpcds_q25/datafusion:vortex-file-compressed 🚀 98697281 110916454 0.89
tpcds_q26/datafusion:vortex-file-compressed 56346871 58555156 0.96
tpcds_q27/datafusion:vortex-file-compressed 🚀 134554005 164195741 0.82
tpcds_q28/datafusion:vortex-file-compressed 🚀 37509114 50738108 0.74
tpcds_q29/datafusion:vortex-file-compressed 99605927 110534641 0.90
tpcds_q30/datafusion:vortex-file-compressed 🚀 24824534 30045067 0.83
tpcds_q31/datafusion:vortex-file-compressed 🚀 151448971 180039399 0.84
tpcds_q32/datafusion:vortex-file-compressed 🚀 17668085 23621734 0.75
tpcds_q33/datafusion:vortex-file-compressed 🚀 29052548 37038777 0.78
tpcds_q34/datafusion:vortex-file-compressed 🚀 33570125 38206593 0.88
tpcds_q35/datafusion:vortex-file-compressed 🚀 49360812 61204484 0.81
tpcds_q36/datafusion:vortex-file-compressed 🚀 79423815 106283010 0.75
tpcds_q37/datafusion:vortex-file-compressed 🚀 31946306 36600789 0.87
tpcds_q38/datafusion:vortex-file-compressed 80132979 86210032 0.93
tpcds_q39/datafusion:vortex-file-compressed 🚀 161444229 196740302 0.82
tpcds_q40/datafusion:vortex-file-compressed 🚀 49043622 54979740 0.89
tpcds_q41/datafusion:vortex-file-compressed 🚀 12788760 14749786 0.87
tpcds_q42/datafusion:vortex-file-compressed 🚀 26736028 30601275 0.87
tpcds_q43/datafusion:vortex-file-compressed 🚀 39318583 46488597 0.85
tpcds_q44/datafusion:vortex-file-compressed 🚀 33238636 43002139 0.77
tpcds_q45/datafusion:vortex-file-compressed 🚀 44313522 49990764 0.89
tpcds_q46/datafusion:vortex-file-compressed 59735377 65357482 0.91
tpcds_q47/datafusion:vortex-file-compressed 🚀 228369042 272737322 0.84
tpcds_q48/datafusion:vortex-file-compressed 🚀 57562533 68493285 0.84
tpcds_q49/datafusion:vortex-file-compressed 🚀 52833251 70529822 0.75
tpcds_q50/datafusion:vortex-file-compressed 🚀 65869520 76671292 0.86
tpcds_q51/datafusion:vortex-file-compressed 🚀 71009660 91468504 0.78
tpcds_q52/datafusion:vortex-file-compressed 🚀 26767038 30136010 0.89
tpcds_q53/datafusion:vortex-file-compressed 🚀 22988367 29270058 0.79
tpcds_q54/datafusion:vortex-file-compressed 🚀 37726299 48246217 0.78
tpcds_q55/datafusion:vortex-file-compressed 🚀 26790157 30457890 0.88
tpcds_q56/datafusion:vortex-file-compressed 🚀 37903906 44191146 0.86
tpcds_q57/datafusion:vortex-file-compressed 🚀 151595176 179598709 0.84
tpcds_q58/datafusion:vortex-file-compressed 🚀 87924869 109198060 0.81
tpcds_q59/datafusion:vortex-file-compressed 🚀 76379110 96182443 0.79
tpcds_q60/datafusion:vortex-file-compressed 🚀 39731088 47289281 0.84
tpcds_q61/datafusion:vortex-file-compressed 🚀 46204837 59745150 0.77
tpcds_q62/datafusion:vortex-file-compressed 42003762 44076312 0.95
tpcds_q63/datafusion:vortex-file-compressed 28339548 29619974 0.96
tpcds_q64/datafusion:vortex-file-compressed 685234637 701895026 0.98
tpcds_q65/datafusion:vortex-file-compressed 🚀 42152263 54313376 0.78
tpcds_q66/datafusion:vortex-file-compressed 🚀 76205411 105554434 0.72
tpcds_q67/datafusion:vortex-file-compressed 🚀 114051626 142682551 0.80
tpcds_q68/datafusion:vortex-file-compressed 🚀 57540763 65135956 0.88
tpcds_q69/datafusion:vortex-file-compressed 🚀 34226092 47111943 0.73
tpcds_q70/datafusion:vortex-file-compressed 🚀 108455458 127880173 0.85
tpcds_q71/datafusion:vortex-file-compressed 🚀 24552180 29925082 0.82
tpcds_q72/datafusion:vortex-file-compressed 🚀 2302321473 3396865900 0.68
tpcds_q73/datafusion:vortex-file-compressed 🚀 32985788 36792278 0.90
tpcds_q74/datafusion:vortex-file-compressed 🚀 132281144 169943086 0.78
tpcds_q75/datafusion:vortex-file-compressed 🚀 98790463 136649177 0.72
tpcds_q76/datafusion:vortex-file-compressed 🚀 52356969 62391017 0.84
tpcds_q77/datafusion:vortex-file-compressed 🚀 38943127 53317176 0.73
tpcds_q78/datafusion:vortex-file-compressed 🚀 125455659 178727329 0.70
tpcds_q79/datafusion:vortex-file-compressed 🚀 37018205 42764920 0.87
tpcds_q80/datafusion:vortex-file-compressed 🚀 88741843 116336377 0.76
tpcds_q81/datafusion:vortex-file-compressed 🚀 30392747 36110899 0.84
tpcds_q82/datafusion:vortex-file-compressed 🚀 33006910 40246619 0.82
tpcds_q83/datafusion:vortex-file-compressed 🚀 58405111 67961032 0.86
tpcds_q84/datafusion:vortex-file-compressed 🚀 13389042 15070114 0.89
tpcds_q85/datafusion:vortex-file-compressed 137855832 134936984 1.02
tpcds_q86/datafusion:vortex-file-compressed 🚀 26568234 32053220 0.83
tpcds_q87/datafusion:vortex-file-compressed 🚀 79847654 89716178 0.89
tpcds_q88/datafusion:vortex-file-compressed 🚀 58004608 78559411 0.74
tpcds_q89/datafusion:vortex-file-compressed 🚀 45798897 57495317 0.80
tpcds_q90/datafusion:vortex-file-compressed 🚀 13301983 16848032 0.79
tpcds_q91/datafusion:vortex-file-compressed 🚀 20752012 27111460 0.77
tpcds_q92/datafusion:vortex-file-compressed 🚀 14818650 19819734 0.75
tpcds_q93/datafusion:vortex-file-compressed 🚀 29030158 37408812 0.78
tpcds_q94/datafusion:vortex-file-compressed 🚀 21498505 26875205 0.80
tpcds_q95/datafusion:vortex-file-compressed 🚀 66861761 89066143 0.75
tpcds_q96/datafusion:vortex-file-compressed 13902718 14811268 0.94
tpcds_q97/datafusion:vortex-file-compressed 🚀 23668513 33078908 0.72
tpcds_q98/datafusion:vortex-file-compressed 🚀 41670818 50786205 0.82
tpcds_q99/datafusion:vortex-file-compressed 🚀 50935593 60495649 0.84
datafusion / vortex-compact (0.774x ✅, 98↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚀 29650121 35515212 0.83
tpcds_q02/datafusion:vortex-compact 🚀 68637310 82650780 0.83
tpcds_q03/datafusion:vortex-compact 🚀 29147028 32778058 0.89
tpcds_q04/datafusion:vortex-compact 🚀 328984583 438579693 0.75
tpcds_q05/datafusion:vortex-compact 🚀 63387766 83253611 0.76
tpcds_q06/datafusion:vortex-compact 🚀 64149230 84841178 0.76
tpcds_q07/datafusion:vortex-compact 🚀 72842399 92408581 0.79
tpcds_q08/datafusion:vortex-compact 🚀 39057096 48242697 0.81
tpcds_q09/datafusion:vortex-compact 🚀 62152810 101940334 0.61
tpcds_q10/datafusion:vortex-compact 🚀 50358367 67752789 0.74
tpcds_q11/datafusion:vortex-compact 🚀 196822036 263441801 0.75
tpcds_q12/datafusion:vortex-compact 🚀 32728899 39417957 0.83
tpcds_q13/datafusion:vortex-compact 🚀 104408451 142175643 0.73
tpcds_q14/datafusion:vortex-compact 🚀 187397703 271239767 0.69
tpcds_q15/datafusion:vortex-compact 🚀 45021324 53991519 0.83
tpcds_q16/datafusion:vortex-compact 🚀 33188723 40434153 0.82
tpcds_q17/datafusion:vortex-compact 🚀 107332933 128455102 0.84
tpcds_q18/datafusion:vortex-compact 🚀 103117290 121637798 0.85
tpcds_q19/datafusion:vortex-compact 🚀 49882031 64086556 0.78
tpcds_q20/datafusion:vortex-compact 🚀 38685877 47944446 0.81
tpcds_q21/datafusion:vortex-compact 🚀 153388225 183696952 0.84
tpcds_q22/datafusion:vortex-compact 🚀 55333356 78541857 0.70
tpcds_q23/datafusion:vortex-compact 🚀 165019313 230760552 0.72
tpcds_q24/datafusion:vortex-compact 🚀 175597639 215582664 0.81
tpcds_q25/datafusion:vortex-compact 🚀 109824594 130763226 0.84
tpcds_q26/datafusion:vortex-compact 🚀 59321779 74051340 0.80
tpcds_q27/datafusion:vortex-compact 🚀 149610352 215450098 0.69
tpcds_q28/datafusion:vortex-compact 🚀 64294900 103611459 0.62
tpcds_q29/datafusion:vortex-compact 🚀 109050396 128358920 0.85
tpcds_q30/datafusion:vortex-compact 🚀 29670879 36564497 0.81
tpcds_q31/datafusion:vortex-compact 🚀 173276734 220212209 0.79
tpcds_q32/datafusion:vortex-compact 🚀 22569708 30458908 0.74
tpcds_q33/datafusion:vortex-compact 🚀 38292392 51809246 0.74
tpcds_q34/datafusion:vortex-compact 🚀 45023305 58662225 0.77
tpcds_q35/datafusion:vortex-compact 🚀 59168088 77469131 0.76
tpcds_q36/datafusion:vortex-compact 🚀 99289492 131387399 0.76
tpcds_q37/datafusion:vortex-compact 🚀 38051870 52787830 0.72
tpcds_q38/datafusion:vortex-compact 🚀 88220439 101182419 0.87
tpcds_q39/datafusion:vortex-compact 🚀 144760477 201012484 0.72
tpcds_q40/datafusion:vortex-compact 🚀 50445206 63430529 0.80
tpcds_q41/datafusion:vortex-compact 🚀 13516004 16818823 0.80
tpcds_q42/datafusion:vortex-compact 🚀 29239768 36980673 0.79
tpcds_q43/datafusion:vortex-compact 🚀 44288400 55741504 0.79
tpcds_q44/datafusion:vortex-compact 🚀 51935847 70924108 0.73
tpcds_q45/datafusion:vortex-compact 🚀 44824799 53503686 0.84
tpcds_q46/datafusion:vortex-compact 🚀 73145290 93365203 0.78
tpcds_q47/datafusion:vortex-compact 🚀 236708423 307687854 0.77
tpcds_q48/datafusion:vortex-compact 🚀 82282731 112017570 0.73
tpcds_q49/datafusion:vortex-compact 🚀 75362419 99774160 0.76
tpcds_q50/datafusion:vortex-compact 🚀 80081423 93927566 0.85
tpcds_q51/datafusion:vortex-compact 🚀 73721736 102130784 0.72
tpcds_q52/datafusion:vortex-compact 🚀 31811291 35407553 0.90
tpcds_q53/datafusion:vortex-compact 🚀 30511787 39400169 0.77
tpcds_q54/datafusion:vortex-compact 🚀 47974865 64909140 0.74
tpcds_q55/datafusion:vortex-compact 🚀 31560140 37337715 0.85
tpcds_q56/datafusion:vortex-compact 🚀 46525982 59917221 0.78
tpcds_q57/datafusion:vortex-compact 🚀 165028568 197381464 0.84
tpcds_q58/datafusion:vortex-compact 🚀 92914977 122347268 0.76
tpcds_q59/datafusion:vortex-compact 🚀 87049142 110041855 0.79
tpcds_q60/datafusion:vortex-compact 🚀 45750819 62805838 0.73
tpcds_q61/datafusion:vortex-compact 🚀 59164012 81644888 0.72
tpcds_q62/datafusion:vortex-compact 🚀 37011061 47628750 0.78
tpcds_q63/datafusion:vortex-compact 🚀 29607853 38351350 0.77
tpcds_q64/datafusion:vortex-compact 🚀 677597677 796469273 0.85
tpcds_q65/datafusion:vortex-compact 🚀 53694068 71423800 0.75
tpcds_q66/datafusion:vortex-compact 🚀 78903922 118963551 0.66
tpcds_q67/datafusion:vortex-compact 🚀 116983651 152686209 0.77
tpcds_q68/datafusion:vortex-compact 🚀 74147803 92901431 0.80
tpcds_q69/datafusion:vortex-compact 🚀 46486815 61934272 0.75
tpcds_q70/datafusion:vortex-compact 🚀 115434262 141465517 0.82
tpcds_q71/datafusion:vortex-compact 🚀 34790666 45853425 0.76
tpcds_q72/datafusion:vortex-compact 🚀 2259979588 3460632828 0.65
tpcds_q73/datafusion:vortex-compact 🚀 44883632 59268549 0.76
tpcds_q74/datafusion:vortex-compact 🚀 141594639 191733787 0.74
tpcds_q75/datafusion:vortex-compact 🚀 137629168 180679517 0.76
tpcds_q76/datafusion:vortex-compact 🚀 61282427 79727568 0.77
tpcds_q77/datafusion:vortex-compact 🚀 50444842 70611189 0.71
tpcds_q78/datafusion:vortex-compact 🚀 150650414 205685820 0.73
tpcds_q79/datafusion:vortex-compact 🚀 52495801 68866100 0.76
tpcds_q80/datafusion:vortex-compact 🚀 102047396 137786349 0.74
tpcds_q81/datafusion:vortex-compact 🚀 35258384 42350565 0.83
tpcds_q82/datafusion:vortex-compact 🚀 38667657 51087159 0.76
tpcds_q83/datafusion:vortex-compact 🚀 58533426 66145144 0.88
tpcds_q84/datafusion:vortex-compact 🚀 15587683 18653540 0.84
tpcds_q85/datafusion:vortex-compact 149048912 160775890 0.93
tpcds_q86/datafusion:vortex-compact 🚀 27182408 33384036 0.81
tpcds_q87/datafusion:vortex-compact 🚀 87600363 105021994 0.83
tpcds_q88/datafusion:vortex-compact 🚀 94536737 133241145 0.71
tpcds_q89/datafusion:vortex-compact 🚀 52427308 66322796 0.79
tpcds_q90/datafusion:vortex-compact 🚀 17204550 22280985 0.77
tpcds_q91/datafusion:vortex-compact 🚀 31139721 41796175 0.75
tpcds_q92/datafusion:vortex-compact 🚀 16879699 22276400 0.76
tpcds_q93/datafusion:vortex-compact 🚀 44932391 52963417 0.85
tpcds_q94/datafusion:vortex-compact 🚀 24696400 32466553 0.76
tpcds_q95/datafusion:vortex-compact 🚀 74713467 99103040 0.75
tpcds_q96/datafusion:vortex-compact 🚀 19342142 25286578 0.76
tpcds_q97/datafusion:vortex-compact 🚀 30492909 44482055 0.69
tpcds_q98/datafusion:vortex-compact 🚀 47288098 56869728 0.83
tpcds_q99/datafusion:vortex-compact 🚀 48273013 67301891 0.72
datafusion / parquet (0.763x ✅, 91↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 🚀 30811585 37235882 0.83
tpcds_q02/datafusion:parquet 🚀 36426567 48907674 0.74
tpcds_q03/datafusion:parquet 🚀 11503822 17178326 0.67
tpcds_q04/datafusion:parquet 🚀 251989168 386096708 0.65
tpcds_q05/datafusion:parquet 🚀 60474899 88427075 0.68
tpcds_q06/datafusion:parquet 100215480 93315983 1.07
tpcds_q07/datafusion:parquet 🚀 114431255 131349977 0.87
tpcds_q08/datafusion:parquet 🚀 29803055 39664732 0.75
tpcds_q09/datafusion:parquet 🚀 37966065 54130401 0.70
tpcds_q10/datafusion:parquet 🚀 81342082 99484659 0.82
tpcds_q11/datafusion:parquet 🚀 158265168 222632191 0.71
tpcds_q12/datafusion:parquet 🚀 23814521 29603995 0.80
tpcds_q13/datafusion:parquet 🚀 121347722 145858759 0.83
tpcds_q14/datafusion:parquet 🚀 157976918 213236281 0.74
tpcds_q15/datafusion:parquet 53849115 54963974 0.98
tpcds_q16/datafusion:parquet 🚀 27503887 34030145 0.81
tpcds_q17/datafusion:parquet 159657403 172215566 0.93
tpcds_q18/datafusion:parquet 166763247 178626510 0.93
tpcds_q19/datafusion:parquet 🚀 26029232 35516555 0.73
tpcds_q20/datafusion:parquet 🚀 20691992 24459895 0.85
tpcds_q21/datafusion:parquet 🚀 21697515 27729752 0.78
tpcds_q22/datafusion:parquet 🚀 113218057 171020733 0.66
tpcds_q23/datafusion:parquet 🚀 125932140 187150032 0.67
tpcds_q24/datafusion:parquet 190441678 208368739 0.91
tpcds_q25/datafusion:parquet 🚀 159546459 178613856 0.89
tpcds_q26/datafusion:parquet 107431743 113949034 0.94
tpcds_q27/datafusion:parquet 🚀 202336910 261377473 0.77
tpcds_q28/datafusion:parquet 🚀 36432965 51947450 0.70
tpcds_q29/datafusion:parquet 🚀 162052133 181661436 0.89
tpcds_q30/datafusion:parquet 🚀 35596152 44230113 0.80
tpcds_q31/datafusion:parquet 🚀 75084032 106317800 0.71
tpcds_q32/datafusion:parquet 🚀 21810715 29988174 0.73
tpcds_q33/datafusion:parquet 🚀 27795761 37505824 0.74
tpcds_q34/datafusion:parquet 🚀 25336818 36680813 0.69
tpcds_q35/datafusion:parquet 🚀 75162418 97544831 0.77
tpcds_q36/datafusion:parquet 🚀 58095040 81970969 0.71
tpcds_q37/datafusion:parquet 🚀 20023757 25744331 0.78
tpcds_q38/datafusion:parquet 🚀 47338753 65314123 0.72
tpcds_q39/datafusion:parquet 🚀 79837825 101887618 0.78
tpcds_q40/datafusion:parquet 🚀 29237489 37284524 0.78
tpcds_q41/datafusion:parquet 🚀 10546631 12722953 0.83
tpcds_q42/datafusion:parquet 🚀 10775555 15731944 0.68
tpcds_q43/datafusion:parquet 🚀 18224989 27460068 0.66
tpcds_q44/datafusion:parquet 🚀 29468564 41078531 0.72
tpcds_q45/datafusion:parquet 🚀 60260969 69284433 0.87
tpcds_q46/datafusion:parquet 🚀 38279977 49401561 0.77
tpcds_q47/datafusion:parquet 🚀 131269007 188462248 0.70
tpcds_q48/datafusion:parquet 🚀 108452940 134581712 0.81
tpcds_q49/datafusion:parquet 🚀 55720629 72082185 0.77
tpcds_q50/datafusion:parquet 99141775 109850125 0.90
tpcds_q51/datafusion:parquet 🚀 72700553 100443486 0.72
tpcds_q52/datafusion:parquet 🚀 11916176 16096550 0.74
tpcds_q53/datafusion:parquet 🚀 22528446 30178871 0.75
tpcds_q54/datafusion:parquet 🚀 37740769 47834795 0.79
tpcds_q55/datafusion:parquet 🚀 12026425 16127106 0.75
tpcds_q56/datafusion:parquet 🚀 27720901 38819807 0.71
tpcds_q57/datafusion:parquet 🚀 100608961 132367210 0.76
tpcds_q58/datafusion:parquet 🚀 55238529 74023045 0.75
tpcds_q59/datafusion:parquet 🚀 47086959 71234641 0.66
tpcds_q60/datafusion:parquet 🚀 27970624 37909616 0.74
tpcds_q61/datafusion:parquet 🚀 48422718 67965573 0.71
tpcds_q62/datafusion:parquet 🚀 29359523 46222405 0.64
tpcds_q63/datafusion:parquet 🚀 22503980 32562316 0.69
tpcds_q64/datafusion:parquet 🚀 885745181 1000334583 0.89
tpcds_q65/datafusion:parquet 🚀 38435149 50420207 0.76
tpcds_q66/datafusion:parquet 🚀 65068940 88032347 0.74
tpcds_q67/datafusion:parquet 🚀 131213651 183967979 0.71
tpcds_q68/datafusion:parquet 🚀 37916909 53760528 0.71
tpcds_q69/datafusion:parquet 🚀 76404355 92876765 0.82
tpcds_q70/datafusion:parquet 🚀 93411189 110079869 0.85
tpcds_q71/datafusion:parquet 🚀 23217319 30641869 0.76
tpcds_q72/datafusion:parquet 🚀 634302783 871111480 0.73
tpcds_q73/datafusion:parquet 🚀 25853757 39126609 0.66
tpcds_q74/datafusion:parquet 🚀 92982692 135075813 0.69
tpcds_q75/datafusion:parquet 🚀 102271530 135163046 0.76
tpcds_q76/datafusion:parquet 🚀 78057539 92735418 0.84
tpcds_q77/datafusion:parquet 🚀 41086590 61176128 0.67
tpcds_q78/datafusion:parquet 🚀 132812129 177195041 0.75
tpcds_q79/datafusion:parquet 🚀 28688529 41882096 0.68
tpcds_q80/datafusion:parquet 🚀 81417736 118714527 0.69
tpcds_q81/datafusion:parquet 🚀 35888644 42639310 0.84
tpcds_q82/datafusion:parquet 🚀 22398816 30071416 0.74
tpcds_q83/datafusion:parquet 🚀 44978990 56658250 0.79
tpcds_q84/datafusion:parquet 🚀 41798861 48997617 0.85
tpcds_q85/datafusion:parquet 228877732 246238354 0.93
tpcds_q86/datafusion:parquet 🚀 16473200 21625971 0.76
tpcds_q87/datafusion:parquet 🚀 50045645 67207247 0.74
tpcds_q88/datafusion:parquet 🚀 58704067 79728617 0.74
tpcds_q89/datafusion:parquet 🚀 24374683 37764089 0.65
tpcds_q90/datafusion:parquet 🚀 14077983 19755163 0.71
tpcds_q91/datafusion:parquet 🚀 66545184 78636479 0.85
tpcds_q92/datafusion:parquet 🚀 19919745 27168525 0.73
tpcds_q93/datafusion:parquet 🚀 31103703 40298798 0.77
tpcds_q94/datafusion:parquet 🚀 21050162 30123845 0.70
tpcds_q95/datafusion:parquet 🚀 115689418 131822783 0.88
tpcds_q96/datafusion:parquet 🚀 11100130 15188583 0.73
tpcds_q97/datafusion:parquet 🚀 27403275 38206039 0.72
tpcds_q98/datafusion:parquet 🚀 26791403 37554435 0.71
tpcds_q99/datafusion:parquet 🚀 33189990 44844867 0.74
duckdb / vortex-file-compressed (0.770x ✅, 97↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 🚀 21554890 25318153 0.85
tpcds_q02/duckdb:vortex-file-compressed 🚀 62061012 82288838 0.75
tpcds_q03/duckdb:vortex-file-compressed 🚀 17694311 22873518 0.77
tpcds_q04/duckdb:vortex-file-compressed 🚀 79908531 106289410 0.75
tpcds_q05/duckdb:vortex-file-compressed 🚀 79071902 99743500 0.79
tpcds_q06/duckdb:vortex-file-compressed 🚀 28781541 35972110 0.80
tpcds_q07/duckdb:vortex-file-compressed 🚀 18360357 23417625 0.78
tpcds_q08/duckdb:vortex-file-compressed 🚀 18804843 24190285 0.78
tpcds_q09/duckdb:vortex-file-compressed 🚀 26407128 40335503 0.65
tpcds_q10/duckdb:vortex-file-compressed 🚀 28919209 36629405 0.79
tpcds_q11/duckdb:vortex-file-compressed 🚀 45031438 61371264 0.73
tpcds_q12/duckdb:vortex-file-compressed 🚀 11851462 14645371 0.81
tpcds_q13/duckdb:vortex-file-compressed 🚀 25332489 33507257 0.76
tpcds_q14/duckdb:vortex-file-compressed 🚀 144159828 197877812 0.73
tpcds_q15/duckdb:vortex-file-compressed 🚀 30483721 40614621 0.75
tpcds_q16/duckdb:vortex-file-compressed 🚀 23107500 30501824 0.76
tpcds_q17/duckdb:vortex-file-compressed 🚀 29980962 39527086 0.76
tpcds_q18/duckdb:vortex-file-compressed 🚀 35556698 47706697 0.75
tpcds_q19/duckdb:vortex-file-compressed 🚀 24230280 32009188 0.76
tpcds_q20/duckdb:vortex-file-compressed 🚀 13829228 15773741 0.88
tpcds_q21/duckdb:vortex-file-compressed 🚀 14461663 22232932 0.65
tpcds_q22/duckdb:vortex-file-compressed 🚀 71512736 104965548 0.68
tpcds_q23/duckdb:vortex-file-compressed 🚀 91718826 130496348 0.70
tpcds_q24/duckdb:vortex-file-compressed 🚀 44538456 56897499 0.78
tpcds_q25/duckdb:vortex-file-compressed 🚀 28721481 36753527 0.78
tpcds_q26/duckdb:vortex-file-compressed 🚀 31298474 40992882 0.76
tpcds_q27/duckdb:vortex-file-compressed 🚀 66484453 88447804 0.75
tpcds_q28/duckdb:vortex-file-compressed 🚀 24503074 37201054 0.66
tpcds_q29/duckdb:vortex-file-compressed 🚀 27539778 37379935 0.74
tpcds_q30/duckdb:vortex-file-compressed 🚀 23887046 28479891 0.84
tpcds_q31/duckdb:vortex-file-compressed 🚀 18915596 27193609 0.70
tpcds_q32/duckdb:vortex-file-compressed 🚀 12735768 17183895 0.74
tpcds_q33/duckdb:vortex-file-compressed 🚀 49288726 63912563 0.77
tpcds_q34/duckdb:vortex-file-compressed 🚀 14438827 18592441 0.78
tpcds_q35/duckdb:vortex-file-compressed 🚀 51560878 60996200 0.85
tpcds_q36/duckdb:vortex-file-compressed 🚀 20678245 26815956 0.77
tpcds_q37/duckdb:vortex-file-compressed 🚀 16489759 22223259 0.74
tpcds_q38/duckdb:vortex-file-compressed 🚀 31236904 35871807 0.87
tpcds_q39/duckdb:vortex-file-compressed 🚀 35534992 55788153 0.64
tpcds_q40/duckdb:vortex-file-compressed 🚀 19465017 24114235 0.81
tpcds_q41/duckdb:vortex-file-compressed 🚀 10852613 13090184 0.83
tpcds_q42/duckdb:vortex-file-compressed 🚀 8574929 12156305 0.71
tpcds_q43/duckdb:vortex-file-compressed 🚀 14058897 19896479 0.71
tpcds_q44/duckdb:vortex-file-compressed 🚀 18533211 22937052 0.81
tpcds_q45/duckdb:vortex-file-compressed 🚀 22452721 28060205 0.80
tpcds_q46/duckdb:vortex-file-compressed 🚀 38443745 46995899 0.82
tpcds_q47/duckdb:vortex-file-compressed 🚀 37926750 50022244 0.76
tpcds_q48/duckdb:vortex-file-compressed 🚀 23386188 29611634 0.79
tpcds_q49/duckdb:vortex-file-compressed 🚀 23095854 31019867 0.74
tpcds_q50/duckdb:vortex-file-compressed 🚀 26370738 35492757 0.74
tpcds_q51/duckdb:vortex-file-compressed 🚀 85703508 100348788 0.85
tpcds_q52/duckdb:vortex-file-compressed 🚀 10142857 12046186 0.84
tpcds_q53/duckdb:vortex-file-compressed 🚀 13026757 16865318 0.77
tpcds_q54/duckdb:vortex-file-compressed 🚀 38293583 48259912 0.79
tpcds_q55/duckdb:vortex-file-compressed 🚀 8742315 12299844 0.71
tpcds_q56/duckdb:vortex-file-compressed 🚀 48980582 67250512 0.73
tpcds_q57/duckdb:vortex-file-compressed 🚀 37351563 43543237 0.86
tpcds_q58/duckdb:vortex-file-compressed 🚀 22311050 32923552 0.68
tpcds_q59/duckdb:vortex-file-compressed 🚀 44963258 56466515 0.80
tpcds_q60/duckdb:vortex-file-compressed 🚀 50000534 69835953 0.72
tpcds_q61/duckdb:vortex-file-compressed 🚀 26631635 38848214 0.69
tpcds_q62/duckdb:vortex-file-compressed 🚀 14587819 18458140 0.79
tpcds_q63/duckdb:vortex-file-compressed 🚀 13504193 17459623 0.77
tpcds_q64/duckdb:vortex-file-compressed 🚀 65393605 79822593 0.82
tpcds_q65/duckdb:vortex-file-compressed 🚀 17395925 23700904 0.73
tpcds_q66/duckdb:vortex-file-compressed 🚀 45324736 59947564 0.76
tpcds_q67/duckdb:vortex-file-compressed 🚀 111156645 144090783 0.77
tpcds_q68/duckdb:vortex-file-compressed 🚀 32295500 40445920 0.80
tpcds_q69/duckdb:vortex-file-compressed 🚀 29185941 37996320 0.77
tpcds_q70/duckdb:vortex-file-compressed 🚀 17835390 24673258 0.72
tpcds_q71/duckdb:vortex-file-compressed 🚀 15057695 20685458 0.73
tpcds_q72/duckdb:vortex-file-compressed 🚀 124950873 175330400 0.71
tpcds_q73/duckdb:vortex-file-compressed 🚀 15443624 19768502 0.78
tpcds_q74/duckdb:vortex-file-compressed 🚀 37871671 49131149 0.77
tpcds_q75/duckdb:vortex-file-compressed 🚀 45791785 60294383 0.76
tpcds_q76/duckdb:vortex-file-compressed 🚀 47406224 58226913 0.81
tpcds_q77/duckdb:vortex-file-compressed 🚀 45574305 68263090 0.67
tpcds_q78/duckdb:vortex-file-compressed 🚀 58735082 80958481 0.73
tpcds_q79/duckdb:vortex-file-compressed 🚀 27683849 34052477 0.81
tpcds_q80/duckdb:vortex-file-compressed 🚀 65918298 94864048 0.69
tpcds_q81/duckdb:vortex-file-compressed 🚀 28491045 32991682 0.86
tpcds_q82/duckdb:vortex-file-compressed 🚀 16709761 22734989 0.73
tpcds_q83/duckdb:vortex-file-compressed 🚀 22317847 27940748 0.80
tpcds_q84/duckdb:vortex-file-compressed 15808789 17095502 0.92
tpcds_q85/duckdb:vortex-file-compressed 🚀 36609594 44699591 0.82
tpcds_q86/duckdb:vortex-file-compressed 🚀 14108854 17596060 0.80
tpcds_q87/duckdb:vortex-file-compressed 🚀 32661197 40863765 0.80
tpcds_q88/duckdb:vortex-file-compressed 🚀 31503867 40460258 0.78
tpcds_q89/duckdb:vortex-file-compressed 🚀 13684439 18543059 0.74
tpcds_q90/duckdb:vortex-file-compressed 🚀 12901319 15318924 0.84
tpcds_q91/duckdb:vortex-file-compressed 🚀 21755606 26768829 0.81
tpcds_q92/duckdb:vortex-file-compressed 🚀 11546366 14511089 0.80
tpcds_q93/duckdb:vortex-file-compressed 🚀 25507922 30500305 0.84
tpcds_q94/duckdb:vortex-file-compressed 🚀 18707602 21822300 0.86
tpcds_q95/duckdb:vortex-file-compressed 🚀 117068991 154192315 0.76
tpcds_q96/duckdb:vortex-file-compressed 16337741 17531824 0.93
tpcds_q97/duckdb:vortex-file-compressed 🚀 30449971 39769255 0.77
tpcds_q98/duckdb:vortex-file-compressed 🚀 14438576 17775916 0.81
tpcds_q99/duckdb:vortex-file-compressed 🚀 24838686 32235094 0.77
duckdb / vortex-compact (0.745x ✅, 98↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚀 28268859 33123731 0.85
tpcds_q02/duckdb:vortex-compact 🚀 95162425 123695331 0.77
tpcds_q03/duckdb:vortex-compact 🚀 38571017 49688955 0.78
tpcds_q04/duckdb:vortex-compact 🚀 95960553 123066730 0.78
tpcds_q05/duckdb:vortex-compact 🚀 115649401 171481264 0.67
tpcds_q06/duckdb:vortex-compact 🚀 33853138 40299796 0.84
tpcds_q07/duckdb:vortex-compact 🚀 28709301 38238761 0.75
tpcds_q08/duckdb:vortex-compact 🚀 22893168 28412528 0.81
tpcds_q09/duckdb:vortex-compact 🚀 65089877 111225634 0.59
tpcds_q10/duckdb:vortex-compact 🚀 36873034 47825075 0.77
tpcds_q11/duckdb:vortex-compact 🚀 53782089 76713073 0.70
tpcds_q12/duckdb:vortex-compact 🚀 16103821 20754431 0.78
tpcds_q13/duckdb:vortex-compact 🚀 37888682 54648895 0.69
tpcds_q14/duckdb:vortex-compact 🚀 190708654 291357138 0.65
tpcds_q15/duckdb:vortex-compact 🚀 34271596 43915623 0.78
tpcds_q16/duckdb:vortex-compact 🚀 27957088 38113624 0.73
tpcds_q17/duckdb:vortex-compact 🚀 39206528 52813403 0.74
tpcds_q18/duckdb:vortex-compact 🚀 51172935 67522286 0.76
tpcds_q19/duckdb:vortex-compact 🚀 31575005 40382572 0.78
tpcds_q20/duckdb:vortex-compact 🚀 16678010 20863660 0.80
tpcds_q21/duckdb:vortex-compact 🚀 19481447 27759760 0.70
tpcds_q22/duckdb:vortex-compact 🚀 80368528 112044343 0.72
tpcds_q23/duckdb:vortex-compact 🚀 114502755 175006075 0.65
tpcds_q24/duckdb:vortex-compact 🚀 61184354 78407247 0.78
tpcds_q25/duckdb:vortex-compact 🚀 39868768 52336448 0.76
tpcds_q26/duckdb:vortex-compact 🚀 40565152 50458162 0.80
tpcds_q27/duckdb:vortex-compact 🚀 105787437 143315323 0.74
tpcds_q28/duckdb:vortex-compact 🚀 62091654 108910856 0.57
tpcds_q29/duckdb:vortex-compact 🚀 37939126 52685305 0.72
tpcds_q30/duckdb:vortex-compact 🚀 28213782 34862582 0.81
tpcds_q31/duckdb:vortex-compact 🚀 23038223 31548159 0.73
tpcds_q32/duckdb:vortex-compact 🚀 17646939 24820719 0.71
tpcds_q33/duckdb:vortex-compact 🚀 97183577 151254586 0.64
tpcds_q34/duckdb:vortex-compact 🚀 22769557 30947100 0.74
tpcds_q35/duckdb:vortex-compact 🚀 57913708 74700024 0.78
tpcds_q36/duckdb:vortex-compact 🚀 24433716 35797421 0.68
tpcds_q37/duckdb:vortex-compact 🚀 23981972 32610328 0.74
tpcds_q38/duckdb:vortex-compact 🚀 31815882 42720998 0.74
tpcds_q39/duckdb:vortex-compact 🚀 41947584 56449188 0.74
tpcds_q40/duckdb:vortex-compact 🚀 23736458 31934272 0.74
tpcds_q41/duckdb:vortex-compact 🚀 13278581 17484053 0.76
tpcds_q42/duckdb:vortex-compact 🚀 11991698 14449029 0.83
tpcds_q43/duckdb:vortex-compact 🚀 16681165 24934520 0.67
tpcds_q44/duckdb:vortex-compact 🚀 26085093 36568414 0.71
tpcds_q45/duckdb:vortex-compact 🚀 26462914 35273807 0.75
tpcds_q46/duckdb:vortex-compact 🚀 47507277 61853419 0.77
tpcds_q47/duckdb:vortex-compact 🚀 42750602 56623419 0.75
tpcds_q48/duckdb:vortex-compact 🚀 32850507 45488501 0.72
tpcds_q49/duckdb:vortex-compact 🚀 35552266 51076695 0.70
tpcds_q50/duckdb:vortex-compact 🚀 40269357 55224579 0.73
tpcds_q51/duckdb:vortex-compact 🚀 86273518 110577527 0.78
tpcds_q52/duckdb:vortex-compact 🚀 11813599 15324462 0.77
tpcds_q53/duckdb:vortex-compact 🚀 17088906 22198927 0.77
tpcds_q54/duckdb:vortex-compact 🚀 59063715 85541746 0.69
tpcds_q55/duckdb:vortex-compact 🚀 11504947 14925400 0.77
tpcds_q56/duckdb:vortex-compact 🚀 94117322 140263481 0.67
tpcds_q57/duckdb:vortex-compact 🚀 38736610 48373122 0.80
tpcds_q58/duckdb:vortex-compact 🚀 27763594 42168384 0.66
tpcds_q59/duckdb:vortex-compact 🚀 55306572 67880510 0.81
tpcds_q60/duckdb:vortex-compact 🚀 96474592 148585831 0.65
tpcds_q61/duckdb:vortex-compact 🚀 36965169 55330174 0.67
tpcds_q62/duckdb:vortex-compact 🚀 19258106 22779261 0.85
tpcds_q63/duckdb:vortex-compact 🚀 18637892 23661280 0.79
tpcds_q64/duckdb:vortex-compact 🚀 84731259 106404693 0.80
tpcds_q65/duckdb:vortex-compact 🚀 21193875 28325319 0.75
tpcds_q66/duckdb:vortex-compact 🚀 64774357 97911218 0.66
tpcds_q67/duckdb:vortex-compact 🚀 113561844 151989235 0.75
tpcds_q68/duckdb:vortex-compact 🚀 43303204 58826026 0.74
tpcds_q69/duckdb:vortex-compact 🚀 39200159 50656070 0.77
tpcds_q70/duckdb:vortex-compact 🚀 21135385 29875875 0.71
tpcds_q71/duckdb:vortex-compact 🚀 19473389 28216078 0.69
tpcds_q72/duckdb:vortex-compact 🚀 140581864 198995585 0.71
tpcds_q73/duckdb:vortex-compact 🚀 22295565 28946397 0.77
tpcds_q74/duckdb:vortex-compact 🚀 45163439 60697343 0.74
tpcds_q75/duckdb:vortex-compact 🚀 56178786 74018008 0.76
tpcds_q76/duckdb:vortex-compact 🚀 92892938 136756702 0.68
tpcds_q77/duckdb:vortex-compact 🚀 89566646 140590657 0.64
tpcds_q78/duckdb:vortex-compact 🚀 68913167 90423852 0.76
tpcds_q79/duckdb:vortex-compact 🚀 45147625 61574974 0.73
tpcds_q80/duckdb:vortex-compact 🚀 118568701 167183564 0.71
tpcds_q81/duckdb:vortex-compact 🚀 33180440 41957075 0.79
tpcds_q82/duckdb:vortex-compact 🚀 24889496 31647035 0.79
tpcds_q83/duckdb:vortex-compact 🚀 35395407 47259874 0.75
tpcds_q84/duckdb:vortex-compact 19512683 21599487 0.90
tpcds_q85/duckdb:vortex-compact 🚀 49619293 62287952 0.80
tpcds_q86/duckdb:vortex-compact 🚀 17338419 20177418 0.86
tpcds_q87/duckdb:vortex-compact 🚀 33326114 43435449 0.77
tpcds_q88/duckdb:vortex-compact 🚀 32605246 44663999 0.73
tpcds_q89/duckdb:vortex-compact 🚀 17471818 23682215 0.74
tpcds_q90/duckdb:vortex-compact 🚀 14259100 16294629 0.88
tpcds_q91/duckdb:vortex-compact 🚀 35499791 46303577 0.77
tpcds_q92/duckdb:vortex-compact 🚀 16460966 22002891 0.75
tpcds_q93/duckdb:vortex-compact 🚀 31835836 39447730 0.81
tpcds_q94/duckdb:vortex-compact 🚀 22290737 29254588 0.76
tpcds_q95/duckdb:vortex-compact 🚀 128030456 154504168 0.83
tpcds_q96/duckdb:vortex-compact 🚀 17261479 21742514 0.79
tpcds_q97/duckdb:vortex-compact 🚀 32070286 42657620 0.75
tpcds_q98/duckdb:vortex-compact 🚀 17645049 22370188 0.79
tpcds_q99/duckdb:vortex-compact 🚀 27448731 36987925 0.74
duckdb / parquet (0.741x ✅, 99↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 🚀 32849535 47235121 0.70
tpcds_q02/duckdb:parquet 🚀 44180431 61502310 0.72
tpcds_q03/duckdb:parquet 🚀 9408657 11940502 0.79
tpcds_q04/duckdb:parquet 🚀 100745121 127768798 0.79
tpcds_q05/duckdb:parquet 🚀 52096799 70250516 0.74
tpcds_q06/duckdb:parquet 🚀 24565199 30092812 0.82
tpcds_q07/duckdb:parquet 🚀 16774054 23462564 0.71
tpcds_q08/duckdb:parquet 🚀 20960051 27805261 0.75
tpcds_q09/duckdb:parquet 🚀 27647091 39992079 0.69
tpcds_q10/duckdb:parquet 🚀 26851644 36862268 0.73
tpcds_q11/duckdb:parquet 🚀 67667472 89059477 0.76
tpcds_q12/duckdb:parquet 🚀 11344753 15019318 0.76
tpcds_q13/duckdb:parquet 🚀 23502550 34500774 0.68
tpcds_q14/duckdb:parquet 🚀 118497914 167674517 0.71
tpcds_q15/duckdb:parquet 🚀 22313946 30485644 0.73
tpcds_q16/duckdb:parquet 🚀 16821524 21324376 0.79
tpcds_q17/duckdb:parquet 🚀 30773543 37392638 0.82
tpcds_q18/duckdb:parquet 🚀 36348859 47562158 0.76
tpcds_q19/duckdb:parquet 🚀 22736972 29509925 0.77
tpcds_q20/duckdb:parquet 🚀 12315886 15961794 0.77
tpcds_q21/duckdb:parquet 🚀 9480082 11605522 0.82
tpcds_q22/duckdb:parquet 🚀 49928784 69363741 0.72
tpcds_q23/duckdb:parquet 🚀 84073833 116486854 0.72
tpcds_q24/duckdb:parquet 🚀 36369193 45834168 0.79
tpcds_q25/duckdb:parquet 🚀 25348257 32311536 0.78
tpcds_q26/duckdb:parquet 🚀 27852599 36766342 0.76
tpcds_q27/duckdb:parquet 🚀 65494862 90230158 0.73
tpcds_q28/duckdb:parquet 🚀 24228643 37399863 0.65
tpcds_q29/duckdb:parquet 🚀 26887050 36294499 0.74
tpcds_q30/duckdb:parquet 🚀 31530687 40143192 0.79
tpcds_q31/duckdb:parquet 🚀 17999310 23078172 0.78
tpcds_q32/duckdb:parquet 🚀 8331951 11076246 0.75
tpcds_q33/duckdb:parquet 🚀 52905065 71594178 0.74
tpcds_q34/duckdb:parquet 🚀 15161477 21001795 0.72
tpcds_q35/duckdb:parquet 🚀 49622622 62008630 0.80
tpcds_q36/duckdb:parquet 🚀 15312455 20863395 0.73
tpcds_q37/duckdb:parquet 🚀 11211774 13494628 0.83
tpcds_q38/duckdb:parquet 🚀 27928597 36791592 0.76
tpcds_q39/duckdb:parquet 🚀 24016220 33113797 0.73
tpcds_q40/duckdb:parquet 🚀 14866088 18613343 0.80
tpcds_q41/duckdb:parquet 🚀 5822370 7514617 0.77
tpcds_q42/duckdb:parquet 🚀 7560020 10677979 0.71
tpcds_q43/duckdb:parquet 🚀 11052216 15871048 0.70
tpcds_q44/duckdb:parquet 🚀 15736526 22632108 0.70
tpcds_q45/duckdb:parquet 🚀 22133288 26861107 0.82
tpcds_q46/duckdb:parquet 🚀 33277317 45606737 0.73
tpcds_q47/duckdb:parquet 🚀 33490122 47129242 0.71
tpcds_q48/duckdb:parquet 🚀 22060516 31344872 0.70
tpcds_q49/duckdb:parquet 🚀 17320253 23879829 0.73
tpcds_q50/duckdb:parquet 🚀 18149131 25184843 0.72
tpcds_q51/duckdb:parquet 🚀 77700224 96911381 0.80
tpcds_q52/duckdb:parquet 🚀 8091025 11240093 0.72
tpcds_q53/duckdb:parquet 🚀 12363874 16334201 0.76
tpcds_q54/duckdb:parquet 🚀 29773040 42754061 0.70
tpcds_q55/duckdb:parquet 🚀 7981956 11067145 0.72
tpcds_q56/duckdb:parquet 🚀 47265608 70855817 0.67
tpcds_q57/duckdb:parquet 🚀 27888474 35306672 0.79
tpcds_q58/duckdb:parquet 🚀 16217371 21850731 0.74
tpcds_q59/duckdb:parquet 🚀 24510143 36504784 0.67
tpcds_q60/duckdb:parquet 🚀 52652655 72905382 0.72
tpcds_q61/duckdb:parquet 🚀 22317666 28795676 0.78
tpcds_q62/duckdb:parquet 🚀 8804811 12841163 0.69
tpcds_q63/duckdb:parquet 🚀 11135441 15520024 0.72
tpcds_q64/duckdb:parquet 🚀 55146335 75616655 0.73
tpcds_q65/duckdb:parquet 🚀 15401883 20971335 0.73
tpcds_q66/duckdb:parquet 🚀 40797709 56458375 0.72
tpcds_q67/duckdb:parquet 🚀 102327974 135324531 0.76
tpcds_q68/duckdb:parquet 🚀 27377822 38040359 0.72
tpcds_q69/duckdb:parquet 🚀 27750239 38251323 0.73
tpcds_q70/duckdb:parquet 🚀 14463417 19726429 0.73
tpcds_q71/duckdb:parquet 🚀 13211167 18750915 0.70
tpcds_q72/duckdb:parquet 🚀 111569375 163167561 0.68
tpcds_q73/duckdb:parquet 🚀 13509207 18216103 0.74
tpcds_q74/duckdb:parquet 🚀 37524943 50958219 0.74
tpcds_q75/duckdb:parquet 🚀 39957441 53633927 0.75
tpcds_q76/duckdb:parquet 🚀 47582974 70129250 0.68
tpcds_q77/duckdb:parquet 🚀 41462417 63031037 0.66
tpcds_q78/duckdb:parquet 🚀 57680365 76071056 0.76
tpcds_q79/duckdb:parquet 🚀 19961088 27778389 0.72
tpcds_q80/duckdb:parquet 🚀 62193460 85036336 0.73
tpcds_q81/duckdb:parquet 🚀 35338631 46731348 0.76
tpcds_q82/duckdb:parquet 🚀 12320159 15651198 0.79
tpcds_q83/duckdb:parquet 🚀 12371528 16483881 0.75
tpcds_q84/duckdb:parquet 🚀 15209530 20406522 0.75
tpcds_q85/duckdb:parquet 🚀 28983994 38306966 0.76
tpcds_q86/duckdb:parquet 🚀 9873372 12174900 0.81
tpcds_q87/duckdb:parquet 🚀 26953906 36776828 0.73
tpcds_q88/duckdb:parquet 🚀 21970465 28893970 0.76
tpcds_q89/duckdb:parquet 🚀 13067809 17337541 0.75
tpcds_q90/duckdb:parquet 🚀 5378874 7695993 0.70
tpcds_q91/duckdb:parquet 🚀 16417869 24248540 0.68
tpcds_q92/duckdb:parquet 🚀 8649307 11760708 0.74
tpcds_q93/duckdb:parquet 🚀 23108495 29539616 0.78
tpcds_q94/duckdb:parquet 🚀 12696263 16729045 0.76
tpcds_q95/duckdb:parquet 🚀 99397820 129745823 0.77
tpcds_q96/duckdb:parquet 🚀 6982636 9166759 0.76
tpcds_q97/duckdb:parquet 🚀 27744649 35219600 0.79
tpcds_q98/duckdb:parquet 🚀 14481738 18246797 0.79
tpcds_q99/duckdb:parquet 🚀 14709983 20026088 0.73
duckdb / duckdb (0.752x ✅, 98↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 🚀 15992681 20242816 0.79
tpcds_q02/duckdb:duckdb 🚀 11919469 18408276 0.65
tpcds_q03/duckdb:duckdb 🚀 6385347 8525509 0.75
tpcds_q04/duckdb:duckdb 🚀 133392190 162861411 0.82
tpcds_q05/duckdb:duckdb 🚀 13826830 18559204 0.75
tpcds_q06/duckdb:duckdb 🚀 16513934 22629390 0.73
tpcds_q07/duckdb:duckdb 🚀 25893932 38719833 0.67
tpcds_q08/duckdb:duckdb 109678415 119822617 0.92
tpcds_q09/duckdb:duckdb 🚀 12892072 19560551 0.66
tpcds_q10/duckdb:duckdb 🚀 17137925 22799040 0.75
tpcds_q11/duckdb:duckdb 🚀 112090799 139242451 0.81
tpcds_q12/duckdb:duckdb 🚀 9309156 11221255 0.83
tpcds_q13/duckdb:duckdb 🚀 17076935 23658721 0.72
tpcds_q14/duckdb:duckdb 🚀 70146929 92816524 0.76
tpcds_q15/duckdb:duckdb 🚀 18291406 23916762 0.76
tpcds_q16/duckdb:duckdb 🚀 13004442 16534186 0.79
tpcds_q17/duckdb:duckdb 🚀 16458160 21884487 0.75
tpcds_q18/duckdb:duckdb 🚀 34837444 43774598 0.80
tpcds_q19/duckdb:duckdb 🚀 11965916 16084856 0.74
tpcds_q20/duckdb:duckdb 🚀 9073220 12295930 0.74
tpcds_q21/duckdb:duckdb 🚀 5253859 6297571 0.83
tpcds_q22/duckdb:duckdb 🚀 44626267 60286224 0.74
tpcds_q23/duckdb:duckdb 🚀 53620674 79726100 0.67
tpcds_q24/duckdb:duckdb 🚀 16164129 21982637 0.74
tpcds_q25/duckdb:duckdb 🚀 12906417 16776537 0.77
tpcds_q26/duckdb:duckdb 🚀 21056031 25768709 0.82
tpcds_q27/duckdb:duckdb 🚀 31869834 40074214 0.80
tpcds_q28/duckdb:duckdb 🚀 14154835 20959343 0.68
tpcds_q29/duckdb:duckdb 🚀 14455505 20091054 0.72
tpcds_q30/duckdb:duckdb 🚀 21034191 27739469 0.76
tpcds_q31/duckdb:duckdb 🚀 14997239 19762472 0.76
tpcds_q32/duckdb:duckdb 🚀 4745747 6878395 0.69
tpcds_q33/duckdb:duckdb 🚀 9510638 12544956 0.76
tpcds_q34/duckdb:duckdb 🚀 10362287 14981945 0.69
tpcds_q35/duckdb:duckdb 🚀 26160518 32664356 0.80
tpcds_q36/duckdb:duckdb 🚀 54137640 69801753 0.78
tpcds_q37/duckdb:duckdb 🚀 5727740 7895239 0.73
tpcds_q38/duckdb:duckdb 🚀 22078906 30153178 0.73
tpcds_q39/duckdb:duckdb 🚀 21314206 26097204 0.82
tpcds_q40/duckdb:duckdb 🚀 10204328 12981733 0.79
tpcds_q41/duckdb:duckdb 🚀 6385008 8176231 0.78
tpcds_q42/duckdb:duckdb 🚀 4586381 6466953 0.71
tpcds_q43/duckdb:duckdb 🚀 7246533 10945996 0.66
tpcds_q44/duckdb:duckdb 🚀 9851342 13519837 0.73
tpcds_q45/duckdb:duckdb 🚀 12237500 17100449 0.72
tpcds_q46/duckdb:duckdb 🚀 27324888 35373476 0.77
tpcds_q47/duckdb:duckdb 🚀 31684816 41220774 0.77
tpcds_q48/duckdb:duckdb 🚀 16002249 22014287 0.73
tpcds_q49/duckdb:duckdb 🚀 12474200 16194694 0.77
tpcds_q50/duckdb:duckdb 🚀 10545604 13567766 0.78
tpcds_q51/duckdb:duckdb 🚀 75640454 92061697 0.82
tpcds_q52/duckdb:duckdb 🚀 5000556 7109076 0.70
tpcds_q53/duckdb:duckdb 🚀 9469834 11414035 0.83
tpcds_q54/duckdb:duckdb 🚀 12084421 17084693 0.71
tpcds_q55/duckdb:duckdb 🚀 5143706 6754418 0.76
tpcds_q56/duckdb:duckdb 🚀 9680344 12991056 0.75
tpcds_q57/duckdb:duckdb 🚀 25575333 31854074 0.80
tpcds_q58/duckdb:duckdb 🚀 9513278 12177334 0.78
tpcds_q59/duckdb:duckdb 🚀 23864585 34136863 0.70
tpcds_q60/duckdb:duckdb 🚀 11703110 14316036 0.82
tpcds_q61/duckdb:duckdb 🚀 9953803 14377140 0.69
tpcds_q62/duckdb:duckdb 🚀 7126343 9035008 0.79
tpcds_q63/duckdb:duckdb 🚀 8117092 11000744 0.74
tpcds_q64/duckdb:duckdb 🚀 40759015 51203728 0.80
tpcds_q65/duckdb:duckdb 🚀 25090849 34513828 0.73
tpcds_q66/duckdb:duckdb 🚀 18303971 25989338 0.70
tpcds_q67/duckdb:duckdb 🚀 98330188 130200279 0.76
tpcds_q68/duckdb:duckdb 🚀 18098676 24794783 0.73
tpcds_q69/duckdb:duckdb 🚀 18085456 24314731 0.74
tpcds_q70/duckdb:duckdb 🚀 10092608 14119311 0.71
tpcds_q71/duckdb:duckdb 🚀 9575747 12040700 0.80
tpcds_q72/duckdb:duckdb 🚀 31172646 41903157 0.74
tpcds_q73/duckdb:duckdb 🚀 7567460 10496840 0.72
tpcds_q74/duckdb:duckdb 🚀 77121282 99129110 0.78
tpcds_q75/duckdb:duckdb 🚀 32512399 43340510 0.75
tpcds_q76/duckdb:duckdb 🚀 8434340 12641968 0.67
tpcds_q77/duckdb:duckdb 🚀 8479535 12414673 0.68
tpcds_q78/duckdb:duckdb 🚀 49303518 62760620 0.79
tpcds_q79/duckdb:duckdb 🚀 13148272 18318038 0.72
tpcds_q80/duckdb:duckdb 🚀 20903355 28598676 0.73
tpcds_q81/duckdb:duckdb 🚀 27283920 36971435 0.74
tpcds_q82/duckdb:duckdb 🚀 6485659 8627462 0.75
tpcds_q83/duckdb:duckdb 🚀 6912442 8943742 0.77
tpcds_q84/duckdb:duckdb 🚀 9916487 13119156 0.76
tpcds_q85/duckdb:duckdb 🚀 18116848 23469752 0.77
tpcds_q86/duckdb:duckdb 🚀 8622397 10051795 0.86
tpcds_q87/duckdb:duckdb 🚀 26415409 32443911 0.81
tpcds_q88/duckdb:duckdb 🚀 17610479 23885335 0.74
tpcds_q89/duckdb:duckdb 🚀 9681424 13246696 0.73
tpcds_q90/duckdb:duckdb 🚀 4190949 5593076 0.75
tpcds_q91/duckdb:duckdb 🚀 8576397 12161433 0.71
tpcds_q92/duckdb:duckdb 🚀 6144893 8545259 0.72
tpcds_q93/duckdb:duckdb 🚀 18545167 21125964 0.88
tpcds_q94/duckdb:duckdb 🚀 9321354 12270462 0.76
tpcds_q95/duckdb:duckdb 🚀 97452977 128017082 0.76
tpcds_q96/duckdb:duckdb 🚀 3253174 4570573 0.71
tpcds_q97/duckdb:duckdb 🚀 24835967 29999750 0.83
tpcds_q98/duckdb:duckdb 🚀 9582347 13293052 0.72
tpcds_q99/duckdb:duckdb 🚀 11893992 15900852 0.75
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -16.5% -24.1% +10.1% +18.0% ➖ noise
1 datafusion:vortex-file-compressed -20.0% -24.1% +5.4% +21.9% ➖ noise
1 duckdb:duckdb -21.0% -24.1% +4.1% +18.0% ➖ noise
1 duckdb:vortex-compact -14.7% -24.1% +12.5% +18.0% ➖ noise
1 duckdb:vortex-file-compressed -14.9% -24.1% +12.2% +18.0% ➖ noise
2 datafusion:vortex-compact -17.0% -26.9% +13.5% +18.0% ➖ noise
2 datafusion:vortex-file-compressed -15.0% -26.9% +16.2% +18.0% ➖ noise
2 duckdb:duckdb -35.2% -26.9% -11.5% +18.0% ➖ noise
2 duckdb:vortex-compact -23.1% -26.9% +5.2% +18.0% ➖ noise
2 duckdb:vortex-file-compressed -24.6% -26.9% +3.1% +18.0% ➖ noise
3 datafusion:vortex-compact -11.1% -27.4% +22.4% +18.0% 🚨 regression
3 datafusion:vortex-file-compressed -13.0% -27.4% +19.7% +18.0% 🚨 regression
3 duckdb:duckdb -25.1% -27.4% +3.1% +18.0% ➖ noise
3 duckdb:vortex-compact -22.4% -27.4% +6.9% +18.0% ➖ noise
3 duckdb:vortex-file-compressed -22.6% -27.4% +6.5% +18.0% ➖ noise
4 datafusion:vortex-compact -25.0% -28.3% +4.6% +18.0% ➖ noise
4 datafusion:vortex-file-compressed -20.3% -28.3% +11.2% +18.0% ➖ noise
4 duckdb:duckdb -18.1% -28.3% +14.2% +18.0% ➖ noise
4 duckdb:vortex-compact -22.0% -28.3% +8.7% +18.0% ➖ noise
4 duckdb:vortex-file-compressed -24.8% -28.3% +4.8% +18.0% ➖ noise
5 datafusion:vortex-compact -23.9% -28.8% +6.9% +18.0% ➖ noise
5 datafusion:vortex-file-compressed -24.3% -28.8% +6.3% +18.0% ➖ noise
5 duckdb:duckdb -25.5% -28.8% +4.6% +18.0% ➖ noise
5 duckdb:vortex-compact -32.6% -28.8% -5.3% +18.0% ➖ noise
5 duckdb:vortex-file-compressed -20.7% -28.8% +11.3% +18.0% ➖ noise
6 datafusion:vortex-compact -24.4% -6.4% -19.2% +18.0% ✅ faster
6 datafusion:vortex-file-compressed -23.2% -6.4% -18.0% +18.0% ✅ faster
6 duckdb:duckdb -27.0% -6.4% -22.1% +18.0% ✅ faster
6 duckdb:vortex-compact -16.0% -6.4% -10.3% +18.0% ➖ noise
6 duckdb:vortex-file-compressed -20.0% -6.4% -14.5% +18.0% ➖ noise
7 datafusion:vortex-compact -21.2% -21.1% -0.1% +18.0% ➖ noise
7 datafusion:vortex-file-compressed -13.4% -21.1% +9.7% +18.0% ➖ noise
7 duckdb:duckdb -33.1% -21.1% -15.3% +22.2% ➖ noise
7 duckdb:vortex-compact -24.9% -21.1% -4.9% +18.0% ➖ noise
7 duckdb:vortex-file-compressed -21.6% -21.1% -0.7% +18.0% ➖ noise
8 datafusion:vortex-compact -19.0% -24.7% +7.6% +18.0% ➖ noise
8 datafusion:vortex-file-compressed -15.5% -24.7% +12.3% +18.0% ➖ noise
8 duckdb:duckdb -8.5% -24.7% +21.6% +18.0% 🚨 regression
8 duckdb:vortex-compact -19.4% -24.7% +7.1% +18.0% ➖ noise
8 duckdb:vortex-file-compressed -22.3% -24.7% +3.3% +18.0% ➖ noise
9 datafusion:vortex-compact -39.0% -30.4% -12.4% +18.0% ➖ noise
9 datafusion:vortex-file-compressed -27.6% -30.4% +3.9% +18.0% ➖ noise
9 duckdb:duckdb -34.1% -30.4% -5.3% +18.0% ➖ noise
9 duckdb:vortex-compact -41.5% -30.4% -16.0% +18.0% ✅ faster
9 duckdb:vortex-file-compressed -34.5% -30.4% -6.0% +18.0% ➖ noise
10 datafusion:vortex-compact -25.7% -22.8% -3.7% +18.0% ➖ noise
10 datafusion:vortex-file-compressed -27.3% -22.8% -5.9% +18.0% ➖ noise
10 duckdb:duckdb -24.8% -22.8% -2.6% +18.0% ➖ noise
10 duckdb:vortex-compact -22.9% -22.8% -0.1% +18.0% ➖ noise
10 duckdb:vortex-file-compressed -21.0% -22.8% +2.3% +18.0% ➖ noise
11 datafusion:vortex-compact -25.3% -26.5% +1.7% +18.0% ➖ noise
11 datafusion:vortex-file-compressed -23.4% -26.5% +4.2% +18.0% ➖ noise
11 duckdb:duckdb -19.5% -26.5% +9.5% +18.0% ➖ noise
11 duckdb:vortex-compact -29.9% -26.5% -4.6% +18.0% ➖ noise
11 duckdb:vortex-file-compressed -26.6% -26.5% -0.2% +18.0% ➖ noise
12 datafusion:vortex-compact -17.0% -22.0% +6.5% +18.0% ➖ noise
12 datafusion:vortex-file-compressed -13.5% -22.0% +10.9% +18.0% ➖ noise
12 duckdb:duckdb -17.0% -22.0% +6.4% +18.0% ➖ noise
12 duckdb:vortex-compact -22.4% -22.0% -0.5% +18.0% ➖ noise
12 duckdb:vortex-file-compressed -19.1% -22.0% +3.8% +18.0% ➖ noise
13 datafusion:vortex-compact -26.6% -24.7% -2.5% +18.0% ➖ noise
13 datafusion:vortex-file-compressed -17.6% -24.7% +9.4% +18.0% ➖ noise
13 duckdb:duckdb -27.8% -24.7% -4.1% +18.0% ➖ noise
13 duckdb:vortex-compact -30.7% -24.7% -7.9% +18.0% ➖ noise
13 duckdb:vortex-file-compressed -24.4% -24.7% +0.4% +18.0% ➖ noise
14 datafusion:vortex-compact -30.9% -27.6% -4.5% +18.0% ➖ noise
14 datafusion:vortex-file-compressed -25.9% -27.6% +2.4% +18.0% ➖ noise
14 duckdb:duckdb -24.4% -27.6% +4.4% +18.0% ➖ noise
14 duckdb:vortex-compact -34.5% -27.6% -9.5% +18.0% ➖ noise
14 duckdb:vortex-file-compressed -27.1% -27.6% +0.7% +18.0% ➖ noise
15 datafusion:vortex-compact -16.6% -15.3% -1.5% +18.0% ➖ noise
15 datafusion:vortex-file-compressed -13.5% -15.3% +2.1% +18.0% ➖ noise
15 duckdb:duckdb -23.5% -15.3% -9.7% +18.0% ➖ noise
15 duckdb:vortex-compact -22.0% -15.3% -7.8% +18.0% ➖ noise
15 duckdb:vortex-file-compressed -24.9% -15.3% -11.4% +18.0% ➖ noise
16 datafusion:vortex-compact -17.9% -20.2% +2.8% +18.0% ➖ noise
16 datafusion:vortex-file-compressed -8.6% -20.2% +14.5% +18.0% ➖ noise
16 duckdb:duckdb -21.3% -20.2% -1.5% +18.0% ➖ noise
16 duckdb:vortex-compact -26.6% -20.2% -8.1% +18.0% ➖ noise
16 duckdb:vortex-file-compressed -24.2% -20.2% -5.1% +18.0% ➖ noise
17 datafusion:vortex-compact -16.4% -12.7% -4.3% +18.0% ➖ noise
17 datafusion:vortex-file-compressed -15.1% -12.7% -2.8% +18.0% ➖ noise
17 duckdb:duckdb -24.8% -12.7% -13.9% +18.0% ➖ noise
17 duckdb:vortex-compact -25.8% -12.7% -15.0% +18.0% ➖ noise
17 duckdb:vortex-file-compressed -24.2% -12.7% -13.2% +18.0% ➖ noise
18 datafusion:vortex-compact -15.2% -15.5% +0.4% +18.0% ➖ noise
18 datafusion:vortex-file-compressed -4.3% -15.5% +13.2% +18.0% ➖ noise
18 duckdb:duckdb -20.4% -15.5% -5.8% +18.0% ➖ noise
18 duckdb:vortex-compact -24.2% -15.5% -10.3% +18.0% ➖ noise
18 duckdb:vortex-file-compressed -25.5% -15.5% -11.8% +18.0% ➖ noise
19 datafusion:vortex-compact -22.2% -24.9% +3.6% +18.0% ➖ noise
19 datafusion:vortex-file-compressed -13.6% -24.9% +14.9% +18.0% ➖ noise
19 duckdb:duckdb -25.6% -24.9% -1.0% +18.0% ➖ noise
19 duckdb:vortex-compact -21.8% -24.9% +4.1% +18.0% ➖ noise
19 duckdb:vortex-file-compressed -24.3% -24.9% +0.7% +18.0% ➖ noise
20 datafusion:vortex-compact -19.3% -19.2% -0.1% +18.0% ➖ noise
20 datafusion:vortex-file-compressed -12.1% -19.2% +8.7% +18.0% ➖ noise
20 duckdb:duckdb -26.2% -19.2% -8.7% +18.0% ➖ noise
20 duckdb:vortex-compact -20.1% -19.2% -1.1% +18.0% ➖ noise
20 duckdb:vortex-file-compressed -12.3% -19.2% +8.5% +18.0% ➖ noise
21 datafusion:vortex-compact -16.5% -20.1% +4.4% +18.0% ➖ noise
21 datafusion:vortex-file-compressed -8.6% -20.1% +14.3% +18.0% ➖ noise
21 duckdb:duckdb -16.6% -20.1% +4.4% +18.0% ➖ noise
21 duckdb:vortex-compact -29.8% -20.1% -12.2% +18.0% ➖ noise
21 duckdb:vortex-file-compressed -35.0% -20.1% -18.6% +18.0% ✅ faster
22 datafusion:vortex-compact -29.5% -31.0% +2.1% +18.0% ➖ noise
22 datafusion:vortex-file-compressed -26.2% -31.0% +6.9% +18.0% ➖ noise
22 duckdb:duckdb -26.0% -31.0% +7.2% +18.0% ➖ noise
22 duckdb:vortex-compact -28.3% -31.0% +3.9% +18.0% ➖ noise
22 duckdb:vortex-file-compressed -31.9% -31.0% -1.3% +18.0% ➖ noise
23 datafusion:vortex-compact -28.5% -30.3% +2.6% +18.0% ➖ noise
23 datafusion:vortex-file-compressed -25.1% -30.3% +7.4% +18.0% ➖ noise
23 duckdb:duckdb -32.7% -30.3% -3.5% +18.0% ➖ noise
23 duckdb:vortex-compact -34.6% -30.3% -6.1% +18.0% ➖ noise
23 duckdb:vortex-file-compressed -29.7% -30.3% +0.9% +18.0% ➖ noise
24 datafusion:vortex-compact -18.5% -14.8% -4.4% +18.0% ➖ noise
24 datafusion:vortex-file-compressed -15.0% -14.8% -0.2% +18.0% ➖ noise
24 duckdb:duckdb -26.5% -14.8% -13.7% +18.0% ➖ noise
24 duckdb:vortex-compact -22.0% -14.8% -8.4% +18.0% ➖ noise
24 duckdb:vortex-file-compressed -21.7% -14.8% -8.1% +18.0% ➖ noise
25 datafusion:vortex-compact -16.0% -16.3% +0.3% +18.0% ➖ noise
25 datafusion:vortex-file-compressed -11.0% -16.3% +6.3% +18.0% ➖ noise
25 duckdb:duckdb -23.1% -16.3% -8.1% +18.0% ➖ noise
25 duckdb:vortex-compact -23.8% -16.3% -9.0% +18.0% ➖ noise
25 duckdb:vortex-file-compressed -21.9% -16.3% -6.6% +18.0% ➖ noise
26 datafusion:vortex-compact -19.9% -15.5% -5.2% +18.0% ➖ noise
26 datafusion:vortex-file-compressed -3.8% -15.5% +13.9% +18.0% ➖ noise
26 duckdb:duckdb -18.3% -15.5% -3.3% +18.0% ➖ noise
26 duckdb:vortex-compact -19.6% -15.5% -4.9% +18.0% ➖ noise
26 duckdb:vortex-file-compressed -23.6% -15.5% -9.7% +18.0% ➖ noise
27 datafusion:vortex-compact -30.6% -25.0% -7.4% +18.0% ➖ noise
27 datafusion:vortex-file-compressed -18.1% -25.0% +9.3% +18.0% ➖ noise
27 duckdb:duckdb -20.5% -25.0% +6.1% +18.0% ➖ noise
27 duckdb:vortex-compact -26.2% -25.0% -1.5% +18.0% ➖ noise
27 duckdb:vortex-file-compressed -24.8% -25.0% +0.3% +18.0% ➖ noise
28 datafusion:vortex-compact -37.9% -32.6% -7.9% +18.0% ➖ noise
28 datafusion:vortex-file-compressed -26.1% -32.6% +9.7% +18.0% ➖ noise
28 duckdb:duckdb -32.5% -32.6% +0.2% +18.0% ➖ noise
28 duckdb:vortex-compact -43.0% -32.6% -15.4% +18.0% ✅ faster
28 duckdb:vortex-file-compressed -34.1% -32.6% -2.3% +18.0% ➖ noise
29 datafusion:vortex-compact -15.0% -18.7% +4.5% +18.0% ➖ noise
29 datafusion:vortex-file-compressed -9.9% -18.7% +10.9% +18.0% ➖ noise
29 duckdb:duckdb -28.1% -18.7% -11.5% +18.0% ➖ noise
29 duckdb:vortex-compact -28.0% -18.7% -11.4% +18.0% ➖ noise
29 duckdb:vortex-file-compressed -26.3% -18.7% -9.4% +18.0% ➖ noise
30 datafusion:vortex-compact -18.9% -20.5% +2.1% +18.0% ➖ noise
30 datafusion:vortex-file-compressed -17.4% -20.5% +3.9% +18.0% ➖ noise
30 duckdb:duckdb -24.2% -20.5% -4.6% +18.0% ➖ noise
30 duckdb:vortex-compact -19.1% -20.5% +1.8% +18.0% ➖ noise
30 duckdb:vortex-file-compressed -16.1% -20.5% +5.5% +18.0% ➖ noise
31 datafusion:vortex-compact -21.3% -25.8% +6.0% +18.0% ➖ noise
31 datafusion:vortex-file-compressed -15.9% -25.8% +13.3% +18.0% ➖ noise
31 duckdb:duckdb -24.1% -25.8% +2.3% +18.0% ➖ noise
31 duckdb:vortex-compact -27.0% -25.8% -1.6% +18.0% ➖ noise
31 duckdb:vortex-file-compressed -30.4% -25.8% -6.3% +18.0% ➖ noise
32 datafusion:vortex-compact -25.9% -26.0% +0.2% +18.0% ➖ noise
32 datafusion:vortex-file-compressed -25.2% -26.0% +1.1% +18.0% ➖ noise
32 duckdb:duckdb -31.0% -26.0% -6.7% +18.0% ➖ noise
32 duckdb:vortex-compact -28.9% -26.0% -3.9% +18.0% ➖ noise
32 duckdb:vortex-file-compressed -25.9% -26.0% +0.2% +18.0% ➖ noise
33 datafusion:vortex-compact -26.1% -26.0% -0.1% +18.0% ➖ noise
33 datafusion:vortex-file-compressed -21.6% -26.0% +6.0% +18.0% ➖ noise
33 duckdb:duckdb -24.2% -26.0% +2.4% +18.0% ➖ noise
33 duckdb:vortex-compact -35.7% -26.0% -13.2% +18.0% ➖ noise
33 duckdb:vortex-file-compressed -22.9% -26.0% +4.2% +18.0% ➖ noise
34 datafusion:vortex-compact -23.2% -29.4% +8.7% +18.0% ➖ noise
34 datafusion:vortex-file-compressed -12.1% -29.4% +24.4% +18.0% 🚨 regression
34 duckdb:duckdb -30.8% -29.4% -2.1% +18.0% ➖ noise
34 duckdb:vortex-compact -26.4% -29.4% +4.2% +18.0% ➖ noise
34 duckdb:vortex-file-compressed -22.3% -29.4% +10.0% +18.0% ➖ noise
35 datafusion:vortex-compact -23.6% -21.5% -2.7% +18.0% ➖ noise
35 datafusion:vortex-file-compressed -19.4% -21.5% +2.7% +18.0% ➖ noise
35 duckdb:duckdb -19.9% -21.5% +2.0% +18.0% ➖ noise
35 duckdb:vortex-compact -22.5% -21.5% -1.3% +18.0% ➖ noise
35 duckdb:vortex-file-compressed -15.5% -21.5% +7.6% +18.0% ➖ noise
36 datafusion:vortex-compact -24.4% -27.9% +4.8% +18.0% ➖ noise
36 datafusion:vortex-file-compressed -25.3% -27.9% +3.6% +18.0% ➖ noise
36 duckdb:duckdb -22.4% -27.9% +7.5% +18.0% ➖ noise
36 duckdb:vortex-compact -31.7% -27.9% -5.4% +18.0% ➖ noise
36 duckdb:vortex-file-compressed -22.9% -27.9% +6.9% +18.0% ➖ noise
37 datafusion:vortex-compact -27.9% -19.6% -10.3% +18.0% ➖ noise
37 datafusion:vortex-file-compressed -12.7% -19.6% +8.6% +18.4% ➖ noise
37 duckdb:duckdb -27.5% -19.6% -9.8% +21.0% ➖ noise
37 duckdb:vortex-compact -26.5% -19.6% -8.5% +22.3% ➖ noise
37 duckdb:vortex-file-compressed -25.8% -19.6% -7.7% +18.0% ➖ noise
38 datafusion:vortex-compact -12.8% -25.8% +17.5% +18.0% ➖ noise
38 datafusion:vortex-file-compressed -7.0% -25.8% +25.3% +18.0% 🚨 regression
38 duckdb:duckdb -26.8% -25.8% -1.3% +18.0% ➖ noise
38 duckdb:vortex-compact -25.5% -25.8% +0.4% +18.0% ➖ noise
38 duckdb:vortex-file-compressed -12.9% -25.8% +17.4% +18.0% ➖ noise
39 datafusion:vortex-compact -28.0% -24.6% -4.5% +18.0% ➖ noise
39 datafusion:vortex-file-compressed -17.9% -24.6% +8.9% +18.0% ➖ noise
39 duckdb:duckdb -18.3% -24.6% +8.3% +18.1% ➖ noise
39 duckdb:vortex-compact -25.7% -24.6% -1.4% +18.0% ➖ noise
39 duckdb:vortex-file-compressed -36.3% -24.6% -15.5% +18.0% ✅ faster
40 datafusion:vortex-compact -20.5% -20.9% +0.5% +18.0% ➖ noise
40 datafusion:vortex-file-compressed -10.8% -20.9% +12.7% +18.0% ➖ noise
40 duckdb:duckdb -21.4% -20.9% -0.7% +18.0% ➖ noise
40 duckdb:vortex-compact -25.7% -20.9% -6.1% +18.0% ➖ noise
40 duckdb:vortex-file-compressed -19.3% -20.9% +2.0% +18.0% ➖ noise
41 datafusion:vortex-compact -19.6% -19.9% +0.3% +18.0% ➖ noise
41 datafusion:vortex-file-compressed -13.3% -19.9% +8.2% +18.0% ➖ noise
41 duckdb:duckdb -21.9% -19.9% -2.6% +18.0% ➖ noise
41 duckdb:vortex-compact -24.1% -19.9% -5.2% +18.0% ➖ noise
41 duckdb:vortex-file-compressed -17.1% -19.9% +3.4% +18.0% ➖ noise
42 datafusion:vortex-compact -20.9% -30.4% +13.5% +18.0% ➖ noise
42 datafusion:vortex-file-compressed -12.6% -30.4% +25.5% +18.0% 🚨 regression
42 duckdb:duckdb -29.1% -30.4% +1.8% +18.0% ➖ noise
42 duckdb:vortex-compact -17.0% -30.4% +19.2% +18.2% 🚨 regression
42 duckdb:vortex-file-compressed -29.5% -30.4% +1.3% +20.1% ➖ noise
43 datafusion:vortex-compact -20.5% -32.0% +16.9% +18.0% ➖ noise
43 datafusion:vortex-file-compressed -15.4% -32.0% +24.4% +18.0% 🚨 regression
43 duckdb:duckdb -33.8% -32.0% -2.6% +18.0% ➖ noise
43 duckdb:vortex-compact -33.1% -32.0% -1.6% +18.0% ➖ noise
43 duckdb:vortex-file-compressed -29.3% -32.0% +3.9% +18.0% ➖ noise
44 datafusion:vortex-compact -26.8% -29.4% +3.7% +18.0% ➖ noise
44 datafusion:vortex-file-compressed -22.7% -29.4% +9.4% +18.0% ➖ noise
44 duckdb:duckdb -27.1% -29.4% +3.2% +18.0% ➖ noise
44 duckdb:vortex-compact -28.7% -29.4% +1.0% +18.0% ➖ noise
44 duckdb:vortex-file-compressed -19.2% -29.4% +14.4% +18.0% ➖ noise
45 datafusion:vortex-compact -16.2% -15.3% -1.0% +18.0% ➖ noise
45 datafusion:vortex-file-compressed -11.4% -15.3% +4.7% +18.0% ➖ noise
45 duckdb:duckdb -28.4% -15.3% -15.5% +18.0% ✅ faster
45 duckdb:vortex-compact -25.0% -15.3% -11.4% +18.0% ➖ noise
45 duckdb:vortex-file-compressed -20.0% -15.3% -5.5% +19.8% ➖ noise
46 datafusion:vortex-compact -21.7% -24.8% +4.2% +18.0% ➖ noise
46 datafusion:vortex-file-compressed -8.6% -24.8% +21.6% +18.0% 🚨 regression
46 duckdb:duckdb -22.8% -24.8% +2.7% +18.0% ➖ noise
46 duckdb:vortex-compact -23.2% -24.8% +2.1% +18.0% ➖ noise
46 duckdb:vortex-file-compressed -18.2% -24.8% +8.8% +18.0% ➖ noise
47 datafusion:vortex-compact -23.1% -29.6% +9.4% +18.0% ➖ noise
47 datafusion:vortex-file-compressed -16.3% -29.6% +19.0% +18.0% 🚨 regression
47 duckdb:duckdb -23.1% -29.6% +9.3% +18.0% ➖ noise
47 duckdb:vortex-compact -24.5% -29.6% +7.3% +18.0% ➖ noise
47 duckdb:vortex-file-compressed -24.2% -29.6% +7.8% +18.0% ➖ noise
48 datafusion:vortex-compact -26.5% -24.7% -2.5% +18.0% ➖ noise
48 datafusion:vortex-file-compressed -16.0% -24.7% +11.6% +18.0% ➖ noise
48 duckdb:duckdb -27.3% -24.7% -3.5% +18.0% ➖ noise
48 duckdb:vortex-compact -27.8% -24.7% -4.1% +18.0% ➖ noise
48 duckdb:vortex-file-compressed -21.0% -24.7% +4.9% +18.0% ➖ noise
49 datafusion:vortex-compact -24.5% -25.1% +0.9% +18.0% ➖ noise
49 datafusion:vortex-file-compressed -25.1% -25.1% +0.0% +18.0% ➖ noise
49 duckdb:duckdb -23.0% -25.1% +2.9% +19.2% ➖ noise
49 duckdb:vortex-compact -30.4% -25.1% -7.0% +18.0% ➖ noise
49 duckdb:vortex-file-compressed -25.5% -25.1% -0.6% +18.0% ➖ noise
50 datafusion:vortex-compact -14.7% -19.4% +5.7% +18.0% ➖ noise
50 datafusion:vortex-file-compressed -14.1% -19.4% +6.5% +18.0% ➖ noise
50 duckdb:duckdb -22.3% -19.4% -3.6% +18.0% ➖ noise
50 duckdb:vortex-compact -27.1% -19.4% -9.6% +18.0% ➖ noise
50 duckdb:vortex-file-compressed -25.7% -19.4% -7.9% +18.0% ➖ noise
51 datafusion:vortex-compact -27.8% -23.8% -5.2% +18.0% ➖ noise
51 datafusion:vortex-file-compressed -22.4% -23.8% +1.9% +18.0% ➖ noise
51 duckdb:duckdb -17.8% -23.8% +7.9% +18.0% ➖ noise
51 duckdb:vortex-compact -22.0% -23.8% +2.4% +18.0% ➖ noise
51 duckdb:vortex-file-compressed -14.6% -23.8% +12.1% +18.0% ➖ noise
52 datafusion:vortex-compact -10.2% -27.0% +23.1% +18.0% 🚨 regression
52 datafusion:vortex-file-compressed -11.2% -27.0% +21.7% +18.0% 🚨 regression
52 duckdb:duckdb -29.7% -27.0% -3.6% +20.2% ➖ noise
52 duckdb:vortex-compact -22.9% -27.0% +5.6% +18.0% ➖ noise
52 duckdb:vortex-file-compressed -15.8% -27.0% +15.3% +25.5% ➖ noise
53 datafusion:vortex-compact -22.6% -24.8% +3.0% +18.0% ➖ noise
53 datafusion:vortex-file-compressed -21.5% -24.8% +4.5% +18.0% ➖ noise
53 duckdb:duckdb -17.0% -24.8% +10.4% +18.0% ➖ noise
53 duckdb:vortex-compact -23.0% -24.8% +2.4% +18.0% ➖ noise
53 duckdb:vortex-file-compressed -22.8% -24.8% +2.8% +18.0% ➖ noise
54 datafusion:vortex-compact -26.1% -25.9% -0.3% +18.0% ➖ noise
54 datafusion:vortex-file-compressed -21.8% -25.9% +5.5% +18.0% ➖ noise
54 duckdb:duckdb -29.3% -25.9% -4.6% +18.0% ➖ noise
54 duckdb:vortex-compact -31.0% -25.9% -6.8% +18.0% ➖ noise
54 duckdb:vortex-file-compressed -20.7% -25.9% +7.0% +18.0% ➖ noise
55 datafusion:vortex-compact -15.5% -26.7% +15.3% +18.0% ➖ noise
55 datafusion:vortex-file-compressed -12.0% -26.7% +19.9% +18.0% 🚨 regression
55 duckdb:duckdb -23.8% -26.7% +3.8% +20.8% ➖ noise
55 duckdb:vortex-compact -22.9% -26.7% +5.1% +18.0% ➖ noise
55 duckdb:vortex-file-compressed -28.9% -26.7% -3.1% +18.0% ➖ noise
56 datafusion:vortex-compact -22.3% -31.0% +12.5% +18.0% ➖ noise
56 datafusion:vortex-file-compressed -14.2% -31.0% +24.3% +18.0% 🚨 regression
56 duckdb:duckdb -25.5% -31.0% +8.0% +18.0% ➖ noise
56 duckdb:vortex-compact -32.9% -31.0% -2.8% +18.0% ➖ noise
56 duckdb:vortex-file-compressed -27.2% -31.0% +5.5% +18.0% ➖ noise
57 datafusion:vortex-compact -16.4% -22.5% +7.9% +18.0% ➖ noise
57 datafusion:vortex-file-compressed -15.6% -22.5% +8.9% +18.0% ➖ noise
57 duckdb:duckdb -19.7% -22.5% +3.6% +18.0% ➖ noise
57 duckdb:vortex-compact -19.9% -22.5% +3.3% +18.0% ➖ noise
57 duckdb:vortex-file-compressed -14.2% -22.5% +10.7% +18.0% ➖ noise
58 datafusion:vortex-compact -24.1% -25.6% +2.0% +18.0% ➖ noise
58 datafusion:vortex-file-compressed -19.5% -25.6% +8.2% +18.0% ➖ noise
58 duckdb:duckdb -21.9% -25.6% +5.0% +18.0% ➖ noise
58 duckdb:vortex-compact -34.2% -25.6% -11.5% +18.0% ➖ noise
58 duckdb:vortex-file-compressed -32.2% -25.6% -8.9% +18.0% ➖ noise
59 datafusion:vortex-compact -20.9% -33.4% +18.7% +18.0% 🚨 regression
59 datafusion:vortex-file-compressed -20.6% -33.4% +19.2% +18.0% 🚨 regression
59 duckdb:duckdb -30.1% -33.4% +4.9% +18.0% ➖ noise
59 duckdb:vortex-compact -18.5% -33.4% +22.3% +18.0% 🚨 regression
59 duckdb:vortex-file-compressed -20.4% -33.4% +19.5% +18.0% 🚨 regression
60 datafusion:vortex-compact -27.2% -27.0% -0.2% +18.0% ➖ noise
60 datafusion:vortex-file-compressed -16.0% -27.0% +15.1% +18.0% ➖ noise
60 duckdb:duckdb -18.3% -27.0% +12.0% +18.0% ➖ noise
60 duckdb:vortex-compact -35.1% -27.0% -11.1% +18.0% ➖ noise
60 duckdb:vortex-file-compressed -28.4% -27.0% -1.9% +18.0% ➖ noise
61 datafusion:vortex-compact -27.5% -25.7% -2.5% +18.0% ➖ noise
61 datafusion:vortex-file-compressed -22.7% -25.7% +4.1% +18.0% ➖ noise
61 duckdb:duckdb -30.8% -25.7% -6.8% +18.0% ➖ noise
61 duckdb:vortex-compact -33.2% -25.7% -10.1% +18.0% ➖ noise
61 duckdb:vortex-file-compressed -31.4% -25.7% -7.7% +18.0% ➖ noise
62 datafusion:vortex-compact -22.3% -34.0% +17.7% +18.0% ➖ noise
62 datafusion:vortex-file-compressed -4.7% -34.0% +44.4% +18.0% 🚨 regression
62 duckdb:duckdb -21.1% -34.0% +19.5% +18.0% 🚨 regression
62 duckdb:vortex-compact -15.5% -34.0% +28.1% +18.0% 🚨 regression
62 duckdb:vortex-file-compressed -21.0% -34.0% +19.8% +18.0% 🚨 regression
63 datafusion:vortex-compact -22.8% -29.6% +9.6% +18.0% ➖ noise
63 datafusion:vortex-file-compressed -4.3% -29.6% +35.9% +18.0% 🚨 regression
63 duckdb:duckdb -26.2% -29.6% +4.8% +18.0% ➖ noise
63 duckdb:vortex-compact -21.2% -29.6% +11.9% +18.0% ➖ noise
63 duckdb:vortex-file-compressed -22.7% -29.6% +9.8% +18.0% ➖ noise
64 datafusion:vortex-compact -14.9% -19.6% +5.9% +18.0% ➖ noise
64 datafusion:vortex-file-compressed -2.4% -19.6% +21.5% +18.0% 🚨 regression
64 duckdb:duckdb -20.4% -19.6% -0.9% +18.0% ➖ noise
64 duckdb:vortex-compact -20.4% -19.6% -0.9% +18.0% ➖ noise
64 duckdb:vortex-file-compressed -18.1% -19.6% +1.9% +18.0% ➖ noise
65 datafusion:vortex-compact -24.8% -25.2% +0.5% +18.0% ➖ noise
65 datafusion:vortex-file-compressed -22.4% -25.2% +3.7% +18.0% ➖ noise
65 duckdb:duckdb -27.3% -25.2% -2.8% +21.8% ➖ noise
65 duckdb:vortex-compact -25.2% -25.2% -0.0% +18.0% ➖ noise
65 duckdb:vortex-file-compressed -26.6% -25.2% -1.9% +18.0% ➖ noise
66 datafusion:vortex-compact -33.7% -26.9% -9.2% +18.0% ➖ noise
66 datafusion:vortex-file-compressed -27.8% -26.9% -1.2% +18.0% ➖ noise
66 duckdb:duckdb -29.6% -26.9% -3.6% +18.0% ➖ noise
66 duckdb:vortex-compact -33.8% -26.9% -9.5% +18.0% ➖ noise
66 duckdb:vortex-file-compressed -24.4% -26.9% +3.5% +18.0% ➖ noise
67 datafusion:vortex-compact -23.4% -26.6% +4.3% +18.0% ➖ noise
67 datafusion:vortex-file-compressed -20.1% -26.6% +8.8% +18.0% ➖ noise
67 duckdb:duckdb -24.5% -26.6% +2.8% +18.0% ➖ noise
67 duckdb:vortex-compact -25.3% -26.6% +1.7% +18.0% ➖ noise
67 duckdb:vortex-file-compressed -22.9% -26.6% +5.0% +18.0% ➖ noise
68 datafusion:vortex-compact -20.2% -28.8% +12.0% +18.0% ➖ noise
68 datafusion:vortex-file-compressed -11.7% -28.8% +24.0% +18.0% 🚨 regression
68 duckdb:duckdb -27.0% -28.8% +2.5% +18.0% ➖ noise
68 duckdb:vortex-compact -26.4% -28.8% +3.3% +18.0% ➖ noise
68 duckdb:vortex-file-compressed -20.2% -28.8% +12.1% +18.0% ➖ noise
69 datafusion:vortex-compact -24.9% -22.7% -2.8% +18.0% ➖ noise
69 datafusion:vortex-file-compressed -27.4% -22.7% -6.0% +18.0% ➖ noise
69 duckdb:duckdb -25.6% -22.7% -3.7% +18.0% ➖ noise
69 duckdb:vortex-compact -22.6% -22.7% +0.2% +18.0% ➖ noise
69 duckdb:vortex-file-compressed -23.2% -22.7% -0.6% +18.0% ➖ noise
70 datafusion:vortex-compact -18.4% -21.1% +3.4% +18.0% ➖ noise
70 datafusion:vortex-file-compressed -15.2% -21.1% +7.5% +18.0% ➖ noise
70 duckdb:duckdb -28.5% -21.1% -9.4% +18.0% ➖ noise
70 duckdb:vortex-compact -29.3% -21.1% -10.3% +18.0% ➖ noise
70 duckdb:vortex-file-compressed -27.7% -21.1% -8.4% +18.0% ➖ noise
71 datafusion:vortex-compact -24.1% -26.9% +3.8% +18.0% ➖ noise
71 datafusion:vortex-file-compressed -18.0% -26.9% +12.3% +18.0% ➖ noise
71 duckdb:duckdb -20.5% -26.9% +8.8% +18.0% ➖ noise
71 duckdb:vortex-compact -31.0% -26.9% -5.5% +18.0% ➖ noise
71 duckdb:vortex-file-compressed -27.2% -26.9% -0.4% +18.0% ➖ noise
72 datafusion:vortex-compact -34.7% -29.4% -7.4% +18.0% ➖ noise
72 datafusion:vortex-file-compressed -32.2% -29.4% -3.9% +18.0% ➖ noise
72 duckdb:duckdb -25.6% -29.4% +5.4% +18.0% ➖ noise
72 duckdb:vortex-compact -29.4% -29.4% +0.1% +18.0% ➖ noise
72 duckdb:vortex-file-compressed -28.7% -29.4% +1.0% +18.0% ➖ noise
73 datafusion:vortex-compact -24.3% -30.0% +8.2% +18.0% ➖ noise
73 datafusion:vortex-file-compressed -10.3% -30.0% +28.1% +21.4% 🚨 regression
73 duckdb:duckdb -27.9% -30.0% +3.0% +18.0% ➖ noise
73 duckdb:vortex-compact -23.0% -30.0% +10.0% +18.0% ➖ noise
73 duckdb:vortex-file-compressed -21.9% -30.0% +11.6% +18.0% ➖ noise
74 datafusion:vortex-compact -26.2% -28.8% +3.7% +18.0% ➖ noise
74 datafusion:vortex-file-compressed -22.2% -28.8% +9.3% +18.0% ➖ noise
74 duckdb:duckdb -22.2% -28.8% +9.3% +18.0% ➖ noise
74 duckdb:vortex-compact -25.6% -28.8% +4.5% +18.0% ➖ noise
74 duckdb:vortex-file-compressed -22.9% -28.8% +8.3% +18.0% ➖ noise
75 datafusion:vortex-compact -23.8% -24.9% +1.5% +18.0% ➖ noise
75 datafusion:vortex-file-compressed -27.7% -24.9% -3.7% +18.0% ➖ noise
75 duckdb:duckdb -25.0% -24.9% -0.1% +18.0% ➖ noise
75 duckdb:vortex-compact -24.1% -24.9% +1.1% +18.0% ➖ noise
75 duckdb:vortex-file-compressed -24.1% -24.9% +1.2% +18.0% ➖ noise
76 datafusion:vortex-compact -23.1% -24.4% +1.7% +18.0% ➖ noise
76 datafusion:vortex-file-compressed -16.1% -24.4% +11.0% +18.0% ➖ noise
76 duckdb:duckdb -33.3% -24.4% -11.7% +19.3% ➖ noise
76 duckdb:vortex-compact -32.1% -24.4% -10.1% +18.0% ➖ noise
76 duckdb:vortex-file-compressed -18.6% -24.4% +7.7% +23.8% ➖ noise
77 datafusion:vortex-compact -28.6% -33.5% +7.5% +18.0% ➖ noise
77 datafusion:vortex-file-compressed -27.0% -33.5% +9.9% +18.0% ➖ noise
77 duckdb:duckdb -31.7% -33.5% +2.8% +18.0% ➖ noise
77 duckdb:vortex-compact -36.3% -33.5% -4.2% +18.0% ➖ noise
77 duckdb:vortex-file-compressed -33.2% -33.5% +0.4% +18.0% ➖ noise
78 datafusion:vortex-compact -26.8% -24.6% -2.8% +18.0% ➖ noise
78 datafusion:vortex-file-compressed -29.8% -24.6% -6.9% +18.0% ➖ noise
78 duckdb:duckdb -21.4% -24.6% +4.2% +18.0% ➖ noise
78 duckdb:vortex-compact -23.8% -24.6% +1.1% +18.0% ➖ noise
78 duckdb:vortex-file-compressed -27.5% -24.6% -3.8% +18.0% ➖ noise
79 datafusion:vortex-compact -23.8% -29.8% +8.7% +18.0% ➖ noise
79 datafusion:vortex-file-compressed -13.4% -29.8% +23.4% +18.0% 🚨 regression
79 duckdb:duckdb -28.2% -29.8% +2.3% +18.0% ➖ noise
79 duckdb:vortex-compact -26.7% -29.8% +4.5% +18.0% ➖ noise
79 duckdb:vortex-file-compressed -18.7% -29.8% +15.9% +18.0% ➖ noise
80 datafusion:vortex-compact -25.9% -29.2% +4.6% +18.0% ➖ noise
80 datafusion:vortex-file-compressed -23.7% -29.2% +7.7% +18.0% ➖ noise
80 duckdb:duckdb -26.9% -29.2% +3.2% +18.0% ➖ noise
80 duckdb:vortex-compact -29.1% -29.2% +0.1% +18.0% ➖ noise
80 duckdb:vortex-file-compressed -30.5% -29.2% -1.9% +18.0% ➖ noise
81 datafusion:vortex-compact -16.7% -20.2% +4.4% +18.0% ➖ noise
81 datafusion:vortex-file-compressed -15.8% -20.2% +5.5% +18.0% ➖ noise
81 duckdb:duckdb -26.2% -20.2% -7.5% +18.0% ➖ noise
81 duckdb:vortex-compact -20.9% -20.2% -0.9% +18.0% ➖ noise
81 duckdb:vortex-file-compressed -13.6% -20.2% +8.2% +18.0% ➖ noise
82 datafusion:vortex-compact -24.3% -23.4% -1.2% +18.0% ➖ noise
82 datafusion:vortex-file-compressed -18.0% -23.4% +7.1% +18.0% ➖ noise
82 duckdb:duckdb -24.8% -23.4% -1.8% +18.0% ➖ noise
82 duckdb:vortex-compact -21.4% -23.4% +2.7% +18.0% ➖ noise
82 duckdb:vortex-file-compressed -26.5% -23.4% -4.0% +26.2% ➖ noise
83 datafusion:vortex-compact -11.5% -22.8% +14.6% +18.0% ➖ noise
83 datafusion:vortex-file-compressed -14.1% -22.8% +11.3% +18.0% ➖ noise
83 duckdb:duckdb -22.7% -22.8% +0.1% +18.0% ➖ noise
83 duckdb:vortex-compact -25.1% -22.8% -3.0% +18.0% ➖ noise
83 duckdb:vortex-file-compressed -20.1% -22.8% +3.5% +18.0% ➖ noise
84 datafusion:vortex-compact -16.4% -20.3% +4.8% +28.6% ➖ noise
84 datafusion:vortex-file-compressed -11.2% -20.3% +11.4% +18.0% ➖ noise
84 duckdb:duckdb -24.4% -20.3% -5.2% +18.0% ➖ noise
84 duckdb:vortex-compact -9.7% -20.3% +13.3% +18.0% ➖ noise
84 duckdb:vortex-file-compressed -7.5% -20.3% +16.0% +18.0% ➖ noise
85 datafusion:vortex-compact -7.3% -16.1% +10.5% +18.0% ➖ noise
85 datafusion:vortex-file-compressed +2.2% -16.1% +21.8% +18.0% 🚨 regression
85 duckdb:duckdb -22.8% -16.1% -8.0% +18.0% ➖ noise
85 duckdb:vortex-compact -20.3% -16.1% -5.0% +18.0% ➖ noise
85 duckdb:vortex-file-compressed -18.1% -16.1% -2.3% +18.0% ➖ noise
86 datafusion:vortex-compact -18.6% -21.4% +3.6% +18.0% ➖ noise
86 datafusion:vortex-file-compressed -17.1% -21.4% +5.5% +18.0% ➖ noise
86 duckdb:duckdb -14.2% -21.4% +9.1% +18.0% ➖ noise
86 duckdb:vortex-compact -14.1% -21.4% +9.3% +18.0% ➖ noise
86 duckdb:vortex-file-compressed -19.8% -21.4% +2.0% +18.0% ➖ noise
87 datafusion:vortex-compact -16.6% -26.1% +12.9% +18.0% ➖ noise
87 datafusion:vortex-file-compressed -11.0% -26.1% +20.5% +18.0% 🚨 regression
87 duckdb:duckdb -18.6% -26.1% +10.2% +18.0% ➖ noise
87 duckdb:vortex-compact -23.3% -26.1% +3.9% +18.0% ➖ noise
87 duckdb:vortex-file-compressed -20.1% -26.1% +8.2% +18.0% ➖ noise
88 datafusion:vortex-compact -29.0% -25.2% -5.2% +18.0% ➖ noise
88 datafusion:vortex-file-compressed -26.2% -25.2% -1.3% +18.0% ➖ noise
88 duckdb:duckdb -26.3% -25.2% -1.5% +18.0% ➖ noise
88 duckdb:vortex-compact -27.0% -25.2% -2.4% +18.0% ➖ noise
88 duckdb:vortex-file-compressed -22.1% -25.2% +4.1% +18.0% ➖ noise
89 datafusion:vortex-compact -21.0% -30.3% +13.3% +18.0% ➖ noise
89 datafusion:vortex-file-compressed -20.3% -30.3% +14.2% +18.0% ➖ noise
89 duckdb:duckdb -26.9% -30.3% +4.8% +18.0% ➖ noise
89 duckdb:vortex-compact -26.2% -30.3% +5.8% +18.0% ➖ noise
89 duckdb:vortex-file-compressed -26.2% -30.3% +5.8% +18.0% ➖ noise
90 datafusion:vortex-compact -22.8% -29.4% +9.4% +18.0% ➖ noise
90 datafusion:vortex-file-compressed -21.0% -29.4% +11.9% +18.0% ➖ noise
90 duckdb:duckdb -25.1% -29.4% +6.2% +18.0% ➖ noise
90 duckdb:vortex-compact -12.5% -29.4% +24.0% +18.0% 🚨 regression
90 duckdb:vortex-file-compressed -15.8% -29.4% +19.3% +18.0% 🚨 regression
91 datafusion:vortex-compact -25.5% -24.3% -1.6% +18.0% ➖ noise
91 datafusion:vortex-file-compressed -23.5% -24.3% +1.1% +18.0% ➖ noise
91 duckdb:duckdb -29.5% -24.3% -6.8% +18.0% ➖ noise
91 duckdb:vortex-compact -23.3% -24.3% +1.3% +18.0% ➖ noise
91 duckdb:vortex-file-compressed -18.7% -24.3% +7.4% +18.0% ➖ noise
92 datafusion:vortex-compact -24.2% -26.6% +3.2% +18.0% ➖ noise
92 datafusion:vortex-file-compressed -25.2% -26.6% +1.8% +18.0% ➖ noise
92 duckdb:duckdb -28.1% -26.6% -2.1% +18.0% ➖ noise
92 duckdb:vortex-compact -25.2% -26.6% +1.9% +18.0% ➖ noise
92 duckdb:vortex-file-compressed -20.4% -26.6% +8.4% +18.0% ➖ noise
93 datafusion:vortex-compact -15.2% -22.3% +9.2% +18.0% ➖ noise
93 datafusion:vortex-file-compressed -22.4% -22.3% -0.1% +18.0% ➖ noise
93 duckdb:duckdb -12.2% -22.3% +13.0% +18.0% ➖ noise
93 duckdb:vortex-compact -19.3% -22.3% +3.9% +18.0% ➖ noise
93 duckdb:vortex-file-compressed -16.4% -22.3% +7.6% +18.0% ➖ noise
94 datafusion:vortex-compact -23.9% -27.2% +4.5% +18.0% ➖ noise
94 datafusion:vortex-file-compressed -20.0% -27.2% +9.8% +18.0% ➖ noise
94 duckdb:duckdb -24.0% -27.2% +4.3% +18.0% ➖ noise
94 duckdb:vortex-compact -23.8% -27.2% +4.6% +18.0% ➖ noise
94 duckdb:vortex-file-compressed -14.3% -27.2% +17.7% +18.0% ➖ noise
95 datafusion:vortex-compact -24.6% -18.0% -8.1% +18.0% ➖ noise
95 datafusion:vortex-file-compressed -24.9% -18.0% -8.4% +18.0% ➖ noise
95 duckdb:duckdb -23.9% -18.0% -7.2% +18.0% ➖ noise
95 duckdb:vortex-compact -17.1% -18.0% +1.1% +18.0% ➖ noise
95 duckdb:vortex-file-compressed -24.1% -18.0% -7.4% +18.0% ➖ noise
96 datafusion:vortex-compact -23.5% -25.4% +2.5% +18.0% ➖ noise
96 datafusion:vortex-file-compressed -6.1% -25.4% +25.8% +18.0% 🚨 regression
96 duckdb:duckdb -28.8% -25.4% -4.6% +20.6% ➖ noise
96 duckdb:vortex-compact -20.6% -25.4% +6.4% +23.8% ➖ noise
96 duckdb:vortex-file-compressed -6.8% -25.4% +24.9% +18.0% 🚨 regression
97 datafusion:vortex-compact -31.4% -24.8% -8.8% +18.0% ➖ noise
97 datafusion:vortex-file-compressed -28.4% -24.8% -4.8% +18.0% ➖ noise
97 duckdb:duckdb -17.2% -24.8% +10.1% +18.0% ➖ noise
97 duckdb:vortex-compact -24.8% -24.8% +0.0% +18.0% ➖ noise
97 duckdb:vortex-file-compressed -23.4% -24.8% +1.9% +18.0% ➖ noise
98 datafusion:vortex-compact -16.8% -24.8% +10.5% +18.0% ➖ noise
98 datafusion:vortex-file-compressed -17.9% -24.8% +9.0% +18.0% ➖ noise
98 duckdb:duckdb -27.9% -24.8% -4.2% +18.0% ➖ noise
98 duckdb:vortex-compact -21.1% -24.8% +4.8% +18.0% ➖ noise
98 duckdb:vortex-file-compressed -18.8% -24.8% +7.9% +18.0% ➖ noise
99 datafusion:vortex-compact -28.3% -26.3% -2.7% +18.0% ➖ noise
99 datafusion:vortex-file-compressed -15.8% -26.3% +14.2% +18.0% ➖ noise
99 duckdb:duckdb -25.2% -26.3% +1.4% +18.0% ➖ noise
99 duckdb:vortex-compact -25.8% -26.3% +0.6% +21.3% ➖ noise
99 duckdb:vortex-file-compressed -22.9% -26.3% +4.5% +19.1% ➖ noise

@github-actions

github-actions Bot commented Mar 13, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Summary

  • Overall: 1.102x ➖
  • Vortex: 1.154x ➖
  • Parquet: 1.006x ➖

Verdict

No clear signal

  • Attributed Vortex impact: +14.8%
  • Confidence: environment too noisy
  • Environment shift: +0.6%

Statistical Summary

  • Systemic shift (parquet controls): +0.6%
  • Control sigma: +15.0%
  • Residual noise: +9.7%
  • Median polish overall: +6.5%
datafusion / vortex-file-compressed (1.309x ❌, 0↑ 11↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 356546954 212694676 1.68
tpch_q02/datafusion:vortex-file-compressed 🚨 784023236 599797501 1.31
tpch_q03/datafusion:vortex-file-compressed 538902825 497569179 1.08
tpch_q04/datafusion:vortex-file-compressed 411469824 344827599 1.19
tpch_q05/datafusion:vortex-file-compressed 643804182 542232739 1.19
tpch_q06/datafusion:vortex-file-compressed 421163434 431250138 0.98
tpch_q07/datafusion:vortex-file-compressed 🚨 641834206 423181846 1.52
tpch_q08/datafusion:vortex-file-compressed 🚨 878153666 662439049 1.33
tpch_q09/datafusion:vortex-file-compressed 668426736 555328517 1.20
tpch_q10/datafusion:vortex-file-compressed 🚨 1043993013 546961113 1.91
tpch_q11/datafusion:vortex-file-compressed 🚨 469598478 342530763 1.37
tpch_q12/datafusion:vortex-file-compressed 620294814 558669066 1.11
tpch_q13/datafusion:vortex-file-compressed 🚨 370500148 172300262 2.15
tpch_q14/datafusion:vortex-file-compressed 253414770 208809767 1.21
tpch_q15/datafusion:vortex-file-compressed 424436071 340626532 1.25
tpch_q16/datafusion:vortex-file-compressed 217085120 209276426 1.04
tpch_q17/datafusion:vortex-file-compressed 🚨 427819077 315743480 1.35
tpch_q18/datafusion:vortex-file-compressed 🚨 446756062 312273846 1.43
tpch_q19/datafusion:vortex-file-compressed 🚨 632770573 397271280 1.59
tpch_q20/datafusion:vortex-file-compressed 🚨 726190319 438989151 1.65
tpch_q21/datafusion:vortex-file-compressed 550630651 640564582 0.86
tpch_q22/datafusion:vortex-file-compressed 228894813 208268227 1.10
datafusion / vortex-compact (1.208x ➖, 0↑ 7↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 250306012 244989179 1.02
tpch_q02/datafusion:vortex-compact 546851538 490202166 1.12
tpch_q03/datafusion:vortex-compact 358251193 433937712 0.83
tpch_q04/datafusion:vortex-compact 272928044 233248110 1.17
tpch_q05/datafusion:vortex-compact 🚨 583068922 447804029 1.30
tpch_q06/datafusion:vortex-compact 🚨 428071209 323056539 1.33
tpch_q07/datafusion:vortex-compact 🚨 542635324 386266962 1.40
tpch_q08/datafusion:vortex-compact 560815737 603530359 0.93
tpch_q09/datafusion:vortex-compact 542650952 487167742 1.11
tpch_q10/datafusion:vortex-compact 584495247 457298052 1.28
tpch_q11/datafusion:vortex-compact 🚨 381893247 265345995 1.44
tpch_q12/datafusion:vortex-compact 🚨 629687627 470501535 1.34
tpch_q13/datafusion:vortex-compact 222490240 200783135 1.11
tpch_q14/datafusion:vortex-compact 342760783 303954111 1.13
tpch_q15/datafusion:vortex-compact 541308196 459750295 1.18
tpch_q16/datafusion:vortex-compact 229108102 179233179 1.28
tpch_q17/datafusion:vortex-compact 🚨 465207702 339460666 1.37
tpch_q18/datafusion:vortex-compact 463241748 366076761 1.27
tpch_q19/datafusion:vortex-compact 🚨 982778712 434079505 2.26
tpch_q20/datafusion:vortex-compact 700219389 607726037 1.15
tpch_q21/datafusion:vortex-compact 635621077 638726525 1.00
tpch_q22/datafusion:vortex-compact 149524840 135270753 1.11
datafusion / parquet (0.974x ➖, 0↑ 5↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 248415472 236232621 1.05
tpch_q02/datafusion:parquet 536118067 653970335 0.82
tpch_q03/datafusion:parquet 538128502 523563651 1.03
tpch_q04/datafusion:parquet 229907623 219949929 1.05
tpch_q05/datafusion:parquet 694185386 715926969 0.97
tpch_q06/datafusion:parquet 🚨 190807846 130488565 1.46
tpch_q07/datafusion:parquet 751644762 781693058 0.96
tpch_q08/datafusion:parquet 🚨 1284577160 807987058 1.59
tpch_q09/datafusion:parquet 🚨 766196768 585562931 1.31
tpch_q10/datafusion:parquet 821917915 870460859 0.94
tpch_q11/datafusion:parquet 464333743 636682760 0.73
tpch_q12/datafusion:parquet 381142806 398264683 0.96
tpch_q13/datafusion:parquet 417613627 542263248 0.77
tpch_q14/datafusion:parquet 215253799 294892570 0.73
tpch_q15/datafusion:parquet 329182883 469613405 0.70
tpch_q16/datafusion:parquet 🚨 222844789 169805420 1.31
tpch_q17/datafusion:parquet 426022300 494640181 0.86
tpch_q18/datafusion:parquet 568183028 566664615 1.00
tpch_q19/datafusion:parquet 374550331 466325026 0.80
tpch_q20/datafusion:parquet 375880089 524984625 0.72
tpch_q21/datafusion:parquet 655043247 734989001 0.89
tpch_q22/datafusion:parquet 🚨 238150961 168633064 1.41
duckdb / vortex-file-compressed (1.086x ➖, 0↑ 2↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 342816422 251307736 1.36
tpch_q02/duckdb:vortex-file-compressed 923998562 912598863 1.01
tpch_q03/duckdb:vortex-file-compressed 613900616 627455250 0.98
tpch_q04/duckdb:vortex-file-compressed 386048451 374775795 1.03
tpch_q05/duckdb:vortex-file-compressed 842502587 960024210 0.88
tpch_q06/duckdb:vortex-file-compressed 406957624 385962021 1.05
tpch_q07/duckdb:vortex-file-compressed 848125801 712977140 1.19
tpch_q08/duckdb:vortex-file-compressed 1073943570 872432432 1.23
tpch_q09/duckdb:vortex-file-compressed 865471953 816436696 1.06
tpch_q10/duckdb:vortex-file-compressed 804305040 756918427 1.06
tpch_q11/duckdb:vortex-file-compressed 531842836 501512456 1.06
tpch_q12/duckdb:vortex-file-compressed 518896609 462584968 1.12
tpch_q13/duckdb:vortex-file-compressed 515594907 458811174 1.12
tpch_q14/duckdb:vortex-file-compressed 471034038 454243491 1.04
tpch_q15/duckdb:vortex-file-compressed 294908341 238198182 1.24
tpch_q16/duckdb:vortex-file-compressed 429114203 331979637 1.29
tpch_q17/duckdb:vortex-file-compressed 618381042 586175840 1.05
tpch_q18/duckdb:vortex-file-compressed 618424906 528142237 1.17
tpch_q19/duckdb:vortex-file-compressed 🚨 586905194 448932894 1.31
tpch_q20/duckdb:vortex-file-compressed 849638529 876401160 0.97
tpch_q21/duckdb:vortex-file-compressed 1070461937 1108609514 0.97
tpch_q22/duckdb:vortex-file-compressed 310721064 357130697 0.87
duckdb / vortex-compact (1.033x ➖, 0↑ 1↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 289654412 292981922 0.99
tpch_q02/duckdb:vortex-compact 862293878 868980281 0.99
tpch_q03/duckdb:vortex-compact 600105379 507770830 1.18
tpch_q04/duckdb:vortex-compact 442262655 341029937 1.30
tpch_q05/duckdb:vortex-compact 🚨 971424143 730374179 1.33
tpch_q06/duckdb:vortex-compact 411619271 369827450 1.11
tpch_q07/duckdb:vortex-compact 768854465 652580141 1.18
tpch_q08/duckdb:vortex-compact 890578697 758820785 1.17
tpch_q09/duckdb:vortex-compact 889041318 855037464 1.04
tpch_q10/duckdb:vortex-compact 656588840 792801921 0.83
tpch_q11/duckdb:vortex-compact 509679629 557239772 0.91
tpch_q12/duckdb:vortex-compact 449480402 442117232 1.02
tpch_q13/duckdb:vortex-compact 440286630 408900902 1.08
tpch_q14/duckdb:vortex-compact 460827003 417222935 1.10
tpch_q15/duckdb:vortex-compact 331178412 354057752 0.94
tpch_q16/duckdb:vortex-compact 318676821 349103649 0.91
tpch_q17/duckdb:vortex-compact 583444038 652942982 0.89
tpch_q18/duckdb:vortex-compact 542248317 562018875 0.96
tpch_q19/duckdb:vortex-compact 468643803 547515651 0.86
tpch_q20/duckdb:vortex-compact 703973004 799699949 0.88
tpch_q21/duckdb:vortex-compact 1047189058 1015864049 1.03
tpch_q22/duckdb:vortex-compact 371837048 304849802 1.22
duckdb / parquet (1.038x ➖, 0↑ 1↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 481304785 475491530 1.01
tpch_q02/duckdb:parquet 1221418046 1284879111 0.95
tpch_q03/duckdb:parquet 1152399090 1125971554 1.02
tpch_q04/duckdb:parquet 561926292 602656794 0.93
tpch_q05/duckdb:parquet 1501689005 1486265405 1.01
tpch_q06/duckdb:parquet 399233719 399752672 1.00
tpch_q07/duckdb:parquet 🚨 1436084527 1019350588 1.41
tpch_q08/duckdb:parquet 1630389836 1434868104 1.14
tpch_q09/duckdb:parquet 1311898961 1336169447 0.98
tpch_q10/duckdb:parquet 1359914379 1329840968 1.02
tpch_q11/duckdb:parquet 845417360 800527393 1.06
tpch_q12/duckdb:parquet 730657489 632411460 1.16
tpch_q13/duckdb:parquet 920339869 830273880 1.11
tpch_q14/duckdb:parquet 699193063 591368017 1.18
tpch_q15/duckdb:parquet 437714054 514817347 0.85
tpch_q16/duckdb:parquet 550367225 517217308 1.06
tpch_q17/duckdb:parquet 845995842 775186740 1.09
tpch_q18/duckdb:parquet 1036538939 939006131 1.10
tpch_q19/duckdb:parquet 820517933 835283410 0.98
tpch_q20/duckdb:parquet 1055537919 1207385684 0.87
tpch_q21/duckdb:parquet 1099903688 1085347610 1.01
tpch_q22/duckdb:parquet 523529576 518681119 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +2.2% +3.2% -1.0% +155.3% ➖ noise
1 datafusion:vortex-file-compressed +67.6% +3.2% +62.5% +148.6% ➖ noise
1 duckdb:vortex-compact -1.1% +3.2% -4.2% +48.7% ➖ noise
1 duckdb:vortex-file-compressed +36.4% +3.2% +32.2% +83.5% ➖ noise
2 datafusion:vortex-compact +11.6% -11.7% +26.4% +52.8% ➖ noise
2 datafusion:vortex-file-compressed +30.7% -11.7% +48.1% +43.4% 🚨 regression
2 duckdb:vortex-compact -0.8% -11.7% +12.4% +43.4% ➖ noise
2 duckdb:vortex-file-compressed +1.2% -11.7% +14.7% +43.4% ➖ noise
3 datafusion:vortex-compact -17.4% +2.6% -19.5% +81.2% ➖ noise
3 datafusion:vortex-file-compressed +8.3% +2.6% +5.6% +109.8% ➖ noise
3 duckdb:vortex-compact +18.2% +2.6% +15.2% +43.4% ➖ noise
3 duckdb:vortex-file-compressed -2.2% +2.6% -4.6% +43.4% ➖ noise
4 datafusion:vortex-compact +17.0% -1.3% +18.5% +45.3% ➖ noise
4 datafusion:vortex-file-compressed +19.3% -1.3% +20.9% +43.4% ➖ noise
4 duckdb:vortex-compact +29.7% -1.3% +31.4% +43.4% ➖ noise
4 duckdb:vortex-file-compressed +3.0% -1.3% +4.3% +43.4% ➖ noise
5 datafusion:vortex-compact +30.2% -1.0% +31.5% +53.0% ➖ noise
5 datafusion:vortex-file-compressed +18.7% -1.0% +20.0% +43.4% ➖ noise
5 duckdb:vortex-compact +33.0% -1.0% +34.4% +43.4% ➖ noise
5 duckdb:vortex-file-compressed -12.2% -1.0% -11.3% +43.4% ➖ noise
6 datafusion:vortex-compact +32.5% +20.8% +9.6% +52.8% ➖ noise
6 datafusion:vortex-file-compressed -2.3% +20.8% -19.2% +78.0% ➖ noise
6 duckdb:vortex-compact +11.3% +20.8% -7.9% +54.8% ➖ noise
6 duckdb:vortex-file-compressed +5.4% +20.8% -12.7% +53.6% ➖ noise
7 datafusion:vortex-compact +40.5% +16.4% +20.7% +43.7% ➖ noise
7 datafusion:vortex-file-compressed +51.7% +16.4% +30.3% +43.4% ➖ noise
7 duckdb:vortex-compact +17.8% +16.4% +1.2% +43.4% ➖ noise
7 duckdb:vortex-file-compressed +19.0% +16.4% +2.2% +43.9% ➖ noise
8 datafusion:vortex-compact -7.1% +34.4% -30.9% +43.4% ✅ faster
8 datafusion:vortex-file-compressed +32.6% +34.4% -1.4% +53.1% ➖ noise
8 duckdb:vortex-compact +17.4% +34.4% -12.7% +43.4% ➖ noise
8 duckdb:vortex-file-compressed +23.1% +34.4% -8.4% +43.4% ➖ noise
9 datafusion:vortex-compact +11.4% +13.3% -1.7% +43.4% ➖ noise
9 datafusion:vortex-file-compressed +20.4% +13.3% +6.2% +43.4% ➖ noise
9 duckdb:vortex-compact +4.0% +13.3% -8.3% +43.4% ➖ noise
9 duckdb:vortex-file-compressed +6.0% +13.3% -6.5% +43.4% ➖ noise
10 datafusion:vortex-compact +27.8% -1.7% +30.1% +43.4% ➖ noise
10 datafusion:vortex-file-compressed +90.9% -1.7% +94.2% +65.4% 🚨 regression
10 duckdb:vortex-compact -17.2% -1.7% -15.7% +43.4% ➖ noise
10 duckdb:vortex-file-compressed +6.3% -1.7% +8.1% +43.4% ➖ noise
11 datafusion:vortex-compact +43.9% -12.2% +64.0% +43.4% 🚨 regression
11 datafusion:vortex-file-compressed +37.1% -12.2% +56.2% +77.6% ➖ noise
11 duckdb:vortex-compact -8.5% -12.2% +4.2% +43.4% ➖ noise
11 duckdb:vortex-file-compressed +6.0% -12.2% +20.8% +43.4% ➖ noise
12 datafusion:vortex-compact +33.8% +5.2% +27.3% +43.4% ➖ noise
12 datafusion:vortex-file-compressed +11.0% +5.2% +5.6% +44.5% ➖ noise
12 duckdb:vortex-compact +1.7% +5.2% -3.3% +43.4% ➖ noise
12 duckdb:vortex-file-compressed +12.2% +5.2% +6.7% +66.1% ➖ noise
13 datafusion:vortex-compact +10.8% -7.6% +19.9% +93.8% ➖ noise
13 datafusion:vortex-file-compressed +115.0% -7.6% +132.7% +84.8% 🚨 regression
13 duckdb:vortex-compact +7.7% -7.6% +16.5% +43.4% ➖ noise
13 duckdb:vortex-file-compressed +12.4% -7.6% +21.6% +69.7% ➖ noise
14 datafusion:vortex-compact +12.8% -7.1% +21.4% +43.4% ➖ noise
14 datafusion:vortex-file-compressed +21.4% -7.1% +30.6% +43.4% ➖ noise
14 duckdb:vortex-compact +10.5% -7.1% +18.9% +43.4% ➖ noise
14 duckdb:vortex-file-compressed +3.7% -7.1% +11.6% +43.4% ➖ noise
15 datafusion:vortex-compact +17.7% -22.8% +52.5% +43.4% 🚨 regression
15 datafusion:vortex-file-compressed +24.6% -22.8% +61.4% +45.4% 🚨 regression
15 duckdb:vortex-compact -6.5% -22.8% +21.2% +43.4% ➖ noise
15 duckdb:vortex-file-compressed +23.8% -22.8% +60.4% +43.4% 🚨 regression
16 datafusion:vortex-compact +27.8% +18.2% +8.2% +43.4% ➖ noise
16 datafusion:vortex-file-compressed +3.7% +18.2% -12.2% +43.4% ➖ noise
16 duckdb:vortex-compact -8.7% +18.2% -22.8% +43.5% ➖ noise
16 duckdb:vortex-file-compressed +29.3% +18.2% +9.4% +67.1% ➖ noise
17 datafusion:vortex-compact +37.0% -3.0% +41.4% +43.4% ➖ noise
17 datafusion:vortex-file-compressed +35.5% -3.0% +39.8% +47.5% ➖ noise
17 duckdb:vortex-compact -10.6% -3.0% -7.8% +43.4% ➖ noise
17 duckdb:vortex-file-compressed +5.5% -3.0% +8.8% +43.4% ➖ noise
18 datafusion:vortex-compact +26.5% +5.2% +20.3% +43.4% ➖ noise
18 datafusion:vortex-file-compressed +43.1% +5.2% +36.0% +43.4% ➖ noise
18 duckdb:vortex-compact -3.5% +5.2% -8.3% +74.1% ➖ noise
18 duckdb:vortex-file-compressed +17.1% +5.2% +11.3% +43.4% ➖ noise
19 datafusion:vortex-compact +126.4% -11.2% +154.9% +85.2% 🚨 regression
19 datafusion:vortex-file-compressed +59.3% -11.2% +79.3% +43.4% 🚨 regression
19 duckdb:vortex-compact -14.4% -11.2% -3.6% +43.4% ➖ noise
19 duckdb:vortex-file-compressed +30.7% -11.2% +47.2% +43.4% 🚨 regression
20 datafusion:vortex-compact +15.2% -20.9% +45.6% +43.4% 🚨 regression
20 datafusion:vortex-file-compressed +65.4% -20.9% +109.1% +52.4% 🚨 regression
20 duckdb:vortex-compact -12.0% -20.9% +11.3% +43.4% ➖ noise
20 duckdb:vortex-file-compressed -3.1% -20.9% +22.5% +43.4% ➖ noise
21 datafusion:vortex-compact -0.5% -5.0% +4.7% +43.4% ➖ noise
21 datafusion:vortex-file-compressed -14.0% -5.0% -9.5% +43.4% ➖ noise
21 duckdb:vortex-compact +3.1% -5.0% +8.5% +43.4% ➖ noise
21 duckdb:vortex-file-compressed -3.4% -5.0% +1.6% +43.4% ➖ noise
22 datafusion:vortex-compact +10.5% +19.4% -7.4% +57.2% ➖ noise
22 datafusion:vortex-file-compressed +9.9% +19.4% -7.9% +43.4% ➖ noise
22 duckdb:vortex-compact +22.0% +19.4% +2.2% +43.4% ➖ noise
22 duckdb:vortex-file-compressed -13.0% +19.4% -27.1% +43.4% ➖ noise

@github-actions

github-actions Bot commented Mar 13, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Summary

  • Overall: 0.750x ✅
  • Vortex: 0.757x ✅
  • Parquet: 0.756x ✅

Verdict

No clear signal

  • Attributed Vortex impact: -1.4%
  • Confidence: environment too noisy
  • Environment shift: -24.4%

Statistical Summary

  • Systemic shift (parquet controls): -24.4%
  • Control sigma: +5.7%
  • Residual noise: +3.9%
  • Median polish overall: -24.0%
datafusion / vortex-file-compressed (0.767x ✅, 40↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚀 1398945 1680875 0.83
clickbench_q01/datafusion:vortex-file-compressed 🚀 10777245 15098841 0.71
clickbench_q02/datafusion:vortex-file-compressed 🚀 25072269 32705751 0.77
clickbench_q03/datafusion:vortex-file-compressed 🚀 27769556 36293284 0.77
clickbench_q04/datafusion:vortex-file-compressed 🚀 216885015 320727699 0.68
clickbench_q05/datafusion:vortex-file-compressed 🚀 227724280 314436961 0.72
clickbench_q06/datafusion:vortex-file-compressed 1538935 1671489 0.92
clickbench_q07/datafusion:vortex-file-compressed 🚀 14469527 18141217 0.80
clickbench_q08/datafusion:vortex-file-compressed 🚀 268988565 389296304 0.69
clickbench_q09/datafusion:vortex-file-compressed 🚀 408121650 592387324 0.69
clickbench_q10/datafusion:vortex-file-compressed 🚀 53854409 71661091 0.75
clickbench_q11/datafusion:vortex-file-compressed 🚀 60027361 81626449 0.74
clickbench_q12/datafusion:vortex-file-compressed 🚀 202496210 274390804 0.74
clickbench_q13/datafusion:vortex-file-compressed 🚀 298669210 417201772 0.72
clickbench_q14/datafusion:vortex-file-compressed 🚀 189655671 251786819 0.75
clickbench_q15/datafusion:vortex-file-compressed 🚀 256780484 377698360 0.68
clickbench_q16/datafusion:vortex-file-compressed 🚀 518256619 717093881 0.72
clickbench_q17/datafusion:vortex-file-compressed 🚀 506751721 708710300 0.72
clickbench_q18/datafusion:vortex-file-compressed 🚀 1034340069 1446532339 0.72
clickbench_q19/datafusion:vortex-file-compressed 🚀 17949790 23830265 0.75
clickbench_q20/datafusion:vortex-file-compressed 🚀 266121690 340432650 0.78
clickbench_q21/datafusion:vortex-file-compressed 🚀 317562277 395790834 0.80
clickbench_q22/datafusion:vortex-file-compressed 🚀 436712467 556602045 0.78
clickbench_q23/datafusion:vortex-file-compressed 546237483 605386815 0.90
clickbench_q24/datafusion:vortex-file-compressed 🚀 38496939 52416050 0.73
clickbench_q25/datafusion:vortex-file-compressed 🚀 57289093 73838136 0.78
clickbench_q26/datafusion:vortex-file-compressed 🚀 36243816 51494465 0.70
clickbench_q27/datafusion:vortex-file-compressed 🚀 605912222 771778186 0.79
clickbench_q28/datafusion:vortex-file-compressed 🚀 4827212771 6843810486 0.71
clickbench_q29/datafusion:vortex-file-compressed 🚀 203304914 241534883 0.84
clickbench_q30/datafusion:vortex-file-compressed 🚀 187935118 251291880 0.75
clickbench_q31/datafusion:vortex-file-compressed 🚀 215866113 294539562 0.73
clickbench_q32/datafusion:vortex-file-compressed 🚀 966840778 1317002923 0.73
clickbench_q33/datafusion:vortex-file-compressed 🚀 1039200029 1418186521 0.73
clickbench_q34/datafusion:vortex-file-compressed 🚀 1039631079 1425191183 0.73
clickbench_q35/datafusion:vortex-file-compressed 🚀 403945380 547988644 0.74
clickbench_q36/datafusion:vortex-file-compressed 🚀 67443067 83026173 0.81
clickbench_q37/datafusion:vortex-file-compressed 🚀 33433229 39190471 0.85
clickbench_q38/datafusion:vortex-file-compressed 🚀 19185942 23747784 0.81
clickbench_q39/datafusion:vortex-file-compressed 🚀 135105105 155512391 0.87
clickbench_q40/datafusion:vortex-file-compressed 19630768 21135828 0.93
clickbench_q41/datafusion:vortex-file-compressed 🚀 16810329 19430386 0.87
clickbench_q42/datafusion:vortex-file-compressed 🚀 19592466 22129779 0.89
datafusion / parquet (0.780x ✅, 42↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚀 1554154 1749488 0.89
clickbench_q01/datafusion:parquet 🚀 18381376 20811464 0.88
clickbench_q02/datafusion:parquet 🚀 39927067 47733633 0.84
clickbench_q03/datafusion:parquet 🚀 34151665 41365079 0.83
clickbench_q04/datafusion:parquet 🚀 237324797 338400246 0.70
clickbench_q05/datafusion:parquet 🚀 276240184 367404077 0.75
clickbench_q06/datafusion:parquet 1433703 1541584 0.93
clickbench_q07/datafusion:parquet 🚀 22570357 25322808 0.89
clickbench_q08/datafusion:parquet 🚀 286252617 412109842 0.69
clickbench_q09/datafusion:parquet 🚀 462551869 648417195 0.71
clickbench_q10/datafusion:parquet 🚀 79569241 120825391 0.66
clickbench_q11/datafusion:parquet 🚀 99229221 143367253 0.69
clickbench_q12/datafusion:parquet 🚀 274451067 368706479 0.74
clickbench_q13/datafusion:parquet 🚀 369069836 511638892 0.72
clickbench_q14/datafusion:parquet 🚀 272860277 361022396 0.76
clickbench_q15/datafusion:parquet 🚀 271653221 384951291 0.71
clickbench_q16/datafusion:parquet 🚀 510434389 748870705 0.68
clickbench_q17/datafusion:parquet 🚀 506735169 714976256 0.71
clickbench_q18/datafusion:parquet 🚀 1085706263 1483860652 0.73
clickbench_q19/datafusion:parquet 🚀 26189734 33446381 0.78
clickbench_q20/datafusion:parquet 🚀 471721878 610843605 0.77
clickbench_q21/datafusion:parquet 🚀 528159438 673937188 0.78
clickbench_q22/datafusion:parquet 🚀 768550018 986234739 0.78
clickbench_q23/datafusion:parquet 🚀 2864674456 3737687311 0.77
clickbench_q24/datafusion:parquet 🚀 72448972 97592980 0.74
clickbench_q25/datafusion:parquet 🚀 114912477 150258529 0.76
clickbench_q26/datafusion:parquet 🚀 73643945 95884707 0.77
clickbench_q27/datafusion:parquet 🚀 832257100 1063245391 0.78
clickbench_q28/datafusion:parquet 🚀 4640377385 6619697144 0.70
clickbench_q29/datafusion:parquet 🚀 208918959 236655102 0.88
clickbench_q30/datafusion:parquet 🚀 279613147 377035080 0.74
clickbench_q31/datafusion:parquet 🚀 302406854 412650296 0.73
clickbench_q32/datafusion:parquet 🚀 970913752 1259100174 0.77
clickbench_q33/datafusion:parquet 🚀 1229876479 1520784393 0.81
clickbench_q34/datafusion:parquet 🚀 1247243594 1534689499 0.81
clickbench_q35/datafusion:parquet 🚀 405969882 549961751 0.74
clickbench_q36/datafusion:parquet 🚀 123119229 139084887 0.89
clickbench_q37/datafusion:parquet 🚀 48865599 58714453 0.83
clickbench_q38/datafusion:parquet 🚀 79902384 92248761 0.87
clickbench_q39/datafusion:parquet 🚀 230004672 267861301 0.86
clickbench_q40/datafusion:parquet 🚀 30432484 35255853 0.86
clickbench_q41/datafusion:parquet 🚀 25674263 30101287 0.85
clickbench_q42/datafusion:parquet 🚀 27792534 32536418 0.85
duckdb / vortex-file-compressed (0.747x ✅, 43↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚀 5782283 6501847 0.89
clickbench_q01/duckdb:vortex-file-compressed 🚀 10809776 13619764 0.79
clickbench_q02/duckdb:vortex-file-compressed 🚀 17585247 23860320 0.74
clickbench_q03/duckdb:vortex-file-compressed 🚀 24648504 30962295 0.80
clickbench_q04/duckdb:vortex-file-compressed 🚀 125581774 173136345 0.73
clickbench_q05/duckdb:vortex-file-compressed 🚀 146738634 198649941 0.74
clickbench_q06/duckdb:vortex-file-compressed 🚀 13243802 19560449 0.68
clickbench_q07/duckdb:vortex-file-compressed 🚀 11467071 15178816 0.76
clickbench_q08/duckdb:vortex-file-compressed 🚀 186966153 269017331 0.69
clickbench_q09/duckdb:vortex-file-compressed 🚀 265748079 381142001 0.70
clickbench_q10/duckdb:vortex-file-compressed 🚀 53907894 74434180 0.72
clickbench_q11/duckdb:vortex-file-compressed 🚀 58847809 81663263 0.72
clickbench_q12/duckdb:vortex-file-compressed 🚀 170456319 217186606 0.78
clickbench_q13/duckdb:vortex-file-compressed 🚀 336496585 443406481 0.76
clickbench_q14/duckdb:vortex-file-compressed 🚀 185984469 238837662 0.78
clickbench_q15/duckdb:vortex-file-compressed 🚀 146442731 211931544 0.69
clickbench_q16/duckdb:vortex-file-compressed 🚀 492281104 713788249 0.69
clickbench_q17/duckdb:vortex-file-compressed 🚀 421639217 531790795 0.79
clickbench_q18/duckdb:vortex-file-compressed 🚀 956320998 1207475426 0.79
clickbench_q19/duckdb:vortex-file-compressed 🚀 15399693 21578625 0.71
clickbench_q20/duckdb:vortex-file-compressed 🚀 283939667 373751831 0.76
clickbench_q21/duckdb:vortex-file-compressed 🚀 311367416 396386393 0.79
clickbench_q22/duckdb:vortex-file-compressed 🚀 464445877 617437594 0.75
clickbench_q23/duckdb:vortex-file-compressed 🚀 605087286 959892066 0.63
clickbench_q24/duckdb:vortex-file-compressed 🚀 38310839 61339046 0.62
clickbench_q25/duckdb:vortex-file-compressed 🚀 56809640 80820948 0.70
clickbench_q26/duckdb:vortex-file-compressed 🚀 32325154 48302421 0.67
clickbench_q27/duckdb:vortex-file-compressed 🚀 419741850 523358937 0.80
clickbench_q28/duckdb:vortex-file-compressed 🚀 1998299389 2977879830 0.67
clickbench_q29/duckdb:vortex-file-compressed 🚀 20261438 27499235 0.74
clickbench_q30/duckdb:vortex-file-compressed 🚀 139688614 190560208 0.73
clickbench_q31/duckdb:vortex-file-compressed 🚀 207956155 270644633 0.77
clickbench_q32/duckdb:vortex-file-compressed 🚀 1025225808 1329545770 0.77
clickbench_q33/duckdb:vortex-file-compressed 🚀 1178360073 1487267478 0.79
clickbench_q34/duckdb:vortex-file-compressed 🚀 1275156194 1565199889 0.81
clickbench_q35/duckdb:vortex-file-compressed 🚀 244244674 374145357 0.65
clickbench_q36/duckdb:vortex-file-compressed 🚀 24752980 30119652 0.82
clickbench_q37/duckdb:vortex-file-compressed 🚀 18118549 22589461 0.80
clickbench_q38/duckdb:vortex-file-compressed 🚀 19317904 24195492 0.80
clickbench_q39/duckdb:vortex-file-compressed 🚀 36744514 46006479 0.80
clickbench_q40/duckdb:vortex-file-compressed 🚀 18223049 22553656 0.81
clickbench_q41/duckdb:vortex-file-compressed 🚀 17528173 22329021 0.78
clickbench_q42/duckdb:vortex-file-compressed 🚀 20110141 25656579 0.78
duckdb / parquet (0.733x ✅, 43↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚀 156490205 221181643 0.71
clickbench_q01/duckdb:parquet 🚀 35890211 49969791 0.72
clickbench_q02/duckdb:parquet 🚀 51861560 66022287 0.79
clickbench_q03/duckdb:parquet 🚀 53061091 64763219 0.82
clickbench_q04/duckdb:parquet 🚀 148160405 202173713 0.73
clickbench_q05/duckdb:parquet 🚀 209903961 279860362 0.75
clickbench_q06/duckdb:parquet 🚀 46231718 60880541 0.76
clickbench_q07/duckdb:parquet 🚀 37090425 54316767 0.68
clickbench_q08/duckdb:parquet 🚀 187455972 272143383 0.69
clickbench_q09/duckdb:parquet 🚀 279077954 397664124 0.70
clickbench_q10/duckdb:parquet 🚀 79305298 97799371 0.81
clickbench_q11/duckdb:parquet 🚀 85050219 109416552 0.78
clickbench_q12/duckdb:parquet 🚀 223531254 299295012 0.75
clickbench_q13/duckdb:parquet 🚀 389681204 523410213 0.74
clickbench_q14/duckdb:parquet 🚀 243563859 331339105 0.74
clickbench_q15/duckdb:parquet 🚀 166250082 242332700 0.69
clickbench_q16/duckdb:parquet 🚀 454921064 607164286 0.75
clickbench_q17/duckdb:parquet 🚀 382971076 509794975 0.75
clickbench_q18/duckdb:parquet 🚀 783678189 1058179705 0.74
clickbench_q19/duckdb:parquet 🚀 38651241 49871062 0.78
clickbench_q20/duckdb:parquet 🚀 353303664 440447045 0.80
clickbench_q21/duckdb:parquet 🚀 446339019 570140093 0.78
clickbench_q22/duckdb:parquet 🚀 741044583 930951289 0.80
clickbench_q23/duckdb:parquet 🚀 249980193 327994895 0.76
clickbench_q24/duckdb:parquet 🚀 58828610 82057811 0.72
clickbench_q25/duckdb:parquet 🚀 106244407 140778135 0.75
clickbench_q26/duckdb:parquet 🚀 39730214 55576979 0.71
clickbench_q27/duckdb:parquet 🚀 502155872 658116560 0.76
clickbench_q28/duckdb:parquet 🚀 3149202205 4926839399 0.64
clickbench_q29/duckdb:parquet 🚀 44600052 61530851 0.72
clickbench_q30/duckdb:parquet 🚀 226492544 304140769 0.74
clickbench_q31/duckdb:parquet 🚀 258170711 348681836 0.74
clickbench_q32/duckdb:parquet 🚀 953602722 1121175713 0.85
clickbench_q33/duckdb:parquet 🚀 1031096749 1252957374 0.82
clickbench_q34/duckdb:parquet 🚀 1027265487 1332813175 0.77
clickbench_q35/duckdb:parquet 🚀 228742967 353088451 0.65
clickbench_q36/duckdb:parquet 🚀 49361920 64634781 0.76
clickbench_q37/duckdb:parquet 🚀 35477287 54626233 0.65
clickbench_q38/duckdb:parquet 🚀 41175559 57482370 0.72
clickbench_q39/duckdb:parquet 🚀 75070989 98977331 0.76
clickbench_q40/duckdb:parquet 🚀 34232213 56174355 0.61
clickbench_q41/duckdb:parquet 🚀 34249656 59058473 0.58
clickbench_q42/duckdb:parquet 🚀 32320310 50146404 0.64
duckdb / duckdb (0.723x ✅, 42↑ 0↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚀 15369493 18382679 0.84
clickbench_q01/duckdb:duckdb 🚀 26788375 34023235 0.79
clickbench_q02/duckdb:duckdb 🚀 34222296 46255055 0.74
clickbench_q03/duckdb:duckdb 🚀 34441481 47604394 0.72
clickbench_q04/duckdb:duckdb 🚀 158794083 228222400 0.70
clickbench_q05/duckdb:duckdb 🚀 236201901 335061699 0.70
clickbench_q06/duckdb:duckdb 🚀 22726914 35568922 0.64
clickbench_q07/duckdb:duckdb 🚀 29558027 36950851 0.80
clickbench_q08/duckdb:duckdb 🚀 226537679 306955520 0.74
clickbench_q09/duckdb:duckdb 🚀 345769354 506378037 0.68
clickbench_q10/duckdb:duckdb 🚀 66817823 99271261 0.67
clickbench_q11/duckdb:duckdb 🚀 73755963 109152046 0.68
clickbench_q12/duckdb:duckdb 🚀 210395881 312575693 0.67
clickbench_q13/duckdb:duckdb 🚀 404921188 572510231 0.71
clickbench_q14/duckdb:duckdb 🚀 255256907 378671526 0.67
clickbench_q15/duckdb:duckdb 🚀 191056592 266277083 0.72
clickbench_q16/duckdb:duckdb 🚀 508728393 911926083 0.56
clickbench_q17/duckdb:duckdb 🚀 440204046 785345596 0.56
clickbench_q18/duckdb:duckdb 🚀 957743333 1276463047 0.75
clickbench_q19/duckdb:duckdb 🚀 28779312 35458533 0.81
clickbench_q20/duckdb:duckdb 🚀 710015458 1024506517 0.69
clickbench_q21/duckdb:duckdb 🚀 796192809 1029937930 0.77
clickbench_q22/duckdb:duckdb 🚀 829871344 1088383112 0.76
clickbench_q23/duckdb:duckdb 234464591 257825673 0.91
clickbench_q24/duckdb:duckdb 🚀 44239216 61629032 0.72
clickbench_q25/duckdb:duckdb 🚀 88485538 134339023 0.66
clickbench_q26/duckdb:duckdb 🚀 42616591 59281004 0.72
clickbench_q27/duckdb:duckdb 🚀 791459609 1173402493 0.67
clickbench_q28/duckdb:duckdb 🚀 3222013474 4662263331 0.69
clickbench_q29/duckdb:duckdb 🚀 36955914 47920273 0.77
clickbench_q30/duckdb:duckdb 🚀 208838421 299638020 0.70
clickbench_q31/duckdb:duckdb 🚀 300615702 442781384 0.68
clickbench_q32/duckdb:duckdb 🚀 1042613119 1526412440 0.68
clickbench_q33/duckdb:duckdb 🚀 1444626052 1959687062 0.74
clickbench_q34/duckdb:duckdb 🚀 1528178109 2160086389 0.71
clickbench_q35/duckdb:duckdb 🚀 176299560 270305202 0.65
clickbench_q36/duckdb:duckdb 🚀 34383440 42818499 0.80
clickbench_q37/duckdb:duckdb 🚀 24672137 31642075 0.78
clickbench_q38/duckdb:duckdb 🚀 25046189 31314924 0.80
clickbench_q39/duckdb:duckdb 🚀 58615336 66150027 0.89
clickbench_q40/duckdb:duckdb 🚀 24821310 32251500 0.77
clickbench_q41/duckdb:duckdb 🚀 24237766 31389286 0.77
clickbench_q42/duckdb:duckdb 🚀 24360143 32708730 0.74
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -16.8% -20.7% +5.0% +766.5% ➖ noise
0 duckdb:duckdb -16.4% -20.7% +5.5% +297.7% ➖ noise
0 duckdb:vortex-file-compressed -11.1% -20.7% +12.2% +342.2% ➖ noise
1 datafusion:vortex-file-compressed -28.6% -20.4% -10.4% +40.0% ➖ noise
1 duckdb:duckdb -21.3% -20.4% -1.1% +48.7% ➖ noise
1 duckdb:vortex-file-compressed -20.6% -20.4% -0.4% +21.4% ➖ noise
2 datafusion:vortex-file-compressed -23.3% -18.9% -5.4% +31.2% ➖ noise
2 duckdb:duckdb -26.0% -18.9% -8.7% +17.6% ➖ noise
2 duckdb:vortex-file-compressed -26.3% -18.9% -9.1% +16.4% ➖ noise
3 datafusion:vortex-file-compressed -23.5% -17.8% -7.0% +123.1% ➖ noise
3 duckdb:duckdb -27.7% -17.8% -12.0% +38.0% ➖ noise
3 duckdb:vortex-file-compressed -20.4% -17.8% -3.2% +18.6% ➖ noise
4 datafusion:vortex-file-compressed -32.4% -28.3% -5.7% +15.3% ➖ noise
4 duckdb:duckdb -30.4% -28.3% -2.9% +15.3% ➖ noise
4 duckdb:vortex-file-compressed -27.5% -28.3% +1.2% +15.3% ➖ noise
5 datafusion:vortex-file-compressed -27.6% -24.9% -3.6% +15.3% ➖ noise
5 duckdb:duckdb -29.5% -24.9% -6.1% +15.3% ➖ noise
5 duckdb:vortex-file-compressed -26.1% -24.9% -1.6% +15.3% ➖ noise
6 datafusion:vortex-file-compressed -7.9% -16.0% +9.6% +48.0% ➖ noise
6 duckdb:duckdb -36.1% -16.0% -24.0% +31.4% ✅ faster
6 duckdb:vortex-file-compressed -32.3% -16.0% -19.4% +22.0% ✅ faster
7 datafusion:vortex-file-compressed -20.2% -22.0% +2.2% +15.3% ➖ noise
7 duckdb:duckdb -20.0% -22.0% +2.5% +15.3% ➖ noise
7 duckdb:vortex-file-compressed -24.5% -22.0% -3.2% +15.3% ➖ noise
8 datafusion:vortex-file-compressed -30.9% -30.8% -0.1% +15.3% ➖ noise
8 duckdb:duckdb -26.2% -30.8% +6.7% +15.3% ➖ noise
8 duckdb:vortex-file-compressed -30.5% -30.8% +0.5% +15.3% ➖ noise
9 datafusion:vortex-file-compressed -31.1% -29.2% -2.6% +15.3% ➖ noise
9 duckdb:duckdb -31.7% -29.2% -3.5% +15.3% ➖ noise
9 duckdb:vortex-file-compressed -30.3% -29.2% -1.5% +15.3% ➖ noise
10 datafusion:vortex-file-compressed -24.8% -26.9% +2.8% +15.3% ➖ noise
10 duckdb:duckdb -32.7% -26.9% -7.9% +15.3% ➖ noise
10 duckdb:vortex-file-compressed -27.6% -26.9% -0.9% +15.3% ➖ noise
11 datafusion:vortex-file-compressed -26.5% -26.7% +0.3% +15.3% ➖ noise
11 duckdb:duckdb -32.4% -26.7% -7.9% +15.3% ➖ noise
11 duckdb:vortex-file-compressed -27.9% -26.7% -1.8% +15.3% ➖ noise
12 datafusion:vortex-file-compressed -26.2% -25.4% -1.0% +15.3% ➖ noise
12 duckdb:duckdb -32.7% -25.4% -9.7% +15.3% ➖ noise
12 duckdb:vortex-file-compressed -21.5% -25.4% +5.3% +15.3% ➖ noise
13 datafusion:vortex-file-compressed -28.4% -26.7% -2.3% +15.3% ➖ noise
13 duckdb:duckdb -29.3% -26.7% -3.5% +15.3% ➖ noise
13 duckdb:vortex-file-compressed -24.1% -26.7% +3.6% +15.3% ➖ noise
14 datafusion:vortex-file-compressed -24.7% -25.5% +1.1% +15.3% ➖ noise
14 duckdb:duckdb -32.6% -25.5% -9.6% +15.3% ➖ noise
14 duckdb:vortex-file-compressed -22.1% -25.5% +4.5% +15.3% ➖ noise
15 datafusion:vortex-file-compressed -32.0% -30.4% -2.3% +15.3% ➖ noise
15 duckdb:duckdb -28.2% -30.4% +3.1% +15.3% ➖ noise
15 duckdb:vortex-file-compressed -30.9% -30.4% -0.7% +15.3% ➖ noise
16 datafusion:vortex-file-compressed -27.7% -28.5% +1.1% +15.3% ➖ noise
16 duckdb:duckdb -44.2% -28.5% -21.9% +15.3% ✅ faster
16 duckdb:vortex-file-compressed -31.0% -28.5% -3.5% +15.3% ➖ noise
17 datafusion:vortex-file-compressed -28.5% -27.0% -2.0% +15.3% ➖ noise
17 duckdb:duckdb -43.9% -27.0% -23.2% +15.3% ✅ faster
17 duckdb:vortex-file-compressed -20.7% -27.0% +8.7% +15.3% ➖ noise
18 datafusion:vortex-file-compressed -28.5% -26.4% -2.9% +15.3% ➖ noise
18 duckdb:duckdb -25.0% -26.4% +1.9% +15.3% ➖ noise
18 duckdb:vortex-file-compressed -20.8% -26.4% +7.6% +15.3% ➖ noise
19 datafusion:vortex-file-compressed -24.7% -22.1% -3.3% +16.1% ➖ noise
19 duckdb:duckdb -18.8% -22.1% +4.2% +15.3% ➖ noise
19 duckdb:vortex-file-compressed -28.6% -22.1% -8.4% +41.3% ➖ noise
20 datafusion:vortex-file-compressed -21.8% -21.3% -0.7% +136.2% ➖ noise
20 duckdb:duckdb -30.7% -21.3% -11.9% +17.5% ➖ noise
20 duckdb:vortex-file-compressed -24.0% -21.3% -3.5% +15.3% ➖ noise
21 datafusion:vortex-file-compressed -19.8% -21.7% +2.4% +15.3% ➖ noise
21 duckdb:duckdb -22.7% -21.7% -1.3% +15.3% ➖ noise
21 duckdb:vortex-file-compressed -21.4% -21.7% +0.3% +15.3% ➖ noise
22 datafusion:vortex-file-compressed -21.5% -21.2% -0.4% +15.3% ➖ noise
22 duckdb:duckdb -23.8% -21.2% -3.2% +15.3% ➖ noise
22 duckdb:vortex-file-compressed -24.8% -21.2% -4.5% +17.2% ➖ noise
23 datafusion:vortex-file-compressed -9.8% -23.6% +18.1% +42.0% ➖ noise
23 duckdb:duckdb -9.1% -23.6% +19.0% +15.3% 🚨 regression
23 duckdb:vortex-file-compressed -37.0% -23.6% -17.5% +15.3% ✅ faster
24 datafusion:vortex-file-compressed -26.6% -27.0% +0.7% +19.5% ➖ noise
24 duckdb:duckdb -28.2% -27.0% -1.6% +15.3% ➖ noise
24 duckdb:vortex-file-compressed -37.5% -27.0% -14.4% +30.6% ➖ noise
25 datafusion:vortex-file-compressed -22.4% -24.0% +2.1% +15.3% ➖ noise
25 duckdb:duckdb -34.1% -24.0% -13.3% +15.3% ✅ faster
25 duckdb:vortex-file-compressed -29.7% -24.0% -7.5% +15.3% ➖ noise
26 datafusion:vortex-file-compressed -29.6% -25.9% -5.0% +15.3% ➖ noise
26 duckdb:duckdb -28.1% -25.9% -3.0% +18.0% ➖ noise
26 duckdb:vortex-file-compressed -33.1% -25.9% -9.7% +35.0% ➖ noise
27 datafusion:vortex-file-compressed -21.5% -22.7% +1.6% +15.3% ➖ noise
27 duckdb:duckdb -32.6% -22.7% -12.7% +15.3% ➖ noise
27 duckdb:vortex-file-compressed -19.8% -22.7% +3.8% +15.3% ➖ noise
28 datafusion:vortex-file-compressed -29.5% -33.1% +5.4% +15.3% ➖ noise
28 duckdb:duckdb -30.9% -33.1% +3.2% +15.3% ➖ noise
28 duckdb:vortex-file-compressed -32.9% -33.1% +0.2% +15.3% ➖ noise
29 datafusion:vortex-file-compressed -15.8% -20.0% +5.2% +15.3% ➖ noise
29 duckdb:duckdb -22.9% -20.0% -3.6% +15.3% ➖ noise
29 duckdb:vortex-file-compressed -26.3% -20.0% -7.9% +15.3% ➖ noise
30 datafusion:vortex-file-compressed -25.2% -25.7% +0.6% +15.3% ➖ noise
30 duckdb:duckdb -30.3% -25.7% -6.2% +15.3% ➖ noise
30 duckdb:vortex-file-compressed -26.7% -25.7% -1.4% +15.3% ➖ noise
31 datafusion:vortex-file-compressed -26.7% -26.3% -0.5% +15.3% ➖ noise
31 duckdb:duckdb -32.1% -26.3% -7.8% +15.3% ➖ noise
31 duckdb:vortex-file-compressed -23.2% -26.3% +4.3% +15.3% ➖ noise
32 datafusion:vortex-file-compressed -26.6% -19.0% -9.4% +22.2% ➖ noise
32 duckdb:duckdb -31.7% -19.0% -15.7% +15.3% ✅ faster
32 duckdb:vortex-file-compressed -22.9% -19.0% -4.8% +15.3% ➖ noise
33 datafusion:vortex-file-compressed -26.7% -18.4% -10.2% +15.3% ➖ noise
33 duckdb:duckdb -26.3% -18.4% -9.6% +15.3% ➖ noise
33 duckdb:vortex-file-compressed -20.8% -18.4% -2.9% +15.3% ➖ noise
34 datafusion:vortex-file-compressed -27.1% -20.9% -7.8% +15.3% ➖ noise
34 duckdb:duckdb -29.3% -20.9% -10.6% +15.3% ➖ noise
34 duckdb:vortex-file-compressed -18.5% -20.9% +2.9% +15.3% ➖ noise
35 datafusion:vortex-file-compressed -26.3% -30.8% +6.6% +15.3% ➖ noise
35 duckdb:duckdb -34.8% -30.8% -5.7% +15.3% ➖ noise
35 duckdb:vortex-file-compressed -34.7% -30.8% -5.6% +15.3% ➖ noise
36 datafusion:vortex-file-compressed -18.8% -17.8% -1.2% +15.3% ➖ noise
36 duckdb:duckdb -19.7% -17.8% -2.3% +15.3% ➖ noise
36 duckdb:vortex-file-compressed -17.8% -17.8% -0.0% +15.3% ➖ noise
37 datafusion:vortex-file-compressed -14.7% -26.5% +16.0% +15.3% 🚨 regression
37 duckdb:duckdb -22.0% -26.5% +6.1% +15.3% ➖ noise
37 duckdb:vortex-file-compressed -19.8% -26.5% +9.1% +15.3% ➖ noise
38 datafusion:vortex-file-compressed -19.2% -21.2% +2.6% +15.3% ➖ noise
38 duckdb:duckdb -20.0% -21.2% +1.5% +15.3% ➖ noise
38 duckdb:vortex-file-compressed -20.2% -21.2% +1.4% +15.3% ➖ noise
39 datafusion:vortex-file-compressed -13.1% -19.3% +7.7% +15.3% ➖ noise
39 duckdb:duckdb -11.4% -19.3% +9.8% +19.3% ➖ noise
39 duckdb:vortex-file-compressed -20.1% -19.3% -1.0% +15.3% ➖ noise
40 datafusion:vortex-file-compressed -7.1% -27.5% +28.1% +15.3% 🚨 regression
40 duckdb:duckdb -23.0% -27.5% +6.1% +15.3% ➖ noise
40 duckdb:vortex-file-compressed -19.2% -27.5% +11.4% +15.3% ➖ noise
41 datafusion:vortex-file-compressed -13.5% -29.7% +23.0% +15.3% 🚨 regression
41 duckdb:duckdb -22.8% -29.7% +9.8% +15.3% ➖ noise
41 duckdb:vortex-file-compressed -21.5% -29.7% +11.6% +15.3% ➖ noise
42 datafusion:vortex-file-compressed -11.5% -25.8% +19.3% +15.3% 🚨 regression
42 duckdb:duckdb -25.5% -25.8% +0.4% +15.3% ➖ noise
42 duckdb:vortex-file-compressed -21.6% -25.8% +5.6% +17.3% ➖ noise

@github-actions

github-actions Bot commented Mar 13, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done f0d3e8f 1 Explore Profiling Data
Previous Runs (2)
Status Commit Job Attempt Link
🟢 Done 830b9e9 2 Explore Profiling Data
🟢 Done 830b9e9 1 Explore Profiling Data

Powered by Polar Signals Cloud

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 13, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 13, 2026
@joseph-isaacs @claude
Remove unused machine_type input from benchmark workflows
f0d3e8f 
Signed-off-by: Joe Isaacs <joe@spiraldb.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 13, 2026
@github-actions

github-actions Bot commented Mar 13, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Summary

  • Overall: 1.042x ➖
  • Vortex: 0.843x ✅
  • Parquet: 0.937x ➖
unknown / unknown (1.042x ➖, 14↑ 20↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 2672004 2383785 1.12
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 🚨 1546013 1284972 1.20
random-access/feature-vectors/correlated/parquet-tokio-local-disk 13186305576 13770485193 0.96
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 12896353864 13458368853 0.96
random-access/feature-vectors/correlated/vortex-tokio-local-disk 8240400 7797253 1.06
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚨 7418171 6218722 1.19
random-access/feature-vectors/uniform/lance-tokio-local-disk 🚨 2458330 1451843 1.69
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 🚨 3289888 2341945 1.40
random-access/feature-vectors/uniform/parquet-tokio-local-disk 12404970771 13441783910 0.92
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 12534720176 13361135620 0.94
random-access/feature-vectors/uniform/vortex-tokio-local-disk 13109166 13557525 0.97
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 12657923 13532137 0.94
random-access/lance-tokio-local-disk 🚨 995879 739994 1.35
random-access/lance-tokio-local-disk-footer 🚨 1703333 1339946 1.27
random-access/nested-lists/correlated/lance-tokio-local-disk 🚨 307970 271015 1.14
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 🚨 809861 712833 1.14
random-access/nested-lists/correlated/parquet-tokio-local-disk 155614878 165430603 0.94
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 156568425 165070629 0.95
random-access/nested-lists/correlated/vortex-tokio-local-disk 815216 852968 0.96
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 798250 840425 0.95
random-access/nested-lists/uniform/lance-tokio-local-disk 🚨 1998179 1169418 1.71
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 🚨 2541538 1655051 1.54
random-access/nested-lists/uniform/parquet-tokio-local-disk 155806954 163149643 0.95
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 160371737 162163467 0.99
random-access/nested-lists/uniform/vortex-tokio-local-disk 🚀 1669519 2511328 0.66
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 🚀 1872618 2649749 0.71
random-access/nested-structs/correlated/lance-tokio-local-disk 🚨 575793 434332 1.33
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 🚨 788091 643731 1.22
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 28340700 25449918 1.11
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 27621235 25678973 1.08
random-access/nested-structs/correlated/vortex-tokio-local-disk 860289 854121 1.01
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 871602 893305 0.98
random-access/nested-structs/uniform/lance-tokio-local-disk 🚨 5474065 2819434 1.94
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 🚨 5667720 3059571 1.85
random-access/nested-structs/uniform/parquet-tokio-local-disk 26174485 25603419 1.02
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 26115106 25699228 1.02
random-access/nested-structs/uniform/vortex-tokio-local-disk 1583823 1741897 0.91
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1615346 1764803 0.92
random-access/parquet-tokio-local-disk 🚀 165376804 185052104 0.89
random-access/parquet-tokio-local-disk-footer 🚀 152221230 185258701 0.82
random-access/taxi/correlated/lance-tokio-local-disk 🚨 1390335 958425 1.45
random-access/taxi/correlated/lance-tokio-local-disk-footer 🚨 2270406 1644188 1.38
random-access/taxi/correlated/parquet-tokio-local-disk 🚀 228209431 277164083 0.82
random-access/taxi/correlated/parquet-tokio-local-disk-footer 🚀 229878557 278726330 0.82
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1639246 2559444 0.64
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1601234 2464171 0.65
random-access/taxi/uniform/lance-tokio-local-disk 🚨 14837433 8466139 1.75
random-access/taxi/uniform/lance-tokio-local-disk-footer 🚨 15631907 9148462 1.71
random-access/taxi/uniform/parquet-tokio-local-disk 🚀 251494188 294243008 0.85
random-access/taxi/uniform/parquet-tokio-local-disk-footer 🚀 255986751 292272284 0.88
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4065933 5240134 0.78
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4143881 5205895 0.80
random-access/vortex-tokio-local-disk 🚀 1178698 1724636 0.68
random-access/vortex-tokio-local-disk-footer 🚀 1192510 1786316 0.67

@github-actions

github-actions Bot commented Mar 13, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Summary

  • Overall: 0.924x ➖
  • Vortex: 1.025x ➖
  • Parquet: 0.943x ➖
unknown / unknown (0.924x ➖, 57↑ 8↓)
name PR f0d3e8f (ns) base da4c196 (ns) ratio (PR/base)
compress time/Arade 🚀 969061324 1153873051 0.84
compress time/Bimbo 🚀 6242976260 7117826657 0.88
compress time/CMSprovider 🚀 2587688780 2954725601 0.88
compress time/Euro2016 🚀 342022524 431625394 0.79
compress time/Food 🚀 343273352 394109458 0.87
compress time/HashTags 🚀 779847255 938961488 0.83
compress time/TPC-H l_comment canonical 🚀 1093742587 1319613317 0.83
compress time/TPC-H l_comment chunked 🚀 1102178335 1350942948 0.82
compress time/taxi 🚀 592459094 724977176 0.82
compress time/wide table cols=100 chunks=1 rows=1000 15800064 15776848 1.00
compress time/wide table cols=100 chunks=50 rows=1000 16727448 15805569 1.06
compress time/wide table cols=1000 chunks=1 rows=1000 169696792 159079066 1.07
compress time/wide table cols=1000 chunks=50 rows=1000 163066081 159340051 1.02
compress time/wide table cols=10000 chunks=1 rows=1000 1564561185 1581469203 0.99
compress time/wide table cols=10000 chunks=50 rows=1000 1588120554 1572635990 1.01
decompress time/Arade 🚀 23641452 31071689 0.76
decompress time/Bimbo 🚀 73600542 97869619 0.75
decompress time/CMSprovider 🚀 59960414 87746482 0.68
decompress time/Euro2016 🚀 16927399 22322237 0.76
decompress time/Food 🚀 6158958 8716883 0.71
decompress time/HashTags 🚀 70310378 78441284 0.90
decompress time/TPC-H l_comment canonical 🚀 31530606 42031829 0.75
decompress time/TPC-H l_comment chunked 🚀 30194996 41692142 0.72
decompress time/taxi 🚀 14161869 20158917 0.70
decompress time/wide table cols=100 chunks=1 rows=1000 🚀 2282574 2669017 0.86
decompress time/wide table cols=100 chunks=50 rows=1000 🚀 2110397 2597517 0.81
decompress time/wide table cols=1000 chunks=1 rows=1000 🚀 18859891 23627301 0.80
decompress time/wide table cols=1000 chunks=50 rows=1000 🚀 19325883 23700457 0.82
decompress time/wide table cols=10000 chunks=1 rows=1000 🚀 192275075 239188254 0.80
decompress time/wide table cols=10000 chunks=50 rows=1000 🚀 190807187 240583894 0.79
parquet size/Arade 305282152 305282152 1.00
parquet size/Bimbo 388935055 388935055 1.00
parquet size/CMSprovider 384634824 384634824 1.00
parquet size/Euro2016 123042700 123042700 1.00
parquet size/Food 36177631 36177631 1.00
parquet size/HashTags 133854962 133854962 1.00
parquet size/TPC-H l_comment canonical 158411391 158411391 1.00
parquet size/TPC-H l_comment chunked 158411391 158411391 1.00
parquet size/taxi 55879185 55879185 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932204 932204 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932204 932204 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9322004 9322004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9322004 9322004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93220004 93220004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93220004 93220004 1.00
parquet_rs-zstd compress time/Arade 🚀 2100640310 2563435461 0.82
parquet_rs-zstd compress time/Bimbo 🚀 12316766565 16179535734 0.76
parquet_rs-zstd compress time/CMSprovider 🚀 6316880930 7849750515 0.80
parquet_rs-zstd compress time/Euro2016 🚀 1161181764 1452803039 0.80
parquet_rs-zstd compress time/Food 🚀 701414085 940659170 0.75
parquet_rs-zstd compress time/HashTags 🚀 1939237454 2520751951 0.77
parquet_rs-zstd compress time/TPC-H l_comment canonical 🚀 2608011636 3192643987 0.82
parquet_rs-zstd compress time/TPC-H l_comment chunked 🚀 2594660862 3178302381 0.82
parquet_rs-zstd compress time/taxi 🚀 1106990786 1408375495 0.79
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚀 5147182 6376592 0.81
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚀 5186841 6572209 0.79
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 🚀 55984274 86490972 0.65
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 🚀 55681422 84954600 0.66
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 🚀 645656582 927815756 0.70
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 🚀 635232219 942853057 0.67
parquet_rs-zstd decompress time/Arade 633545617 661100221 0.96
parquet_rs-zstd decompress time/Bimbo 🚀 1903540464 2300886645 0.83
parquet_rs-zstd decompress time/CMSprovider 🚀 1829233791 2097526186 0.87
parquet_rs-zstd decompress time/Euro2016 🚀 357745327 416512211 0.86
parquet_rs-zstd decompress time/Food 🚀 194581772 238196489 0.82
parquet_rs-zstd decompress time/HashTags 🚀 567617051 671016295 0.85
parquet_rs-zstd decompress time/TPC-H l_comment canonical 🚀 548175363 707525079 0.77
parquet_rs-zstd decompress time/TPC-H l_comment chunked 🚀 544417473 711160955 0.77
parquet_rs-zstd decompress time/taxi 🚀 241166164 289233683 0.83
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2287478 2530344 0.90
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2297153 2543420 0.90
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 🚀 23356616 29333025 0.80
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 🚀 22989752 29237402 0.79
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 🚀 281383585 343557781 0.82
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 🚀 284581918 340929937 0.83
vortex-file-compressed size/Arade 143320892 143320892 1.00
vortex-file-compressed size/Bimbo 526057964 526057964 1.00
vortex-file-compressed size/CMSprovider 448338524 448338524 1.00
vortex-file-compressed size/Euro2016 167917628 167863828 1.00
vortex-file-compressed size/Food 44162400 44162400 1.00
vortex-file-compressed size/HashTags 198700644 198700644 1.00
vortex-file-compressed size/TPC-H l_comment canonical 180408824 180408824 1.00
vortex-file-compressed size/TPC-H l_comment chunked 180408824 180408824 1.00
vortex-file-compressed size/taxi 51448740 51448740 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 88317584 88317584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 88317584 88317584 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.02
vortex:parquet-zstd ratio compress time/Bimbo 🚨 0 0 1.15
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.09
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.99
vortex:parquet-zstd ratio compress time/Food 🚨 0 0 1.17
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.08
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.00
vortex:parquet-zstd ratio compress time/taxi 0 0 1.04
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚨 3 2 1.24
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 🚨 3 2 1.34
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 🚨 3 1 1.65
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 🚨 2 1 1.56
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 🚨 2 1 1.42
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 🚨 2 1 1.50
vortex:parquet-zstd ratio decompress time/Arade 🚀 0 0 0.79
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.91
vortex:parquet-zstd ratio decompress time/CMSprovider 🚀 0 0 0.78
vortex:parquet-zstd ratio decompress time/Euro2016 🚀 0 0 0.88
vortex:parquet-zstd ratio decompress time/Food 🚀 0 0 0.86
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.06
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.97
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.95
vortex:parquet-zstd ratio decompress time/taxi 🚀 0 0 0.84
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 1 0.95
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 🚀 0 1 0.90
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.95
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 13, 2026
@github-actions

github-actions Bot commented Apr 13, 2026

Copy link
Copy Markdown
Contributor

This PR has been marked as stale because it has been open for 30 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days

@github-actions github-actions Bot added the stale This PR is stale and will be auto-closed soon label Apr 13, 2026
@github-actions

github-actions Bot commented Apr 21, 2026

Copy link
Copy Markdown
Contributor

This PR was closed because it has been inactive for 7 days since being marked as stale.

@github-actions github-actions Bot closed this Apr 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@robert3005 robert3005 Awaiting requested review from robert3005

Assignees

No one assigned

Labels

stale This PR is stale and will be auto-closed soon

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@joseph-isaacs