Skip to content

Better fixed-width buffer filtering#8723

Draft
robert3005 wants to merge 5 commits into
developfrom
rk/filterbuffer
Draft

Better fixed-width buffer filtering#8723
robert3005 wants to merge 5 commits into
developfrom
rk/filterbuffer

Conversation

@robert3005

@robert3005 robert3005 commented Jul 10, 2026

Copy link
Copy Markdown
Contributor

Port logic from Primitive types to Decimal types and adjust the way we choose
filter strategies from simple threshold for indices and slices

@codspeed-hq

codspeed-hq Bot commented Jul 10, 2026 •
edited
Loading

Copy link
Copy Markdown

Merging this PR will improve performance by 54.04%

⚡ 15 improved benchmarks
✅ 1655 untouched benchmarks
⏩ 44 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ Simulation patterns_i128[Contiguous] 234.6 µs 17.8 µs ×13
⚡ Simulation random_i64[0.8] 277.6 µs 157.3 µs +76.49%
⚡ Simulation random_i64[0.5] 204.5 µs 138.3 µs +47.93%
⚡ Simulation random_i32[0.8] 128.4 µs 87 µs +47.56%
⚡ Simulation random_i32[0.5] 114.2 µs 78.7 µs +45.04%
⚡ Simulation random_i128[0.8] 389 µs 276.2 µs +40.86%
⚡ Simulation patterns_i128[Runs] 244.8 µs 173.8 µs +40.8%
⚡ Simulation random_i128[0.5] 290.1 µs 218.7 µs +32.67%
⚡ Simulation patterns_i128[Random] 290.1 µs 219.2 µs +32.34%
⚡ Simulation random_i256[0.8] 639.3 µs 525.7 µs +21.61%
⚡ Simulation random_i32[0.95] 108.6 µs 89.4 µs +21.37%
⚡ Simulation random_i256[0.5] 445.4 µs 373.9 µs +19.14%
⚡ Simulation take_filter_primitive_large_random_mask_random_indices[(12500, 25000)] 366.9 µs 312.4 µs +17.46%
⚡ Simulation random_i256[0.01] 31.8 µs 28.6 µs +11.5%
⚡ Simulation random_i64[0.95] 182.6 µs 165.5 µs +10.33%

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.

Comparing rk/filterbuffer (be5e458) with develop (05c7c2f)

Open in CodSpeed

Footnotes

  1. 44 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@robert3005

robert3005 commented Jul 12, 2026

Copy link
Copy Markdown
Contributor Author

Moved benchmarks here #8727

@robert3005 robert3005 added the changelog/performance A performance improvement label Jul 12, 2026
@robert3005
Better fixed-width buffer filtering
69e1b44 
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
lessassert
85f7fd0 
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
more
5efe3a9 
Signed-off-by: Robert Kruszewski <github@robertk.io>
@github-actions

github-actions Bot commented Jul 20, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done be5e458 1 Explore Profiling Data
Previous Runs (3)
Status Commit Job Attempt Link
🟢 Done 0d7c75e 1 Explore Profiling Data
🟢 Done 5efe3a9 2 Explore Profiling Data
🟢 Done 5efe3a9 1 Explore Profiling Data

Powered by Polar Signals Cloud

@robert3005 robert3005 added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 20, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 20, 2026
@github-actions

github-actions Bot commented Jul 20, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Vortex queries 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.7%
Engines: DataFusion Likely regression (+10.0%, medium confidence) · DuckDB No clear signal (-4.1%, low confidence)
Vortex (geomean): 0.976x ➖
Parquet (geomean): 0.963x ➖
Shifts: Parquet (control) -3.7% · Median polish -2.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.028x ➖, 0↑ 0↓)
name PR be5e458 (ns) base 05c7c2f (ns) ratio (PR/base)
vortex_q00/datafusion:vortex-file-compressed 9884949 9447028 1.05
vortex_q01/datafusion:vortex-file-compressed 6186506 6130391 1.01
datafusion / parquet (0.934x ➖, 0↑ 0↓)
name PR be5e458 (ns) base 05c7c2f (ns) ratio (PR/base)
vortex_q00/datafusion:parquet 19794648 20931306 0.95
vortex_q01/datafusion:parquet 4437385 4811001 0.92
duckdb / vortex-file-compressed (0.953x ➖, 0↑ 0↓)
name PR be5e458 (ns) base 05c7c2f (ns) ratio (PR/base)
vortex_q00/duckdb:vortex-file-compressed 9884358 10304025 0.96
vortex_q01/duckdb:vortex-file-compressed 5887371 6223625 0.95
duckdb / parquet (0.993x ➖, 0↑ 0↓)
name PR be5e458 (ns) base 05c7c2f (ns) ratio (PR/base)
vortex_q00/duckdb:parquet 23359541 23586269 0.99
vortex_q01/duckdb:parquet 9427033 9459430 1.00

No file size changes detected.

@github-actions

github-actions Bot commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Vortex (geomean): 1.038x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.038x ➖, 0↑ 3↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 107817713 117034916 0.92
polarsignals_q01/datafusion:vortex-file-compressed 270758607 274486415 0.99
polarsignals_q02/datafusion:vortex-file-compressed 23343241 24704495 0.94
polarsignals_q03/datafusion:vortex-file-compressed 268159158 273618741 0.98
polarsignals_q04/datafusion:vortex-file-compressed 🚨 10367122 9293672 1.12
polarsignals_q05/datafusion:vortex-file-compressed 🚨 16908076 14525381 1.16
polarsignals_q06/datafusion:vortex-file-compressed 21719895 21242656 1.02
polarsignals_q07/datafusion:vortex-file-compressed 🚨 15748382 13242247 1.19
polarsignals_q08/datafusion:vortex-file-compressed 409759543 390105494 1.05
polarsignals_q09/datafusion:vortex-file-compressed 12355573 11848073 1.04

No file size changes detected.

@github-actions

github-actions Bot commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.3%
Engines: DataFusion No clear signal (-1.6%, low confidence) · DuckDB No clear signal (-3.0%, low confidence)
Vortex (geomean): 0.965x ➖
Parquet (geomean): 0.988x ➖
Shifts: Parquet (control) -1.2% · Median polish -2.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.964x ➖, 2↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5315244 4933528 1.08
fineweb_q01/datafusion:vortex-file-compressed 🚀 29627569 34385483 0.86
fineweb_q02/datafusion:vortex-file-compressed 🚀 31664314 37865067 0.84
fineweb_q03/datafusion:vortex-file-compressed 55485505 53428176 1.04
fineweb_q04/datafusion:vortex-file-compressed 234372856 242394062 0.97
fineweb_q05/datafusion:vortex-file-compressed 184985067 185394936 1.00
fineweb_q06/datafusion:vortex-file-compressed 48510618 48295399 1.00
fineweb_q07/datafusion:vortex-file-compressed 54358663 56952765 0.95
fineweb_q08/datafusion:vortex-file-compressed 20903888 21630733 0.97
datafusion / parquet (0.980x ➖, 0↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6628711 7018548 0.94
fineweb_q01/datafusion:parquet 279165303 295055340 0.95
fineweb_q02/datafusion:parquet 289711127 295606447 0.98
fineweb_q03/datafusion:parquet 290978225 277097080 1.05
fineweb_q04/datafusion:parquet 300040281 301954597 0.99
fineweb_q05/datafusion:parquet 293185694 306492762 0.96
fineweb_q06/datafusion:parquet 285100981 294123479 0.97
fineweb_q07/datafusion:parquet 279787118 284512464 0.98
fineweb_q08/datafusion:parquet 275872361 275111626 1.00
duckdb / vortex-file-compressed (0.966x ➖, 2↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3195331 3369844 0.95
fineweb_q01/duckdb:vortex-file-compressed 🚀 29893955 33667536 0.89
fineweb_q02/duckdb:vortex-file-compressed 🚀 33564704 38257387 0.88
fineweb_q03/duckdb:vortex-file-compressed 100347254 100591434 1.00
fineweb_q04/duckdb:vortex-file-compressed 230722420 237733916 0.97
fineweb_q05/duckdb:vortex-file-compressed 179442873 186930992 0.96
fineweb_q06/duckdb:vortex-file-compressed 52820575 53882863 0.98
fineweb_q07/duckdb:vortex-file-compressed 55144729 52383314 1.05
fineweb_q08/duckdb:vortex-file-compressed 21436615 20707503 1.04
duckdb / parquet (0.996x ➖, 0↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 33081984 33419520 0.99
fineweb_q01/duckdb:parquet 90073795 89734129 1.00
fineweb_q02/duckdb:parquet 88398699 88840104 1.00
fineweb_q03/duckdb:parquet 321023488 323119256 0.99
fineweb_q04/duckdb:parquet 447498121 446834986 1.00
fineweb_q05/duckdb:parquet 418788844 420276635 1.00
fineweb_q06/duckdb:parquet 206215794 206757481 1.00
fineweb_q07/duckdb:parquet 217925549 217285745 1.00
fineweb_q08/duckdb:parquet 37258074 37714209 0.99
File Size Changes (2 files changed, -46.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
sample.vortex 1.0 vortex-compact 1.23 GB 0 B 1.23 GB -100.0%

Totals:

  • vortex-compact: 1.23 GB → 0 B (-100.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (0.0%)

@github-actions

github-actions Bot commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.3%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (-2.6%, environment too noisy confidence)
Vortex (geomean): 0.993x ➖
Parquet (geomean): 1.010x ➖
Shifts: Parquet (control) +1.0% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.997x ➖, 0↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51711326 53852195 0.96
tpch_q02/datafusion:vortex-file-compressed 23692901 23240440 1.02
tpch_q03/datafusion:vortex-file-compressed 30955175 31401434 0.99
tpch_q04/datafusion:vortex-file-compressed 19370298 19850715 0.98
tpch_q05/datafusion:vortex-file-compressed 47560416 45894493 1.04
tpch_q06/datafusion:vortex-file-compressed 10118397 9958533 1.02
tpch_q07/datafusion:vortex-file-compressed 51776306 53120210 0.97
tpch_q08/datafusion:vortex-file-compressed 38580789 39076229 0.99
tpch_q09/datafusion:vortex-file-compressed 50929484 51361067 0.99
tpch_q10/datafusion:vortex-file-compressed 33315987 32855541 1.01
tpch_q11/datafusion:vortex-file-compressed 17204579 16586406 1.04
tpch_q12/datafusion:vortex-file-compressed 23215383 23917163 0.97
tpch_q13/datafusion:vortex-file-compressed 26800159 26042874 1.03
tpch_q14/datafusion:vortex-file-compressed 15140992 15316307 0.99
tpch_q15/datafusion:vortex-file-compressed 22234073 22897414 0.97
tpch_q16/datafusion:vortex-file-compressed 20252043 20099305 1.01
tpch_q17/datafusion:vortex-file-compressed 66944901 66104332 1.01
tpch_q18/datafusion:vortex-file-compressed 75816810 76874031 0.99
tpch_q19/datafusion:vortex-file-compressed 18526420 18209081 1.02
tpch_q20/datafusion:vortex-file-compressed 30579900 30863134 0.99
tpch_q21/datafusion:vortex-file-compressed 67020029 70485631 0.95
tpch_q22/datafusion:vortex-file-compressed 12517435 12189073 1.03
datafusion / parquet (1.004x ➖, 0↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 141683836 143748207 0.99
tpch_q02/datafusion:parquet 62294601 61864933 1.01
tpch_q03/datafusion:parquet 83836374 81742325 1.03
tpch_q04/datafusion:parquet 49118814 48991487 1.00
tpch_q05/datafusion:parquet 93994105 95531013 0.98
tpch_q06/datafusion:parquet 41935042 43422606 0.97
tpch_q07/datafusion:parquet 105835576 102881721 1.03
tpch_q08/datafusion:parquet 94763839 96848049 0.98
tpch_q09/datafusion:parquet 127573553 124688856 1.02
tpch_q10/datafusion:parquet 118484584 119607401 0.99
tpch_q11/datafusion:parquet 41884194 42185437 0.99
tpch_q12/datafusion:parquet 79405587 79338172 1.00
tpch_q13/datafusion:parquet 198468804 197394488 1.01
tpch_q14/datafusion:parquet 45761059 45779004 1.00
tpch_q15/datafusion:parquet 62431076 61954171 1.01
tpch_q16/datafusion:parquet 43937335 42842688 1.03
tpch_q17/datafusion:parquet 145756286 143246760 1.02
tpch_q18/datafusion:parquet 158976149 156701867 1.01
tpch_q19/datafusion:parquet 68433086 72974665 0.94
tpch_q20/datafusion:parquet 73120171 67930232 1.08
tpch_q21/datafusion:parquet 143290951 144521377 0.99
tpch_q22/datafusion:parquet 46335332 44684509 1.04
datafusion / arrow (1.002x ➖, 1↑ 1↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 57142982 66301702 0.86
tpch_q02/datafusion:arrow 16715055 17049455 0.98
tpch_q03/datafusion:arrow 32036038 31727279 1.01
tpch_q04/datafusion:arrow 26498030 26836904 0.99
tpch_q05/datafusion:arrow 56481167 56724902 1.00
tpch_q06/datafusion:arrow 🚨 23539472 20909852 1.13
tpch_q07/datafusion:arrow 108502096 105226649 1.03
tpch_q08/datafusion:arrow 43799498 42721999 1.03
tpch_q09/datafusion:arrow 68721713 68530798 1.00
tpch_q10/datafusion:arrow 50092050 53055231 0.94
tpch_q11/datafusion:arrow 9325793 9293821 1.00
tpch_q12/datafusion:arrow 50404523 49564897 1.02
tpch_q13/datafusion:arrow 49037362 47293659 1.04
tpch_q14/datafusion:arrow 22655609 23464671 0.97
tpch_q15/datafusion:arrow 44870251 46573566 0.96
tpch_q16/datafusion:arrow 16523374 16549613 1.00
tpch_q17/datafusion:arrow 67581470 67003408 1.01
tpch_q18/datafusion:arrow 111554434 111522265 1.00
tpch_q19/datafusion:arrow 37639345 36518679 1.03
tpch_q20/datafusion:arrow 36717766 35410311 1.04
tpch_q21/datafusion:arrow 161157497 155165905 1.04
tpch_q22/datafusion:arrow 12240060 12106165 1.01
duckdb / vortex-file-compressed (0.989x ➖, 0↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 28547908 27174903 1.05
tpch_q02/duckdb:vortex-file-compressed 24553561 24908127 0.99
tpch_q03/duckdb:vortex-file-compressed 30415841 32438219 0.94
tpch_q04/duckdb:vortex-file-compressed 26927772 27767250 0.97
tpch_q05/duckdb:vortex-file-compressed 34736267 34805138 1.00
tpch_q06/duckdb:vortex-file-compressed 8181795 8513390 0.96
tpch_q07/duckdb:vortex-file-compressed 32624314 33433004 0.98
tpch_q08/duckdb:vortex-file-compressed 38412572 39051416 0.98
tpch_q09/duckdb:vortex-file-compressed 55619535 55539838 1.00
tpch_q10/duckdb:vortex-file-compressed 40145039 40754612 0.99
tpch_q11/duckdb:vortex-file-compressed 13895584 13699155 1.01
tpch_q12/duckdb:vortex-file-compressed 22600804 23125125 0.98
tpch_q13/duckdb:vortex-file-compressed 39272881 38988243 1.01
tpch_q14/duckdb:vortex-file-compressed 19906358 20443052 0.97
tpch_q15/duckdb:vortex-file-compressed 14976199 16120695 0.93
tpch_q16/duckdb:vortex-file-compressed 27421649 27467521 1.00
tpch_q17/duckdb:vortex-file-compressed 22937808 22955492 1.00
tpch_q18/duckdb:vortex-file-compressed 51835865 51630643 1.00
tpch_q19/duckdb:vortex-file-compressed 25905324 25704982 1.01
tpch_q20/duckdb:vortex-file-compressed 29757136 30827715 0.97
tpch_q21/duckdb:vortex-file-compressed 97785835 99425796 0.98
tpch_q22/duckdb:vortex-file-compressed 17005982 16163429 1.05
duckdb / parquet (1.015x ➖, 0↑ 2↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 78096244 77681014 1.01
tpch_q02/duckdb:parquet 40242650 40035658 1.01
tpch_q03/duckdb:parquet 72547455 71343602 1.02
tpch_q04/duckdb:parquet 50051369 50366914 0.99
tpch_q05/duckdb:parquet 69232718 69384390 1.00
tpch_q06/duckdb:parquet 22715548 22681841 1.00
tpch_q07/duckdb:parquet 🚨 86198450 71334164 1.21
tpch_q08/duckdb:parquet 85420551 83478070 1.02
tpch_q09/duckdb:parquet 🚨 158763156 136801305 1.16
tpch_q10/duckdb:parquet 129311935 134719480 0.96
tpch_q11/duckdb:parquet 22923222 22929061 1.00
tpch_q12/duckdb:parquet 47568650 47649740 1.00
tpch_q13/duckdb:parquet 256218118 253189395 1.01
tpch_q14/duckdb:parquet 51835639 51498944 1.01
tpch_q15/duckdb:parquet 29367147 28864207 1.02
tpch_q16/duckdb:parquet 59636058 58701154 1.02
tpch_q17/duckdb:parquet 53732868 58598026 0.92
tpch_q18/duckdb:parquet 121165058 121701071 1.00
tpch_q19/duckdb:parquet 73244220 72887807 1.00
tpch_q20/duckdb:parquet 66410410 66668112 1.00
tpch_q21/duckdb:parquet 182985601 175987978 1.04
tpch_q22/duckdb:parquet 55629321 55946295 0.99
File Size Changes (10 files changed, -43.9% overall, 0↑ 10↓)
File Scale Format Base HEAD Change %
customer_0.vortex 1.0 vortex-compact 7.40 MB 0 B 7.40 MB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem_0.vortex 1.0 vortex-compact 63.00 MB 0 B 63.00 MB -100.0%
lineitem_1.vortex 1.0 vortex-compact 63.03 MB 0 B 63.03 MB -100.0%
nation_0.vortex 1.0 vortex-compact 7.80 KB 0 B 7.80 KB -100.0%
orders_0.vortex 1.0 vortex-compact 31.73 MB 0 B 31.73 MB -100.0%
part_0.vortex 1.0 vortex-compact 3.55 MB 0 B 3.55 MB -100.0%
partsupp_0.vortex 1.0 vortex-compact 20.29 MB 0 B 20.29 MB -100.0%
region_0.vortex 1.0 vortex-compact 5.83 KB 0 B 5.83 KB -100.0%
supplier_0.vortex 1.0 vortex-compact 496.46 KB 0 B 496.46 KB -100.0%

Totals:

  • vortex-compact: 189.76 MB → 0 B (-100.0%)
  • vortex-file-compressed: 242.92 MB → 242.92 MB (0.0%)

@github-actions

github-actions Bot commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.0%
Engines: DataFusion No clear signal (+1.4%, environment too noisy confidence) · DuckDB No clear signal (-3.4%, low confidence)
Vortex (geomean): 0.971x ➖
Parquet (geomean): 0.981x ➖
Shifts: Parquet (control) -1.9% · Median polish -4.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.978x ➖, 13↑ 3↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 25838520 25423983 1.02
tpcds_q02/datafusion:vortex-file-compressed 49969673 47734597 1.05
tpcds_q03/datafusion:vortex-file-compressed 17232573 16228225 1.06
tpcds_q04/datafusion:vortex-file-compressed 264656858 242856018 1.09
tpcds_q05/datafusion:vortex-file-compressed 🚨 50010397 44073033 1.13
tpcds_q06/datafusion:vortex-file-compressed 26831120 25467500 1.05
tpcds_q07/datafusion:vortex-file-compressed 50155563 45846004 1.09
tpcds_q08/datafusion:vortex-file-compressed 🚨 34590379 31389508 1.10
tpcds_q09/datafusion:vortex-file-compressed 34832692 33671299 1.03
tpcds_q10/datafusion:vortex-file-compressed 41758525 40084577 1.04
tpcds_q11/datafusion:vortex-file-compressed 151086262 139509168 1.08
tpcds_q12/datafusion:vortex-file-compressed 19564561 18291672 1.07
tpcds_q13/datafusion:vortex-file-compressed 45090895 43863555 1.03
tpcds_q14/datafusion:vortex-file-compressed 177471875 166131846 1.07
tpcds_q15/datafusion:vortex-file-compressed 29292139 27062455 1.08
tpcds_q16/datafusion:vortex-file-compressed 27463494 25621459 1.07
tpcds_q17/datafusion:vortex-file-compressed 69273102 63091336 1.10
tpcds_q18/datafusion:vortex-file-compressed 66344903 63114376 1.05
tpcds_q19/datafusion:vortex-file-compressed 24378233 23691308 1.03
tpcds_q20/datafusion:vortex-file-compressed 21710798 21202408 1.02
tpcds_q21/datafusion:vortex-file-compressed 41106433 38108837 1.08
tpcds_q22/datafusion:vortex-file-compressed 132786472 134633337 0.99
tpcds_q23/datafusion:vortex-file-compressed 154200400 160463169 0.96
tpcds_q24/datafusion:vortex-file-compressed 87731027 90633621 0.97
tpcds_q25/datafusion:vortex-file-compressed 63182159 67950234 0.93
tpcds_q26/datafusion:vortex-file-compressed 29914637 31972829 0.94
tpcds_q27/datafusion:vortex-file-compressed 🚀 91863948 102078386 0.90
tpcds_q28/datafusion:vortex-file-compressed 33027500 35397392 0.93
tpcds_q29/datafusion:vortex-file-compressed 59426068 61636488 0.96
tpcds_q30/datafusion:vortex-file-compressed 23451845 24977190 0.94
tpcds_q31/datafusion:vortex-file-compressed 69287467 73726991 0.94
tpcds_q32/datafusion:vortex-file-compressed 18667598 19347000 0.96
tpcds_q33/datafusion:vortex-file-compressed 29349043 31177964 0.94
tpcds_q34/datafusion:vortex-file-compressed 25421054 27377640 0.93
tpcds_q35/datafusion:vortex-file-compressed 42756860 46536766 0.92
tpcds_q36/datafusion:vortex-file-compressed 🚀 56771052 63890548 0.89
tpcds_q37/datafusion:vortex-file-compressed 🚀 20424769 22718179 0.90
tpcds_q38/datafusion:vortex-file-compressed 39730758 42235551 0.94
tpcds_q39/datafusion:vortex-file-compressed 🚀 104627005 118241410 0.88
tpcds_q40/datafusion:vortex-file-compressed 29419970 31279888 0.94
tpcds_q41/datafusion:vortex-file-compressed 🚀 19297470 22111618 0.87
tpcds_q42/datafusion:vortex-file-compressed 🚀 13380952 15245455 0.88
tpcds_q43/datafusion:vortex-file-compressed 18805429 20133509 0.93
tpcds_q44/datafusion:vortex-file-compressed 🚀 29031988 33404438 0.87
tpcds_q45/datafusion:vortex-file-compressed 25611459 26261356 0.98
tpcds_q46/datafusion:vortex-file-compressed 34848350 37393728 0.93
tpcds_q47/datafusion:vortex-file-compressed 148310804 149679825 0.99
tpcds_q48/datafusion:vortex-file-compressed 36630232 39909163 0.92
tpcds_q49/datafusion:vortex-file-compressed 60211547 59998461 1.00
tpcds_q50/datafusion:vortex-file-compressed 42901647 40617261 1.06
tpcds_q51/datafusion:vortex-file-compressed 94268000 97569098 0.97
tpcds_q52/datafusion:vortex-file-compressed 15664043 14560755 1.08
tpcds_q53/datafusion:vortex-file-compressed 24772133 23304342 1.06
tpcds_q54/datafusion:vortex-file-compressed 37179475 36234621 1.03
tpcds_q55/datafusion:vortex-file-compressed 16060585 15482290 1.04
tpcds_q56/datafusion:vortex-file-compressed 🚨 34338588 30828423 1.11
tpcds_q57/datafusion:vortex-file-compressed 104999498 96221689 1.09
tpcds_q58/datafusion:vortex-file-compressed 61551474 57052566 1.08
tpcds_q59/datafusion:vortex-file-compressed 65749889 62139127 1.06
tpcds_q60/datafusion:vortex-file-compressed 33514336 32580812 1.03
tpcds_q61/datafusion:vortex-file-compressed 44960211 41768557 1.08
tpcds_q62/datafusion:vortex-file-compressed 23529502 23034210 1.02
tpcds_q63/datafusion:vortex-file-compressed 25470435 24322077 1.05
tpcds_q64/datafusion:vortex-file-compressed 451474203 424939013 1.06
tpcds_q65/datafusion:vortex-file-compressed 57855191 56983395 1.02
tpcds_q66/datafusion:vortex-file-compressed 75749061 73345129 1.03
tpcds_q67/datafusion:vortex-file-compressed 155432766 170553194 0.91
tpcds_q68/datafusion:vortex-file-compressed 35389024 35033629 1.01
tpcds_q69/datafusion:vortex-file-compressed 35916129 37005660 0.97
tpcds_q70/datafusion:vortex-file-compressed 96164469 102291663 0.94
tpcds_q71/datafusion:vortex-file-compressed 22987069 24140006 0.95
tpcds_q72/datafusion:vortex-file-compressed 2087046099 2254635617 0.93
tpcds_q73/datafusion:vortex-file-compressed 23565242 25457179 0.93
tpcds_q74/datafusion:vortex-file-compressed 79285395 83094360 0.95
tpcds_q75/datafusion:vortex-file-compressed 112274914 112047860 1.00
tpcds_q76/datafusion:vortex-file-compressed 27322165 28508398 0.96
tpcds_q77/datafusion:vortex-file-compressed 35818976 39063245 0.92
tpcds_q78/datafusion:vortex-file-compressed 111422776 116347964 0.96
tpcds_q79/datafusion:vortex-file-compressed 🚀 28706743 32319319 0.89
tpcds_q80/datafusion:vortex-file-compressed 🚀 85719698 95580692 0.90
tpcds_q81/datafusion:vortex-file-compressed 23645317 25522018 0.93
tpcds_q82/datafusion:vortex-file-compressed 🚀 20458901 25077758 0.82
tpcds_q83/datafusion:vortex-file-compressed 34968552 36004642 0.97
tpcds_q84/datafusion:vortex-file-compressed 12129129 13201783 0.92
tpcds_q85/datafusion:vortex-file-compressed 85739336 93144566 0.92
tpcds_q86/datafusion:vortex-file-compressed 15238140 15758564 0.97
tpcds_q87/datafusion:vortex-file-compressed 🚀 38990534 43582776 0.89
tpcds_q88/datafusion:vortex-file-compressed 54893625 57136839 0.96
tpcds_q89/datafusion:vortex-file-compressed 25718269 28320231 0.91
tpcds_q90/datafusion:vortex-file-compressed 13270774 13968858 0.95
tpcds_q91/datafusion:vortex-file-compressed 17729254 19527950 0.91
tpcds_q92/datafusion:vortex-file-compressed 🚀 15545446 17495039 0.89
tpcds_q93/datafusion:vortex-file-compressed 31439448 33844477 0.93
tpcds_q94/datafusion:vortex-file-compressed 20293015 22218840 0.91
tpcds_q95/datafusion:vortex-file-compressed 56048515 57494465 0.97
tpcds_q96/datafusion:vortex-file-compressed 13174536 14184124 0.93
tpcds_q97/datafusion:vortex-file-compressed 30094751 30738576 0.98
tpcds_q98/datafusion:vortex-file-compressed 🚀 24499540 27657764 0.89
tpcds_q99/datafusion:vortex-file-compressed 25542967 28152305 0.91
datafusion / parquet (0.965x ➖, 9↑ 3↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 🚀 23490998 26544178 0.88
tpcds_q02/datafusion:parquet 41035096 42259473 0.97
tpcds_q03/datafusion:parquet 13791927 14211167 0.97
tpcds_q04/datafusion:parquet 293101527 318627886 0.92
tpcds_q05/datafusion:parquet 46164145 48245266 0.96
tpcds_q06/datafusion:parquet 22908844 23501278 0.97
tpcds_q07/datafusion:parquet 78232484 82621954 0.95
tpcds_q08/datafusion:parquet 29240978 29844065 0.98
tpcds_q09/datafusion:parquet 40446846 40678725 0.99
tpcds_q10/datafusion:parquet 73760514 75724514 0.97
tpcds_q11/datafusion:parquet 157237980 156421309 1.01
tpcds_q12/datafusion:parquet 18533952 19145199 0.97
tpcds_q13/datafusion:parquet 78165974 78445573 1.00
tpcds_q14/datafusion:parquet 159645584 170352943 0.94
tpcds_q15/datafusion:parquet 21157717 22441856 0.94
tpcds_q16/datafusion:parquet 28078163 30595994 0.92
tpcds_q17/datafusion:parquet 🚀 61169958 69465236 0.88
tpcds_q18/datafusion:parquet 109112868 108975735 1.00
tpcds_q19/datafusion:parquet 23437870 25553867 0.92
tpcds_q20/datafusion:parquet 17518421 18564748 0.94
tpcds_q21/datafusion:parquet 19066651 20721459 0.92
tpcds_q22/datafusion:parquet 🚨 183314348 158184332 1.16
tpcds_q23/datafusion:parquet 160527934 157764139 1.02
tpcds_q24/datafusion:parquet 90486733 97837418 0.92
tpcds_q25/datafusion:parquet 67894953 65637587 1.03
tpcds_q26/datafusion:parquet 🚀 63756900 71809488 0.89
tpcds_q27/datafusion:parquet 141916767 152118375 0.93
tpcds_q28/datafusion:parquet 45782125 48291210 0.95
tpcds_q29/datafusion:parquet 65946844 68922811 0.96
tpcds_q30/datafusion:parquet 34611873 34011390 1.02
tpcds_q31/datafusion:parquet 69548722 69019526 1.01
tpcds_q32/datafusion:parquet 16995925 17935439 0.95
tpcds_q33/datafusion:parquet 27642234 29628182 0.93
tpcds_q34/datafusion:parquet 🚀 21270093 25505988 0.83
tpcds_q35/datafusion:parquet 72479195 80304177 0.90
tpcds_q36/datafusion:parquet 57735107 63919239 0.90
tpcds_q37/datafusion:parquet 20263438 21075391 0.96
tpcds_q38/datafusion:parquet 🚀 41072140 46386334 0.89
tpcds_q39/datafusion:parquet 77371750 81622925 0.95
tpcds_q40/datafusion:parquet 24318466 24704956 0.98
tpcds_q41/datafusion:parquet 🚀 14186565 15866549 0.89
tpcds_q42/datafusion:parquet 12478845 12438859 1.00
tpcds_q43/datafusion:parquet 17119345 18540924 0.92
tpcds_q44/datafusion:parquet 31962217 35165139 0.91
tpcds_q45/datafusion:parquet 27810940 29694449 0.94
tpcds_q46/datafusion:parquet 32648333 34167787 0.96
tpcds_q47/datafusion:parquet 127384727 139103720 0.92
tpcds_q48/datafusion:parquet 70570717 72475408 0.97
tpcds_q49/datafusion:parquet 56575662 58851067 0.96
tpcds_q50/datafusion:parquet 43341383 44037896 0.98
tpcds_q51/datafusion:parquet 86254857 90831695 0.95
tpcds_q52/datafusion:parquet 12222624 13350648 0.92
tpcds_q53/datafusion:parquet 19495665 18905981 1.03
tpcds_q54/datafusion:parquet 🚀 32248259 36697139 0.88
tpcds_q55/datafusion:parquet 11513214 12401689 0.93
tpcds_q56/datafusion:parquet 28269136 31109766 0.91
tpcds_q57/datafusion:parquet 🚀 95687854 112965874 0.85
tpcds_q58/datafusion:parquet 56152533 59508379 0.94
tpcds_q59/datafusion:parquet 62277683 65890526 0.95
tpcds_q60/datafusion:parquet 27480061 28457463 0.97
tpcds_q61/datafusion:parquet 42538162 45993051 0.92
tpcds_q62/datafusion:parquet 20330696 21917397 0.93
tpcds_q63/datafusion:parquet 17740440 19141096 0.93
tpcds_q64/datafusion:parquet 296206750 311323785 0.95
tpcds_q65/datafusion:parquet 37821788 39462498 0.96
tpcds_q66/datafusion:parquet 71408788 70932315 1.01
tpcds_q67/datafusion:parquet 151945240 156481808 0.97
tpcds_q68/datafusion:parquet 31968421 33639613 0.95
tpcds_q69/datafusion:parquet 66799504 69872992 0.96
tpcds_q70/datafusion:parquet 🚀 33064728 37269372 0.89
tpcds_q71/datafusion:parquet 23204279 24180748 0.96
tpcds_q72/datafusion:parquet 590948080 636727815 0.93
tpcds_q73/datafusion:parquet 22560696 23068768 0.98
tpcds_q74/datafusion:parquet 86369210 89022921 0.97
tpcds_q75/datafusion:parquet 109964995 110006065 1.00
tpcds_q76/datafusion:parquet 30299135 32519909 0.93
tpcds_q77/datafusion:parquet 40563543 40736814 1.00
tpcds_q78/datafusion:parquet 108186701 119340666 0.91
tpcds_q79/datafusion:parquet 26969183 27457493 0.98
tpcds_q80/datafusion:parquet 75973257 82923209 0.92
tpcds_q81/datafusion:parquet 28909927 31246373 0.93
tpcds_q82/datafusion:parquet 20175477 20441805 0.99
tpcds_q83/datafusion:parquet 42363226 42449831 1.00
tpcds_q84/datafusion:parquet 39922474 41511927 0.96
tpcds_q85/datafusion:parquet 152830824 153779620 0.99
tpcds_q86/datafusion:parquet 🚨 16221580 14512960 1.12
tpcds_q87/datafusion:parquet 47765649 46246376 1.03
tpcds_q88/datafusion:parquet 63183746 62712781 1.01
tpcds_q89/datafusion:parquet 🚨 25680996 22837012 1.12
tpcds_q90/datafusion:parquet 16676625 15261251 1.09
tpcds_q91/datafusion:parquet 65540653 62298208 1.05
tpcds_q92/datafusion:parquet 20647367 18989033 1.09
tpcds_q93/datafusion:parquet 37058089 33818732 1.10
tpcds_q94/datafusion:parquet 24074852 22899211 1.05
tpcds_q95/datafusion:parquet 68022404 62959108 1.08
tpcds_q96/datafusion:parquet 13431341 13516187 0.99
tpcds_q97/datafusion:parquet 34269027 33058516 1.04
tpcds_q98/datafusion:parquet 24666280 22522369 1.10
tpcds_q99/datafusion:parquet 28190602 27673298 1.02
duckdb / vortex-file-compressed (0.963x ➖, 4↑ 1↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 22874210 24073050 0.95
tpcds_q02/duckdb:vortex-file-compressed 23172683 24397908 0.95
tpcds_q03/duckdb:vortex-file-compressed 18975123 20747928 0.91
tpcds_q04/duckdb:vortex-file-compressed 94194740 99608061 0.95
tpcds_q05/duckdb:vortex-file-compressed 33342135 36036101 0.93
tpcds_q06/duckdb:vortex-file-compressed 34503493 35993360 0.96
tpcds_q07/duckdb:vortex-file-compressed 28650441 30009818 0.95
tpcds_q08/duckdb:vortex-file-compressed 🚀 26975626 30464109 0.89
tpcds_q09/duckdb:vortex-file-compressed 16189703 16536317 0.98
tpcds_q10/duckdb:vortex-file-compressed 39945889 42805803 0.93
tpcds_q11/duckdb:vortex-file-compressed 75362728 76261711 0.99
tpcds_q12/duckdb:vortex-file-compressed 14382183 14934537 0.96
tpcds_q13/duckdb:vortex-file-compressed 34916609 36291240 0.96
tpcds_q14/duckdb:vortex-file-compressed 100874409 108331456 0.93
tpcds_q15/duckdb:vortex-file-compressed 27433078 29235497 0.94
tpcds_q16/duckdb:vortex-file-compressed 23852354 26298358 0.91
tpcds_q17/duckdb:vortex-file-compressed 49228040 49876092 0.99
tpcds_q18/duckdb:vortex-file-compressed 🚀 39900274 44770328 0.89
tpcds_q19/duckdb:vortex-file-compressed 35840655 37775832 0.95
tpcds_q20/duckdb:vortex-file-compressed 14292357 15711084 0.91
tpcds_q21/duckdb:vortex-file-compressed 15983519 17148074 0.93
tpcds_q22/duckdb:vortex-file-compressed 72343320 75106229 0.96
tpcds_q23/duckdb:vortex-file-compressed 86423392 93073131 0.93
tpcds_q24/duckdb:vortex-file-compressed 44047813 48071835 0.92
tpcds_q25/duckdb:vortex-file-compressed 🚀 34028582 38083488 0.89
tpcds_q26/duckdb:vortex-file-compressed 19239612 20024005 0.96
tpcds_q27/duckdb:vortex-file-compressed 28336227 30509416 0.93
tpcds_q28/duckdb:vortex-file-compressed 11352361 12469583 0.91
tpcds_q29/duckdb:vortex-file-compressed 44590168 49157010 0.91
tpcds_q30/duckdb:vortex-file-compressed 25553283 26324067 0.97
tpcds_q31/duckdb:vortex-file-compressed 31127869 32065621 0.97
tpcds_q32/duckdb:vortex-file-compressed 13952527 14497165 0.96
tpcds_q33/duckdb:vortex-file-compressed 26138847 27888302 0.94
tpcds_q34/duckdb:vortex-file-compressed 🚀 26281557 29743037 0.88
tpcds_q35/duckdb:vortex-file-compressed 72255388 70475204 1.03
tpcds_q36/duckdb:vortex-file-compressed 25838855 26875568 0.96
tpcds_q37/duckdb:vortex-file-compressed 19663666 20413703 0.96
tpcds_q38/duckdb:vortex-file-compressed 38585583 41842090 0.92
tpcds_q39/duckdb:vortex-file-compressed 🚨 35777223 29269754 1.22
tpcds_q40/duckdb:vortex-file-compressed 19986937 20280440 0.99
tpcds_q41/duckdb:vortex-file-compressed 13644138 12811630 1.06
tpcds_q42/duckdb:vortex-file-compressed 16809617 16505164 1.02
tpcds_q43/duckdb:vortex-file-compressed 19304246 18967135 1.02
tpcds_q44/duckdb:vortex-file-compressed 23535951 22612935 1.04
tpcds_q45/duckdb:vortex-file-compressed 33632140 32252785 1.04
tpcds_q46/duckdb:vortex-file-compressed 33481601 33033786 1.01
tpcds_q47/duckdb:vortex-file-compressed 58100086 56830130 1.02
tpcds_q48/duckdb:vortex-file-compressed 33879385 33650363 1.01
tpcds_q49/duckdb:vortex-file-compressed 38964686 37478931 1.04
tpcds_q50/duckdb:vortex-file-compressed 28490790 29233238 0.97
tpcds_q51/duckdb:vortex-file-compressed 110135866 106635812 1.03
tpcds_q52/duckdb:vortex-file-compressed 16081105 16731153 0.96
tpcds_q53/duckdb:vortex-file-compressed 25369013 25576320 0.99
tpcds_q54/duckdb:vortex-file-compressed 34191215 31259144 1.09
tpcds_q55/duckdb:vortex-file-compressed 15465806 15388522 1.01
tpcds_q56/duckdb:vortex-file-compressed 29719072 29822944 1.00
tpcds_q57/duckdb:vortex-file-compressed 38862332 38395534 1.01
tpcds_q58/duckdb:vortex-file-compressed 34463751 32523121 1.06
tpcds_q59/duckdb:vortex-file-compressed 39342759 39628517 0.99
tpcds_q60/duckdb:vortex-file-compressed 28212038 29232418 0.97
tpcds_q61/duckdb:vortex-file-compressed 31687260 34419262 0.92
tpcds_q62/duckdb:vortex-file-compressed 14586601 16013037 0.91
tpcds_q63/duckdb:vortex-file-compressed 21799929 23189651 0.94
tpcds_q64/duckdb:vortex-file-compressed 99314440 105262985 0.94
tpcds_q65/duckdb:vortex-file-compressed 23599147 23983847 0.98
tpcds_q66/duckdb:vortex-file-compressed 29556748 29980176 0.99
tpcds_q67/duckdb:vortex-file-compressed 138287763 146992795 0.94
tpcds_q68/duckdb:vortex-file-compressed 32089230 34873242 0.92
tpcds_q69/duckdb:vortex-file-compressed 41943061 45250150 0.93
tpcds_q70/duckdb:vortex-file-compressed 31704773 33729426 0.94
tpcds_q71/duckdb:vortex-file-compressed 24172750 23803114 1.02
tpcds_q72/duckdb:vortex-file-compressed 147129320 156299829 0.94
tpcds_q73/duckdb:vortex-file-compressed 29782246 29675330 1.00
tpcds_q74/duckdb:vortex-file-compressed 46774591 48652943 0.96
tpcds_q75/duckdb:vortex-file-compressed 48524803 52395449 0.93
tpcds_q76/duckdb:vortex-file-compressed 22822367 22750659 1.00
tpcds_q77/duckdb:vortex-file-compressed 24777354 26319256 0.94
tpcds_q78/duckdb:vortex-file-compressed 66488087 69019194 0.96
tpcds_q79/duckdb:vortex-file-compressed 26436382 28742113 0.92
tpcds_q80/duckdb:vortex-file-compressed 49599427 51352373 0.97
tpcds_q81/duckdb:vortex-file-compressed 29865528 31781494 0.94
tpcds_q82/duckdb:vortex-file-compressed 47017875 48115956 0.98
tpcds_q83/duckdb:vortex-file-compressed 29447698 30276408 0.97
tpcds_q84/duckdb:vortex-file-compressed 17101355 18577432 0.92
tpcds_q85/duckdb:vortex-file-compressed 44008095 45008640 0.98
tpcds_q86/duckdb:vortex-file-compressed 16856136 17749049 0.95
tpcds_q87/duckdb:vortex-file-compressed 38472152 40237991 0.96
tpcds_q88/duckdb:vortex-file-compressed 59317817 62413326 0.95
tpcds_q89/duckdb:vortex-file-compressed 22036166 24467959 0.90
tpcds_q90/duckdb:vortex-file-compressed 11187954 12279946 0.91
tpcds_q91/duckdb:vortex-file-compressed 22490049 24005215 0.94
tpcds_q92/duckdb:vortex-file-compressed 17786161 19759532 0.90
tpcds_q93/duckdb:vortex-file-compressed 29226877 30450408 0.96
tpcds_q94/duckdb:vortex-file-compressed 22761235 23961174 0.95
tpcds_q95/duckdb:vortex-file-compressed 124818877 128832264 0.97
tpcds_q96/duckdb:vortex-file-compressed 13794812 14187620 0.97
tpcds_q97/duckdb:vortex-file-compressed 37090430 39794568 0.93
tpcds_q98/duckdb:vortex-file-compressed 19813691 20379031 0.97
tpcds_q99/duckdb:vortex-file-compressed 20756377 19617171 1.06
duckdb / parquet (0.997x ➖, 1↑ 1↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29169978 31121687 0.94
tpcds_q02/duckdb:parquet 24518652 25039791 0.98
tpcds_q03/duckdb:parquet 13698790 13023110 1.05
tpcds_q04/duckdb:parquet 171063094 174343234 0.98
tpcds_q05/duckdb:parquet 32882355 33229539 0.99
tpcds_q06/duckdb:parquet 34523740 35420692 0.97
tpcds_q07/duckdb:parquet 25336615 25430698 1.00
tpcds_q08/duckdb:parquet 29552044 30924382 0.96
tpcds_q09/duckdb:parquet 44593328 47198424 0.94
tpcds_q10/duckdb:parquet 37720767 39712571 0.95
tpcds_q11/duckdb:parquet 92931013 96384773 0.96
tpcds_q12/duckdb:parquet 16237601 16528103 0.98
tpcds_q13/duckdb:parquet 35759815 36770626 0.97
tpcds_q14/duckdb:parquet 105056790 106608023 0.99
tpcds_q15/duckdb:parquet 31966355 32318678 0.99
tpcds_q16/duckdb:parquet 24267402 23770961 1.02
tpcds_q17/duckdb:parquet 41669961 42323034 0.98
tpcds_q18/duckdb:parquet 53012293 50530221 1.05
tpcds_q19/duckdb:parquet 34595981 33137063 1.04
tpcds_q20/duckdb:parquet 18634742 17626116 1.06
tpcds_q21/duckdb:parquet 13023066 12328280 1.06
tpcds_q22/duckdb:parquet 79411531 75585970 1.05
tpcds_q23/duckdb:parquet 89701849 83035502 1.08
tpcds_q24/duckdb:parquet 🚨 55785311 49891326 1.12
tpcds_q25/duckdb:parquet 39219334 37110604 1.06
tpcds_q26/duckdb:parquet 43933138 41132362 1.07
tpcds_q27/duckdb:parquet 57877890 55231072 1.05
tpcds_q28/duckdb:parquet 45604579 43898835 1.04
tpcds_q29/duckdb:parquet 42453674 39838709 1.07
tpcds_q30/duckdb:parquet 40243567 38873593 1.04
tpcds_q31/duckdb:parquet 30283115 28803025 1.05
tpcds_q32/duckdb:parquet 13950021 14217363 0.98
tpcds_q33/duckdb:parquet 26450944 24809539 1.07
tpcds_q34/duckdb:parquet 24428416 24409306 1.00
tpcds_q35/duckdb:parquet 67411127 64901191 1.04
tpcds_q36/duckdb:parquet 23823866 23847411 1.00
tpcds_q37/duckdb:parquet 15884306 14869470 1.07
tpcds_q38/duckdb:parquet 39092965 38997145 1.00
tpcds_q39/duckdb:parquet 35189842 33893376 1.04
tpcds_q40/duckdb:parquet 21680241 20940390 1.04
tpcds_q41/duckdb:parquet 9518865 9377235 1.02
tpcds_q42/duckdb:parquet 13159276 13724647 0.96
tpcds_q43/duckdb:parquet 18420172 19796341 0.93
tpcds_q44/duckdb:parquet 28469827 27741677 1.03
tpcds_q45/duckdb:parquet 31513234 32267796 0.98
tpcds_q46/duckdb:parquet 51184674 49918418 1.03
tpcds_q47/duckdb:parquet 53448888 52372154 1.02
tpcds_q48/duckdb:parquet 34047461 33698759 1.01
tpcds_q49/duckdb:parquet 30614199 28829059 1.06
tpcds_q50/duckdb:parquet 27058120 27322833 0.99
tpcds_q51/duckdb:parquet 105232420 111786292 0.94
tpcds_q52/duckdb:parquet 13196159 13822932 0.95
tpcds_q53/duckdb:parquet 17184208 18269945 0.94
tpcds_q54/duckdb:parquet 29403588 29858485 0.98
tpcds_q55/duckdb:parquet 12784885 13293365 0.96
tpcds_q56/duckdb:parquet 24225293 25725735 0.94
tpcds_q57/duckdb:parquet 39163191 40944984 0.96
tpcds_q58/duckdb:parquet 26571278 26940770 0.99
tpcds_q59/duckdb:parquet 37444173 37079216 1.01
tpcds_q60/duckdb:parquet 26206877 26270260 1.00
tpcds_q61/duckdb:parquet 35444326 35454589 1.00
tpcds_q62/duckdb:parquet 13030468 13441733 0.97
tpcds_q63/duckdb:parquet 16152135 16567582 0.97
tpcds_q64/duckdb:parquet 78294098 78581423 1.00
tpcds_q65/duckdb:parquet 23651419 22999296 1.03
tpcds_q66/duckdb:parquet 34486139 31545551 1.09
tpcds_q67/duckdb:parquet 138526854 142828279 0.97
tpcds_q68/duckdb:parquet 40275096 40002900 1.01
tpcds_q69/duckdb:parquet 39137712 39852300 0.98
tpcds_q70/duckdb:parquet 22848382 22911178 1.00
tpcds_q71/duckdb:parquet 23493680 25337781 0.93
tpcds_q72/duckdb:parquet 166623207 172113646 0.97
tpcds_q73/duckdb:parquet 21409603 21556346 0.99
tpcds_q74/duckdb:parquet 130861861 132023399 0.99
tpcds_q75/duckdb:parquet 59230374 60399414 0.98
tpcds_q76/duckdb:parquet 23422626 23504596 1.00
tpcds_q77/duckdb:parquet 25370665 26240930 0.97
tpcds_q78/duckdb:parquet 78925257 80351330 0.98
tpcds_q79/duckdb:parquet 30933432 31692797 0.98
tpcds_q80/duckdb:parquet 44269766 45608025 0.97
tpcds_q81/duckdb:parquet 36215129 36283104 1.00
tpcds_q82/duckdb:parquet 17915037 18556750 0.97
tpcds_q83/duckdb:parquet 18861771 19305059 0.98
tpcds_q84/duckdb:parquet 21013418 21394402 0.98
tpcds_q85/duckdb:parquet 44721675 43478642 1.03
tpcds_q86/duckdb:parquet 14432503 14270925 1.01
tpcds_q87/duckdb:parquet 39941408 41121376 0.97
tpcds_q88/duckdb:parquet 54027424 55324089 0.98
tpcds_q89/duckdb:parquet 19687474 19705256 1.00
tpcds_q90/duckdb:parquet 8603506 9017585 0.95
tpcds_q91/duckdb:parquet 26087635 26641273 0.98
tpcds_q92/duckdb:parquet 13707428 13919613 0.98
tpcds_q93/duckdb:parquet 35238064 34206829 1.03
tpcds_q94/duckdb:parquet 18639744 19227295 0.97
tpcds_q95/duckdb:parquet 🚀 135644136 153176355 0.89
tpcds_q96/duckdb:parquet 10835268 11092907 0.98
tpcds_q97/duckdb:parquet 40651838 40632082 1.00
tpcds_q98/duckdb:parquet 21737358 23282361 0.93
tpcds_q99/duckdb:parquet 20657588 20995076 0.98
File Size Changes (25 files changed, -43.5% overall, 0↑ 25↓)
File Scale Format Base HEAD Change %
call_center.vortex 1.0 vortex-compact 47.43 KB 0 B 47.43 KB -100.0%
catalog_page.vortex 1.0 vortex-compact 362.44 KB 0 B 362.44 KB -100.0%
catalog_returns.vortex 1.0 vortex-compact 6.04 MB 0 B 6.04 MB -100.0%
catalog_sales.vortex 1.0 vortex-compact 59.49 MB 0 B 59.49 MB -100.0%
customer.vortex 1.0 vortex-compact 3.29 MB 0 B 3.29 MB -100.0%
customer_address.vortex 1.0 vortex-compact 638.84 KB 0 B 638.84 KB -100.0%
customer_demographics.vortex 1.0 vortex-compact 424.18 KB 0 B 424.18 KB -100.0%
date_dim.vortex 1.0 vortex-compact 140.28 KB 0 B 140.28 KB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
household_demographics.vortex 1.0 vortex-compact 10.29 KB 0 B 10.29 KB -100.0%
income_band.vortex 1.0 vortex-compact 5.56 KB 0 B 5.56 KB -100.0%
inventory.vortex 1.0 vortex-compact 16.07 MB 0 B 16.07 MB -100.0%
item.vortex 1.0 vortex-compact 1000.32 KB 0 B 1000.32 KB -100.0%
promotion.vortex 1.0 vortex-compact 50.31 KB 0 B 50.31 KB -100.0%
reason.vortex 1.0 vortex-compact 5.96 KB 0 B 5.96 KB -100.0%
ship_mode.vortex 1.0 vortex-compact 10.73 KB 0 B 10.73 KB -100.0%
store.vortex 1.0 vortex-compact 43.22 KB 0 B 43.22 KB -100.0%
store_returns.vortex 1.0 vortex-compact 9.36 MB 0 B 9.36 MB -100.0%
store_sales.vortex 1.0 vortex-compact 78.12 MB 0 B 78.12 MB -100.0%
time_dim.vortex 1.0 vortex-compact 96.59 KB 0 B 96.59 KB -100.0%
warehouse.vortex 1.0 vortex-compact 22.14 KB 0 B 22.14 KB -100.0%
web_page.vortex 1.0 vortex-compact 25.01 KB 0 B 25.01 KB -100.0%
web_returns.vortex 1.0 vortex-compact 3.00 MB 0 B 3.00 MB -100.0%
web_sales.vortex 1.0 vortex-compact 29.45 MB 0 B 29.45 MB -100.0%
web_site.vortex 1.0 vortex-compact 42.19 KB 0 B 42.19 KB -100.0%

Totals:

  • vortex-compact: 207.94 MB → 0 B (-100.0%)
  • vortex-file-compressed: 269.98 MB → 269.98 MB (0.0%)

@github-actions

github-actions Bot commented Jul 20, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.6%
Engines: DataFusion No clear signal (-2.4%, low confidence) · DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): 0.982x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.973x ➖, 3↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1628007 1567817 1.04
clickbench_q01/datafusion:vortex-file-compressed 18825359 18137232 1.04
clickbench_q02/datafusion:vortex-file-compressed 33631125 35155304 0.96
clickbench_q03/datafusion:vortex-file-compressed 37526751 38038976 0.99
clickbench_q04/datafusion:vortex-file-compressed 229859136 238050899 0.97
clickbench_q05/datafusion:vortex-file-compressed 299445208 304169826 0.98
clickbench_q06/datafusion:vortex-file-compressed 1626699 1610211 1.01
clickbench_q07/datafusion:vortex-file-compressed 22061963 23625363 0.93
clickbench_q08/datafusion:vortex-file-compressed 325840766 330581477 0.99
clickbench_q09/datafusion:vortex-file-compressed 445932427 455325059 0.98
clickbench_q10/datafusion:vortex-file-compressed 70703738 76147923 0.93
clickbench_q11/datafusion:vortex-file-compressed 81864314 88332789 0.93
clickbench_q12/datafusion:vortex-file-compressed 257511660 260134866 0.99
clickbench_q13/datafusion:vortex-file-compressed 413074920 417052296 0.99
clickbench_q14/datafusion:vortex-file-compressed 252461965 249636845 1.01
clickbench_q15/datafusion:vortex-file-compressed 278157967 287634652 0.97
clickbench_q16/datafusion:vortex-file-compressed 642932363 657089492 0.98
clickbench_q17/datafusion:vortex-file-compressed 642500105 640972203 1.00
clickbench_q18/datafusion:vortex-file-compressed 1331258049 1461080676 0.91
clickbench_q19/datafusion:vortex-file-compressed 🚀 25322836 28197759 0.90
clickbench_q20/datafusion:vortex-file-compressed 263374499 260729948 1.01
clickbench_q21/datafusion:vortex-file-compressed 347246653 350294916 0.99
clickbench_q22/datafusion:vortex-file-compressed 433248047 448810605 0.97
clickbench_q23/datafusion:vortex-file-compressed 🚀 532955487 641425732 0.83
clickbench_q24/datafusion:vortex-file-compressed 🚀 39877143 44799668 0.89
clickbench_q25/datafusion:vortex-file-compressed 71248072 74901540 0.95
clickbench_q26/datafusion:vortex-file-compressed 41777860 43515064 0.96
clickbench_q27/datafusion:vortex-file-compressed 381354856 373078332 1.02
clickbench_q28/datafusion:vortex-file-compressed 2299901188 2316971119 0.99
clickbench_q29/datafusion:vortex-file-compressed 50274459 55192357 0.91
clickbench_q30/datafusion:vortex-file-compressed 215298987 229050100 0.94
clickbench_q31/datafusion:vortex-file-compressed 234596508 244087819 0.96
clickbench_q32/datafusion:vortex-file-compressed 1034478686 1060335523 0.98
clickbench_q33/datafusion:vortex-file-compressed 1366450782 1386516078 0.99
clickbench_q34/datafusion:vortex-file-compressed 1381543068 1380926881 1.00
clickbench_q35/datafusion:vortex-file-compressed 241134691 234732704 1.03
clickbench_q36/datafusion:vortex-file-compressed 57014752 53517667 1.07
clickbench_q37/datafusion:vortex-file-compressed 23984842 24916362 0.96
clickbench_q38/datafusion:vortex-file-compressed 16029796 15715280 1.02
clickbench_q39/datafusion:vortex-file-compressed 119534662 120399293 0.99
clickbench_q40/datafusion:vortex-file-compressed 12177253 12879976 0.95
clickbench_q41/datafusion:vortex-file-compressed 12304756 11948292 1.03
clickbench_q42/datafusion:vortex-file-compressed 11250926 11460231 0.98
datafusion / parquet (0.997x ➖, 0↑ 1↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1485301 1571228 0.95
clickbench_q01/datafusion:parquet 18880511 19458128 0.97
clickbench_q02/datafusion:parquet 42692209 43127267 0.99
clickbench_q03/datafusion:parquet 33397946 33134805 1.01
clickbench_q04/datafusion:parquet 263485955 262765595 1.00
clickbench_q05/datafusion:parquet 319276524 326388724 0.98
clickbench_q06/datafusion:parquet 1514425 1528076 0.99
clickbench_q07/datafusion:parquet 21929422 21193289 1.03
clickbench_q08/datafusion:parquet 328932337 327478146 1.00
clickbench_q09/datafusion:parquet 470593181 473715538 0.99
clickbench_q10/datafusion:parquet 92759431 90963399 1.02
clickbench_q11/datafusion:parquet 118622257 116853363 1.02
clickbench_q12/datafusion:parquet 295397340 294184180 1.00
clickbench_q13/datafusion:parquet 475263708 470304780 1.01
clickbench_q14/datafusion:parquet 308577854 312584416 0.99
clickbench_q15/datafusion:parquet 277720351 273028594 1.02
clickbench_q16/datafusion:parquet 649763179 669481359 0.97
clickbench_q17/datafusion:parquet 642091337 647367435 0.99
clickbench_q18/datafusion:parquet 1338201784 1377831607 0.97
clickbench_q19/datafusion:parquet 26660353 26251701 1.02
clickbench_q20/datafusion:parquet 557005662 583693618 0.95
clickbench_q21/datafusion:parquet 628150860 623902836 1.01
clickbench_q22/datafusion:parquet 910300630 911341592 1.00
clickbench_q23/datafusion:parquet 3989572713 4031776126 0.99
clickbench_q24/datafusion:parquet 53466091 55167277 0.97
clickbench_q25/datafusion:parquet 126081335 127398379 0.99
clickbench_q26/datafusion:parquet 53913258 52047607 1.04
clickbench_q27/datafusion:parquet 646236867 648798974 1.00
clickbench_q28/datafusion:parquet 2427578908 2464350820 0.99
clickbench_q29/datafusion:parquet 🚨 51797575 43397385 1.19
clickbench_q30/datafusion:parquet 318773387 313634207 1.02
clickbench_q31/datafusion:parquet 350344766 341887376 1.02
clickbench_q32/datafusion:parquet 1063929125 1061991958 1.00
clickbench_q33/datafusion:parquet 1480401457 1489547165 0.99
clickbench_q34/datafusion:parquet 1479387197 1503348734 0.98
clickbench_q35/datafusion:parquet 235600438 246422335 0.96
clickbench_q36/datafusion:parquet 103627721 104377788 0.99
clickbench_q37/datafusion:parquet 43814674 42834832 1.02
clickbench_q38/datafusion:parquet 59026380 60664885 0.97
clickbench_q39/datafusion:parquet 209146567 204065800 1.02
clickbench_q40/datafusion:parquet 21588570 22944836 0.94
clickbench_q41/datafusion:parquet 20532947 21945231 0.94
clickbench_q42/datafusion:parquet 21614183 21901188 0.99
duckdb / vortex-file-compressed (0.992x ➖, 3↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 9834878 10088013 0.97
clickbench_q01/duckdb:vortex-file-compressed 16038295 15719738 1.02
clickbench_q02/duckdb:vortex-file-compressed 20472896 20936333 0.98
clickbench_q03/duckdb:vortex-file-compressed 26493894 25953527 1.02
clickbench_q04/duckdb:vortex-file-compressed 199308537 202073749 0.99
clickbench_q05/duckdb:vortex-file-compressed 184196788 180863742 1.02
clickbench_q06/duckdb:vortex-file-compressed 19332810 18283594 1.06
clickbench_q07/duckdb:vortex-file-compressed 20317306 20220017 1.00
clickbench_q08/duckdb:vortex-file-compressed 265210257 266430936 1.00
clickbench_q09/duckdb:vortex-file-compressed 349618113 351452809 0.99
clickbench_q10/duckdb:vortex-file-compressed 73197390 74678302 0.98
clickbench_q11/duckdb:vortex-file-compressed 82984587 84952915 0.98
clickbench_q12/duckdb:vortex-file-compressed 202879388 212157666 0.96
clickbench_q13/duckdb:vortex-file-compressed 415312880 415468287 1.00
clickbench_q14/duckdb:vortex-file-compressed 240814002 249390462 0.97
clickbench_q15/duckdb:vortex-file-compressed 255386373 256162139 1.00
clickbench_q16/duckdb:vortex-file-compressed 547454448 544143667 1.01
clickbench_q17/duckdb:vortex-file-compressed 451326597 430527362 1.05
clickbench_q18/duckdb:vortex-file-compressed 943573388 953648974 0.99
clickbench_q19/duckdb:vortex-file-compressed 19356691 20659355 0.94
clickbench_q20/duckdb:vortex-file-compressed 246946852 254616453 0.97
clickbench_q21/duckdb:vortex-file-compressed 332052531 328995703 1.01
clickbench_q22/duckdb:vortex-file-compressed 478334451 482313695 0.99
clickbench_q23/duckdb:vortex-file-compressed 🚀 154375758 183788042 0.84
clickbench_q24/duckdb:vortex-file-compressed 🚀 35758197 39772271 0.90
clickbench_q25/duckdb:vortex-file-compressed 81847137 79578207 1.03
clickbench_q26/duckdb:vortex-file-compressed 🚀 45229408 51251512 0.88
clickbench_q27/duckdb:vortex-file-compressed 221542075 222561052 1.00
clickbench_q28/duckdb:vortex-file-compressed 3066021693 3032520053 1.01
clickbench_q29/duckdb:vortex-file-compressed 26247684 28324319 0.93
clickbench_q30/duckdb:vortex-file-compressed 194789018 202343183 0.96
clickbench_q31/duckdb:vortex-file-compressed 289070867 301195987 0.96
clickbench_q32/duckdb:vortex-file-compressed 1133966022 1127625166 1.01
clickbench_q33/duckdb:vortex-file-compressed 1078244513 1106889551 0.97
clickbench_q34/duckdb:vortex-file-compressed 1187382763 1189832909 1.00
clickbench_q35/duckdb:vortex-file-compressed 376252070 371478864 1.01
clickbench_q36/duckdb:vortex-file-compressed 31528368 28744152 1.10
clickbench_q37/duckdb:vortex-file-compressed 21628796 21473092 1.01
clickbench_q38/duckdb:vortex-file-compressed 23564595 23329262 1.01
clickbench_q39/duckdb:vortex-file-compressed 46674052 44619700 1.05
clickbench_q40/duckdb:vortex-file-compressed 21981315 20401058 1.08
clickbench_q41/duckdb:vortex-file-compressed 21020456 19646450 1.07
clickbench_q42/duckdb:vortex-file-compressed 22031622 21801832 1.01
duckdb / parquet (1.000x ➖, 0↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 23500896 24487846 0.96
clickbench_q01/duckdb:parquet 30522556 30863036 0.99
clickbench_q02/duckdb:parquet 50898733 50895222 1.00
clickbench_q03/duckdb:parquet 41092251 40150012 1.02
clickbench_q04/duckdb:parquet 211865223 206334653 1.03
clickbench_q05/duckdb:parquet 262690981 262246142 1.00
clickbench_q06/duckdb:parquet 47547294 48689469 0.98
clickbench_q07/duckdb:parquet 32532980 32722579 0.99
clickbench_q08/duckdb:parquet 276738430 274539087 1.01
clickbench_q09/duckdb:parquet 401172790 406178136 0.99
clickbench_q10/duckdb:parquet 85529224 84855628 1.01
clickbench_q11/duckdb:parquet 102215861 101731529 1.00
clickbench_q12/duckdb:parquet 281309700 285442237 0.99
clickbench_q13/duckdb:parquet 471220767 476757231 0.99
clickbench_q14/duckdb:parquet 317027574 319413273 0.99
clickbench_q15/duckdb:parquet 262871473 258003243 1.02
clickbench_q16/duckdb:parquet 599756323 603544585 0.99
clickbench_q17/duckdb:parquet 504308237 506086017 1.00
clickbench_q18/duckdb:parquet 1032138890 1039062911 0.99
clickbench_q19/duckdb:parquet 28631770 28825689 0.99
clickbench_q20/duckdb:parquet 416888506 416489071 1.00
clickbench_q21/duckdb:parquet 539096437 538177217 1.00
clickbench_q22/duckdb:parquet 915714532 931167398 0.98
clickbench_q23/duckdb:parquet 270156662 266238867 1.01
clickbench_q24/duckdb:parquet 73889275 73418948 1.01
clickbench_q25/duckdb:parquet 165550531 165202925 1.00
clickbench_q26/duckdb:parquet 57492555 56909075 1.01
clickbench_q27/duckdb:parquet 479217464 475621819 1.01
clickbench_q28/duckdb:parquet 4799014759 4790778841 1.00
clickbench_q29/duckdb:parquet 44121686 44097801 1.00
clickbench_q30/duckdb:parquet 315057149 311853882 1.01
clickbench_q31/duckdb:parquet 379794708 386621035 0.98
clickbench_q32/duckdb:parquet 1118525671 1114525384 1.00
clickbench_q33/duckdb:parquet 1107691481 1105981705 1.00
clickbench_q34/duckdb:parquet 1150772340 1158541464 0.99
clickbench_q35/duckdb:parquet 371049802 369774997 1.00
clickbench_q36/duckdb:parquet 50486297 48871192 1.03
clickbench_q37/duckdb:parquet 34590565 34334676 1.01
clickbench_q38/duckdb:parquet 38410308 37706252 1.02
clickbench_q39/duckdb:parquet 85779364 80032641 1.07
clickbench_q40/duckdb:parquet 20665374 22173931 0.93
clickbench_q41/duckdb:parquet 21309261 20976541 1.02
clickbench_q42/duckdb:parquet 23822674 24873844 0.96
File Size Changes (101 files changed, -39.2% overall, 0↑ 101↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_0.vortex 1.0 vortex-compact 58.88 MB 0 B 58.88 MB -100.0%
hits_1.vortex 1.0 vortex-compact 90.67 MB 0 B 90.67 MB -100.0%
hits_10.vortex 1.0 vortex-compact 49.48 MB 0 B 49.48 MB -100.0%
hits_11.vortex 1.0 vortex-compact 56.11 MB 0 B 56.11 MB -100.0%
hits_12.vortex 1.0 vortex-compact 69.86 MB 0 B 69.86 MB -100.0%
hits_13.vortex 1.0 vortex-compact 69.24 MB 0 B 69.24 MB -100.0%
hits_14.vortex 1.0 vortex-compact 74.88 MB 0 B 74.88 MB -100.0%
hits_15.vortex 1.0 vortex-compact 48.41 MB 0 B 48.41 MB -100.0%
hits_16.vortex 1.0 vortex-compact 49.56 MB 0 B 49.56 MB -100.0%
hits_17.vortex 1.0 vortex-compact 58.79 MB 0 B 58.79 MB -100.0%
hits_18.vortex 1.0 vortex-compact 64.89 MB 0 B 64.89 MB -100.0%
hits_19.vortex 1.0 vortex-compact 49.73 MB 0 B 49.73 MB -100.0%
hits_2.vortex 1.0 vortex-compact 129.16 MB 0 B 129.16 MB -100.0%
hits_20.vortex 1.0 vortex-compact 38.36 MB 0 B 38.36 MB -100.0%
hits_21.vortex 1.0 vortex-compact 51.99 MB 0 B 51.99 MB -100.0%
hits_22.vortex 1.0 vortex-compact 46.22 MB 0 B 46.22 MB -100.0%
hits_23.vortex 1.0 vortex-compact 46.13 MB 0 B 46.13 MB -100.0%
hits_24.vortex 1.0 vortex-compact 45.11 MB 0 B 45.11 MB -100.0%
hits_25.vortex 1.0 vortex-compact 73.88 MB 0 B 73.88 MB -100.0%
hits_26.vortex 1.0 vortex-compact 71.99 MB 0 B 71.99 MB -100.0%
hits_27.vortex 1.0 vortex-compact 69.86 MB 0 B 69.86 MB -100.0%
hits_28.vortex 1.0 vortex-compact 70.92 MB 0 B 70.92 MB -100.0%
hits_29.vortex 1.0 vortex-compact 36.68 MB 0 B 36.68 MB -100.0%
hits_3.vortex 1.0 vortex-compact 95.12 MB 0 B 95.12 MB -100.0%
hits_30.vortex 1.0 vortex-compact 58.57 MB 0 B 58.57 MB -100.0%
hits_31.vortex 1.0 vortex-compact 55.77 MB 0 B 55.77 MB -100.0%
hits_32.vortex 1.0 vortex-compact 44.61 MB 0 B 44.61 MB -100.0%
hits_33.vortex 1.0 vortex-compact 35.92 MB 0 B 35.92 MB -100.0%
hits_34.vortex 1.0 vortex-compact 58.24 MB 0 B 58.24 MB -100.0%
hits_35.vortex 1.0 vortex-compact 75.53 MB 0 B 75.53 MB -100.0%
hits_36.vortex 1.0 vortex-compact 49.21 MB 0 B 49.21 MB -100.0%
hits_37.vortex 1.0 vortex-compact 54.76 MB 0 B 54.76 MB -100.0%
hits_38.vortex 1.0 vortex-compact 63.39 MB 0 B 63.39 MB -100.0%
hits_39.vortex 1.0 vortex-compact 50.10 MB 0 B 50.10 MB -100.0%
hits_4.vortex 1.0 vortex-compact 71.94 MB 0 B 71.94 MB -100.0%
hits_40.vortex 1.0 vortex-compact 77.42 MB 0 B 77.42 MB -100.0%
hits_41.vortex 1.0 vortex-compact 166.05 MB 0 B 166.05 MB -100.0%
hits_42.vortex 1.0 vortex-compact 164.53 MB 0 B 164.53 MB -100.0%
hits_43.vortex 1.0 vortex-compact 169.21 MB 0 B 169.21 MB -100.0%
hits_44.vortex 1.0 vortex-compact 133.26 MB 0 B 133.26 MB -100.0%
hits_45.vortex 1.0 vortex-compact 75.80 MB 0 B 75.80 MB -100.0%
hits_46.vortex 1.0 vortex-compact 42.27 MB 0 B 42.27 MB -100.0%
hits_47.vortex 1.0 vortex-compact 18.22 MB 0 B 18.22 MB -100.0%
hits_48.vortex 1.0 vortex-compact 17.85 MB 0 B 17.85 MB -100.0%
hits_49.vortex 1.0 vortex-compact 51.00 MB 0 B 51.00 MB -100.0%
hits_5.vortex 1.0 vortex-compact 63.33 MB 0 B 63.33 MB -100.0%
hits_50.vortex 1.0 vortex-compact 114.20 MB 0 B 114.20 MB -100.0%
hits_51.vortex 1.0 vortex-compact 168.34 MB 0 B 168.34 MB -100.0%
hits_52.vortex 1.0 vortex-compact 65.08 MB 0 B 65.08 MB -100.0%
hits_53.vortex 1.0 vortex-compact 60.05 MB 0 B 60.05 MB -100.0%
hits_54.vortex 1.0 vortex-compact 117.57 MB 0 B 117.57 MB -100.0%
hits_55.vortex 1.0 vortex-compact 92.56 MB 0 B 92.56 MB -100.0%
hits_56.vortex 1.0 vortex-compact 78.58 MB 0 B 78.58 MB -100.0%
hits_57.vortex 1.0 vortex-compact 83.73 MB 0 B 83.73 MB -100.0%
hits_58.vortex 1.0 vortex-compact 61.24 MB 0 B 61.24 MB -100.0%
hits_59.vortex 1.0 vortex-compact 66.68 MB 0 B 66.68 MB -100.0%
hits_6.vortex 1.0 vortex-compact 63.57 MB 0 B 63.57 MB -100.0%
hits_60.vortex 1.0 vortex-compact 64.92 MB 0 B 64.92 MB -100.0%
hits_61.vortex 1.0 vortex-compact 57.73 MB 0 B 57.73 MB -100.0%
hits_62.vortex 1.0 vortex-compact 75.45 MB 0 B 75.45 MB -100.0%
hits_63.vortex 1.0 vortex-compact 46.44 MB 0 B 46.44 MB -100.0%
hits_64.vortex 1.0 vortex-compact 54.09 MB 0 B 54.09 MB -100.0%
hits_65.vortex 1.0 vortex-compact 129.40 MB 0 B 129.40 MB -100.0%
hits_66.vortex 1.0 vortex-compact 53.52 MB 0 B 53.52 MB -100.0%
hits_67.vortex 1.0 vortex-compact 114.44 MB 0 B 114.44 MB -100.0%
hits_68.vortex 1.0 vortex-compact 76.67 MB 0 B 76.67 MB -100.0%
hits_69.vortex 1.0 vortex-compact 80.98 MB 0 B 80.98 MB -100.0%
hits_7.vortex 1.0 vortex-compact 64.19 MB 0 B 64.19 MB -100.0%
hits_70.vortex 1.0 vortex-compact 61.84 MB 0 B 61.84 MB -100.0%
hits_71.vortex 1.0 vortex-compact 69.96 MB 0 B 69.96 MB -100.0%
hits_72.vortex 1.0 vortex-compact 52.74 MB 0 B 52.74 MB -100.0%
hits_73.vortex 1.0 vortex-compact 71.07 MB 0 B 71.07 MB -100.0%
hits_74.vortex 1.0 vortex-compact 71.87 MB 0 B 71.87 MB -100.0%
hits_75.vortex 1.0 vortex-compact 45.12 MB 0 B 45.12 MB -100.0%
hits_76.vortex 1.0 vortex-compact 77.10 MB 0 B 77.10 MB -100.0%
hits_77.vortex 1.0 vortex-compact 118.50 MB 0 B 118.50 MB -100.0%
hits_78.vortex 1.0 vortex-compact 97.85 MB 0 B 97.85 MB -100.0%
hits_79.vortex 1.0 vortex-compact 86.17 MB 0 B 86.17 MB -100.0%
hits_8.vortex 1.0 vortex-compact 63.39 MB 0 B 63.39 MB -100.0%
hits_80.vortex 1.0 vortex-compact 68.67 MB 0 B 68.67 MB -100.0%
hits_81.vortex 1.0 vortex-compact 65.95 MB 0 B 65.95 MB -100.0%
hits_82.vortex 1.0 vortex-compact 67.43 MB 0 B 67.43 MB -100.0%
hits_83.vortex 1.0 vortex-compact 53.62 MB 0 B 53.62 MB -100.0%
hits_84.vortex 1.0 vortex-compact 74.35 MB 0 B 74.35 MB -100.0%
hits_85.vortex 1.0 vortex-compact 52.86 MB 0 B 52.86 MB -100.0%
hits_86.vortex 1.0 vortex-compact 49.12 MB 0 B 49.12 MB -100.0%
hits_87.vortex 1.0 vortex-compact 118.86 MB 0 B 118.86 MB -100.0%
hits_88.vortex 1.0 vortex-compact 73.58 MB 0 B 73.58 MB -100.0%
hits_89.vortex 1.0 vortex-compact 114.10 MB 0 B 114.10 MB -100.0%
hits_9.vortex 1.0 vortex-compact 66.32 MB 0 B 66.32 MB -100.0%
hits_90.vortex 1.0 vortex-compact 82.09 MB 0 B 82.09 MB -100.0%
hits_91.vortex 1.0 vortex-compact 61.24 MB 0 B 61.24 MB -100.0%
hits_92.vortex 1.0 vortex-compact 94.40 MB 0 B 94.40 MB -100.0%
hits_93.vortex 1.0 vortex-compact 59.92 MB 0 B 59.92 MB -100.0%
hits_94.vortex 1.0 vortex-compact 90.90 MB 0 B 90.90 MB -100.0%
hits_95.vortex 1.0 vortex-compact 58.20 MB 0 B 58.20 MB -100.0%
hits_96.vortex 1.0 vortex-compact 91.73 MB 0 B 91.73 MB -100.0%
hits_97.vortex 1.0 vortex-compact 69.58 MB 0 B 69.58 MB -100.0%
hits_98.vortex 1.0 vortex-compact 73.15 MB 0 B 73.15 MB -100.0%
hits_99.vortex 1.0 vortex-compact 77.65 MB 0 B 77.65 MB -100.0%

Totals:

  • vortex-compact: 7.11 GB → 0 B (-100.0%)
  • vortex-file-compressed: 11.04 GB → 11.04 GB (0.0%)

@github-actions

github-actions Bot commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +11.4%
Engines: DataFusion No clear signal (+10.9%, environment too noisy confidence) · DuckDB No clear signal (+11.8%, low confidence)
Vortex (geomean): 1.149x ➖
Parquet (geomean): 1.031x ➖
Shifts: Parquet (control) +3.1% · Median polish +7.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.149x ➖, 0↑ 1↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 37058339 29418677 1.26
fineweb_q01/datafusion:vortex-file-compressed 503902186 478867596 1.05
fineweb_q02/datafusion:vortex-file-compressed 🚨 643014436 473514013 1.36
fineweb_q03/datafusion:vortex-file-compressed 1280908416 1104690675 1.16
fineweb_q04/datafusion:vortex-file-compressed 1386450944 1164929392 1.19
fineweb_q05/datafusion:vortex-file-compressed 1201802045 1091675193 1.10
fineweb_q06/datafusion:vortex-file-compressed 1337539908 1254852726 1.07
fineweb_q07/datafusion:vortex-file-compressed 1293054491 1141134554 1.13
fineweb_q08/datafusion:vortex-file-compressed 477749550 451629275 1.06
datafusion / parquet (1.036x ➖, 0↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 997795407 1057966186 0.94
fineweb_q01/datafusion:parquet 1668951037 1749355024 0.95
fineweb_q02/datafusion:parquet 1838412691 1751035696 1.05
fineweb_q03/datafusion:parquet 1713896474 1628003946 1.05
fineweb_q04/datafusion:parquet 1807317737 1759622418 1.03
fineweb_q05/datafusion:parquet 1749644364 1735860102 1.01
fineweb_q06/datafusion:parquet 1815568666 1841112018 0.99
fineweb_q07/datafusion:parquet 1961608954 1767695957 1.11
fineweb_q08/datafusion:parquet 1988159194 1632936974 1.22
duckdb / vortex-file-compressed (1.148x ➖, 0↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 76607900 74593249 1.03
fineweb_q01/duckdb:vortex-file-compressed 595779131 543898785 1.10
fineweb_q02/duckdb:vortex-file-compressed 540892624 519831482 1.04
fineweb_q03/duckdb:vortex-file-compressed 1697228482 1368419306 1.24
fineweb_q04/duckdb:vortex-file-compressed 1827193224 1532228991 1.19
fineweb_q05/duckdb:vortex-file-compressed 1626122190 1404194992 1.16
fineweb_q06/duckdb:vortex-file-compressed 1748005615 1500649169 1.16
fineweb_q07/duckdb:vortex-file-compressed 1625416412 1309176138 1.24
fineweb_q08/duckdb:vortex-file-compressed 691921544 578923638 1.20
duckdb / parquet (1.026x ➖, 0↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1056431857 1045191799 1.01
fineweb_q01/duckdb:parquet 1335162837 1337605920 1.00
fineweb_q02/duckdb:parquet 1331673664 1279032185 1.04
fineweb_q03/duckdb:parquet 3584359686 3553029257 1.01
fineweb_q04/duckdb:parquet 1883821374 1819520937 1.04
fineweb_q05/duckdb:parquet 2151527809 2087802377 1.03
fineweb_q06/duckdb:parquet 4280943633 4194469187 1.02
fineweb_q07/duckdb:parquet 2686057561 2486405913 1.08
fineweb_q08/duckdb:parquet 1104256068 1088291520 1.01

@github-actions

github-actions Bot commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.5%
Engines: DuckDB No clear signal (-3.5%, low confidence)
Vortex (geomean): 0.985x ➖
Parquet (geomean): 1.021x ➖
Shifts: Parquet (control) +2.1% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (0.985x ➖, 0↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12420481 12335520 1.01
statpopgen_q01/duckdb:vortex-file-compressed 26672974 26324818 1.01
statpopgen_q02/duckdb:vortex-file-compressed 520024532 524157518 0.99
statpopgen_q03/duckdb:vortex-file-compressed 1045188134 1025220466 1.02
statpopgen_q04/duckdb:vortex-file-compressed 1029315111 1045844168 0.98
statpopgen_q05/duckdb:vortex-file-compressed 476840353 477726421 1.00
statpopgen_q06/duckdb:vortex-file-compressed 1497313490 1512069762 0.99
statpopgen_q07/duckdb:vortex-file-compressed 181427461 198465185 0.91
statpopgen_q08/duckdb:vortex-file-compressed 204217110 222470743 0.92
statpopgen_q09/duckdb:vortex-file-compressed 816494065 818524214 1.00
statpopgen_q10/duckdb:vortex-file-compressed 2545479582 2539218255 1.00
duckdb / parquet (1.021x ➖, 0↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 346542491 340315894 1.02
statpopgen_q01/duckdb:parquet 432539505 416255286 1.04
statpopgen_q02/duckdb:parquet 812566517 802384872 1.01
statpopgen_q03/duckdb:parquet 1236599626 1212683833 1.02
statpopgen_q04/duckdb:parquet 1226016255 1226019489 1.00
statpopgen_q05/duckdb:parquet 857309692 838449204 1.02
statpopgen_q06/duckdb:parquet 1476328948 1438837118 1.03
statpopgen_q07/duckdb:parquet 915883784 863960655 1.06
statpopgen_q08/duckdb:parquet 923961199 905142915 1.02
statpopgen_q09/duckdb:parquet 1058229162 1047063964 1.01
statpopgen_q10/duckdb:parquet 2281628864 2288079779 1.00
File Size Changes (2 files changed, -32.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 100000 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 960.66 MB 0 B 960.66 MB -100.0%

Totals:

  • vortex-compact: 960.92 MB → 0 B (-100.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (0.0%)

@github-actions

github-actions Bot commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.7%
Engines: DataFusion No clear signal (-4.0%, environment too noisy confidence) · DuckDB No clear signal (-1.4%, low confidence)
Vortex (geomean): 0.973x ➖
Parquet (geomean): 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish -1.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.952x ➖, 1↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-file-compressed 432155893 461570384 0.94
clickbench-sorted_q24/datafusion:vortex-file-compressed 🚀 21708831 24873577 0.87
clickbench-sorted_q26/datafusion:vortex-file-compressed 23357386 23689990 0.99
clickbench-sorted_q36/datafusion:vortex-file-compressed 56109189 57309784 0.98
clickbench-sorted_q37/datafusion:vortex-file-compressed 41780793 42430266 0.98
clickbench-sorted_q38/datafusion:vortex-file-compressed 41823585 42552267 0.98
clickbench-sorted_q39/datafusion:vortex-file-compressed 107886435 112017949 0.96
clickbench-sorted_q40/datafusion:vortex-file-compressed 19324626 20619567 0.94
clickbench-sorted_q41/datafusion:vortex-file-compressed 18682974 20171270 0.93
clickbench-sorted_q42/datafusion:vortex-file-compressed 14047782 14713220 0.95
datafusion / parquet (0.992x ➖, 0↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet 4613622726 4745458448 0.97
clickbench-sorted_q24/datafusion:parquet 28525281 30661213 0.93
clickbench-sorted_q26/datafusion:parquet 27093046 29326778 0.92
clickbench-sorted_q36/datafusion:parquet 182052543 174667167 1.04
clickbench-sorted_q37/datafusion:parquet 115069750 105223627 1.09
clickbench-sorted_q38/datafusion:parquet 160231134 159856627 1.00
clickbench-sorted_q39/datafusion:parquet 291800897 291021834 1.00
clickbench-sorted_q40/datafusion:parquet 70906914 73604529 0.96
clickbench-sorted_q41/datafusion:parquet 59915879 61656139 0.97
clickbench-sorted_q42/datafusion:parquet 32418611 31595233 1.03
duckdb / vortex-file-compressed (0.996x ➖, 0↑ 2↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-file-compressed 164493256 178944565 0.92
clickbench-sorted_q24/duckdb:vortex-file-compressed 🚨 28837007 26070269 1.11
clickbench-sorted_q26/duckdb:vortex-file-compressed 🚨 46140567 39505058 1.17
clickbench-sorted_q36/duckdb:vortex-file-compressed 57068046 61280314 0.93
clickbench-sorted_q37/duckdb:vortex-file-compressed 44435822 46486542 0.96
clickbench-sorted_q38/duckdb:vortex-file-compressed 49933408 50484034 0.99
clickbench-sorted_q39/duckdb:vortex-file-compressed 103800225 114700339 0.90
clickbench-sorted_q40/duckdb:vortex-file-compressed 29620756 28095523 1.05
clickbench-sorted_q41/duckdb:vortex-file-compressed 27975013 27923020 1.00
clickbench-sorted_q42/duckdb:vortex-file-compressed 24120101 25145617 0.96
duckdb / parquet (1.010x ➖, 0↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet 194694969 198182031 0.98
clickbench-sorted_q24/duckdb:parquet 28093887 28361083 0.99
clickbench-sorted_q26/duckdb:parquet 25382915 24748473 1.03
clickbench-sorted_q36/duckdb:parquet 109352803 105674778 1.03
clickbench-sorted_q37/duckdb:parquet 94434120 94075074 1.00
clickbench-sorted_q38/duckdb:parquet 94986054 95039944 1.00
clickbench-sorted_q39/duckdb:parquet 180689134 181963309 0.99
clickbench-sorted_q40/duckdb:parquet 41703801 43336980 0.96
clickbench-sorted_q41/duckdb:parquet 42564124 41698704 1.02
clickbench-sorted_q42/duckdb:parquet 32491222 29825655 1.09
File Size Changes (201 files changed, -42.8% overall, 61↑ 140↓)
File Scale Format Base HEAD Change %
hits_075.vortex 1.0 vortex-file-compressed 189.60 MB 191.72 MB +2.13 MB +1.1%
hits_090.vortex 1.0 vortex-file-compressed 192.58 MB 194.41 MB +1.83 MB +1.0%
hits_033.vortex 1.0 vortex-file-compressed 198.72 MB 200.52 MB +1.80 MB +0.9%
hits_073.vortex 1.0 vortex-file-compressed 172.61 MB 173.83 MB +1.22 MB +0.7%
hits_040.vortex 1.0 vortex-file-compressed 142.96 MB 143.81 MB +866.05 KB +0.6%
hits_007.vortex 1.0 vortex-file-compressed 198.97 MB 200.14 MB +1.17 MB +0.6%
hits_003.vortex 1.0 vortex-file-compressed 136.54 MB 137.27 MB +743.74 KB +0.5%
hits_002.vortex 1.0 vortex-file-compressed 161.06 MB 161.71 MB +660.62 KB +0.4%
hits_085.vortex 1.0 vortex-file-compressed 199.56 MB 200.26 MB +714.95 KB +0.3%
hits_036.vortex 1.0 vortex-file-compressed 171.34 MB 171.86 MB +529.43 KB +0.3%
hits_071.vortex 1.0 vortex-file-compressed 140.13 MB 140.54 MB +424.00 KB +0.3%
hits_055.vortex 1.0 vortex-file-compressed 199.29 MB 199.85 MB +578.51 KB +0.3%
hits_070.vortex 1.0 vortex-file-compressed 198.38 MB 198.93 MB +563.89 KB +0.3%
hits_039.vortex 1.0 vortex-file-compressed 161.11 MB 161.55 MB +455.66 KB +0.3%
hits_011.vortex 1.0 vortex-file-compressed 199.19 MB 199.74 MB +563.04 KB +0.3%
hits_044.vortex 1.0 vortex-file-compressed 199.99 MB 200.53 MB +547.66 KB +0.3%
hits_052.vortex 1.0 vortex-file-compressed 130.86 MB 131.17 MB +316.21 KB +0.2%
hits_097.vortex 1.0 vortex-file-compressed 192.75 MB 193.15 MB +402.91 KB +0.2%
hits_008.vortex 1.0 vortex-file-compressed 140.07 MB 140.33 MB +272.12 KB +0.2%
hits_072.vortex 1.0 vortex-file-compressed 102.19 MB 102.34 MB +158.67 KB +0.2%
hits_035.vortex 1.0 vortex-file-compressed 102.59 MB 102.73 MB +149.80 KB +0.1%
hits_083.vortex 1.0 vortex-file-compressed 157.04 MB 157.26 MB +225.56 KB +0.1%
hits_063.vortex 1.0 vortex-file-compressed 131.80 MB 131.98 MB +184.29 KB +0.1%
hits_000.vortex 1.0 vortex-file-compressed 131.69 MB 131.87 MB +179.74 KB +0.1%
hits_005.vortex 1.0 vortex-file-compressed 167.52 MB 167.74 MB +226.68 KB +0.1%
hits_038.vortex 1.0 vortex-file-compressed 190.08 MB 190.28 MB +203.73 KB +0.1%
hits_010.vortex 1.0 vortex-file-compressed 168.99 MB 169.16 MB +173.48 KB +0.1%
hits_004.vortex 1.0 vortex-file-compressed 131.50 MB 131.63 MB +128.07 KB +0.1%
hits_037.vortex 1.0 vortex-file-compressed 177.16 MB 177.33 MB +172.29 KB +0.1%
hits_023.vortex 1.0 vortex-file-compressed 195.31 MB 195.49 MB +184.84 KB +0.1%
hits_089.vortex 1.0 vortex-file-compressed 131.52 MB 131.64 MB +117.41 KB +0.1%
hits_032.vortex 1.0 vortex-file-compressed 154.68 MB 154.81 MB +134.52 KB +0.1%
hits_068.vortex 1.0 vortex-file-compressed 160.80 MB 160.94 MB +137.37 KB +0.1%
hits_061.vortex 1.0 vortex-file-compressed 160.79 MB 160.91 MB +130.52 KB +0.1%
hits_067.vortex 1.0 vortex-file-compressed 131.77 MB 131.87 MB +104.34 KB +0.1%
hits_029.vortex 1.0 vortex-file-compressed 199.85 MB 200.00 MB +154.20 KB +0.1%
hits_062.vortex 1.0 vortex-file-compressed 170.61 MB 170.74 MB +128.76 KB +0.1%
hits_057.vortex 1.0 vortex-file-compressed 159.97 MB 160.07 MB +108.66 KB +0.1%
hits_019.vortex 1.0 vortex-file-compressed 140.86 MB 140.94 MB +86.98 KB +0.1%
hits_074.vortex 1.0 vortex-file-compressed 199.08 MB 199.20 MB +121.65 KB +0.1%
hits_059.vortex 1.0 vortex-file-compressed 199.10 MB 199.22 MB +121.16 KB +0.1%
hits_013.vortex 1.0 vortex-file-compressed 161.25 MB 161.34 MB +93.26 KB +0.1%
hits_034.vortex 1.0 vortex-file-compressed 181.98 MB 182.08 MB +104.80 KB +0.1%
hits_016.vortex 1.0 vortex-file-compressed 180.20 MB 180.30 MB +99.26 KB +0.1%
hits_031.vortex 1.0 vortex-file-compressed 160.21 MB 160.29 MB +83.41 KB +0.1%
hits_051.vortex 1.0 vortex-file-compressed 173.02 MB 173.11 MB +87.18 KB +0.0%
hits_012.vortex 1.0 vortex-file-compressed 190.80 MB 190.89 MB +95.21 KB +0.0%
hits_024.vortex 1.0 vortex-file-compressed 160.49 MB 160.56 MB +73.41 KB +0.0%
hits_047.vortex 1.0 vortex-file-compressed 154.49 MB 154.56 MB +70.63 KB +0.0%
hits_050.vortex 1.0 vortex-file-compressed 161.10 MB 161.16 MB +63.17 KB +0.0%
hits_026.vortex 1.0 vortex-file-compressed 131.41 MB 131.46 MB +48.35 KB +0.0%
hits_099.vortex 1.0 vortex-file-compressed 171.26 MB 171.31 MB +55.77 KB +0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.51 MB 126.53 MB +24.66 KB +0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.86 MB 126.88 MB +21.23 KB +0.0%
hits_092.vortex 1.0 vortex-file-compressed 199.60 MB 199.62 MB +19.52 KB +0.0%
hits_009.vortex 1.0 vortex-file-compressed 101.41 MB 101.42 MB +9.38 KB +0.0%
hits_022.vortex 1.0 vortex-file-compressed 199.19 MB 199.21 MB +17.89 KB +0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.36 MB 126.37 MB +11.20 KB +0.0%
hits_046.vortex 1.0 vortex-file-compressed 101.28 MB 101.29 MB +7.98 KB +0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.95 MB 131.96 MB +3.24 KB +0.0%
hits_021.vortex 1.0 vortex-file-compressed 154.48 MB 154.48 MB +1.69 KB +0.0%
hits_049.vortex 1.0 vortex-file-compressed 191.51 MB 191.51 MB 8.99 KB -0.0%
hits_078.vortex 1.0 vortex-file-compressed 130.91 MB 130.89 MB 19.81 KB -0.0%
hits_014.vortex 1.0 vortex-file-compressed 172.10 MB 172.07 MB 33.46 KB -0.0%
hits_066.vortex 1.0 vortex-file-compressed 163.19 MB 163.16 MB 34.24 KB -0.0%
hits_018.vortex 1.0 vortex-file-compressed 199.71 MB 199.65 MB 53.67 KB -0.0%
hits_069.vortex 1.0 vortex-file-compressed 142.24 MB 142.21 MB 38.38 KB -0.0%
hits_082.vortex 1.0 vortex-file-compressed 139.98 MB 139.95 MB 37.98 KB -0.0%
hits_096.vortex 1.0 vortex-file-compressed 199.46 MB 199.40 MB 64.23 KB -0.0%
hits_060.vortex 1.0 vortex-file-compressed 193.35 MB 193.28 MB 69.38 KB -0.0%
hits_015.vortex 1.0 vortex-file-compressed 131.29 MB 131.24 MB 50.43 KB -0.0%
hits_056.vortex 1.0 vortex-file-compressed 135.76 MB 135.70 MB 59.20 KB -0.0%
hits_048.vortex 1.0 vortex-file-compressed 199.48 MB 199.39 MB 87.28 KB -0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.12 MB 147.06 MB 66.59 KB -0.0%
hits_042.vortex 1.0 vortex-file-compressed 202.10 MB 202.00 MB 95.27 KB -0.0%
hits_087.vortex 1.0 vortex-file-compressed 161.15 MB 161.04 MB 115.66 KB -0.1%
hits_077.vortex 1.0 vortex-file-compressed 172.57 MB 172.43 MB 139.73 KB -0.1%
hits_086.vortex 1.0 vortex-file-compressed 192.37 MB 192.21 MB 169.58 KB -0.1%
hits_041.vortex 1.0 vortex-file-compressed 131.45 MB 131.34 MB 118.98 KB -0.1%
hits_098.vortex 1.0 vortex-file-compressed 137.73 MB 137.54 MB 195.47 KB -0.1%
hits_081.vortex 1.0 vortex-file-compressed 200.40 MB 200.07 MB 336.42 KB -0.2%
hits_028.vortex 1.0 vortex-file-compressed 152.03 MB 151.76 MB 278.73 KB -0.2%
hits_095.vortex 1.0 vortex-file-compressed 154.71 MB 154.41 MB 305.18 KB -0.2%
hits_020.vortex 1.0 vortex-file-compressed 160.80 MB 160.46 MB 356.38 KB -0.2%
hits_058.vortex 1.0 vortex-file-compressed 155.52 MB 155.14 MB 388.16 KB -0.2%
hits_076.vortex 1.0 vortex-file-compressed 161.41 MB 160.96 MB 457.65 KB -0.3%
hits_017.vortex 1.0 vortex-file-compressed 147.27 MB 146.84 MB 440.37 KB -0.3%
hits_084.vortex 1.0 vortex-file-compressed 155.00 MB 154.51 MB 505.14 KB -0.3%
hits_025.vortex 1.0 vortex-file-compressed 172.50 MB 171.95 MB 562.87 KB -0.3%
hits_093.vortex 1.0 vortex-file-compressed 132.12 MB 131.68 MB 442.77 KB -0.3%
hits_094.vortex 1.0 vortex-file-compressed 159.49 MB 158.89 MB 608.90 KB -0.4%
hits_045.vortex 1.0 vortex-file-compressed 140.63 MB 140.07 MB 575.02 KB -0.4%
hits_054.vortex 1.0 vortex-file-compressed 147.84 MB 147.01 MB 849.82 KB -0.6%
hits_088.vortex 1.0 vortex-file-compressed 172.99 MB 171.92 MB 1.07 MB -0.6%
hits_079.vortex 1.0 vortex-file-compressed 182.46 MB 181.07 MB 1.39 MB -0.8%
hits_065.vortex 1.0 vortex-file-compressed 161.20 MB 159.83 MB 1.37 MB -0.9%
hits_027.vortex 1.0 vortex-file-compressed 191.65 MB 190.01 MB 1.64 MB -0.9%
hits_053.vortex 1.0 vortex-file-compressed 192.07 MB 190.22 MB 1.86 MB -1.0%
hits_064.vortex 1.0 vortex-file-compressed 193.02 MB 190.89 MB 2.13 MB -1.1%
hits_001.vortex 1.0 vortex-file-compressed 193.85 MB 191.02 MB 2.83 MB -1.5%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_000.vortex 1.0 vortex-compact 99.07 MB 0 B 99.07 MB -100.0%
hits_001.vortex 1.0 vortex-compact 140.48 MB 0 B 140.48 MB -100.0%
hits_002.vortex 1.0 vortex-compact 124.18 MB 0 B 124.18 MB -100.0%
hits_003.vortex 1.0 vortex-compact 104.54 MB 0 B 104.54 MB -100.0%
hits_004.vortex 1.0 vortex-compact 98.44 MB 0 B 98.44 MB -100.0%
hits_005.vortex 1.0 vortex-compact 115.84 MB 0 B 115.84 MB -100.0%
hits_006.vortex 1.0 vortex-compact 95.46 MB 0 B 95.46 MB -100.0%
hits_007.vortex 1.0 vortex-compact 153.71 MB 0 B 153.71 MB -100.0%
hits_008.vortex 1.0 vortex-compact 106.12 MB 0 B 106.12 MB -100.0%
hits_009.vortex 1.0 vortex-compact 75.24 MB 0 B 75.24 MB -100.0%
hits_010.vortex 1.0 vortex-compact 123.10 MB 0 B 123.10 MB -100.0%
hits_011.vortex 1.0 vortex-compact 152.79 MB 0 B 152.79 MB -100.0%
hits_012.vortex 1.0 vortex-compact 138.74 MB 0 B 138.74 MB -100.0%
hits_013.vortex 1.0 vortex-compact 124.47 MB 0 B 124.47 MB -100.0%
hits_014.vortex 1.0 vortex-compact 133.73 MB 0 B 133.73 MB -100.0%
hits_015.vortex 1.0 vortex-compact 98.13 MB 0 B 98.13 MB -100.0%
hits_016.vortex 1.0 vortex-compact 127.62 MB 0 B 127.62 MB -100.0%
hits_017.vortex 1.0 vortex-compact 112.40 MB 0 B 112.40 MB -100.0%
hits_018.vortex 1.0 vortex-compact 153.85 MB 0 B 153.85 MB -100.0%
hits_019.vortex 1.0 vortex-compact 106.59 MB 0 B 106.59 MB -100.0%
hits_020.vortex 1.0 vortex-compact 111.63 MB 0 B 111.63 MB -100.0%
hits_021.vortex 1.0 vortex-compact 110.64 MB 0 B 110.64 MB -100.0%
hits_022.vortex 1.0 vortex-compact 153.12 MB 0 B 153.12 MB -100.0%
hits_023.vortex 1.0 vortex-compact 142.62 MB 0 B 142.62 MB -100.0%
hits_024.vortex 1.0 vortex-compact 125.12 MB 0 B 125.12 MB -100.0%
hits_025.vortex 1.0 vortex-compact 133.49 MB 0 B 133.49 MB -100.0%
hits_026.vortex 1.0 vortex-compact 97.90 MB 0 B 97.90 MB -100.0%
hits_027.vortex 1.0 vortex-compact 139.40 MB 0 B 139.40 MB -100.0%
hits_028.vortex 1.0 vortex-compact 115.91 MB 0 B 115.91 MB -100.0%
hits_029.vortex 1.0 vortex-compact 153.57 MB 0 B 153.57 MB -100.0%
hits_030.vortex 1.0 vortex-compact 97.99 MB 0 B 97.99 MB -100.0%
hits_031.vortex 1.0 vortex-compact 111.43 MB 0 B 111.43 MB -100.0%
hits_032.vortex 1.0 vortex-compact 110.63 MB 0 B 110.63 MB -100.0%
hits_033.vortex 1.0 vortex-compact 153.22 MB 0 B 153.22 MB -100.0%
hits_034.vortex 1.0 vortex-compact 133.47 MB 0 B 133.47 MB -100.0%
hits_035.vortex 1.0 vortex-compact 75.94 MB 0 B 75.94 MB -100.0%
hits_036.vortex 1.0 vortex-compact 133.28 MB 0 B 133.28 MB -100.0%
hits_037.vortex 1.0 vortex-compact 132.24 MB 0 B 132.24 MB -100.0%
hits_038.vortex 1.0 vortex-compact 139.55 MB 0 B 139.55 MB -100.0%
hits_039.vortex 1.0 vortex-compact 124.94 MB 0 B 124.94 MB -100.0%
hits_040.vortex 1.0 vortex-compact 110.05 MB 0 B 110.05 MB -100.0%
hits_041.vortex 1.0 vortex-compact 98.26 MB 0 B 98.26 MB -100.0%
hits_042.vortex 1.0 vortex-compact 136.27 MB 0 B 136.27 MB -100.0%
hits_043.vortex 1.0 vortex-compact 94.06 MB 0 B 94.06 MB -100.0%
hits_044.vortex 1.0 vortex-compact 153.74 MB 0 B 153.74 MB -100.0%
hits_045.vortex 1.0 vortex-compact 106.06 MB 0 B 106.06 MB -100.0%
hits_046.vortex 1.0 vortex-compact 74.91 MB 0 B 74.91 MB -100.0%
hits_047.vortex 1.0 vortex-compact 110.49 MB 0 B 110.49 MB -100.0%
hits_048.vortex 1.0 vortex-compact 153.20 MB 0 B 153.20 MB -100.0%
hits_049.vortex 1.0 vortex-compact 139.32 MB 0 B 139.32 MB -100.0%
hits_050.vortex 1.0 vortex-compact 125.13 MB 0 B 125.13 MB -100.0%
hits_051.vortex 1.0 vortex-compact 133.94 MB 0 B 133.94 MB -100.0%
hits_052.vortex 1.0 vortex-compact 97.92 MB 0 B 97.92 MB -100.0%
hits_053.vortex 1.0 vortex-compact 138.96 MB 0 B 138.96 MB -100.0%
hits_054.vortex 1.0 vortex-compact 112.03 MB 0 B 112.03 MB -100.0%
hits_055.vortex 1.0 vortex-compact 153.25 MB 0 B 153.25 MB -100.0%
hits_056.vortex 1.0 vortex-compact 101.40 MB 0 B 101.40 MB -100.0%
hits_057.vortex 1.0 vortex-compact 111.78 MB 0 B 111.78 MB -100.0%
hits_058.vortex 1.0 vortex-compact 111.06 MB 0 B 111.06 MB -100.0%
hits_059.vortex 1.0 vortex-compact 152.94 MB 0 B 152.94 MB -100.0%
hits_060.vortex 1.0 vortex-compact 139.92 MB 0 B 139.92 MB -100.0%
hits_061.vortex 1.0 vortex-compact 123.83 MB 0 B 123.83 MB -100.0%
hits_062.vortex 1.0 vortex-compact 132.65 MB 0 B 132.65 MB -100.0%
hits_063.vortex 1.0 vortex-compact 98.90 MB 0 B 98.90 MB -100.0%
hits_064.vortex 1.0 vortex-compact 140.34 MB 0 B 140.34 MB -100.0%
hits_065.vortex 1.0 vortex-compact 125.65 MB 0 B 125.65 MB -100.0%
hits_066.vortex 1.0 vortex-compact 117.69 MB 0 B 117.69 MB -100.0%
hits_067.vortex 1.0 vortex-compact 99.26 MB 0 B 99.26 MB -100.0%
hits_068.vortex 1.0 vortex-compact 112.46 MB 0 B 112.46 MB -100.0%
hits_069.vortex 1.0 vortex-compact 99.85 MB 0 B 99.85 MB -100.0%
hits_070.vortex 1.0 vortex-compact 153.65 MB 0 B 153.65 MB -100.0%
hits_071.vortex 1.0 vortex-compact 106.19 MB 0 B 106.19 MB -100.0%
hits_072.vortex 1.0 vortex-compact 75.64 MB 0 B 75.64 MB -100.0%
hits_073.vortex 1.0 vortex-compact 134.21 MB 0 B 134.21 MB -100.0%
hits_074.vortex 1.0 vortex-compact 152.82 MB 0 B 152.82 MB -100.0%
hits_075.vortex 1.0 vortex-compact 137.86 MB 0 B 137.86 MB -100.0%
hits_076.vortex 1.0 vortex-compact 124.65 MB 0 B 124.65 MB -100.0%
hits_077.vortex 1.0 vortex-compact 134.44 MB 0 B 134.44 MB -100.0%
hits_078.vortex 1.0 vortex-compact 97.83 MB 0 B 97.83 MB -100.0%
hits_079.vortex 1.0 vortex-compact 128.20 MB 0 B 128.20 MB -100.0%
hits_080.vortex 1.0 vortex-compact 96.74 MB 0 B 96.74 MB -100.0%
hits_081.vortex 1.0 vortex-compact 153.84 MB 0 B 153.84 MB -100.0%
hits_082.vortex 1.0 vortex-compact 105.73 MB 0 B 105.73 MB -100.0%
hits_083.vortex 1.0 vortex-compact 110.06 MB 0 B 110.06 MB -100.0%
hits_084.vortex 1.0 vortex-compact 111.02 MB 0 B 111.02 MB -100.0%
hits_085.vortex 1.0 vortex-compact 153.20 MB 0 B 153.20 MB -100.0%
hits_086.vortex 1.0 vortex-compact 140.83 MB 0 B 140.83 MB -100.0%
hits_087.vortex 1.0 vortex-compact 123.82 MB 0 B 123.82 MB -100.0%
hits_088.vortex 1.0 vortex-compact 134.42 MB 0 B 134.42 MB -100.0%
hits_089.vortex 1.0 vortex-compact 98.92 MB 0 B 98.92 MB -100.0%
hits_090.vortex 1.0 vortex-compact 141.22 MB 0 B 141.22 MB -100.0%
hits_091.vortex 1.0 vortex-compact 112.18 MB 0 B 112.18 MB -100.0%
hits_092.vortex 1.0 vortex-compact 153.30 MB 0 B 153.30 MB -100.0%
hits_093.vortex 1.0 vortex-compact 99.09 MB 0 B 99.09 MB -100.0%
hits_094.vortex 1.0 vortex-compact 110.72 MB 0 B 110.72 MB -100.0%
hits_095.vortex 1.0 vortex-compact 110.68 MB 0 B 110.68 MB -100.0%
hits_096.vortex 1.0 vortex-compact 153.25 MB 0 B 153.25 MB -100.0%
hits_097.vortex 1.0 vortex-compact 141.22 MB 0 B 141.22 MB -100.0%
hits_098.vortex 1.0 vortex-compact 103.86 MB 0 B 103.86 MB -100.0%
hits_099.vortex 1.0 vortex-compact 132.89 MB 0 B 132.89 MB -100.0%

Totals:

  • vortex-compact: 11.93 GB → 0 B (-100.0%)
  • vortex-file-compressed: 15.97 GB → 15.97 GB (+0.0%)

@github-actions

github-actions Bot commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.4%
Engines: DataFusion No clear signal (+2.4%, environment too noisy confidence) · DuckDB No clear signal (-5.2%, low confidence)
Vortex (geomean): 0.955x ➖
Parquet (geomean): 0.973x ➖
Shifts: Parquet (control) -2.7% · Median polish -4.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.952x ➖, 3↑ 1↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 445075856 464608341 0.96
tpch_q02/datafusion:vortex-file-compressed 107628459 109147041 0.99
tpch_q03/datafusion:vortex-file-compressed 🚀 189032772 210637707 0.90
tpch_q04/datafusion:vortex-file-compressed 96481487 105241886 0.92
tpch_q05/datafusion:vortex-file-compressed 347533181 367918152 0.94
tpch_q06/datafusion:vortex-file-compressed 🚀 36800101 41265422 0.89
tpch_q07/datafusion:vortex-file-compressed 452146487 477768602 0.95
tpch_q08/datafusion:vortex-file-compressed 349691594 364071593 0.96
tpch_q09/datafusion:vortex-file-compressed 612801674 621438402 0.99
tpch_q10/datafusion:vortex-file-compressed 220770797 237291638 0.93
tpch_q11/datafusion:vortex-file-compressed 79149287 87850886 0.90
tpch_q12/datafusion:vortex-file-compressed 112284853 123308818 0.91
tpch_q13/datafusion:vortex-file-compressed 🚀 195788804 222645893 0.88
tpch_q14/datafusion:vortex-file-compressed 52040581 53661778 0.97
tpch_q15/datafusion:vortex-file-compressed 99096707 103556339 0.96
tpch_q16/datafusion:vortex-file-compressed 74754006 77884377 0.96
tpch_q17/datafusion:vortex-file-compressed 607874373 607331875 1.00
tpch_q18/datafusion:vortex-file-compressed 🚨 1130603065 889153021 1.27
tpch_q19/datafusion:vortex-file-compressed 77122413 80134533 0.96
tpch_q20/datafusion:vortex-file-compressed 158376220 167255597 0.95
tpch_q21/datafusion:vortex-file-compressed 563507814 623456452 0.90
tpch_q22/datafusion:vortex-file-compressed 57426249 61631217 0.93
datafusion / parquet (0.939x ➖, 7↑ 2↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 481693990 608379997 0.79
tpch_q02/datafusion:parquet 🚀 170285754 214978339 0.79
tpch_q03/datafusion:parquet 🚀 263354179 330370933 0.80
tpch_q04/datafusion:parquet 🚀 120228380 149452125 0.80
tpch_q05/datafusion:parquet 🚀 427240570 502523434 0.85
tpch_q06/datafusion:parquet 🚨 157319937 139055315 1.13
tpch_q07/datafusion:parquet 🚨 751865138 615607591 1.22
tpch_q08/datafusion:parquet 469166510 516735935 0.91
tpch_q09/datafusion:parquet 🚀 732204418 828505436 0.88
tpch_q10/datafusion:parquet 648343388 633261431 1.02
tpch_q11/datafusion:parquet 🚀 121435198 135201165 0.90
tpch_q12/datafusion:parquet 211058596 234094088 0.90
tpch_q13/datafusion:parquet 366539189 365111101 1.00
tpch_q14/datafusion:parquet 177105081 167405787 1.06
tpch_q15/datafusion:parquet 309279024 284123417 1.09
tpch_q16/datafusion:parquet 120252359 130447165 0.92
tpch_q17/datafusion:parquet 662214565 727251451 0.91
tpch_q18/datafusion:parquet 892400800 956655253 0.93
tpch_q19/datafusion:parquet 281904906 292096633 0.97
tpch_q20/datafusion:parquet 298397141 310585927 0.96
tpch_q21/datafusion:parquet 662873134 694144469 0.95
tpch_q22/datafusion:parquet 213051859 213992561 1.00
datafusion / arrow (0.971x ➖, 5↑ 4↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 714975873 770469891 0.93
tpch_q02/datafusion:arrow 🚀 114976996 129918290 0.88
tpch_q03/datafusion:arrow 🚀 515647266 594468427 0.87
tpch_q04/datafusion:arrow 🚀 380268809 452177020 0.84
tpch_q05/datafusion:arrow 🚨 941829069 816183330 1.15
tpch_q06/datafusion:arrow 🚨 421875158 354609724 1.19
tpch_q07/datafusion:arrow 1234504087 1267012197 0.97
tpch_q08/datafusion:arrow 948566602 1043171174 0.91
tpch_q09/datafusion:arrow 1100780929 1149028623 0.96
tpch_q10/datafusion:arrow 🚨 812561692 704111261 1.15
tpch_q11/datafusion:arrow 101382892 94808442 1.07
tpch_q12/datafusion:arrow 1371393207 1435403593 0.96
tpch_q13/datafusion:arrow 480779657 495225679 0.97
tpch_q14/datafusion:arrow 374809856 399125539 0.94
tpch_q15/datafusion:arrow 926445912 863299076 1.07
tpch_q16/datafusion:arrow 81989988 87160912 0.94
tpch_q17/datafusion:arrow 1002500023 1047205116 0.96
tpch_q18/datafusion:arrow 1921314134 2006323185 0.96
tpch_q19/datafusion:arrow 🚨 726174019 592872027 1.22
tpch_q20/datafusion:arrow 534314341 566387212 0.94
tpch_q21/datafusion:arrow 🚀 3134365272 3520879456 0.89
tpch_q22/datafusion:arrow 🚀 83943993 113435254 0.74
duckdb / vortex-file-compressed (0.957x ➖, 4↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 186529211 171696064 1.09
tpch_q02/duckdb:vortex-file-compressed 56559926 54367215 1.04
tpch_q03/duckdb:vortex-file-compressed 🚀 107512887 124473470 0.86
tpch_q04/duckdb:vortex-file-compressed 144962109 158472348 0.91
tpch_q05/duckdb:vortex-file-compressed 133458423 138015949 0.97
tpch_q06/duckdb:vortex-file-compressed 31523923 35013682 0.90
tpch_q07/duckdb:vortex-file-compressed 🚀 115142069 132676079 0.87
tpch_q08/duckdb:vortex-file-compressed 167170396 172926745 0.97
tpch_q09/duckdb:vortex-file-compressed 393791704 395968921 0.99
tpch_q10/duckdb:vortex-file-compressed 184613590 194140438 0.95
tpch_q11/duckdb:vortex-file-compressed 30331138 30903840 0.98
tpch_q12/duckdb:vortex-file-compressed 106550318 107404156 0.99
tpch_q13/duckdb:vortex-file-compressed 270377750 271081891 1.00
tpch_q14/duckdb:vortex-file-compressed 53104077 54961029 0.97
tpch_q15/duckdb:vortex-file-compressed 🚀 77467444 90156073 0.86
tpch_q16/duckdb:vortex-file-compressed 76616963 80518966 0.95
tpch_q17/duckdb:vortex-file-compressed 85704211 88063652 0.97
tpch_q18/duckdb:vortex-file-compressed 287665675 293883480 0.98
tpch_q19/duckdb:vortex-file-compressed 74083385 74038396 1.00
tpch_q20/duckdb:vortex-file-compressed 🚀 123291178 139795190 0.88
tpch_q21/duckdb:vortex-file-compressed 469232894 482668272 0.97
tpch_q22/duckdb:vortex-file-compressed 63207898 64845292 0.97
duckdb / parquet (1.009x ➖, 0↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 278949027 263439671 1.06
tpch_q02/duckdb:parquet 104776289 105581047 0.99
tpch_q03/duckdb:parquet 225810400 214899618 1.05
tpch_q04/duckdb:parquet 138056675 142033594 0.97
tpch_q05/duckdb:parquet 227147057 230101477 0.99
tpch_q06/duckdb:parquet 75651405 74951798 1.01
tpch_q07/duckdb:parquet 190433701 188398323 1.01
tpch_q08/duckdb:parquet 262091876 268349368 0.98
tpch_q09/duckdb:parquet 520201948 515656602 1.01
tpch_q10/duckdb:parquet 654045301 631916509 1.04
tpch_q11/duckdb:parquet 64659206 65671749 0.98
tpch_q12/duckdb:parquet 132427075 134710631 0.98
tpch_q13/duckdb:parquet 445244092 457673577 0.97
tpch_q14/duckdb:parquet 181104544 180827414 1.00
tpch_q15/duckdb:parquet 106257120 106942257 0.99
tpch_q16/duckdb:parquet 169738867 166031181 1.02
tpch_q17/duckdb:parquet 180080836 185644725 0.97
tpch_q18/duckdb:parquet 370002740 368920593 1.00
tpch_q19/duckdb:parquet 308095036 286513162 1.08
tpch_q20/duckdb:parquet 242473550 239006258 1.01
tpch_q21/duckdb:parquet 593695414 572758371 1.04
tpch_q22/duckdb:parquet 319108101 305247914 1.05
File Size Changes (25 files changed, -44.0% overall, 0↑ 25↓)
File Scale Format Base HEAD Change %
customer_0.vortex 10.0 vortex-compact 74.00 MB 0 B 74.00 MB -100.0%
duckdb.db 10.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem_0.vortex 10.0 vortex-compact 100.59 MB 0 B 100.59 MB -100.0%
lineitem_1.vortex 10.0 vortex-compact 100.64 MB 0 B 100.64 MB -100.0%
lineitem_10.vortex 10.0 vortex-compact 100.83 MB 0 B 100.83 MB -100.0%
lineitem_11.vortex 10.0 vortex-compact 100.75 MB 0 B 100.75 MB -100.0%
lineitem_12.vortex 10.0 vortex-compact 100.62 MB 0 B 100.62 MB -100.0%
lineitem_2.vortex 10.0 vortex-compact 100.79 MB 0 B 100.79 MB -100.0%
lineitem_3.vortex 10.0 vortex-compact 100.85 MB 0 B 100.85 MB -100.0%
lineitem_4.vortex 10.0 vortex-compact 100.55 MB 0 B 100.55 MB -100.0%
lineitem_5.vortex 10.0 vortex-compact 100.70 MB 0 B 100.70 MB -100.0%
lineitem_6.vortex 10.0 vortex-compact 100.88 MB 0 B 100.88 MB -100.0%
lineitem_7.vortex 10.0 vortex-compact 100.79 MB 0 B 100.79 MB -100.0%
lineitem_8.vortex 10.0 vortex-compact 100.59 MB 0 B 100.59 MB -100.0%
lineitem_9.vortex 10.0 vortex-compact 100.46 MB 0 B 100.46 MB -100.0%
nation_0.vortex 10.0 vortex-compact 7.80 KB 0 B 7.80 KB -100.0%
orders_0.vortex 10.0 vortex-compact 114.79 MB 0 B 114.79 MB -100.0%
orders_1.vortex 10.0 vortex-compact 114.76 MB 0 B 114.76 MB -100.0%
orders_2.vortex 10.0 vortex-compact 114.78 MB 0 B 114.78 MB -100.0%
part_0.vortex 10.0 vortex-compact 17.92 MB 0 B 17.92 MB -100.0%
part_1.vortex 10.0 vortex-compact 17.98 MB 0 B 17.98 MB -100.0%
partsupp_0.vortex 10.0 vortex-compact 101.84 MB 0 B 101.84 MB -100.0%
partsupp_1.vortex 10.0 vortex-compact 102.09 MB 0 B 102.09 MB -100.0%
region_0.vortex 10.0 vortex-compact 5.83 KB 0 B 5.83 KB -100.0%
supplier_0.vortex 10.0 vortex-compact 4.73 MB 0 B 4.73 MB -100.0%

Totals:

  • vortex-compact: 1.93 GB → 0 B (-100.0%)
  • vortex-file-compressed: 2.45 GB → 2.45 GB (0.0%)

@github-actions

github-actions Bot commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.2%
Engines: DataFusion No clear signal (-7.9%, environment too noisy confidence) · DuckDB No clear signal (-0.3%, environment too noisy confidence)
Vortex (geomean): 0.990x ➖
Parquet (geomean): 1.033x ➖
Shifts: Parquet (control) +3.3% · Median polish +1.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.967x ➖, 1↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 282964435 265957706 1.06
tpch_q02/datafusion:vortex-file-compressed 458878908 506446634 0.91
tpch_q03/datafusion:vortex-file-compressed 405760788 418682763 0.97
tpch_q04/datafusion:vortex-file-compressed 202285668 250830567 0.81
tpch_q05/datafusion:vortex-file-compressed 333349948 430499382 0.77
tpch_q06/datafusion:vortex-file-compressed 292703559 302108209 0.97
tpch_q07/datafusion:vortex-file-compressed 388058184 430880200 0.90
tpch_q08/datafusion:vortex-file-compressed 461984875 465450831 0.99
tpch_q09/datafusion:vortex-file-compressed 322216997 321907272 1.00
tpch_q10/datafusion:vortex-file-compressed 414164634 412420254 1.00
tpch_q11/datafusion:vortex-file-compressed 261844998 252967021 1.04
tpch_q12/datafusion:vortex-file-compressed 366380969 367157981 1.00
tpch_q13/datafusion:vortex-file-compressed 213372161 188221542 1.13
tpch_q14/datafusion:vortex-file-compressed 231697567 227181806 1.02
tpch_q15/datafusion:vortex-file-compressed 407027605 431977102 0.94
tpch_q16/datafusion:vortex-file-compressed 193475232 210004859 0.92
tpch_q17/datafusion:vortex-file-compressed 393113181 365888328 1.07
tpch_q18/datafusion:vortex-file-compressed 291252880 250873885 1.16
tpch_q19/datafusion:vortex-file-compressed 480982259 470775943 1.02
tpch_q20/datafusion:vortex-file-compressed 411595102 383806938 1.07
tpch_q21/datafusion:vortex-file-compressed 506209700 516319854 0.98
tpch_q22/datafusion:vortex-file-compressed 🚀 144901030 212625659 0.68
datafusion / parquet (1.050x ➖, 0↑ 1↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 189095148 234677333 0.81
tpch_q02/datafusion:parquet 383034785 386725401 0.99
tpch_q03/datafusion:parquet 313429399 305073099 1.03
tpch_q04/datafusion:parquet 156848787 155990580 1.01
tpch_q05/datafusion:parquet 430071494 422213755 1.02
tpch_q06/datafusion:parquet 147974601 141240377 1.05
tpch_q07/datafusion:parquet 439059050 430873443 1.02
tpch_q08/datafusion:parquet 547753579 519091065 1.06
tpch_q09/datafusion:parquet 472064917 447100339 1.06
tpch_q10/datafusion:parquet 480762950 456054260 1.05
tpch_q11/datafusion:parquet 🚨 487901410 367911111 1.33
tpch_q12/datafusion:parquet 220916272 220326765 1.00
tpch_q13/datafusion:parquet 460107396 423744759 1.09
tpch_q14/datafusion:parquet 201417844 162526957 1.24
tpch_q15/datafusion:parquet 344644541 294459611 1.17
tpch_q16/datafusion:parquet 164178930 167907231 0.98
tpch_q17/datafusion:parquet 380872022 348364655 1.09
tpch_q18/datafusion:parquet 449005173 425568696 1.06
tpch_q19/datafusion:parquet 345194034 294051896 1.17
tpch_q20/datafusion:parquet 364049670 325573837 1.12
tpch_q21/datafusion:parquet 571473296 548429118 1.04
tpch_q22/datafusion:parquet 161807854 187410807 0.86
duckdb / vortex-file-compressed (1.014x ➖, 0↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 267255451 248519691 1.08
tpch_q02/duckdb:vortex-file-compressed 919457626 913484730 1.01
tpch_q03/duckdb:vortex-file-compressed 610698075 579728806 1.05
tpch_q04/duckdb:vortex-file-compressed 385263399 352271564 1.09
tpch_q05/duckdb:vortex-file-compressed 773063911 799920955 0.97
tpch_q06/duckdb:vortex-file-compressed 326079854 329725403 0.99
tpch_q07/duckdb:vortex-file-compressed 855630060 833794717 1.03
tpch_q08/duckdb:vortex-file-compressed 1044592794 1047140603 1.00
tpch_q09/duckdb:vortex-file-compressed 912769668 839649189 1.09
tpch_q10/duckdb:vortex-file-compressed 648714343 670345813 0.97
tpch_q11/duckdb:vortex-file-compressed 450496886 502943732 0.90
tpch_q12/duckdb:vortex-file-compressed 570089569 591085121 0.96
tpch_q13/duckdb:vortex-file-compressed 421438861 420168417 1.00
tpch_q14/duckdb:vortex-file-compressed 418225044 355944629 1.17
tpch_q15/duckdb:vortex-file-compressed 304905689 272723952 1.12
tpch_q16/duckdb:vortex-file-compressed 338358850 321383058 1.05
tpch_q17/duckdb:vortex-file-compressed 639119490 658468852 0.97
tpch_q18/duckdb:vortex-file-compressed 573135445 537280651 1.07
tpch_q19/duckdb:vortex-file-compressed 433342413 436121585 0.99
tpch_q20/duckdb:vortex-file-compressed 740899303 805289376 0.92
tpch_q21/duckdb:vortex-file-compressed 866512463 1057060391 0.82
tpch_q22/duckdb:vortex-file-compressed 276277184 244789306 1.13
duckdb / parquet (1.017x ➖, 0↑ 0↓)
name PR 5efe3a9 (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 419638226 421905244 0.99
tpch_q02/duckdb:parquet 1059710466 1072427345 0.99
tpch_q03/duckdb:parquet 939313113 953600079 0.99
tpch_q04/duckdb:parquet 581174440 634984647 0.92
tpch_q05/duckdb:parquet 1179750460 1176808396 1.00
tpch_q06/duckdb:parquet 376345877 405139858 0.93
tpch_q07/duckdb:parquet 1067283869 1108875416 0.96
tpch_q08/duckdb:parquet 1483331512 1352989312 1.10
tpch_q09/duckdb:parquet 1247671169 1232388224 1.01
tpch_q10/duckdb:parquet 1287097202 1181931164 1.09
tpch_q11/duckdb:parquet 662424042 675954911 0.98
tpch_q12/duckdb:parquet 696252868 617763591 1.13
tpch_q13/duckdb:parquet 894284395 879249721 1.02
tpch_q14/duckdb:parquet 665158328 625126076 1.06
tpch_q15/duckdb:parquet 486825942 501320914 0.97
tpch_q16/duckdb:parquet 660770154 609016169 1.08
tpch_q17/duckdb:parquet 735756268 680643915 1.08
tpch_q18/duckdb:parquet 821366793 809571210 1.01
tpch_q19/duckdb:parquet 706014550 717194709 0.98
tpch_q20/duckdb:parquet 1079112128 1061271104 1.02
tpch_q21/duckdb:parquet 1016487064 989144577 1.03
tpch_q22/duckdb:parquet 546362238 519301101 1.05

robert3005
robert3005 commented Jul 20, 2026
View reviewed changes
Comment thread vortex-array/src/arrays/filter/execute/simd_compress.rs Outdated
robert3005
robert3005 commented Jul 20, 2026
View reviewed changes
Comment thread vortex-array/src/arrays/filter/execute/simd_compress.rs Outdated
@robert3005
flags
0d7c75e 
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
something
be5e458 
Signed-off-by: Robert Kruszewski <github@robertk.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

changelog/performance A performance improvement

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@robert3005