ji/remove-double-filter#7315
Conversation
ecba214 to
a714ea6
Compare
Merging this PR will improve performance by 20.09%
Performance Changes
Comparing Footnotes
|
Polar Signals Profiling ResultsLatest Run
Powered by Polar Signals Cloud |
Benchmarks: PolarSignals ProfilingVortex (geomean): 1.052x ➖ datafusion / vortex-file-compressed (1.052x ➖, 0↑ 0↓)
|
File Sizes: PolarSignals ProfilingNo file size changes detected. |
Benchmarks: TPC-H SF=1 on NVMEVerdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.948x ➖, 1↑ 0↓)
datafusion / vortex-compact (0.944x ➖, 2↑ 0↓)
datafusion / parquet (0.930x ➖, 5↑ 0↓)
datafusion / arrow (0.912x ➖, 10↑ 0↓)
duckdb / vortex-file-compressed (0.974x ➖, 8↑ 3↓)
duckdb / vortex-compact (0.962x ➖, 7↑ 4↓)
duckdb / parquet (0.975x ➖, 2↑ 3↓)
duckdb / duckdb (0.964x ➖, 2↑ 0↓)
Full attributed analysis
|
File Sizes: TPC-H SF=1 on NVMENo file size changes detected. |
Benchmarks: FineWeb NVMeVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.081x ➖, 1↑ 5↓)
datafusion / vortex-compact (1.092x ➖, 0↑ 2↓)
datafusion / parquet (1.121x ❌, 0↑ 7↓)
duckdb / vortex-file-compressed (0.933x ➖, 4↑ 1↓)
duckdb / vortex-compact (0.938x ➖, 2↑ 0↓)
duckdb / parquet (1.022x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: FineWeb NVMeNo file size changes detected. |
Benchmarks: TPC-H SF=10 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.932x ➖, 1↑ 0↓)
datafusion / vortex-compact (1.060x ➖, 0↑ 13↓)
datafusion / parquet (1.014x ➖, 0↑ 2↓)
datafusion / arrow (1.007x ➖, 1↑ 8↓)
duckdb / vortex-file-compressed (1.243x ❌, 1↑ 11↓)
duckdb / vortex-compact (1.078x ➖, 4↑ 7↓)
duckdb / parquet (0.986x ➖, 1↑ 1↓)
duckdb / duckdb (1.083x ➖, 0↑ 5↓)
Full attributed analysis
|
File Sizes: TPC-H SF=10 on NVMENo file size changes detected. |
Benchmarks: TPC-H SF=1 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (1.030x ➖, 0↑ 2↓)
datafusion / vortex-compact (0.971x ➖, 1↑ 0↓)
datafusion / parquet (1.079x ➖, 1↑ 3↓)
duckdb / vortex-file-compressed (0.994x ➖, 1↑ 1↓)
duckdb / vortex-compact (0.952x ➖, 1↑ 1↓)
duckdb / parquet (0.961x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: FineWeb S3Verdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.209x ➖, 0↑ 2↓)
datafusion / vortex-compact (1.005x ➖, 1↑ 2↓)
datafusion / parquet (1.024x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (0.889x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.978x ➖, 0↑ 0↓)
duckdb / parquet (0.983x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: Random AccessVortex (geomean): 0.871x ✅ unknown / unknown (0.952x ➖, 10↑ 0↓)
|
Benchmarks: Statistical and Population GeneticsVerdict: No clear signal (low confidence) duckdb / vortex-file-compressed (0.947x ➖, 1↑ 0↓)
duckdb / vortex-compact (0.987x ➖, 0↑ 0↓)
duckdb / parquet (0.983x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: Statistical and Population GeneticsNo file size changes detected. |
Benchmarks: Clickbench on NVMEVerdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.984x ➖, 8↑ 3↓)
datafusion / parquet (0.963x ➖, 15↑ 7↓)
duckdb / vortex-file-compressed (0.959x ➖, 13↑ 5↓)
duckdb / parquet (1.001x ➖, 2↑ 7↓)
duckdb / duckdb (0.988x ➖, 6↑ 1↓)
Full attributed analysis
|
File Sizes: Clickbench on NVME
Totals:
|
Benchmarks: TPC-H SF=10 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (1.035x ➖, 1↑ 4↓)
datafusion / vortex-compact (1.039x ➖, 0↑ 1↓)
datafusion / parquet (1.017x ➖, 1↑ 0↓)
duckdb / vortex-file-compressed (1.087x ➖, 2↑ 4↓)
duckdb / vortex-compact (1.105x ➖, 0↑ 4↓)
duckdb / parquet (1.054x ➖, 0↑ 1↓)
Full attributed analysis
|
Benchmarks: TPC-DS SF=1 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.002x ➖, 0↑ 0↓)
datafusion / vortex-compact (1.000x ➖, 0↑ 0↓)
datafusion / parquet (0.990x ➖, 1↑ 1↓)
duckdb / vortex-file-compressed (1.138x ❌, 18↑ 38↓)
duckdb / vortex-compact (1.193x ❌, 15↑ 54↓)
duckdb / parquet (0.997x ➖, 1↑ 2↓)
duckdb / duckdb (0.994x ➖, 0↑ 1↓)
Full attributed analysis
|
File Sizes: TPC-DS SF=1 on NVMENo file size changes detected. |
Benchmarks: CompressionVortex (geomean): 1.008x ➖ unknown / unknown (1.029x ➖, 1↑ 12↓)
|
|
This PR has been marked as stale because it has been open for 14 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days |
Summary
Closes: #000
Testing