tryout fsst decompress speedup#6998
Conversation
Merging this PR will improve performance by 22.5%
Performance Changes
Comparing Footnotes
|
Polar Signals Profiling ResultsLatest Run
Powered by Polar Signals Cloud |
Benchmarks: PolarSignals ProfilingVortex (geomean): 1.018x ➖ datafusion / vortex-file-compressed (1.018x ➖, 0↑ 0↓)
|
Benchmarks: TPC-H SF=1 on NVMEVerdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.984x ➖, 0↑ 0↓)
datafusion / vortex-compact (0.993x ➖, 0↑ 0↓)
datafusion / parquet (0.966x ➖, 3↑ 1↓)
datafusion / arrow (0.995x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (0.982x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.001x ➖, 0↑ 0↓)
duckdb / parquet (0.991x ➖, 2↑ 1↓)
duckdb / duckdb (1.002x ➖, 0↑ 1↓)
Full attributed analysis
|
Benchmarks: FineWeb NVMeVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.930x ➖, 3↑ 0↓)
datafusion / vortex-compact (1.053x ➖, 0↑ 2↓)
datafusion / parquet (0.973x ➖, 1↑ 0↓)
duckdb / vortex-file-compressed (1.007x ➖, 1↑ 2↓)
duckdb / vortex-compact (1.062x ➖, 0↑ 2↓)
duckdb / parquet (1.028x ➖, 0↑ 1↓)
Full attributed analysis
|
Benchmarks: TPC-DS SF=1 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.001x ➖, 0↑ 2↓)
datafusion / vortex-compact (1.002x ➖, 0↑ 0↓)
datafusion / parquet (1.006x ➖, 2↑ 0↓)
duckdb / vortex-file-compressed (1.006x ➖, 1↑ 1↓)
duckdb / vortex-compact (0.995x ➖, 1↑ 0↓)
duckdb / parquet (1.000x ➖, 1↑ 0↓)
duckdb / duckdb (1.000x ➖, 2↑ 0↓)
Full attributed analysis
|
Benchmarks: TPC-H SF=10 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.978x ➖, 0↑ 0↓)
datafusion / vortex-compact (0.980x ➖, 0↑ 0↓)
datafusion / parquet (0.986x ➖, 0↑ 0↓)
datafusion / arrow (0.956x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.005x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.992x ➖, 0↑ 0↓)
duckdb / parquet (0.992x ➖, 1↑ 0↓)
duckdb / duckdb (0.988x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: TPC-H SF=1 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (1.033x ➖, 0↑ 3↓)
datafusion / vortex-compact (1.049x ➖, 0↑ 4↓)
datafusion / parquet (1.148x ➖, 1↑ 6↓)
duckdb / vortex-file-compressed (1.024x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.068x ➖, 0↑ 1↓)
duckdb / parquet (1.083x ➖, 0↑ 1↓)
Full attributed analysis
|
Benchmarks: FineWeb S3Verdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.001x ➖, 0↑ 1↓)
datafusion / vortex-compact (0.990x ➖, 0↑ 0↓)
datafusion / parquet (0.982x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.016x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.129x ➖, 0↑ 1↓)
duckdb / parquet (1.012x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: Random AccessVortex (geomean): 0.877x ✅ unknown / unknown (0.934x ➖, 9↑ 1↓)
|
Benchmarks: Statistical and Population GeneticsVerdict: No clear signal (low confidence) duckdb / vortex-file-compressed (0.884x ✅, 4↑ 0↓)
duckdb / vortex-compact (0.964x ➖, 1↑ 0↓)
duckdb / parquet (0.953x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: TPC-H SF=10 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.891x ➖, 3↑ 0↓)
datafusion / vortex-compact (1.053x ➖, 0↑ 1↓)
datafusion / parquet (0.926x ➖, 3↑ 0↓)
duckdb / vortex-file-compressed (1.044x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.082x ➖, 0↑ 2↓)
duckdb / parquet (0.997x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: Clickbench on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.967x ➖, 2↑ 0↓)
datafusion / parquet (0.975x ➖, 0↑ 1↓)
duckdb / vortex-file-compressed (0.994x ➖, 1↑ 3↓)
duckdb / parquet (0.995x ➖, 0↑ 0↓)
duckdb / duckdb (0.971x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: CompressionVortex (geomean): 0.999x ➖ unknown / unknown (1.002x ➖, 0↑ 2↓)
|
|
This PR has been marked as stale because it has been open for 14 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days |
Summary
Closes: #000
Testing