Minimize default sql benchmarks suite#8465
1 benchmark regressed
⚠️ Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.
For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.
⚠️ Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.
⚡ 5 improved benchmarks
❌ 1 regressed benchmark
✅ 1575 untouched benchmarks
⏩ 1 skipped benchmark1
Warning
Please fix the performance issues or acknowledge them on CodSpeed.
Performance Changes
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| ❌ | Simulation | chunked_bool_canonical_into[(1000, 10)] |
20.3 µs | 34.9 µs | -41.86% |
| ⚡ | Simulation | take_10k_random |
255.8 µs | 197.9 µs | +29.25% |
| ⚡ | Simulation | take_10k_contiguous |
276.3 µs | 218.4 µs | +26.49% |
| ⚡ | Simulation | patched_take_10k_contiguous_patches |
291 µs | 232.3 µs | +25.27% |
| ⚡ | Simulation | patched_take_10k_random |
303 µs | 244.2 µs | +24.08% |
| ⚡ | WallTime | cuda/bitpacked_u8/unpack/3bw[100M] |
353.5 µs | 302.3 µs | +16.93% |
Tip
Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.
Comparing adamg/minimize-benchmarks (b93e467) with develop (69ce1ed)
Footnotes
-
1 benchmark was skipped, so the baseline result was used instead. If it was deleted from the codebase, click here and archive it to remove it from the performance reports. ↩