We have two ways of verifying performance and correctness for our query engine integrations (namely duckdb and datafusion):
- SQL logic tests which are fast but verify correctness only, and
- Benchmarks, which are run on-demand in PRs, verify correctness and performance, and wihch are slow.
I propose adding a third verification:
- Only targeting vortex:duckdb and vortex:datafusion, since we don't care about baseline comparison.
- Run for every commit in PR without a separate tag,
- Checking performance of queries like
SELECT len(str) from '1.vortex' on small-scale data to keep runtime fast.
We have two ways of verifying performance and correctness for our query engine integrations (namely duckdb and datafusion):
I propose adding a third verification:
SELECT len(str) from '1.vortex'on small-scale data to keep runtime fast.