This ticket is a tracking ticket for the migration from lukewarm to true cold runs. Details about this can be found here (original issue which triggered this) and in the benchmark rules about caching.
I suggest that we crowd-source this effort. Submissions are asked to
- change their scripts (usually
run.sh) to stop or kill the database before each first run of each query. This ensures all databases caches are cleared.
- remove tag
lukewarm-cold-run from their template.json file and from their result json files,
- mark the submission as done in below list.
Affected submissions:
This ticket is a tracking ticket for the migration from lukewarm to true cold runs. Details about this can be found here (original issue which triggered this) and in the benchmark rules about caching.
I suggest that we crowd-source this effort. Submissions are asked to
run.sh) to stop or kill the database before each first run of each query. This ensures all databases caches are cleared.lukewarm-cold-runfrom their template.json file and from their result json files,Affected submissions: