Skip to content

Testing ci with feature#3

Open
lorenarosati wants to merge 19 commits into
mainfrom
testing-ci-with-feature
Open

Testing ci with feature#3
lorenarosati wants to merge 19 commits into
mainfrom
testing-ci-with-feature

Conversation

@lorenarosati

Copy link
Copy Markdown
Owner

What changes are proposed in this pull request?

How was this change tested?

@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench --tags listing-optimization

@github-actions

github-actions Bot commented Mar 28, 2026

Copy link
Copy Markdown

PR title does not match the required pattern. Please ensure you follow the conventional commits spec.

Your title should start with feat:, fix:, chore:, docs:, perf:, refactor:, test:, or ci:, and if it's a breaking change that should be suffixed with a ! (like feat!:), and then a 1-72 character brief description of your change.

Title: Testing ci with feature
PR title does not match the required pattern. Please ensure you follow the conventional commits spec.

Your title should start with feat:, fix:, chore:, docs:, perf:, refactor:, test:, or ci:, and if it's a breaking change that should be suffixed with a ! (like feat!:), and then a 1-72 character brief description of your change.

Title: Testing ci with feature
PR title does not match the required pattern. Please ensure you follow the conventional commits spec.

Your title should start with feat:, fix:, chore:, docs:, perf:, refactor:, test:, or ci:, and if it's a breaking change that should be suffixed with a ! (like feat!:), and then a 1-72 character brief description of your change.

Title: Testing ci with feature
PR title does not match the required pattern. Please ensure you follow the conventional commits spec.

Your title should start with feat:, fix:, chore:, docs:, perf:, refactor:, test:, or ci:, and if it's a breaking change that should be suffixed with a ! (like feat!:), and then a 1-72 character brief description of your change.

Title: Testing ci with feature

add list with backward checkpoint scan

added tests, some restructuring

fixes

fix

restored list() tests for reviewer readability

quick fix

quick fix

fix

final tests

test

fixes

fix
git checkout -- <name> treats the argument as a pathspec, not a branch
name, causing "pathspec did not match" errors. Using FETCH_HEAD avoids
passing any user-controlled input to the checkout command entirely.
@lorenarosati lorenarosati force-pushed the testing-ci-with-feature branch from 20f0d5c to b55bee6 Compare March 30, 2026 05:57
@lorenarosati lorenarosati reopened this Mar 30, 2026
@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench --tags listing-optimization

The post-comment job runs on a fresh runner with no checkout, so gh
cannot auto-detect the repository from git. Pass --repo explicitly.
@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench --tags listing-optimization

@github-actions

Copy link
Copy Markdown

Benchmark for c651b7d

Click to view benchmark
Test Base PR %
200kAdds0CommitsSinceChkpt2Chkpts0CommitsSinceCrc/snapshotV1985/snapshotConstruction 208.8±3.46ms 251.6±4.10ms +20.50%
200kAdds0CommitsSinceChkpt2Chkpts0CommitsSinceCrc/snapshotV1995/snapshotConstruction 208.6±3.52ms 115.0±3.87ms -44.87%

@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench

1 similar comment
@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench

@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench --filter snapshotConstruction

@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench --tags base --filter 101kAdds.*snapshotConstruction

@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench

@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench --filter snapshotConstruction

@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench --tags base --filter 101kAdds.*snapshotConstruction

@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench --filter 101kAdds|10kAdds

@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench --tags listing-optimization,metadata-only

@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench --tags metadata-only, listing-optimization

@github-actions

Copy link
Copy Markdown

Benchmark for 7a7215a

tags: `base`
Test Base PR %
101kAdds1kCommitsSinceChkpt1Chkpt/readLatest/readMetadata/serial 358.4±8.68ms 354.4±9.99ms -1.12%
101kAdds1kCommitsSinceChkpt1Chkpt/readV10/readMetadata/serial 1556.6±54.63µs 1513.2±26.14µs -2.79%
101kAdds1kCommitsSinceChkpt1Chkpt/readV110/readMetadata/serial 36.4±1.02ms 36.3±0.90ms -0.27%
101kAdds1kCommitsSinceChkpt1Chkpt/readV210/readMetadata/serial 69.9±2.15ms 71.1±2.91ms +1.72%
101kAdds1kCommitsSinceChkpt1Chkpt/readV510/readMetadata/serial 176.7±5.16ms 174.6±6.20ms -1.19%
101kAdds1kCommitsSinceChkpt1Chkpt/readV60/readMetadata/serial 19.3±0.92ms 19.2±0.98ms -0.52%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotLatest/snapshotConstruction 113.7±4.60ms 107.5±2.48ms -5.45%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotV10/snapshotConstruction 30.1±1.22ms 30.0±0.35ms -0.33%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotV110/snapshotConstruction 39.0±0.62ms 38.5±0.44ms -1.28%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotV210/snapshotConstruction 47.4±0.91ms 46.7±0.53ms -1.48%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotV510/snapshotConstruction 73.2±2.04ms 70.6±1.35ms -3.55%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotV60/snapshotConstruction 34.5±0.42ms 34.3±0.36ms -0.58%

@github-actions

Copy link
Copy Markdown

Benchmark for 7a7215a

tags: `listing-optimization,metadata-only`
Test Base PR %
1MAddsNoData0Chkpts/readLatest/readMetadata/serial 2.1±0.04s 2.1±0.03s -0.00%
1MAddsNoData0Chkpts/snapshotLatest/snapshotConstruction 1663.7±21.82µs 1669.7±30.50µs +0.36%
200kAdds0CommitsSinceChkpt2Chkpts0CommitsSinceCrc/snapshotV1985/snapshotConstruction 225.3±3.79ms 267.7±5.53ms +18.82%
200kAdds0CommitsSinceChkpt2Chkpts0CommitsSinceCrc/snapshotV1995/snapshotConstruction 226.0±4.04ms 122.8±3.70ms -45.66%

@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench --filter 101kAdds|10kAdds

@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench --tags metadata-only, listing-optimization

@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench --filter snapshotConstruction

@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench --filter snapshot

@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench --filter 101kAdds|10kAdds

@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench --tags listing-optimization, base

@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench --tags base --filter 101kAdds.*snapshotConstruction

@github-actions

Copy link
Copy Markdown

Benchmark for 7a7215a

tags: `listing-optimization,`
Test Base PR %
200kAdds0CommitsSinceChkpt2Chkpts0CommitsSinceCrc/snapshotV1985/snapshotConstruction 207.7±3.96ms 248.3±3.75ms +19.55%
200kAdds0CommitsSinceChkpt2Chkpts0CommitsSinceCrc/snapshotV1995/snapshotConstruction 208.0±3.63ms 114.0±2.60ms -45.19%

@github-actions

Copy link
Copy Markdown

Benchmark for 7a7215a

tags: `base` | filter: `101kAdds.*snapshotConstruction`
Test Base PR %
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotLatest/snapshotConstruction 121.5±24.62ms 128.7±25.11ms +5.93%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotV10/snapshotConstruction 33.9±1.95ms 30.2±0.80ms -10.91%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotV110/snapshotConstruction 52.8±5.15ms 37.1±0.48ms -29.73%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotV210/snapshotConstruction 45.4±1.40ms 46.4±3.09ms +2.20%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotV510/snapshotConstruction 123.4±10.95ms 68.6±1.62ms -44.41%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotV60/snapshotConstruction 43.0±3.51ms 34.5±1.05ms -19.77%

@github-actions

Copy link
Copy Markdown

Benchmark for 7a7215a

filter: `101kAdds|10kAdds`
Test Base PR %
101kAdds1kCommitsSinceChkpt1Chkpt/readLatest/readMetadata/serial 342.1±6.35ms 362.8±6.93ms +6.05%
101kAdds1kCommitsSinceChkpt1Chkpt/readV10/readMetadata/serial 1512.5±36.95µs 1467.4±61.31µs -2.98%
101kAdds1kCommitsSinceChkpt1Chkpt/readV110/readMetadata/serial 35.0±0.40ms 35.2±1.00ms +0.57%
101kAdds1kCommitsSinceChkpt1Chkpt/readV210/readMetadata/serial 67.3±1.35ms 69.9±1.76ms +3.86%
101kAdds1kCommitsSinceChkpt1Chkpt/readV510/readMetadata/serial 168.6±5.46ms 167.5±2.94ms -0.65%
101kAdds1kCommitsSinceChkpt1Chkpt/readV60/readMetadata/serial 18.6±1.06ms 18.8±1.25ms +1.08%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotLatest/snapshotConstruction 105.5±1.73ms 105.6±2.34ms +0.09%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotV10/snapshotConstruction 29.3±0.18ms 29.5±0.12ms +0.68%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotV110/snapshotConstruction 37.1±0.45ms 37.3±0.31ms +0.54%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotV210/snapshotConstruction 44.9±0.44ms 46.4±0.67ms +3.34%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotV510/snapshotConstruction 67.8±1.04ms 68.1±1.07ms +0.44%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotV60/snapshotConstruction 33.3±0.26ms 33.3±0.20ms -0.00%
10kAdds0Chkpts/readLatest/readMetadata/serial 16.3±0.44ms 15.9±0.13ms -2.45%
10kAdds0Chkpts/snapshotLatest/snapshotConstruction 688.3±21.36µs 666.1±12.00µs -3.23%
10kAdds0CommitsSinceChkpt1Chkpt/readLatest/readMetadata/serial 5.2±0.08ms 5.1±0.09ms -1.92%
10kAdds0CommitsSinceChkpt1Chkpt/snapshotLatest/snapshotConstruction 962.0±18.27µs 932.8±22.57µs -3.04%
10kAdds0CommitsSinceChkpt1V2Chkpt/readLatest/readMetadata/parallel2 4.8±0.12ms 4.6±0.06ms -4.17%
10kAdds0CommitsSinceChkpt1V2Chkpt/readLatest/readMetadata/serial 7.5±0.15ms 7.3±0.07ms -2.67%
10kAdds0CommitsSinceChkpt1V2Chkpt/snapshotLatest/snapshotConstruction 1289.2±42.32µs 1272.4±35.21µs -1.30%

@github-actions

Copy link
Copy Markdown

Benchmark for 7a7215a

filter: `snapshot`
Test Base PR %
100Adds0Chkpts/snapshotLatest/snapshotConstruction 671.0±21.51µs 671.5±24.17µs +0.07%
100kAdds0Chkpts/snapshotLatest/snapshotConstruction 669.4±23.86µs 689.6±20.98µs +3.02%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotLatest/snapshotConstruction 106.9±1.52ms 107.3±1.73ms +0.37%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotV10/snapshotConstruction 30.7±0.30ms 31.0±0.23ms +0.98%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotV110/snapshotConstruction 38.7±0.32ms 38.8±0.36ms +0.26%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotV210/snapshotConstruction 46.3±0.55ms 46.8±0.45ms +1.08%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotV510/snapshotConstruction 70.6±3.57ms 70.0±0.87ms -0.85%
101kAdds1kCommitsSinceChkpt1Chkpt/snapshotV60/snapshotConstruction 35.0±0.94ms 35.0±0.71ms -0.00%
10kAdds0Chkpts/snapshotLatest/snapshotConstruction 674.4±19.52µs 684.3±23.36µs +1.47%
10kAdds0CommitsSinceChkpt1Chkpt/snapshotLatest/snapshotConstruction 933.4±37.01µs 948.8±31.79µs +1.65%
10kAdds0CommitsSinceChkpt1V2Chkpt/snapshotLatest/snapshotConstruction 1253.1±43.83µs 1273.3±46.30µs +1.61%
1MAddsNoData0Chkpts/snapshotLatest/snapshotConstruction 1635.9±42.73µs 1637.2±44.85µs +0.08%
1kAdds0Chkpts/snapshotLatest/snapshotConstruction 672.5±18.05µs 667.6±23.36µs -0.73%
200kAdds0CommitsSinceChkpt2Chkpts0CommitsSinceCrc/snapshotV1985/snapshotConstruction 210.1±3.09ms 255.4±4.07ms +21.56%
200kAdds0CommitsSinceChkpt2Chkpts0CommitsSinceCrc/snapshotV1995/snapshotConstruction 212.3±2.82ms 116.7±2.29ms -45.03%
20kAdds100CommitsSinceChkpt1Chkpt0CommitsSinceCrc/snapshotLatest/snapshotConstruction 6.5±0.15ms 6.8±0.16ms +4.62%
20kAdds100CommitsSinceChkpt1Chkpt0CommitsSinceCrc/snapshotV100/snapshotConstruction 5.8±0.06ms 5.9±0.15ms +1.72%
20kAdds100CommitsSinceChkpt1Chkpt0CommitsSinceCrc/snapshotV150/snapshotConstruction 19.5±0.44ms 19.6±0.34ms +0.51%
20kAdds100CommitsSinceChkpt1Chkpt50CommitsSinceCrc/snapshotLatest/snapshotConstruction 19.1±0.96ms 19.2±0.78ms +0.52%
20kAdds100CommitsSinceChkpt1Chkpt50CommitsSinceCrc/snapshotV100/snapshotConstruction 5.9±0.14ms 5.8±0.19ms -1.69%
20kAdds100CommitsSinceChkpt1Chkpt50CommitsSinceCrc/snapshotV150/snapshotConstruction 4.8±0.09ms 4.8±0.27ms -0.00%
20kAdds100CommitsSinceChkpt1ChkptNoCrc/snapshotLatest/snapshotConstruction 33.7±1.20ms 34.0±0.78ms +0.89%
20kAdds100CommitsSinceChkpt1ChkptNoCrc/snapshotV100/snapshotConstruction 5.8±0.13ms 6.0±0.17ms +3.45%
20kAdds100CommitsSinceChkpt1ChkptNoCrc/snapshotV150/snapshotConstruction 19.6±0.60ms 20.1±0.39ms +2.55%

@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench --tags crc-optimization --filter SinceCrc.*snapshotConstruction

@github-actions

Copy link
Copy Markdown

Benchmark for 47d1fb2

tags: `crc-optimization` | filter: `SinceCrc.*snapshotConstruction`
Test Base PR %
20kAdds100CommitsSinceChkpt1Chkpt0CommitsSinceCrc/snapshotLatest/snapshotConstruction 7.1±0.18ms 7.0±0.17ms -1.41%
20kAdds100CommitsSinceChkpt1Chkpt0CommitsSinceCrc/snapshotV100/snapshotConstruction 5.9±0.08ms 5.8±0.07ms -1.69%
20kAdds100CommitsSinceChkpt1Chkpt0CommitsSinceCrc/snapshotV150/snapshotConstruction 20.1±0.36ms 19.8±0.37ms -1.49%
20kAdds100CommitsSinceChkpt1Chkpt50CommitsSinceCrc/snapshotLatest/snapshotConstruction 19.4±0.80ms 19.3±0.97ms -0.52%
20kAdds100CommitsSinceChkpt1Chkpt50CommitsSinceCrc/snapshotV100/snapshotConstruction 5.9±0.12ms 5.8±0.13ms -1.69%
20kAdds100CommitsSinceChkpt1Chkpt50CommitsSinceCrc/snapshotV150/snapshotConstruction 5.0±0.10ms 5.0±0.20ms -0.00%

@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench --tags listing-optimization, base

@lorenarosati

Copy link
Copy Markdown
Owner Author

/bench --tags listing-optimization

@github-actions

Copy link
Copy Markdown

Benchmark for 47d1fb2

tags: `listing-optimization`
Test Base PR %
200kAdds0CommitsSinceChkpt2Chkpts0CommitsSinceCrc/snapshotV1985/snapshotConstruction 225.5±4.80ms 266.3±4.30ms +18.09%
200kAdds0CommitsSinceChkpt2Chkpts0CommitsSinceCrc/snapshotV1995/snapshotConstruction 226.0±4.44ms 122.6±3.78ms -45.75%

github-merge-queue Bot pushed a commit to delta-io/delta-kernel-rs that referenced this pull request Apr 1, 2026
…action (#2264)

## What changes are proposed in this pull request?

  This PR introduces the following functionality:

- Replaces the boa-dev/criterion-compare-action GitHub Action with a
custom bash script (.github/scripts/run-benchmarks.sh) that replicates
its output format, including a markdown table with base and PR
durations, a percentage change column, and bolding of the faster result
when the difference is statistically significant based on Criterion's
error bounds.
- Splits the benchmark workflow into two jobs — run-benchmark (which
checks out and runs untrusted PR code with only contents: read
permission) and post-comment (which holds pull-requests: write and posts
results) — so that GH_TOKEN is never in the environment when untrusted
code executes.
- Extends the /bench comment syntax to support both a --tags flag
(comma-separated list passed as BENCH_TAGS) and a --filter flag
(Criterion benchmark name regex), where bare /bench defaults to --tags
base.
- Pins all GitHub Actions to full commit SHAs and passes all
user-controlled values through environment variables rather than inline
expressions to prevent expression injection.
 
## How was this change tested?
Made a pull request on my fork and checked that it commented correctly
and that --tags and --filter work:
lorenarosati#3
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant