Skip to content

Change CI Perf to run on schedule, no runs on PRs#1646

Merged
alganet merged 1 commit intoRespect:mainfrom
alganet:ci-perf-sched
Jan 30, 2026
Merged

Change CI Perf to run on schedule, no runs on PRs#1646
alganet merged 1 commit intoRespect:mainfrom
alganet:ci-perf-sched

Conversation

@alganet
Copy link
Copy Markdown
Member

@alganet alganet commented Jan 30, 2026

See #1635

The goal is to collect data for a while. Until we have enough benchmarks, the PR check is not very useful, so it was disabled.

We added --tolerate-failure to all runs, so this check will never fail because of a missed performance assertion, but it will report it and archive it.

@codecov
Copy link
Copy Markdown

codecov Bot commented Jan 30, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 99.14%. Comparing base (d8e31db) to head (cba9efd).
⚠️ Report is 2 commits behind head on main.

Additional details and impacted files
@@             Coverage Diff              @@
##               main    #1646      +/-   ##
============================================
+ Coverage     99.00%   99.14%   +0.13%     
  Complexity      962      962              
============================================
  Files           197      197              
  Lines          2214     2215       +1     
============================================
+ Hits           2192     2196       +4     
+ Misses           22       19       -3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates the CI performance benchmark workflow to stop running on pull requests and instead run on a daily schedule plus pushes to main, aiming to gather benchmark history while avoiding PR friction.

Changes:

  • Switch ci-perf triggers to schedule (daily) and push to main, removing pull_request triggers.
  • Simplify phpbench execution to always compare against latest using --tolerate-failure.
  • Make the benchmark job non-blocking via continue-on-error: true.
Comments suppressed due to low confidence (1)

.github/workflows/ci-perf.yml:21

  • workflow_dispatch exposes a rebaseline option, but the workflow currently only commits benchmark/baseline updates on push events. That means a manual rebaseline run won’t actually update the benchmarks branch. Consider allowing the “Commit Results” logic to run for workflow_dispatch (at least when baseline == rebaseline) so the input has the intended effect.
  workflow_dispatch:
    inputs:
      baseline:
        description: 'Baseline mode. latest: compare against latest benchmarks; rebaseline: store new baseline.'
        type: choice

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread .github/workflows/ci-perf.yml
Comment thread .github/workflows/ci-perf.yml Outdated
Comment thread .github/workflows/ci-perf.yml Outdated
Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 1 out of 1 changed files in this pull request and generated 2 comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread .github/workflows/ci-perf.yml
Comment thread .github/workflows/ci-perf.yml
See Respect#1635

The goal is to collect data for a while. Until we have enough
benchmarks, the PR check is not very useful, so it was disabled.

We added `--tolerate-failure` to all runs, so this check will
never fail because of a missed performance assertion, but it will
report it and archive it.
@alganet alganet marked this pull request as ready for review January 30, 2026 01:48
@alganet alganet requested a review from henriquemoody January 30, 2026 01:49
@alganet alganet merged commit 7876576 into Respect:main Jan 30, 2026
7 checks passed
@alganet alganet deleted the ci-perf-sched branch January 30, 2026 11:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants