Skip to content

EPIC-07: Add CI perf regression and repro replay gates#59

Merged
RtlZeroMemory merged 3 commits into
mainfrom
epic-07-ci-gates
Feb 16, 2026
Merged

EPIC-07: Add CI perf regression and repro replay gates#59
RtlZeroMemory merged 3 commits into
mainfrom
epic-07-ci-gates

Conversation

@RtlZeroMemory

@RtlZeroMemory RtlZeroMemory commented Feb 16, 2026

Copy link
Copy Markdown
Owner

Summary

  • add reduced deterministic benchmark CI profile and runner (bench:ci)
  • add threshold comparator with baseline config and actionable reports (bench:ci:compare)
  • add committed CI baseline artifacts under benchmarks/ci-baseline/
  • wire PR performance gate workflow with artifact upload
  • add explicit replay-harness gate step on Linux CI for every PR
  • add developer docs for perf regression workflow and repro replay CI usage

Validation

  • npm run lint
  • npm run typecheck
  • npm run build
  • npm test
  • npm run test:e2e
  • npm run test:e2e:reduced
  • npm run test:native:smoke
  • npm run bench:ci -- --output-dir /tmp/rezi-bench-ci-pr
  • npm run bench:ci:compare -- --baseline benchmarks/ci-baseline/results.json --current /tmp/rezi-bench-ci-pr/results.json --config benchmarks/ci-baseline/config.json --report-json /tmp/rezi-bench-ci-pr/compare.json --report-md /tmp/rezi-bench-ci-pr/compare.md

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 5d68383e45

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread benchmarks/ci-baseline/results.json Outdated
"arch": "x64",
"osType": "Linux",
"osRelease": "6.6.87.2-microsoft-standard-WSL2",
"cpuModel": "AMD Ryzen 7 9800X3D 8-Core Processor",

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Regenerate perf baseline on CI runner environment

This baseline artifact was captured on a local WSL host (cpuModel is a desktop Ryzen and the file also records Node v20), but the perf gate in .github/workflows/ci.yml runs on ubuntu-latest with Node 22, so the comparator is gating absolute timing deltas against a different machine/runtime than the one used in CI. Because bench-ci-compare enforces hard thresholds on timing.mean, this can create persistent false regressions (or hide real ones) on every PR; the committed baseline should be generated in the same CI environment as the gate.

Useful? React with 👍 / 👎.

@RtlZeroMemory
RtlZeroMemory merged commit 1333f18 into main Feb 16, 2026
18 checks passed
@RtlZeroMemory
RtlZeroMemory deleted the epic-07-ci-gates branch February 16, 2026 08:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant