Skip to content

chore(extensions): enable E2E coverage (e2e-test-utils 2.1.0)#2674

Open
gustavolira wants to merge 4 commits into
mainfrom
chore/e2e-coverage-extensions-2.1.0
Open

chore(extensions): enable E2E coverage (e2e-test-utils 2.1.0)#2674
gustavolira wants to merge 4 commits into
mainfrom
chore/e2e-coverage-extensions-2.1.0

Conversation

@gustavolira

Copy link
Copy Markdown
Member

Enables E2E coverage for the extensions workspace: bump @red-hat-developer-hub/e2e-test-utils to 2.1.0 + commit the Codecov anchors.

After /publish + /test e2e-ocp-helm, the e2e run uploads the e2e-extensions flag. Once it passes and reports coverage, we add its snapshot so the seed maintains it on the dashboard.

Part of the coverage rollout (after theme/global-header/bulk-import).

🤖 Generated with Claude Code

Bump @red-hat-developer-hub/e2e-test-utils to 2.1.0 (coverage collector
fixture) and commit the static Codecov coverage anchors. After /publish +
/test the e2e run uploads the e2e-extensions flag.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@gustavolira gustavolira requested review from a team as code owners June 25, 2026 12:26
@gustavolira gustavolira requested review from divyanshiGupta and rohitkrai03 and removed request for a team June 25, 2026 12:26
@github-actions github-actions Bot requested review from a team, gashcrumb and kadel as code owners June 25, 2026 13:46
@github-actions github-actions Bot added mandatory-workspace PR affects a workspace with required plugins for releases workspace-update PR modifies files in an existing workspace labels Jun 25, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Successfully updated file versions.jsonfrom branch main into this PR in commit 9828e5f

@github-actions

Copy link
Copy Markdown
Contributor

Publish workflow has completed with success.

Publishing process

✅ Finished successfully.

✅ Published container images:

  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-catalog-backend-module-extensions:pr_2674__0.17.1
  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-extensions:pr_2674__0.17.1
  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-extensions-backend:pr_2674__0.17.1

Backstage-incompatible workspaces

Some workspaces have a backstage version (in sources or in their overlay folder) which is incompatible with the target Backstage version (1.52.0).
1 incompatible workspaces, 0 of which are mandatory:

Folder Backstage version Mandatory Info
workspaces/extensions 1.49.2 BS Version History
How to fix

You have 3 main options:

  • Use the already-opened PR : For automatically-discovered workspaces, there might already be an automatically-opened PR that updates the commit to the target backstage version (Automatic PR link in column 4 above): just publish the plugins and test them from the PR by following the PR instructions.
  • Manually update the workspace commit :
    • Find a newer commit, with a backstage version compatible with the target backstage version :__*
      • Backstage version history available: A BS Version History link might be available in column 4: in the workspace source repository, it points to the list of commits touching the backstage.json file. This would help you finding out whether this workspace has a commit that has been published for the target backstage version.
      • No info available: If no information is is provided in column 4, the backstage.json probably does not exist in workspace sources. You would have to look deeper into the newer commits of workspace sources, possibly in the low-level dependencies in the package.json files, to find out a commit with an underlying backstage version compatible with the target backstage version.
    • Then, in the overlay repository, update the repo-ref field of the source.json file to the new source commit, and remember to also change the repo-backstage-version field to the corresponding compatible backstage version.
  • No compatible commit : If the workspace sources contain no compatible newer commit ( == a commit that provides a backstage.json version compatible with the target backstage), but the current workspace commit is known to work with the target backstage version, then you can override the declared backstage version compatibility for this workspace commit in the overlay repository using the /override-backstage command which will add a backstage.json file at the root of the overlay workspace folder with the desired target backstage version. This would require full testing of the workspace plugins on the target backstage though.

Metadata Validation

✅ All metadata files validated successfully.

Running e2e tests
/test e2e-ocp-helm

@rhdh-test-bot

Copy link
Copy Markdown

❌ Failed E2E Tests - extensions

Platform: ocp 4.18 | RHDH Version: 1.11 | Duration: 7m 14s
Passed: 0 | Failed: 1 | Flaky: 0 | Skipped: 13
Playwright Report | Build Log | Logs | Artifacts

@gustavolira

Copy link
Copy Markdown
Member Author

/override-backstage

@github-actions

Copy link
Copy Markdown
Contributor

Override Backstage workflow partially completed.

The backstage.json override to 1.52.0 was applied, but metadata files (OCI tags, supportedVersions) were not updated automatically. You can retry with /override-backstage or manually update the metadata files.

@gustavolira

Copy link
Copy Markdown
Member Author

/update-commit

@github-actions

Copy link
Copy Markdown
Contributor

Update Commit workflow has completed with success.

@github-actions

Copy link
Copy Markdown
Contributor

Publish workflow has completed with success.

Publishing process

✅ Finished successfully.

✅ Published container images:

  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-catalog-backend-module-extensions:pr_2674__0.17.1
  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-extensions:pr_2674__0.17.1
  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-extensions-backend:pr_2674__0.17.1

Backstage Compatibility Check

✅ All workspaces are compatible with the target Backstage version (1.52.0).

No action required.

Metadata Validation

✅ All metadata files validated successfully.

Running e2e tests
/test e2e-ocp-helm

@github-actions

Copy link
Copy Markdown
Contributor


Smoke tests workflow failed.

⚠️ Smoke tests failed. Check the workflow logs for details.

These plugins failed to load:
(log-errors)

Error logs from container
�[2m2026-06-26T17:22:07.351Z�[22m �[34mrootHttpRouter�[39m �[32minfo�[39m Listening on :7007 
�[2m2026-06-26T17:22:07.352Z�[22m �[34mbackstage�[39m �[32minfo�[39m Plugin initialization started: 'app', 'auth', 'catalog', 'dynamic-plugins-info', 'events', 'extensions', 'healthcheck', 'licensed-users-info', 'permission', 'proxy', 'scaffolder', 'scalprum', 'search', 'translations', 'user-settings' �[36mtype�[39m="initialization"
�[2m2026-06-26T17:22:07.472Z�[22m �[34mbackstage�[39m �[31merror�[39m Plugin 'catalog' threw an error during startup, waiting for 14 other plugins to finish before shutting down the process. Cannot read properties of undefined (reading 'id') �[36mtype�[39m="initialization" �[36mstack�[39m="TypeError: Cannot read properties of undefined (reading 'id')\n    at /opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:307:72\n    at Array.map (<anonymous>)\n    at /opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:307:59\n    at Array.map (<anonymous>)\n    at /opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:301:35\n    at async Promise.all (index 2)\n    at async #doStart (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:291:5)\n    at async BackendInitializer.start (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:237:12)\n    at async BackstageBackend.start (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackstageBackend.cjs.js:23:12)"
�[2m2026-06-26T17:22:07.482Z�[22m �[34mauth�[39m �[32minfo�[39m Enabled Provider Factories : {} 
�[2m2026-06-26T17:22:07.482Z�[22m �[34msearch�[39m �[33mwarn�[39m Postgres search engine is not supported, skipping registration of search-backend-module-pg 
�[2m2026-06-26T17:22:08.756Z�[22m �[34mapp�[39m �[32minfo�[39m Storing 0 updated assets and 373 new assets 
�[2m2026-06-26T17:22:08.945Z�[22m �[34mbackstage�[39m �[32minfo�[39m Plugin initialization complete, newly initialized: 'app' �[36mtype�[39m="initialization"
�[2m2026-06-26T17:22:08.945Z�[22m �[34mbackstage�[39m �[31merror�[39m Unhandled rejection Backend startup failed due to the following errors:
  Plugin 'catalog' startup failed; caused by TypeError: Cannot read properties of undefined (reading 'id') �[36mtype�[39m="unhandledRejection" �[36mcause�[39m=undefined �[36mname�[39m="BackendStartupError" �[36mstack�[39m="BackendStartupError: Backend startup failed due to the following errors:\n  Plugin 'catalog' startup failed; caused by TypeError: Cannot read properties of undefined (reading 'id')\n    at #doStart (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:359:13)\n    at async BackendInitializer.start (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:237:12)\n    at async BackstageBackend.start (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackstageBackend.cjs.js:23:12)"
�[2m2026-06-26T17:22:17.330Z�[22m �[34mrootHttpRouter�[39m �[32minfo�[39m [2026-06-26T17:22:17.330Z] "GET /health HTTP/1.1" 200 2849 "-" "curl/8.5.0" �[36mtype�[39m="incomingRequest" �[36mdate�[39m="2026-06-26T17:22:17.330Z" �[36mmethod�[39m="GET" �[36murl�[39m="/health" �[36mstatus�[39m=200 �[36mhttpVersion�[39m="1.1" �[36muserAgent�[39m="curl/8.5.0" �[36mcontentLength�[39m=2849

@rhdh-test-bot

Copy link
Copy Markdown

❌ Failed E2E Tests - extensions

Platform: ocp 4.18 | RHDH Version: 1.11 | Duration: 3m 50s
Passed: 0 | Failed: 1 | Flaky: 0 | Skipped: 13
Playwright Report | Build Log | Logs | Artifacts

@gustavolira

Copy link
Copy Markdown
Member Author

/update-commit

@github-actions

Copy link
Copy Markdown
Contributor

Update Commit workflow has completed with success.

@sonarqubecloud

Copy link
Copy Markdown

@gustavolira

Copy link
Copy Markdown
Member Author

/publish

@github-actions

Copy link
Copy Markdown
Contributor

Publish workflow has completed with success.

Publishing process

✅ Finished successfully.

✅ Published container images:

  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-catalog-backend-module-extensions:pr_2674__0.17.1
  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-extensions:pr_2674__0.17.1
  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-extensions-backend:pr_2674__0.17.1

Backstage Compatibility Check

✅ All workspaces are compatible with the target Backstage version (1.52.0).

No action required.

Metadata Validation

✅ All metadata files validated successfully.

Running e2e tests
/test e2e-ocp-helm

@github-actions

Copy link
Copy Markdown
Contributor

Publish workflow has completed with success.

Publishing process

✅ Finished successfully.

✅ Published container images:

  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-catalog-backend-module-extensions:pr_2674__0.17.1
  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-extensions:pr_2674__0.17.1
  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-extensions-backend:pr_2674__0.17.1

Backstage Compatibility Check

✅ All workspaces are compatible with the target Backstage version (1.52.0).

No action required.

Metadata Validation

✅ All metadata files validated successfully.

Running e2e tests
/test e2e-ocp-helm

@github-actions

Copy link
Copy Markdown
Contributor


Smoke tests workflow failed.

⚠️ Smoke tests failed. Check the workflow logs for details.

These plugins failed to load:
(log-errors)

Error logs from container
�[2m2026-06-26T19:25:25.410Z�[22m �[34mrootHttpRouter�[39m �[32minfo�[39m Listening on :7007 
�[2m2026-06-26T19:25:25.412Z�[22m �[34mbackstage�[39m �[32minfo�[39m Plugin initialization started: 'app', 'auth', 'catalog', 'dynamic-plugins-info', 'events', 'extensions', 'healthcheck', 'licensed-users-info', 'permission', 'proxy', 'scaffolder', 'scalprum', 'search', 'translations', 'user-settings' �[36mtype�[39m="initialization"
�[2m2026-06-26T19:25:25.510Z�[22m �[34mbackstage�[39m �[31merror�[39m Plugin 'catalog' threw an error during startup, waiting for 14 other plugins to finish before shutting down the process. Cannot read properties of undefined (reading 'id') �[36mtype�[39m="initialization" �[36mstack�[39m="TypeError: Cannot read properties of undefined (reading 'id')\n    at /opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:307:72\n    at Array.map (<anonymous>)\n    at /opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:307:59\n    at Array.map (<anonymous>)\n    at /opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:301:35\n    at async Promise.all (index 2)\n    at async #doStart (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:291:5)\n    at async BackendInitializer.start (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:237:12)\n    at async BackstageBackend.start (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackstageBackend.cjs.js:23:12)"
�[2m2026-06-26T19:25:25.517Z�[22m �[34mauth�[39m �[32minfo�[39m Enabled Provider Factories : {} 
�[2m2026-06-26T19:25:25.517Z�[22m �[34msearch�[39m �[33mwarn�[39m Postgres search engine is not supported, skipping registration of search-backend-module-pg 
�[2m2026-06-26T19:25:26.709Z�[22m �[34mapp�[39m �[32minfo�[39m Storing 0 updated assets and 373 new assets 
�[2m2026-06-26T19:25:26.880Z�[22m �[34mbackstage�[39m �[32minfo�[39m Plugin initialization complete, newly initialized: 'app' �[36mtype�[39m="initialization"
�[2m2026-06-26T19:25:26.880Z�[22m �[34mbackstage�[39m �[31merror�[39m Unhandled rejection Backend startup failed due to the following errors:
  Plugin 'catalog' startup failed; caused by TypeError: Cannot read properties of undefined (reading 'id') �[36mtype�[39m="unhandledRejection" �[36mcause�[39m=undefined �[36mname�[39m="BackendStartupError" �[36mstack�[39m="BackendStartupError: Backend startup failed due to the following errors:\n  Plugin 'catalog' startup failed; caused by TypeError: Cannot read properties of undefined (reading 'id')\n    at #doStart (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:359:13)\n    at async BackendInitializer.start (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:237:12)\n    at async BackstageBackend.start (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackstageBackend.cjs.js:23:12)"
�[2m2026-06-26T19:25:34.582Z�[22m �[34mrootHttpRouter�[39m �[32minfo�[39m [2026-06-26T19:25:34.582Z] "GET /health HTTP/1.1" 200 2849 "-" "curl/8.5.0" �[36mtype�[39m="incomingRequest" �[36mdate�[39m="2026-06-26T19:25:34.582Z" �[36mmethod�[39m="GET" �[36murl�[39m="/health" �[36mstatus�[39m=200 �[36mhttpVersion�[39m="1.1" �[36muserAgent�[39m="curl/8.5.0" �[36mcontentLength�[39m=2849

@rhdh-test-bot

Copy link
Copy Markdown

❌ Failed E2E Tests - extensions

Platform: ocp 4.18 | RHDH Version: 1.11 | Duration: 4m 16s
Passed: 0 | Failed: 1 | Flaky: 0 | Skipped: 13
Playwright Report | Build Log | Logs | Artifacts

@gustavolira

Copy link
Copy Markdown
Member Author

/update-commit

@github-actions

Copy link
Copy Markdown
Contributor

Update Commit workflow has completed with success.

@github-actions

Copy link
Copy Markdown
Contributor

Publish workflow has completed with success.

Publishing process

✅ Finished successfully.

✅ Published container images:

  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-catalog-backend-module-extensions:pr_2674__0.17.1
  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-extensions:pr_2674__0.17.1
  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-extensions-backend:pr_2674__0.17.1

Backstage Compatibility Check

✅ All workspaces are compatible with the target Backstage version (1.52.0).

No action required.

Metadata Validation

✅ All metadata files validated successfully.

Running e2e tests
/test e2e-ocp-helm

@github-actions

Copy link
Copy Markdown
Contributor


Smoke tests workflow failed.

⚠️ Smoke tests failed. Check the workflow logs for details.

These plugins failed to load:
(log-errors)

Error logs from container
�[2m2026-06-26T19:49:27.583Z�[22m �[34mrootHttpRouter�[39m �[32minfo�[39m Listening on :7007 
�[2m2026-06-26T19:49:27.584Z�[22m �[34mbackstage�[39m �[32minfo�[39m Plugin initialization started: 'app', 'auth', 'catalog', 'dynamic-plugins-info', 'events', 'extensions', 'healthcheck', 'licensed-users-info', 'permission', 'proxy', 'scaffolder', 'scalprum', 'search', 'translations', 'user-settings' �[36mtype�[39m="initialization"
�[2m2026-06-26T19:49:27.653Z�[22m �[34mbackstage�[39m �[31merror�[39m Plugin 'catalog' threw an error during startup, waiting for 14 other plugins to finish before shutting down the process. Cannot read properties of undefined (reading 'id') �[36mtype�[39m="initialization" �[36mstack�[39m="TypeError: Cannot read properties of undefined (reading 'id')\n    at /opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:307:72\n    at Array.map (<anonymous>)\n    at /opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:307:59\n    at Array.map (<anonymous>)\n    at /opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:301:35\n    at async Promise.all (index 2)\n    at async #doStart (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:291:5)\n    at async BackendInitializer.start (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:237:12)\n    at async BackstageBackend.start (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackstageBackend.cjs.js:23:12)"
�[2m2026-06-26T19:49:27.658Z�[22m �[34mauth�[39m �[32minfo�[39m Enabled Provider Factories : {} 
�[2m2026-06-26T19:49:27.658Z�[22m �[34msearch�[39m �[33mwarn�[39m Postgres search engine is not supported, skipping registration of search-backend-module-pg 
�[2m2026-06-26T19:49:28.583Z�[22m �[34mbackstage�[39m �[32minfo�[39m Plugin initialization in progress, newly initialized: 'catalog', 'healthcheck', 'translations', 'proxy', 'scalprum', 'dynamic-plugins-info', 'extensions', 'licensed-users-info', 'events', 'search', 'user-settings', 'scaffolder', 'permission', 'auth', still initializing: 'app' �[36mtype�[39m="initialization"
�[2m2026-06-26T19:49:28.701Z�[22m �[34mbackstage�[39m �[32minfo�[39m Plugin initialization complete, newly initialized: 'app' �[36mtype�[39m="initialization"
�[2m2026-06-26T19:49:28.702Z�[22m �[34mbackstage�[39m �[31merror�[39m Unhandled rejection Backend startup failed due to the following errors:
  Plugin 'catalog' startup failed; caused by TypeError: Cannot read properties of undefined (reading 'id') �[36mtype�[39m="unhandledRejection" �[36mcause�[39m=undefined �[36mname�[39m="BackendStartupError" �[36mstack�[39m="BackendStartupError: Backend startup failed due to the following errors:\n  Plugin 'catalog' startup failed; caused by TypeError: Cannot read properties of undefined (reading 'id')\n    at #doStart (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:359:13)\n    at async BackendInitializer.start (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackendInitializer.cjs.js:237:12)\n    at async BackstageBackend.start (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/wiring/BackstageBackend.cjs.js:23:12)"
�[2m2026-06-26T19:49:30.963Z�[22m �[34mrootHttpRouter�[39m �[32minfo�[39m [2026-06-26T19:49:30.963Z] "GET /health HTTP/1.1" 200 2849 "-" "curl/8.5.0" �[36mtype�[39m="incomingRequest" �[36mdate�[39m="2026-06-26T19:49:30.963Z" �[36mmethod�[39m="GET" �[36murl�[39m="/health" �[36mstatus�[39m=200 �[36mhttpVersion�[39m="1.1" �[36muserAgent�[39m="curl/8.5.0" �[36mcontentLength�[39m=2849

@rhdh-test-bot

Copy link
Copy Markdown

❌ Failed E2E Tests - extensions

Platform: ocp 4.18 | RHDH Version: 1.11 | Duration: 3m 34s
Passed: 0 | Failed: 1 | Flaky: 0 | Skipped: 13
Playwright Report | Build Log | Logs | Artifacts

@openshift-ci

openshift-ci Bot commented Jun 26, 2026

Copy link
Copy Markdown

@gustavolira: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-ocp-helm a7f8f56 link false /test e2e-ocp-helm

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

mandatory-workspace PR affects a workspace with required plugins for releases workspace-update PR modifies files in an existing workspace

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants