feat: add weekly end-to-end test workflows for all devops-infra GitHub Actions#1
Merged
ChristophShyper merged 15 commits intoMay 24, 2026
Merged
Conversation
Agent-Logs-Url: https://github.com/devops-infra/end-to-end-tests/sessions/b430f53f-9c34-435e-b906-a500c6daf9ed Co-authored-by: ChristophShyper <45788587+ChristophShyper@users.noreply.github.com>
Copilot
AI
changed the title
[WIP] Add workflows for end-to-end tests for organization actions
feat: add weekly end-to-end test workflows for all devops-infra GitHub Actions
May 23, 2026
…est e2e workflow Agent-Logs-Url: https://github.com/devops-infra/end-to-end-tests/sessions/dd39da71-3100-4bc0-90b0-bda2c04dfa4f Co-authored-by: ChristophShyper <45788587+ChristophShyper@users.noreply.github.com>
There was a problem hiding this comment.
Pull request overview
Adds the “Triglav” repository-level end-to-end (E2E) testing framework for devops-infra GitHub Actions, including scheduled orchestration, reusable per-action E2E workflows, and local tooling to track/guard action input coverage.
Changes:
- Introduces weekly scheduled orchestration via a cron workflow that calls reusable per-action E2E workflows.
- Adds per-action E2E workflows plus container-structure-test fixtures used by those workflows.
- Adds local developer tooling (Taskfile tasks + Python script + baseline JSON) and updates repo documentation/ignore/lint configuration.
Reviewed changes
Copilot reviewed 21 out of 23 changed files in this pull request and generated 17 comments.
Show a summary per file
| File | Description |
|---|---|
.env.example |
Updates example environment variables used by local task commands. |
.github/workflows/auto-pull-request-create.yml |
Adjusts branch ignore patterns related to automation PR creation. |
.github/workflows/cron-e2e-tests.yml |
New weekly/manual orchestrator calling the E2E workflows. |
.github/workflows/e2e-action-commit-push.yml |
New reusable E2E workflow for action-commit-push. |
.github/workflows/e2e-action-container-structure-test.yml |
New reusable E2E workflow for action-container-structure-test. |
.github/workflows/e2e-action-format-hcl.yml |
New reusable E2E workflow for action-format-hcl. |
.github/workflows/e2e-action-pull-request.yml |
New reusable E2E workflow for action-pull-request. |
.github/workflows/e2e-action-template-action.yml |
New reusable E2E workflow for template-action. |
.github/workflows/e2e-action-terraform-copy-vars.yml |
New reusable E2E workflow for action-terraform-copy-vars. |
.github/workflows/e2e-action-terraform-validate.yml |
New reusable E2E workflow for action-terraform-validate. |
.github/workflows/e2e-action-tflint.yml |
New reusable E2E workflow for action-tflint. |
.gitignore |
Updates ignored Python cache and local test artifact paths. |
.pre-commit-config.yaml |
Adds a pylint pre-commit hook. |
.pylintrc |
Introduces pylint configuration file. |
README.md |
Replaces template README with Triglav framework documentation and usage guidance. |
Taskfile.cicd.yml |
Wires new tasks (pylint, E2E helpers, coverage reporting/gate) into CI Taskfile. |
Taskfile.scripts.yml |
Adds scripts tasks for pylint, triggering/viewing E2E workflows, and coverage reporting/gate. |
Taskfile.variables.yml |
Adds repository resolution variable (GH_REPO) for gh-based task commands. |
scripts/check_action_input_coverage.py |
New Python utility to report/strict-gate action input coverage across tests and E2E workflows. |
tests/coverage-baseline.json |
New baseline file for accepted uncovered inputs. |
tests/fixtures/container-structure-test/alpine-extended.yml |
Additional container-structure-test fixture used in E2E workflows. |
tests/fixtures/container-structure-test/alpine.yml |
Container-structure-test fixture used in E2E workflows. |
triglav.jpeg |
Adds Triglav image used in README. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
…n reference updates
…e invalid JSON in baseline
ChristophShyper
approved these changes
May 24, 2026
2 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
📝 Brief description
Initial plan
feat: add end-to-end test workflows for all devops-infra actions
test: add repository and repository_path coverage in action-pull-request e2e workflow
feat: enhance end-to-end testing framework with new workflows and coverage reporting
refactor: update repository references to Triglav in documentation and scripts
refactor: update repository references to Triglav in documentation and scripts
feat: add end-to-end testing workflows with mode validation and action reference updates
feat: add end-to-end testing workflows and refine input handling
feat: add execution mode and image tag inputs to workflow dispatch for E2E actions
feat: enhance action input parsing and add unit tests for coverage
feat: add validation for mode input and handle empty action repositories in workflows
feat: add input validation for mode in end-to-end workflows and handle invalid JSON in baseline
fix: validate mode input for end-to-end testing workflow
fix: update Alpine image version to 3.23.4 in end-to-end testing workflows
feat: add preflight validation step for workflow inputs in end-to-end testing
💻 Commits
| feat: add preflight validation step for workflow inputs in end-to-end testing
|
| fix: update Alpine image version to 3.23.4 in end-to-end testing workflows
|
| fix: validate mode input for end-to-end testing workflow
|
| feat: add input validation for mode in end-to-end workflows and handle invalid JSON in baseline
|
| feat: add validation for mode input and handle empty action repositories in workflows
|
| feat: enhance action input parsing and add unit tests for coverage
|
| feat: add execution mode and image tag inputs to workflow dispatch for E2E actions
|
| feat: add end-to-end testing workflows and refine input handling
|
| feat: add end-to-end testing workflows with mode validation and action reference updates
|
| refactor: update repository references to Triglav in documentation and scripts
|
| refactor: update repository references to Triglav in documentation and scripts
|
| feat: enhance end-to-end testing framework with new workflows and coverage reporting
|
| test: add repository and repository_path coverage in action-pull-request e2e workflow
| Agent-Logs-Url: https://github.com/devops-infra/end-to-end-tests/sessions/dd39da71-3100-4bc0-90b0-bda2c04dfa4f
|
| Co-authored-by: ChristophShyper 45788587+ChristophShyper@users.noreply.github.com
|
| feat: add end-to-end test workflows for all devops-infra actions
| Agent-Logs-Url: https://github.com/devops-infra/end-to-end-tests/sessions/b430f53f-9c34-435e-b906-a500c6daf9ed
|
| Co-authored-by: ChristophShyper 45788587+ChristophShyper@users.noreply.github.com
|
Initial plan
📁 Modified files
.env.example | 8 +-
.github/workflows/auto-pull-request-create.yml | 1 +
.github/workflows/cron-e2e-tests.yml (new) | 98 +++++
.github/workflows/e2e-action-commit-push.yml (new) | 463 +++++++++++++++++++++
.../e2e-action-container-structure-test.yml (new) | 303 ++++++++++++++
.github/workflows/e2e-action-format-hcl.yml (new) | 268 ++++++++++++
.../workflows/e2e-action-pull-request.yml (new) | 306 ++++++++++++++
.../workflows/e2e-action-template-action.yml (new) | 106 +++++
.../e2e-action-terraform-copy-vars.yml (new) | 278 +++++++++++++
.../e2e-action-terraform-validate.yml (new) | 159 +++++++
.github/workflows/e2e-action-tflint.yml (new) | 324 ++++++++++++++
.gitignore | 10 +-
.pre-commit-config.yaml | 6 +
.pylintrc (new) | 1 +
README.md | 175 ++++++--
Taskfile.cicd.yml | 41 ++
Taskfile.scripts.yml | 126 ++++++
Taskfile.variables.yml | 7 +
scripts/check_action_input_coverage.py (new) | 253 +++++++++++
tests/coverage-baseline.json (new) | 9 +
.../alpine-extended.yml (new) | 12 +
.../container-structure-test/alpine.yml (new) | 21 +
tests/test_check_action_input_coverage.py (new) | 84 ++++
triglav.jpeg (new) | Bin 0 -> 145328 bytes
24 files changed, 3024 insertions(+), 35 deletions(-)
Check CONTRIBUTING.md and CODE_OF_CONDUCT.md for more information