Adding MIWI tests to aro e2e#77992
Conversation
|
Hi @rachelvweber. Thanks for your PR. I'm waiting for a openshift member to verify that this patch is reasonable to test. If it is, they should reply with Tip We noticed you've done this a few times! Consider joining the org to skip this step and gain Once the patch is verified, the new status will be reflected by the I understand the commands that are listed here. DetailsInstructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
WalkthroughThe CI configuration is updated to support two parallel E2E test variants: Changes
Estimated code review effort🎯 4 (Complex) | ⏱️ ~45 minutes 🚥 Pre-merge checks | ✅ 12✅ Passed checks (12 passed)
✏️ Tip: You can configure your own custom pre-merge checks in the settings. ✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
There was a problem hiding this comment.
Caution
Some comments are outside the diff and can’t be posted inline due to platform limitations.
⚠️ Outside diff range comments (1)
ci-operator/config/Azure/ARO-RP/Azure-ARO-RP-master.yaml (1)
97-103:⚠️ Potential issue | 🟡 MinorMissing
optional: trueon the deve2e-parallel-cspentry.All other test entries in this file set
optional: true, and the previouse2e-parallelentry likely did too. If the omission here is intentional (i.e., the dev variant should actually gate PRs), disregard — otherwise add it for consistency.Proposed fix
- always_run: false as: e2e-parallel-csp + optional: true steps: cluster_profile: aro-classic-dev🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed. In `@ci-operator/config/Azure/ARO-RP/Azure-ARO-RP-master.yaml` around lines 97 - 103, The e2e-parallel-csp job is missing the optional flag; update the job block that has "as: e2e-parallel-csp" (workflow: aro-classic-e2e, cluster_profile: aro-classic-dev) to include "optional: true" so it matches the other test entries and does not gate PRs unintentionally.
🧹 Nitpick comments (1)
ci-operator/jobs/Azure/ARO-RP/Azure-ARO-RP-master-presubmits.yaml (1)
1-637: Prowgen-generated file—recommend regenerating via standard flow.This file carries the
ci.openshift.io/generator: prowgenlabel and is intended to be regenerated from the ci-operator config rather than hand-edited. Verification confirms the seven test targets in the config (e2e-parallel-csp,integration-e2e-parallel-csp,integration-e2e-parallel-miwi,prod-e2e-parallel-csp,prod-e2e-parallel-miwi,stage-e2e-parallel-csp,stage-e2e-parallel-miwi) all have matching presubmits with correct--targetvalues, trigger patterns, andoptional/always_runflags.The Boskos resource types
aro-classic-test-msi-containers-{int,stg,prod}required by the MIWI variants are already declared incore-services/prow/02_config/_boskos.yamlwith 50 numbered instances (0–49) each.Regenerate this file via
make jobsorci-operator-prowgento ensure byte-for-byte consistency with the canonical config and to guarantee any additional fields (e.g.,max_concurrency,pathAlias) are included if defined upstream.🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed. In `@ci-operator/jobs/Azure/ARO-RP/Azure-ARO-RP-master-presubmits.yaml` around lines 1 - 637, This file is prowgen-generated and should not be hand-edited; regenerate it to restore canonical output: run the standard generation flow (e.g. make jobs or ci-operator-prowgen) to recreate Azure/ARO-RP presubmits so that the ci.openshift.io/generator: prowgen label, the seven targets (e2e-parallel-csp, integration-e2e-parallel-csp, integration-e2e-parallel-miwi, prod-e2e-parallel-csp, prod-e2e-parallel-miwi, stage-e2e-parallel-csp, stage-e2e-parallel-miwi), their --target args, trigger regexes, optional/always_run flags, and any missing fields like max_concurrency or pathAlias match the canonical ci-operator config and the Boskos resource declarations.
🤖 Prompt for all review comments with AI agents
Verify each finding against the current code and only fix it if needed.
Outside diff comments:
In `@ci-operator/config/Azure/ARO-RP/Azure-ARO-RP-master.yaml`:
- Around line 97-103: The e2e-parallel-csp job is missing the optional flag;
update the job block that has "as: e2e-parallel-csp" (workflow: aro-classic-e2e,
cluster_profile: aro-classic-dev) to include "optional: true" so it matches the
other test entries and does not gate PRs unintentionally.
---
Nitpick comments:
In `@ci-operator/jobs/Azure/ARO-RP/Azure-ARO-RP-master-presubmits.yaml`:
- Around line 1-637: This file is prowgen-generated and should not be
hand-edited; regenerate it to restore canonical output: run the standard
generation flow (e.g. make jobs or ci-operator-prowgen) to recreate Azure/ARO-RP
presubmits so that the ci.openshift.io/generator: prowgen label, the seven
targets (e2e-parallel-csp, integration-e2e-parallel-csp,
integration-e2e-parallel-miwi, prod-e2e-parallel-csp, prod-e2e-parallel-miwi,
stage-e2e-parallel-csp, stage-e2e-parallel-miwi), their --target args, trigger
regexes, optional/always_run flags, and any missing fields like max_concurrency
or pathAlias match the canonical ci-operator config and the Boskos resource
declarations.
ℹ️ Review info
⚙️ Run configuration
Configuration used: Repository: openshift/coderabbit/.coderabbit.yaml
Review profile: CHILL
Plan: Pro Plus
Run ID: ea088835-fd1f-46af-8a66-78104b27c89c
📒 Files selected for processing (4)
ci-operator/config/Azure/ARO-RP/Azure-ARO-RP-master.yamlci-operator/jobs/Azure/ARO-RP/Azure-ARO-RP-master-presubmits.yamlcore-services/prow/02_config/_boskos.yamlcore-services/prow/02_config/generate-boskos.py
|
/ok-to-test |
|
/pj-rehearse pull-ci-Azure-ARO-RP-master-prod-e2e-parallel-miwi |
|
@rachelvweber: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
|
/pj-rehearse pull-ci-Azure-ARO-RP-master-prod-e2e-parallel-miwi |
|
@rachelvweber: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
|
/pj-rehearse pull-ci-Azure-ARO-RP-master-prod-e2e-parallel-miwi |
|
@rachelvweber: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
66dd82c to
4c78ff2
Compare
|
/pj-rehearse pull-ci-Azure-ARO-RP-master-prod-e2e-parallel-miwi |
|
@rachelvweber: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
|
/pj-rehearse pull-ci-Azure-ARO-RP-master-prod-e2e-parallel-miwi |
|
@rachelvweber: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
4c78ff2 to
2aba005
Compare
|
/pj-rehearse pull-ci-Azure-ARO-RP-master-prod-e2e-parallel-miwi |
|
@rachelvweber: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
|
/pj-rehearse pull-ci-Azure-ARO-RP-master-prod-e2e-parallel-miwi |
|
@rachelvweber: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
6bdbe09 to
4609a4e
Compare
|
/pj-rehearse pull-ci-Azure-ARO-RP-master-prod-e2e-parallel-miwi |
|
@rachelvweber: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
|
[REHEARSALNOTIFIER]
Interacting with pj-rehearseComment: Once you are satisfied with the results of the rehearsals, comment: |
There was a problem hiding this comment.
Actionable comments posted: 2
🧹 Nitpick comments (1)
ci-operator/step-registry/aro-classic/test/persistent/aro-classic-test-persistent-ref.yaml (1)
18-23: Use block scalar for consistency and add the new sentence under the correct key.The added sentence on Line 19 is implicitly folded into the
documentationplain scalar ofMULTISTAGE_PARAM_OVERRIDE_LOCATIONvia YAML line-continuation. It works, but it's inconsistent with the|-block scalars used forLOCATIONand the newly addedE2E_TYPE, and the continuation indent makes the ownership of the sentence easy to misread. TheE2E_TYPEentry itself looks good (default"csp"aligns with the behavior inaro-classic-test-persistent-commands.shLine 23).🧹 Suggested formatting tweak
- name: MULTISTAGE_PARAM_OVERRIDE_LOCATION default: "" - documentation: Overrides LOCATION via Gangway API. - That way we can have tests that choose different locations. + documentation: |- + Overrides LOCATION via Gangway API. + That way we can have tests that choose different locations. - name: E2E_TYPE default: "csp" documentation: |- Type of end-to-end test to run. For example, "csp" or "miwi".🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed. In `@ci-operator/step-registry/aro-classic/test/persistent/aro-classic-test-persistent-ref.yaml` around lines 18 - 23, The documentation scalar for MULTISTAGE_PARAM_OVERRIDE_LOCATION should use a block scalar (|-) like LOCATION and E2E_TYPE to avoid accidental line-folding and make ownership clear; update the MULTISTAGE_PARAM_OVERRIDE_LOCATION entry so its documentation value is written with |- and move the added sentence onto its own indented line under that key, ensuring E2E_TYPE remains a separate top-level mapping with its default "csp" and documentation block intact.
🤖 Prompt for all review comments with AI agents
Verify each finding against the current code and only fix it if needed.
Inline comments:
In `@ci-operator/jobs/Azure/ARO-RP/Azure-ARO-RP-master-presubmits.yaml`:
- Around line 84-166: The PR config currently makes the job
pull-ci-Azure-ARO-RP-master-e2e-parallel-miwi a required (blocking) gate because
it lacks optional: true and its trigger includes remaining-required; either
confirm this blocking behavior is intentional or change the job definition for
pull-ci-Azure-ARO-RP-master-e2e-parallel-miwi to include optional: true so MIWI
starts as non-blocking (matching the integration/stage/prod variants) and avoid
immediate merge breaks by /test remaining-required triggering both
e2e-parallel-csp and e2e-parallel-miwi.
In
`@ci-operator/step-registry/aro-classic/test/persistent/aro-classic-test-persistent-commands.sh`:
- Around line 22-30: The script conditionally exports
PLATFORM_WORKLOAD_IDENTITY_ROLE_SETS when E2E_TYPE == "miwi" but that env var is
not documented; add PLATFORM_WORKLOAD_IDENTITY_ROLE_SETS to the env section of
aro-classic-test-persistent-ref.yaml with a short description of purpose
(platform workload identity role sets) and expected format (JSON array of
properties), then verify with the ARO-RP e2e binary whether it accepts
pretty‑printed JSON (multi-line) or requires a compact single-line JSON/TSV; if
the binary needs single-line JSON, change the az rest invocation in the script
that sets PLATFORM_WORKLOAD_IDENTITY_ROLE_SETS to use an explicit output
query/format (e.g. -o json or -o tsv) to produce the exact format required; also
confirm the az rest API version behavior for 2025-07-25 is acceptable (failing
under errexit is intended) before rolling out.
---
Nitpick comments:
In
`@ci-operator/step-registry/aro-classic/test/persistent/aro-classic-test-persistent-ref.yaml`:
- Around line 18-23: The documentation scalar for
MULTISTAGE_PARAM_OVERRIDE_LOCATION should use a block scalar (|-) like LOCATION
and E2E_TYPE to avoid accidental line-folding and make ownership clear; update
the MULTISTAGE_PARAM_OVERRIDE_LOCATION entry so its documentation value is
written with |- and move the added sentence onto its own indented line under
that key, ensuring E2E_TYPE remains a separate top-level mapping with its
default "csp" and documentation block intact.
🪄 Autofix (Beta)
Fix all unresolved CodeRabbit comments on this PR:
- Push a commit to this branch (recommended)
- Create a new PR with the fixes
ℹ️ Review info
⚙️ Run configuration
Configuration used: Repository: openshift/coderabbit/.coderabbit.yaml
Review profile: CHILL
Plan: Pro Plus
Run ID: 115578c0-4e63-4fba-9166-c6d178b141c1
📒 Files selected for processing (6)
ci-operator/config/Azure/ARO-RP/Azure-ARO-RP-master.yamlci-operator/config/Azure/ARO-RP/Azure-ARO-RP-master__periodic.yamlci-operator/jobs/Azure/ARO-RP/Azure-ARO-RP-master-periodics.yamlci-operator/jobs/Azure/ARO-RP/Azure-ARO-RP-master-presubmits.yamlci-operator/step-registry/aro-classic/test/persistent/aro-classic-test-persistent-commands.shci-operator/step-registry/aro-classic/test/persistent/aro-classic-test-persistent-ref.yaml
🚧 Files skipped from review as they are similar to previous changes (1)
- ci-operator/config/Azure/ARO-RP/Azure-ARO-RP-master.yaml
|
/pj-rehearse pull-ci-Azure-ARO-RP-master-prod-e2e-parallel-csp |
|
@rachelvweber: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
|
/pj-rehearse pull-ci-Azure-ARO-RP-master-prod-e2e-parallel-csp |
|
@rachelvweber: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
|
@rachelvweber: all tests passed! Full PR test history. Your PR dashboard. DetailsInstructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here. |
|
/pj-rehearse ack |
|
@rachelvweber: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
|
/approve /lgtm |
|
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: rachelvweber, shubhadapaithankar, tsatam The full list of commands accepted by this bot can be found here. The pull request process is described here DetailsNeeds approval from an approver in each of these files:
Approvers can indicate their approval by writing |
Adding MIWI tests to aro e2e
Summary by CodeRabbit