Skip to content

Add Maestro smoke test tooling foundation#16196

Draft
JorgeMucientes wants to merge 13 commits into
trunkfrom
feature/maestro-smoke-foundations
Draft

Add Maestro smoke test tooling foundation#16196
JorgeMucientes wants to merge 13 commits into
trunkfrom
feature/maestro-smoke-foundations

Conversation

@JorgeMucientes

@JorgeMucientes JorgeMucientes commented Jul 4, 2026

Copy link
Copy Markdown
Contributor

Description

Adds the local Maestro smoke-test foundation without adding executable app flows yet.

This introduces the runner, fixture seeding/cleanup helper, Android string environment generator, offline P2 coverage checker, local smoke-test documentation, Codex skills for smoke-test operation/repair, the Maestro MCP entry, and gitignore protection for local credentials and generated artifacts.

The runner is designed for local iteration first: lab-store defaults, explicit shared-store mode, no credential echoing, one retry per failed flow, animation restoration, HTML/JUnit reports, and screenshot/video artifact handling.

Stack navigation: next #16197

Test Steps

  1. Run .maestro/scripts/generate-strings-env.py --check-flow-references.
  2. Run set -u; source .maestro/strings.env.
  3. Run bash -n .maestro/scripts/run-smoke-tests.sh.
  4. Open .maestro/docs/index.html and confirm the local smoke-test guide renders.

Images/gif

N/A

  • I have considered if this change warrants release notes and have added them to RELEASE-NOTES.txt if necessary. Use the "[Internal]" label for non-user-facing changes.

@dangermattic

Copy link
Copy Markdown
Collaborator
1 Warning
⚠️ This PR is larger than 300 lines of changes. Please consider splitting it into smaller PRs for easier and faster reviews.
1 Message
📖 This PR is still a Draft: some checks will be skipped.

Generated by 🚫 Danger

@JorgeMucientes JorgeMucientes added type: task An internally driven task. category: tooling Anything that involves building & maintaining the project, including scripts, `Fastfile`, etc. category: ui tests Related to UI testing. labels Jul 4, 2026
@JorgeMucientes JorgeMucientes added this to the 25.2 milestone Jul 4, 2026
@wpmobilebot

wpmobilebot commented Jul 4, 2026

Copy link
Copy Markdown
Collaborator

App Icon📲 You can test the changes from this Pull Request in WooCommerce Android by scanning the QR code below to install the corresponding build.

App NameWooCommerce Android
Platform📱 Mobile
FlavorJalapeno
Build TypeDebug
Build Number766
Version25.1-rc-1
Application IDcom.woocommerce.android.prealpha
Commit3a95c34
Installation URL73l66rd67jvf8
Automatticians: You can use our internal self-serve MC tool to give yourself access to those builds if needed.

@wpmobilebot wpmobilebot modified the milestones: 25.2, 25.3 Jul 10, 2026
@wpmobilebot

Copy link
Copy Markdown
Collaborator

Version 25.2 has now entered code-freeze, so the milestone of this PR has been updated to 25.3.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

category: tooling Anything that involves building & maintaining the project, including scripts, `Fastfile`, etc. category: ui tests Related to UI testing. type: task An internally driven task.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants