Skip to content

[automated runtime tests][10/11] feat: Suite opt-in via --include and Metro cache reset in the runtime tests CLI#9931

Open
tjzel wants to merge 3 commits into
@tjzel/runtime-tests-release-configfrom
@tjzel/runtime-tests-fixes
Open

[automated runtime tests][10/11] feat: Suite opt-in via --include and Metro cache reset in the runtime tests CLI#9931
tjzel wants to merge 3 commits into
@tjzel/runtime-tests-release-configfrom
@tjzel/runtime-tests-fixes

Conversation

@tjzel

@tjzel tjzel commented Jul 10, 2026

Copy link
Copy Markdown
Collaborator

Note

This PR description is AI-generated.

Summary

Two CI-driven reliability gaps remained after the test fixes in #9974. The bundle mode core suite is skipByDefault, so nothing could run it in an automated session — I added an --include flag to the CLI protocol (server flag, start envelope field, runner selection) and wired it into the Bundle Mode legs of both CI workflows. Metro also served stale module maps when a cache produced under the other Bundle Mode survived a toggle ("Requiring unknown module"), so the server now spawns it with --reset-cache, detached into its own process group so shutdown cannot orphan it. I also made the Reanimated auto-run app warm up the animation pipeline at boot, so the first test's fixed wait budget starts against a warm pipeline on loaded CI runners.

Test plan

The bundle mode core suite runs and passes in the Bundle Mode legs on CI; consecutive local runs across Bundle Mode toggles no longer hit stale Metro caches.

@tjzel
tjzel force-pushed the @tjzel/runtime-tests-cli branch 2 times, most recently from d9e850e to 579d7be Compare July 13, 2026 08:03
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-fixes branch 3 times, most recently from 65f0e5b to 0c5a165 Compare July 13, 2026 08:49
@tjzel
tjzel changed the base branch from @tjzel/runtime-tests-cli to @tjzel/runtime-tests-release-config July 13, 2026 08:50
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-fixes branch from 0c5a165 to ed9d84b Compare July 13, 2026 11:05
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-release-config branch from e3c5853 to 45aa713 Compare July 13, 2026 11:05
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-fixes branch from ed9d84b to 9586c37 Compare July 13, 2026 13:18
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-release-config branch from 45aa713 to 621007f Compare July 13, 2026 13:18
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-fixes branch from 9586c37 to 6d7aed3 Compare July 13, 2026 13:25
@tjzel tjzel changed the title fix: Make runtime tests pass in the whole Debug/Release × BundleMode/LegacyEval matrix [automated runtime tests][7/9] fix: Make runtime tests pass in the whole Debug/Release × BundleMode/LegacyEval matrix Jul 14, 2026
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-fixes branch from 1783278 to e85a191 Compare July 14, 2026 08:29
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-release-config branch 2 times, most recently from 922ac4a to fe80b9c Compare July 14, 2026 09:25
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-fixes branch 2 times, most recently from 68b6844 to 843a70b Compare July 14, 2026 10:26
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-release-config branch from fe80b9c to 3c7c13c Compare July 14, 2026 10:26
@tjzel tjzel changed the title [automated runtime tests][7/9] fix: Make runtime tests pass in the whole Debug/Release × BundleMode/LegacyEval matrix [automated runtime tests][8/10] fix: Make runtime tests pass in the whole Debug/Release × BundleMode/LegacyEval matrix Jul 14, 2026
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-fixes branch 2 times, most recently from ab87d55 to e2115ac Compare July 14, 2026 12:29
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-release-config branch from 86c9d0f to 7ac91ba Compare July 14, 2026 12:29
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-fixes branch from e2115ac to 79ef0a1 Compare July 14, 2026 13:16
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-release-config branch 2 times, most recently from eb81a35 to 804625c Compare July 14, 2026 14:03
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-fixes branch from 79ef0a1 to 500453b Compare July 14, 2026 14:03
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-release-config branch from 804625c to a689e19 Compare July 14, 2026 14:14
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-fixes branch from 3c731b0 to 2ea989d Compare July 16, 2026 13:27
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-release-config branch from 6b372ed to e69d482 Compare July 16, 2026 14:17
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-fixes branch 2 times, most recently from 2d8b642 to 8d9575c Compare July 16, 2026 14:32
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-release-config branch from e69d482 to 636f871 Compare July 16, 2026 14:32
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-fixes branch from 8d9575c to f3cf0ca Compare July 16, 2026 14:43
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-release-config branch from 636f871 to 93aaf9b Compare July 16, 2026 14:43
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-fixes branch from f3cf0ca to 996c326 Compare July 16, 2026 14:47
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-release-config branch from 93aaf9b to 084cdf0 Compare July 16, 2026 14:47
@tjzel tjzel changed the title [automated runtime tests][9/11] fix: Make runtime tests pass in the whole Debug/Release × BundleMode/LegacyEval matrix [automated runtime tests][9/10] fix: Make runtime tests pass in the whole Debug/Release × BundleMode/LegacyEval matrix Jul 16, 2026
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-release-config branch from 084cdf0 to ec98292 Compare July 16, 2026 15:15
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-fixes branch from 996c326 to eba7fd4 Compare July 16, 2026 15:15
@tjzel tjzel changed the title [automated runtime tests][9/10] fix: Make runtime tests pass in the whole Debug/Release × BundleMode/LegacyEval matrix [automated runtime tests][10/11] fix: Make runtime tests pass in the whole Debug/Release × BundleMode/LegacyEval matrix Jul 16, 2026
@tjzel tjzel changed the title [automated runtime tests][10/11] fix: Make runtime tests pass in the whole Debug/Release × BundleMode/LegacyEval matrix [automated runtime tests][10/11] feat: Suite opt-in via --include and Metro cache reset in the runtime tests CLI Jul 16, 2026
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-fixes branch from eba7fd4 to 8d3fd65 Compare July 16, 2026 15:28
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-release-config branch from ec98292 to 414b74e Compare July 16, 2026 15:28
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-fixes branch from 8d3fd65 to 6251c22 Compare July 16, 2026 15:54
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-release-config branch from 414b74e to 4cdc540 Compare July 16, 2026 15:54
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-fixes branch from 6251c22 to ecf4e16 Compare July 16, 2026 20:18
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-release-config branch 2 times, most recently from 87cc13d to f5e35a2 Compare July 17, 2026 07:55
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-fixes branch 2 times, most recently from 2cb710d to 148949e Compare July 17, 2026 08:09
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-release-config branch 2 times, most recently from 02fca5e to 12cd243 Compare July 17, 2026 09:07
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-fixes branch from 148949e to 67107a8 Compare July 17, 2026 09:07
@tjzel
tjzel force-pushed the @tjzel/runtime-tests-release-config branch from 12cd243 to 87c589b Compare July 17, 2026 09:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant