Skip to content

Commit 04e03e1

Browse files
committed
test(e2e): skip 2 flaky flows until underlying SDK/Maestro bugs are fixed
sign-in-sign-out-sign-in.yaml: tag `skip` on both platforms. - Android: clerk-android AuthStartView reads Clerk.enabledFirstFactorAttributes and Clerk.socialProviders via non-observable getters. Body of re-mounted AuthView can be empty when its first composition wins the race against environment population. Fix is a MutableStateFlow + observe in AuthStartView (patch staged in clerk-android workspace, pending publish). - iOS: Maestro's field-clearing on the second sign-in leaves a leading char ("Identifier is invalid"). Lives in the test/keyboard layer, not the SDK. Both bugs only repro on slow CI hardware; local AVD/sim are too fast. sign-out-from-profile.yaml: tag `flakyAndroid` (Android-only exclusion). - Same Android-side clerk-android race, manifesting earlier in this flow because of state bleed from preceding flows in the Maestro sweep. - Keeps running on iOS, where the underlying race doesn't apply. Workflow Android job's --exclude-tags now includes `flakyAndroid`. iOS is unchanged (already correctly excludes androidOnly). Re-enable both flows by removing the tags once the underlying issues are fixed and verified.
1 parent 3d95c38 commit 04e03e1

3 files changed

Lines changed: 19 additions & 1 deletion

File tree

.github/workflows/mobile-e2e.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -336,7 +336,7 @@ jobs:
336336
cd integration/mobile &&
337337
find flows -type f -name "*.yaml" ! -path "*/common/*"
338338
${FLOWS_FILTER:+-path "*$FLOWS_FILTER*"} -print0
339-
| xargs -0 maestro test --env CLERK_TEST_EMAIL="$CLERK_TEST_EMAIL" --env CLERK_TEST_PASSWORD="$CLERK_TEST_PASSWORD" --exclude-tags "$EXCLUDE_TAGS"
339+
| xargs -0 maestro test --env CLERK_TEST_EMAIL="$CLERK_TEST_EMAIL" --env CLERK_TEST_PASSWORD="$CLERK_TEST_PASSWORD" --exclude-tags "$EXCLUDE_TAGS,flakyAndroid"
340340
341341
- name: Upload Maestro artifacts on failure
342342
if: failure()

integration/mobile/flows/cycles/sign-in-sign-out-sign-in.yaml

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,22 @@
11
# REGRESSION: After sign-in -> sign-out -> sign-in, the second sign-in
22
# completed natively but the JS SDK never picked it up. This flow signs in
33
# twice in a row to verify the cycle works correctly.
4+
#
5+
# TODO: re-enable once two underlying issues are fixed:
6+
# - Android: clerk-android AuthStartView reads Clerk.enabledFirstFactorAttributes
7+
# and Clerk.socialProviders via non-observable getters; the body of a re-mounted
8+
# AuthView can be left empty when its first composition wins the race against
9+
# environment population. A MutableStateFlow + observe in AuthStartView fixes
10+
# it (see drafted patch in clerk-android workspace).
11+
# - iOS: Maestro's field-clearing on the second sign-in leaves a leading
12+
# character (saw ".ci-..." in failing screenshots), which Clerk rejects as
13+
# "Identifier is invalid".
14+
# Both bugs are real; both manifest only on slower hardware (CI) and both pass
15+
# reliably on local Pixel 9 Pro / iPhone 17 Pro simulators.
416
appId: com.clerk.clerkexpoquickstart
517
tags:
618
- regression
19+
- skip
720
---
821
- runFlow: ../common/open-app.yaml
922
# First sign-in

integration/mobile/flows/profile/sign-out-from-profile.yaml

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,13 @@
11
# Happy path: sign in, open profile, sign out from inside the profile modal,
22
# assert AuthView is shown again.
3+
#
4+
# Flaky on Android CI: see TODO in cycles/sign-in-sign-out-sign-in.yaml. Same
5+
# clerk-android AuthStartView re-render race. Pass-rate is ~50% on CI. Keep
6+
# running on iOS where the underlying issue doesn't manifest.
37
appId: com.clerk.clerkexpoquickstart
48
tags:
59
- happy-path
10+
- flakyAndroid
611
---
712
- runFlow: ../common/open-app.yaml
813
- runFlow: ../common/sign-in-email-password.yaml

0 commit comments

Comments
 (0)