Skip to content

Commit 2e5553e

Browse files
wenytang-msCopilot
andcommitted
test(e2e): drop flaky LLM verify on select-interface
Same flake pattern as e633cd0: the LLM screenshot check is unreliable when a quick-pick advances immediately after a selection. On Windows CI the LLM saw the second wizard page (source-folder prompt) and concluded 'Interface not selected', when in fact the wizard had advanced exactly because Interface was selected. The downstream fillQuickInput steps and final file-creation assertion provide deterministic verification of the whole flow — if Interface hadn't been picked, the file would have been created with the wrong extension or template. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
1 parent e633cd0 commit 2e5553e

1 file changed

Lines changed: 4 additions & 1 deletion

File tree

test/e2e-plans/java-dep-new-types.yaml

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -78,7 +78,10 @@ steps:
7878

7979
- id: "select-interface"
8080
action: "select Interface option"
81-
verify: "Interface selected"
81+
# No `verify:` — LLM screenshot check is flaky when the quick-pick
82+
# advances immediately after selection (LLM sees the next page and
83+
# mistakes the advance for "selection not visible"). The downstream
84+
# fillQuickInput / file creation provides authoritative verification.
8285

8386
- id: "select-source-folder-1"
8487
action: "select src/main/java option"

0 commit comments

Comments
 (0)