Skip to content

Commit 08bac93

Browse files
wenytang-msCopilot
andcommitted
test(autotest): drop verify: on basic-editing save-all-step5
Last remaining CI failure (run 25665240373): the save-all-step5 verify text 'All files saved, no compilation errors' caused an LLM downgrade. After the prior step 'apply-code-action Create method call()' Eclipse inserts a TODO-marked stub. The LLM consistently flagged the lingering TODO marker as 'compilation error persists', concluding Save All didn't work. Ground truth: verifyProblems.errors:0 already passes (TODOs are not errors). Drop verify: text — deterministic verifier remains. Local: java-basic-editing 21/21 with LLM verification on. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
1 parent 1d526b7 commit 08bac93

1 file changed

Lines changed: 4 additions & 1 deletion

File tree

test-plans/java-basic-editing.yaml

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -78,9 +78,12 @@ steps:
7878
timeout: 15
7979

8080
# ── Step 5: Save all + verify 0 errors ──────────────────────
81+
# Drop verify: text — apply-code-action above creates a stub with a
82+
# TODO marker which the LLM consistently misreads as a "compilation
83+
# error", causing downgrades on otherwise-passing steps. The
84+
# deterministic verifyProblems.errors:0 is the ground truth.
8185
- id: "save-all-step5"
8286
action: "run command File: Save All"
83-
verify: "All files saved, no compilation errors"
8487
verifyProblems:
8588
errors: 0
8689
timeout: 60

0 commit comments

Comments
 (0)