Skip to content

Commit ed5e30e

Browse files
wenytang-msCopilot
andcommitted
ci: enable LLM verification when secrets are available
LLM gating already has three layers in autotest: --no-llm flag, AZURE_OPENAI_ENDPOINT+API_KEY env vars, and per-step verify field. Fork PRs without secret access automatically skip the LLM block, so the unconditional --no-llm on PRs was overly defensive. Internal PRs and scheduled / manual runs with secrets now get LLM verification of every passing step (downgrades pass -> fail when LLM is confident the deterministic check was a silent pass). Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
1 parent d9843d7 commit ed5e30e

1 file changed

Lines changed: 5 additions & 4 deletions

File tree

.github/workflows/e2e-autotest.yml

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -200,12 +200,13 @@ jobs:
200200
if ($vsixFiles) { $autotestArgs += @("--vsix", $vsixFiles) }
201201
}
202202
203-
# PRs always test the branch-built VSIX against stable marketplace deps (no LLM, no pre-release).
203+
# PRs test the branch-built VSIX against stable marketplace deps.
204+
# LLM verification activates automatically when AZURE_OPENAI_* secrets
205+
# are available (e.g. internal PRs); fork PRs without secret access
206+
# simply skip the LLM step (LLMClient.isConfigured() returns false).
204207
# Scheduled & manual runs default to --pre-release unless explicitly disabled.
205208
$isPR = "${{ github.event_name }}" -eq "pull_request"
206-
if ($isPR) {
207-
$autotestArgs += "--no-llm"
208-
} elseif ("${{ inputs.pre_release }}" -ne "false") {
209+
if (-not $isPR -and "${{ inputs.pre_release }}" -ne "false") {
209210
$autotestArgs += "--pre-release"
210211
}
211212

0 commit comments

Comments
 (0)