Skip to content

Commit 3f4acc4

Browse files
wbrezaCopilot
andcommitted
ci(eval): pass COPILOT_CLI_TOKEN for Copilot SDK session auth
The copilot-sdk executor in @microsoft/vally-cli reads GITHUB_TOKEN to create a Copilot session. The default Actions GITHUB_TOKEN doesn't have Copilot API scope, causing "Session was not created with authentication info or custom provider" at eval execution time. Reuse the existing repo secret COPILOT_CLI_TOKEN (a Copilot-enabled PAT) and expose it as GITHUB_TOKEN to the eval run step. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
1 parent 0385f74 commit 3f4acc4

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

.github/workflows/eval.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -30,7 +30,7 @@ jobs:
3030
- name: Run evaluations
3131
run: npx @microsoft/vally-cli eval --eval-spec evals/azure-hosted-copilot-sdk/eval.yaml --output-dir ./results --output jsonl
3232
env:
33-
NODE_AUTH_TOKEN: ${{ secrets.VALLY_NPM_TOKEN }}
33+
GITHUB_TOKEN: ${{ secrets.COPILOT_CLI_TOKEN }}
3434
- name: Upload results
3535
if: always()
3636
uses: actions/upload-artifact@bbbca2ddaa5d8feaa63e36b76fdaad77386f024f # v7.0.0

0 commit comments

Comments
 (0)