Add /ort-ci skill for triaging and re-running CI checks#29721
Open
tianleiwu wants to merge 2 commits into
Open
Add /ort-ci skill for triaging and re-running CI checks#29721tianleiwu wants to merge 2 commits into
tianleiwu wants to merge 2 commits into
Conversation
Contributor
There was a problem hiding this comment.
Pull request overview
This PR adds a new /ort-ci agent skill and supporting tooling to help contributors triage ONNX Runtime CI on pull requests, with guidance on when to diagnose vs. re-run checks and how to unblock common required checks.
Changes:
- Added a new
/ort-ciskill documenting CI triage, re-run workflows, and playbooks for common required checks (GitHub Actions, Azure Pipelines QNN, CLA bot, Python format, doc-gen). - Added
tools/scripts/rerun_failed_ci.shto selectively re-run genuinely failed/cancelled GitHub Actions runs for a PR head SHA while avoiding duplicate in-flight reruns. - Linked the new skill from
AGENTS.md.
Reviewed changes
Copilot reviewed 3 out of 3 changed files in this pull request and generated 2 comments.
| File | Description |
|---|---|
.agents/skills/ort-ci/SKILL.md |
New CI triage/re-run/unblock playbook for PR checks (GHA + Azure Pipelines QNN + special checks). |
tools/scripts/rerun_failed_ci.sh |
Helper script to re-run failed/cancelled GitHub Actions runs for a PR head SHA, with duplicate-run avoidance. |
AGENTS.md |
Adds a CI section pointing contributors/agents to /ort-ci. |
Comment on lines
+75
to
+79
| def active: ["queued","in_progress","requested","pending","waiting"]; | ||
| def needs_rerun: ["failure","cancelled","timed_out","startup_failure","action_required","stale"]; | ||
| group_by(.workflowName)[] | ||
| | { latest: (sort_by(.createdAt) | last), | ||
| has_active: (any(.[]; .status as $s | active | index($s) != null)) } |
Comment on lines
+205
to
+207
| gh pr view <number> --repo microsoft/onnxruntime --json comments \ | ||
| --jq '.comments[] | select(.author.login=="azure-pipelines") | ||
| | {createdAt, body}' | tail |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Adds a new
/ort-ciagent skill that documents how to trigger, re-run, and unblock ONNX Runtime CI checks on a GitHub pull request, plus a helper script that safely re-runs only genuinely failed/cancelled GitHub Actions workflows. The skill emphasizes diagnosing each failure before re-running, since most CI failures require a code change and re-running them just fails again.Key Changes
.agents/skills/ort-ci/SKILL.mdtools/scripts/rerun_failed_ci.sh--dry-runand auto-detectsowner/repo.AGENTS.mdCIsection pointing to the new/ort-ciskill.The skill covers the current ORT CI topology (as of 2026-07): nearly all checks run as GitHub Actions; only
Linux Android Emulator QNN CI Pipelineremains on Azure Pipelines, plus the bot-drivenlicense/claandPython formatchecks. It includes step-by-step playbooks for:rerun_failed_ci.sh)license/claPython formatrequired check/azp runand direct fallback)Windows GPU Doc Gen CIcheck when operator docs are out of dateTesting Notes
rerun_failed_ci.shwas exercised in--dry-runmode against live PRs (e.g../rerun_failed_ci.sh <pr> --dry-run) to confirm it correctly lists failed/cancelled workflows and triggers nothing.ghCLI and uses onlygh's built-in--jq(no externaljqbinary needed).