Skip to content

Commit 2f5b89e

Browse files
authored
Add ready-for-review AW accuracy reviewer workflow (#1411)
1 parent be8cd4b commit 2f5b89e

19 files changed

Lines changed: 1700 additions & 22 deletions

.github/workflows/aw-accuracy-reviewer.lock.yml

Lines changed: 1613 additions & 0 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Lines changed: 65 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,65 @@
1+
---
2+
emoji:
3+
name: AW Accuracy PR Reviewer
4+
description: >
5+
Reviews ready-for-review pull requests for GitHub Agentic Workflows accuracy
6+
and opens review comments on incorrect guidance.
7+
on:
8+
pull_request:
9+
types: [ready_for_review]
10+
paths:
11+
- "**/*.md"
12+
permissions:
13+
contents: read
14+
pull-requests: read
15+
copilot-requests: write
16+
strict: true
17+
network:
18+
allowed:
19+
- defaults
20+
- github
21+
tools:
22+
github:
23+
mode: gh-proxy
24+
toolsets: [pull_requests, repos]
25+
safe-outputs:
26+
create-pull-request-review-comment:
27+
max: 20
28+
timeout-minutes: 20
29+
---
30+
31+
# AW Accuracy PR Reviewer
32+
33+
## Task
34+
35+
Review this ready-for-review pull request for factual accuracy about GitHub
36+
Agentic Workflows (`gh-aw`).
37+
38+
Before reviewing, read `.github/skills/agentic-workflows/SKILL.md` and apply the
39+
relevant guidance exactly as if the author had asked for the
40+
`/agentic-workflows` skill. Load only the upstream gh-aw reference files needed
41+
for the changed content.
42+
43+
Review only the changed files in this pull request that match the workflow
44+
trigger scope. Focus on statements about:
45+
46+
- `gh aw` commands, flags, and workflow lifecycle
47+
- workflow frontmatter, trigger syntax, tools, permissions, skills, safe
48+
outputs, and network rules
49+
- rendered gh-aw documentation links under `https://github.github.com/gh-aw/`
50+
51+
Use the pull request diff, changed line context, and current repository files to
52+
confirm whether a statement is incorrect, outdated, or misleading. Report only
53+
high-confidence factual problems. Do not comment on style, tone, formatting, or
54+
optional alternative approaches.
55+
56+
## Review rules
57+
58+
- Post one `create-pull-request-review-comment` per confirmed inaccuracy on the
59+
exact changed line when possible.
60+
- Quote the incorrect claim, explain the correct current behavior briefly, and
61+
suggest the smallest accurate fix.
62+
- Skip files or changes that do not make agentic workflow claims.
63+
- Avoid duplicate comments when one precise review comment covers the problem.
64+
- Call `noop` with a short reason when the changed content is accurate or when
65+
nothing in scope needs review.

.github/workflows/curriculum-evaluator.lock.yml

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

.github/workflows/guidelines-enforcer.lock.yml

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

.github/workflows/manual-semver-release.lock.yml

Lines changed: 6 additions & 6 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

.github/workflows/markdown-dedup.lock.yml

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

.github/workflows/security-side-quest.lock.yml

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

.github/workflows/side-quest.lock.yml

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

.github/workflows/title-similarity-review.lock.yml

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

.github/workflows/training-plan-research.lock.yml

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)