Captured on 2026-05-04 against the readiness branch.
- PR: #532
- Base:
codex/roadmap-readiness-20260504 - Head:
codex/live-action-smoke-20260504 - Workflow run: https://github.com/bssm-oss/CodeAgora/actions/runs/25317789874
- Review job: https://github.com/bssm-oss/CodeAgora/actions/runs/25317789874/job/74219180113
- Review output: #532 (review)
- Head SHA:
784ff6322b85b6b766a26ae4d793bb615a356551 - Base SHA:
38533d467f9ec7ee97fb4ae8f9176be8046027d6
Result:
review: success, 22 seconds.size-label: success, 5 seconds.- CodeAgora posted a GitHub PR review through the real composite Action path.
- Verdict:
ACCEPT. - Session:
2026-05-04/001. - Review body reported no issues across 3 reviewers.
- Posting used
post-results: true,max-diff-lines: 5000, andconfig-path: .ca/config.json. - The first review post attempted
APPROVE, received GitHub 422 becauseGITHUB_TOKENcannot approve PRs, then downgraded toCOMMENTand preserved the review body.
The temporary fixture PR was closed after evidence capture and the remote branch was deleted.
- PR: #531
- Workflow run: https://github.com/bssm-oss/CodeAgora/actions/runs/25317537322
- Review job: https://github.com/bssm-oss/CodeAgora/actions/runs/25317537322/job/74218381302
- Head SHA:
38533d467f9ec7ee97fb4ae8f9176be8046027d6 - Base SHA:
0dc5ded15641f3acd8308decd355494bd57f2230
Result:
review: success, 10 seconds.- PR checks also passed for CI Node 20, CI Node 22, and PR size label.
- Action detected a diff of 11,483 lines against the 5,000 line limit and skipped review with a structured warning instead of running a partial provider review.
The remaining degraded Action paths are deterministic regression coverage rather than additional live provider runs. They are kept separate from the same-repo PR smoke above so release notes do not mistake simulated degraded coverage for live provider quality evidence.
| Scenario | Evidence | Result |
|---|---|---|
| Fork PR, even with provider secrets present | pnpm vitest run src/tests/github-action-parse-args.test.ts packages/github/src/tests/action-runtime.test.ts |
determineActionPolicy() returns SKIPPED, degraded: true, and degradedReason: "untrusted-fork-pr" before reviewer/provider invocation |
Same-repository GitHub Models path with only GITHUB_TOKEN |
pnpm vitest run src/tests/github-action-parse-args.test.ts |
determineActionPolicy() runs and posts because GitHub Models uses the workflow GITHUB_TOKEN; fork PRs remain skipped as untrusted-fork-pr |
| Missing GitHub token while posting is enabled | pnpm vitest run src/tests/github-action-parse-args.test.ts |
returns SKIPPED, degraded: true, and degradedReason: "missing-github-token" |
| Stale or force-pushed head SHA | pnpm vitest run src/tests/github-action-parse-args.test.ts |
isStaleHead() detects mismatched expected/current head SHAs before posting |
| Runtime provider/API failure | pnpm vitest run src/tests/critical-core-errors-orchestrator.test.ts |
all-reviewer provider failures produce an error result with provider/API failure details, classified reviewer causes, agora doctor --live guidance, and the failed session path |
| Provider-free GitHub Models CI path | pnpm vitest run src/tests/github-actions-runtime.test.ts |
generated workflow uses models: read and github-models so the same-repo live smoke can run without external provider quota |
| Invalid inline position / GitHub 422 | pnpm vitest run packages/github/src/tests/github-poster.test.ts |
first posts with inline comments, then retries summary-only without successful probe reviews or duplicate side effects |
| GitHub Actions approval permission 422 | pnpm vitest run packages/github/src/tests/github-poster.test.ts |
downgrades APPROVE to COMMENT only for the specific GitHub Actions approval permission error |
Stable release notes should cite the live same-repo and oversized PR run IDs separately from this deterministic degraded-path matrix.