Skip to content

chore(ci): improve agent workflows and skills from run feedback#2182

Merged
naqvitalha merged 4 commits into
mainfrom
chore/agent-feedback-improvements
Mar 20, 2026
Merged

chore(ci): improve agent workflows and skills from run feedback#2182
naqvitalha merged 4 commits into
mainfrom
chore/agent-feedback-improvements

Conversation

@naqvitalha
Copy link
Copy Markdown
Collaborator

@naqvitalha naqvitalha commented Mar 20, 2026

Description

Improvements to agent workflows and skills based on feedback from today's workflow runs (triage, fix, and bot). Each change addresses a specific blocker or inefficiency the agents reported.

Changes

  1. Add pod install to allowed tools (fix, bot, android-bot) — fix agent couldn't build iOS native app without it
  2. Add bundle exec to android-bot — was missing, already present in fix and bot
  3. Add git fetch origin main step (fix, bot, android-bot) — bot agent hit "no merge base" error when diffing against main
  4. raise-pr skill: use --body-file — inline --body with markdown # headers triggers Claude Code permission checks, wasting agent turns
  5. Triage skill: search closed issues — catch regressions of previously fixed bugs
  6. Triage skill: clarification on vague requests — allow comments when feature requests are too vague to act on
  7. Fix skill: feature requests skip reproduce — "reproduce first" doesn't apply to feature requests / new examples

Test plan

  • Triage agent correctly searches both open and closed issues
  • Fix agent can run pod install without permission denial
  • Bot agent can diff against main without "no merge base" error
  • Fix agent uses --body-file for PR creation

- Add pod install to allowed tools in fix, bot, and android-bot workflows
- Add bundle exec to android-bot allowed tools (was missing)
- Add git fetch origin main step to fix, bot, and android-bot workflows
  to prevent "no merge base" errors when diffing against main
- Switch raise-pr skill to use --body-file instead of inline --body
  to avoid Claude Code permission checks on markdown headers
- Triage skill: search closed issues too to catch regressions
- Triage skill: allow clarification comments on vague feature requests
- Fix skill: feature requests skip the "reproduce first" constraint
Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates the CI “agent” GitHub Actions workflows and Claude skill docs to remove blockers seen in recent agent runs (diffing against main, PR creation friction, triage duplicate detection, and fix workflow guidance).

Changes:

  • Expand agent allowlists (e.g., pod install, bundle exec) and add a git fetch origin main step to support diffing against main.
  • Adjust triage workflow triggering to run on an agent-triage label and refine triage guidance (search closed issues, ask for clarification when needed).
  • Update raise-pr and fix skills to reduce Claude Code permission-check friction and clarify when “reproduce first” applies.

Reviewed changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated 2 comments.

Show a summary per file
File Description
.github/workflows/agent-triage.yml Trigger triage on agent-triage label and ignore bot senders.
.github/workflows/agent-fix.yml Allow pod install and fetch main for diffing before running the fix agent.
.github/workflows/agent-bot.yml Allow pod install and fetch main for diffing before running the bot agent.
.github/workflows/agent-android-bot.yml Add bundle exec, pod install, and fetch main for diffing before running the Android bot agent.
.claude/skills/triage-issue/SKILL.md Search both open/closed issues; refine when triage should comment.
.claude/skills/raise-pr/SKILL.md Switch PR creation guidance to gh pr create --body-file using a temp body file.
.claude/skills/fix-github-issue/SKILL.md Clarify exception to “reproduce first” for feature requests/new example screens.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread .claude/skills/raise-pr/SKILL.md Outdated
Comment thread .claude/skills/triage-issue/SKILL.md
- raise-pr: use Write tool instead of cat for /tmp/pr-body.md (cat not in allowed tools)
- triage: fix Rules section to match Step 5 comment guidance
@naqvitalha naqvitalha enabled auto-merge (squash) March 20, 2026 23:06
@naqvitalha naqvitalha merged commit a063fce into main Mar 20, 2026
21 checks passed
@naqvitalha naqvitalha deleted the chore/agent-feedback-improvements branch March 20, 2026 23:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants