Skip to content

Automation agent#1262

Closed
RT-Mukeshkanna wants to merge 3 commits into
github:mainfrom
RT-Mukeshkanna:automation-agent
Closed

Automation agent#1262
RT-Mukeshkanna wants to merge 3 commits into
github:mainfrom
RT-Mukeshkanna:automation-agent

Conversation

@RT-Mukeshkanna
Copy link
Copy Markdown

Pull Request Checklist

  • I have read and followed the CONTRIBUTING.md guidelines.
  • I have read and followed the Guidance for submissions involving paid services.
  • My contribution adds a new instruction, prompt, agent, skill, or workflow file in the correct directory.
  • The file follows the required naming convention.
  • The content is clearly structured and follows the example format.
  • I have tested my instructions, prompt, agent, skill, or workflow with GitHub Copilot.
  • I have run npm start and verified that README.md is up to date.
  • I am targeting the staged branch for this pull request.

Description


Type of Contribution

  • New instruction file.
  • New prompt file.
  • New agent file.
  • New plugin.
  • New skill file.
  • New agentic workflow.
  • Update to existing instruction, prompt, agent, plugin, skill, or workflow.
  • Other (please specify):

Additional Notes


By submitting this pull request, I confirm that my contribution abides by the Code of Conduct and will be licensed under the MIT License.

Copilot AI review requested due to automatic review settings April 2, 2026 07:35
Copy link
Copy Markdown
Contributor

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ This PR targets main, but PRs should target staged.

The main branch is auto-published from staged and should not receive direct PRs.
Please close this PR and re-open it against the staged branch.

You can change the base branch using the Edit button at the top of this PR,
or run: gh pr edit 1262 --base staged

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds a new custom agent definition intended to guide automated test creation for the RentlyQE framework.

Changes:

  • Introduces a new agent file defining workflow, architecture rules, and templates for RentlyQE automation.
  • Specifies a large toolset and prescriptive steps for credential handling, DB context retrieval, and TestLink-based test generation.

tools: ['edit', 'runNotebooks', 'search', 'new', 'runCommands', 'runTasks', 'Copilot Container Tools/*', 'playwright/*', 'tlink-docker-global/*', 'usages', 'vscodeAPI', 'problems', 'changes', 'testFailure', 'openSimpleBrowser', 'fetch', 'githubRepo', 'extensions', 'todos', 'runSubagent']
---

# RentlyQE Automation Tester Agent
Copy link

Copilot AI Apr 2, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

docs/README.agents.md doesn’t appear to include this new agent yet. In this repo, agent lists are generated—please run the update script (npm start / npm run build per CONTRIBUTING.md) and commit the resulting docs/README.agents.md changes so the new agent is discoverable.

Copilot uses AI. Check for mistakes.
@@ -0,0 +1,267 @@
---
Copy link

Copilot AI Apr 2, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The agent frontmatter is missing name and model. CONTRIBUTING.md’s agent example includes both (and notes required frontmatter fields), and adding them improves listing/filtering on the generated site/README.

Suggested change
---
---
name: 'rently-qe-automation-coding'
model: 'gpt-4.1'

Copilot uses AI. Check for mistakes.
Comment on lines +35 to +38
[Determine_URL] = Context-aware. Template values: Admin=https://rently.rentlyqeop.com/admin/login, Manager=https://rently.rentlyqeop.com/, Renter=https://homes.rentlyqeop.com/, SmartHome=https://smarthome.rentlyqeop.com. Auto-select when clear, present options if ambiguous.
[Confirm_Credentials] = REQUIRED. First check existing TestData/{TeamName}/*Data.json for matching credentials. If found: Reuse JSON key. If new: Create entry in TestData/{TeamName}/{PageName}Data.json. Never hardcode. Format: {"loginCredentials":{"username":"test@rently.com","password":"Pass123"}}
[Retrieve_DB_Context] = MANDATORY. Before code generation, search Weaviate DB (Rently collection) for relevant context. Query: Test case description/feature name. Use semantic_search to retrieve existing implementations, data structures, locators, workflows. Enhances code accuracy and consistency.
[Reference_TestLink] = DEFAULT SOURCE. Use TestLink as primary test spec source. Tools: mcp_tlink-docker-_search_test_cases_weaviate, mcp_tlink-docker-_list_test_cases, mcp_tlink-docker-_search_testcase_by_id. Workflow: ID/description → Search → Extract specs → Generate code.
Copy link

Copilot AI Apr 2, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This agent makes semantic_search mandatory (e.g., for DB context retrieval), but semantic_search is not included in the frontmatter tools list. Either add semantic_search to tools (or configure an MCP server that provides it) or revise the instructions to use only the declared tools.

Copilot uses AI. Check for mistakes.
[Determine_URL] = Context-aware. Template values: Admin=https://rently.rentlyqeop.com/admin/login, Manager=https://rently.rentlyqeop.com/, Renter=https://homes.rentlyqeop.com/, SmartHome=https://smarthome.rentlyqeop.com. Auto-select when clear, present options if ambiguous.
[Confirm_Credentials] = REQUIRED. First check existing TestData/{TeamName}/*Data.json for matching credentials. If found: Reuse JSON key. If new: Create entry in TestData/{TeamName}/{PageName}Data.json. Never hardcode. Format: {"loginCredentials":{"username":"test@rently.com","password":"Pass123"}}
[Retrieve_DB_Context] = MANDATORY. Before code generation, search Weaviate DB (Rently collection) for relevant context. Query: Test case description/feature name. Use semantic_search to retrieve existing implementations, data structures, locators, workflows. Enhances code accuracy and consistency.
[Reference_TestLink] = DEFAULT SOURCE. Use TestLink as primary test spec source. Tools: mcp_tlink-docker-_search_test_cases_weaviate, mcp_tlink-docker-_list_test_cases, mcp_tlink-docker-_search_testcase_by_id. Workflow: ID/description → Search → Extract specs → Generate code.
Copy link

Copilot AI Apr 2, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The TestLink tool names referenced here (mcp_tlink-docker-_...) don’t match the declared tool namespace in frontmatter (tlink-docker-global/*). Please align the documentation with the actual tool IDs the agent can call (and/or add the correct MCP server config) so users aren’t instructed to use non-existent tools.

Suggested change
[Reference_TestLink] = DEFAULT SOURCE. Use TestLink as primary test spec source. Tools: mcp_tlink-docker-_search_test_cases_weaviate, mcp_tlink-docker-_list_test_cases, mcp_tlink-docker-_search_testcase_by_id. Workflow: ID/description → Search → Extract specs → Generate code.
[Reference_TestLink] = DEFAULT SOURCE. Use TestLink as primary test spec source. Tools: tlink-docker-global/search_test_cases_weaviate, tlink-docker-global/list_test_cases, tlink-docker-global/search_testcase_by_id. Workflow: ID/description → Search → Extract specs → Generate code.

Copilot uses AI. Check for mistakes.
@@ -0,0 +1,267 @@
---
description: 'Automation Agent for RentlyQE Framework'
tools: ['edit', 'runNotebooks', 'search', 'new', 'runCommands', 'runTasks', 'Copilot Container Tools/*', 'playwright/*', 'tlink-docker-global/*', 'usages', 'vscodeAPI', 'problems', 'changes', 'testFailure', 'openSimpleBrowser', 'fetch', 'githubRepo', 'extensions', 'todos', 'runSubagent']
Copy link

Copilot AI Apr 2, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tools includes an entry with spaces (Copilot Container Tools/*). Tool identifiers elsewhere in this repo are slash-delimited IDs without spaces; this may prevent tool resolution. Consider verifying the exact toolset ID and updating it to the canonical name used by Copilot/MCP.

Suggested change
tools: ['edit', 'runNotebooks', 'search', 'new', 'runCommands', 'runTasks', 'Copilot Container Tools/*', 'playwright/*', 'tlink-docker-global/*', 'usages', 'vscodeAPI', 'problems', 'changes', 'testFailure', 'openSimpleBrowser', 'fetch', 'githubRepo', 'extensions', 'todos', 'runSubagent']
tools: ['edit', 'runNotebooks', 'search', 'new', 'runCommands', 'runTasks', 'copilot-container-tools/*', 'playwright/*', 'tlink-docker-global/*', 'usages', 'vscodeAPI', 'problems', 'changes', 'testFailure', 'openSimpleBrowser', 'fetch', 'githubRepo', 'extensions', 'todos', 'runSubagent']

Copilot uses AI. Check for mistakes.
Comment on lines +188 to +189
[Pre_Development] = Present template OR ask Team Name. Check existing credentials in JSON (reuse if found). Retrieve DB Context from Rently collection (MANDATORY semantic_search with TEST_DESCRIPTION). Determine URL. Confirm/create credentials in JSON. Reference TestLink. Check existing reusable logic.
[Pre_Development] = Ask Team Name. Retrieve DB Context from Rently collection (MANDATORY semantic_search). Determine URL. Confirm credentials in JSON. Reference TestLink. Check existing reusable logic.
Copy link

Copilot AI Apr 2, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The ::QUALITY_CHECKLIST:: has two different [Pre_Development] entries with the same key, which creates ambiguity about which checklist to follow. Recommend merging into a single ordered checklist (or renaming them) to avoid contradictory guidance.

Suggested change
[Pre_Development] = Present template OR ask Team Name. Check existing credentials in JSON (reuse if found). Retrieve DB Context from Rently collection (MANDATORY semantic_search with TEST_DESCRIPTION). Determine URL. Confirm/create credentials in JSON. Reference TestLink. Check existing reusable logic.
[Pre_Development] = Ask Team Name. Retrieve DB Context from Rently collection (MANDATORY semantic_search). Determine URL. Confirm credentials in JSON. Reference TestLink. Check existing reusable logic.
[Pre_Development] = Present template OR ask Team Name. Retrieve DB Context from Rently collection (MANDATORY semantic_search with TEST_DESCRIPTION). Determine URL. Check existing credentials in JSON (reuse if found) and confirm/create credentials in JSON if missing. Reference TestLink. Check existing reusable logic.

Copilot uses AI. Check for mistakes.
TEST_DESCRIPTION = Create new invoice for property
TESTLINK_ID = TC-BIL-789

[Example_No_Login] =
Copy link

Copilot AI Apr 2, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[Example_No_Login] is empty and the ::TROUBLESHOOTING:: section begins immediately after it, which makes the examples section hard to follow. Please either provide the no-login example content or remove the placeholder so sections don’t get interleaved.

Suggested change
[Example_No_Login] =

Copilot uses AI. Check for mistakes.
[Missing_Team] = Present template first. If not provided, ask "Which team?" and validate against valid teams
[Invalid_Template] = If template format invalid, display correct format and request re-submission or switch to Q&A mode
[Credential_Reuse] = Always check TestData/{Team}/*Data.json before creating new credentials. Reuse existing when possible.
TESTLINK_ID = TC-RPC-321
Copy link

Copilot AI Apr 2, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There’s a stray TESTLINK_ID = TC-RPC-321 line inside the troubleshooting block, which looks like it belongs in the example templates instead. Moving/removing it would prevent confusing users about where TestLink IDs should be provided.

Suggested change
TESTLINK_ID = TC-RPC-321

Copilot uses AI. Check for mistakes.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants