Skip to content

Improve copilot question quality by replacing obvious distractors#440

Closed
Copilot wants to merge 4 commits into
masterfrom
copilot/update-incorrect-answers
Closed

Improve copilot question quality by replacing obvious distractors#440
Copilot wants to merge 4 commits into
masterfrom
copilot/update-incorrect-answers

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented Dec 5, 2025

PR Type

  • Adding new question(s)
  • Other content changes (updating questions, answers, explanations or study resources)
  • Code changes (non-content)
  • Documentation changes
  • Other

What's new?

Reviewed all 38 copilot questions and improved 9 that could be answered through elimination without domain knowledge.

Changes by question:

  • Q003 (IDE Support): Split multi-IDE options into individual choices; replaced unsupported editors (NetBeans, BlueJ) with plausible alternatives (Sublime Text, Atom)

  • Q011 (Custom Instructions): Replaced "email GitHub support" with README.md alternative; added .copilot/config.yaml distractor

  • Q014 (Getting Started): Replaced "Request access from GitHub Support" with CLI setup and build-from-source options

  • Q020 (Benefits): Replaced "completely replaces code review" with subtle incorrect claims about guaranteed bug-free code and eliminating tests

  • Q022 (/tests Command): Replaced "permanently removes test files" with plausible alternatives about running tests and analyzing coverage

  • Q024 (Public Code Matching): Replaced "last 24 hours only" with per-request enabling option

  • Q028 (Context): Converted True/False (50% guess) to 6-option multiple choice (select 3); added environment variables and external docs as distractors

  • Q030 (Smart Actions): Replaced debugging-specific option with automation scripts and keyboard shortcuts alternatives

  • Q033 (CLI Alias): Replaced "review PRs on your behalf" with technical options about shortcuts, model switching, and command history

All changes verified against official GitHub Copilot documentation via Context7.

Related issue(s)

Screenshots

Warning

Firewall rules blocked me from connecting to one or more addresses (expand for details)

I tried to connect to the following addresses, but was blocked by firewall rules:

  • code.visualstudio.com
    • Triggering command: /usr/bin/curl curl -I -s REDACTED (dns block)
    • Triggering command: /usr/bin/curl curl -s REDACTED (dns block)
  • learn.microsoft.com
    • Triggering command: /usr/bin/curl curl -s REDACTED (dns block)

If you need me to access, download, or install something from one of these locations, you can either:

Original prompt

Go through the all content/en/questions/copilot question files one by one and search for question files with incorrect answers that are obviously incorrect and update them.

The questions should not be easy to be answered by process of elimination without required knowledge

Use context7 mcp server to leverage github documentation about any given topic


💬 We'd love your input! Share your thoughts on Copilot coding agent in our 2 minute survey.

Copilot AI and others added 3 commits December 5, 2025 17:54
…nswers

Co-authored-by: FidelusAleksander <63016446+FidelusAleksander@users.noreply.github.com>
Co-authored-by: FidelusAleksander <63016446+FidelusAleksander@users.noreply.github.com>
Co-authored-by: FidelusAleksander <63016446+FidelusAleksander@users.noreply.github.com>
Copilot AI changed the title [WIP] Update question files with incorrect answers Improve copilot question quality by replacing obvious distractors Dec 5, 2025
@FidelusAleksander FidelusAleksander deleted the copilot/update-incorrect-answers branch April 11, 2026 08:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants