fix(systematic-debugging): defuse "ultrathink" keyword scanner trigger (fixes #1283)#1558
Open
ngalatis wants to merge 1 commit into
Open
Conversation
…ner trigger
The "Signals You're Doing It Wrong" bullet in systematic-debugging/SKILL.md
contains the literal token Claude Code's runtime scans for in tool result
bodies. Every Skill-tool invocation of this skill caused the harness to
inject a spurious system-reminder claiming the user requested deeper
reasoning, silently bumping every session into extended thinking.
Replace the bullet's spelling so the contiguous letter sequence the scanner
matches is broken with a hyphen. The signal text remains recognizable to
the agent and the documented action ("Question fundamentals, not just
symptoms") is unchanged.
Fixes obra#1283
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fixes #1283.
What problem are you trying to solve?
skills/systematic-debugging/SKILL.mdline 240 contains the literal token that Claude Code's runtime scans for in tool result bodies. Every time the Skill tool returns this skill's content, the harness injects:even when the user never typed it. This silently bumps every session that loads
systematic-debugginginto extended thinking, raising token cost and shifting model behavior without consent. This is exactly the issue filed in #1283 by @sk3d; I encountered it in my daily workflow.Reproduction (Claude Code 2.1.143, Opus 4.7):
superpowers:systematic-debuggingvia the Skill tool.I verified this with two independent clean subagent contexts whose own prompts did not contain the keyword. Both saw the reminder fire. Same behavior was reported by @sk3d on superpowers 5.0.7 / CC 2.1.119.
What does this PR change?
One bullet on one line:
Ultrathink→Ultra-think. Breaks the contiguous letter sequence the harness keyword scanner matches; preserves the signal's meaning for the agent and the documented action.Is this change appropriate for the core library?
Yes. The bug affects every Claude Code user of this core skill. The fix benefits all users on Claude Code regardless of project. No third-party dependency, no domain-specific content, no new harness.
What alternatives did you consider?
\Ultrathink this— rejected, substring still present, scanner still matches (this was my initial instinct in the issue comments; I was wrong).`Ultrathink this`(backticks) — same problem.U!ltrathink this(sk3d's local workaround) — works but reads as a typo.Ultra<wbr>think this— works in raw text but adds HTML to markdown.Ultra-think this(chosen) — natural English compounding, breaks the scanner, signal still readable as the same phrase by an LLM.Does this PR contain multiple unrelated changes?
No. One line, one file, one purpose.
Existing PRs
bug/claude-code/skills) — this PR addresses that exact report.Environment tested
New harness support (required if this PR adds a new harness)
Not applicable — no new harness.
Evaluation
ultrathinksubstring in the file (grep -i 'ultrathink' SKILL.mdreturns zero hits after). Since the scanner triggers on substring match in tool result bodies, no substring → no trigger. Reviewers can confirm by running the same Skill-tool repro in a fresh session against this branch.Rigor
superpowers:writing-skillsand completed adversarial pressure testing — not applicable for this change. This is a defusal of a harness side effect at the character level, not a behavior-shaping content rewrite. No bullet was added, removed, or re-worded; only the spelling of one word was broken with a hyphen. The agent's behavioral response to the signal is unchanged.Human review