Skip to content

[codex] Speed up MCP tool CLI coverage test - #240

Merged
ScriptedAlchemy merged 2 commits into
masterfrom
codex/slow-junit-tests
Jul 3, 2026
Merged

[codex] Speed up MCP tool CLI coverage test#240
ScriptedAlchemy merged 2 commits into
masterfrom
codex/slow-junit-tests

Conversation

@ScriptedAlchemy

Copy link
Copy Markdown
Owner

Summary

  • downloaded 40 recent Windows nextest JUnit XML reports across 8 successful master CI runs
  • identified tool_skill_coverage_test::every_mcp_tool_is_invocable_via_the_cli as the slowest consistent Windows test: median 3.2765s, average 3.359s, max 3.852s
  • moved dynamic tracedecay tool <name> --help rendering into the library and reused it from the CLI
  • changed the broad MCP coverage test to validate every tool's help in-process, while keeping the existing CLI smoke test for end-to-end coverage

Validation

  • cargo fmt --all -- --check
  • git diff --check
  • cargo clippy --workspace --all-targets --locked -- -D warnings
  • cargo nextest run --profile ci --locked --test agent_suite tool_skill_coverage_test::every_mcp_tool_is_invocable_via_the_cli (test body 0.020s locally)
  • cargo nextest run --profile ci --locked --test core_cli_suite cli_help_test::tool_name_help_still_prints_tool_schema
  • cargo test --locked mcp::tools::tests::tool_result_constructors_keep_internal_analytics_explicit

@changeset-bot

changeset-bot Bot commented Jul 3, 2026

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: f82e3e5

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

Renames the in-process render check to say what it actually covers and
adds a single binary invocation asserting the CLI prints exactly the
rendered help, so tool-name resolution and help dispatch stay covered
end-to-end. Also uses strip_prefix for the short-name helper.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@ScriptedAlchemy
ScriptedAlchemy marked this pull request as ready for review July 3, 2026 03:21
@chatgpt-codex-connector

Copy link
Copy Markdown

You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard.
To continue using code reviews, add credits to your account and enable them for code reviews in your settings.

@ScriptedAlchemy
ScriptedAlchemy merged commit 376c3e5 into master Jul 3, 2026
16 checks passed
@ScriptedAlchemy
ScriptedAlchemy deleted the codex/slow-junit-tests branch July 4, 2026 01:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant