Skip to content

Improve developer experience of MCP dev guide#347

Closed
JakeSCahill wants to merge 3 commits intomainfrom
improve-devex
Closed

Improve developer experience of MCP dev guide#347
JakeSCahill wants to merge 3 commits intomainfrom
improve-devex

Conversation

@JakeSCahill
Copy link
Copy Markdown
Contributor

@JakeSCahill JakeSCahill commented Dec 22, 2025

Description

Addresses negative feedback received on the docs site about developer experience and findability.

Changes

Developer Guide (modules/ai-agents/pages/mcp-server/developer-guide.adoc):

  • Added a quick reference section and examples to the top (< 5 min to first tool)
  • Improved structure with scannable tables (concepts, workflow)
  • Clarified that outputs/inputs can contain processors (not just top-level types)

Pipeline Patterns (modules/ai-agents/pages/mcp-server/pipeline-patterns.adoc):

  • Added "Outputs with processors" section with anchor for cross-references
  • Created example showing data enrichment before publishing

New Example:

  • modules/ai-agents/examples/resources/outputs/redpanda-publish-with-processors.yaml

Impact

Before After
20+ min reading to first success < 5 min (quickstart section)
Examples at bottom Examples at top
Linear navigation only Task-based quick navigation
Dense paragraphs Scannable tables and callouts

Reduces time to value and improves findability for developers.

Page previews

Checks

  • New feature
  • Content gap
  • Support Follow-up
  • Small fix (typos, links, copyedits, etc)

@JakeSCahill JakeSCahill requested a review from a team as a code owner December 22, 2025 15:49
@netlify
Copy link
Copy Markdown

netlify Bot commented Dec 22, 2025

Deploy Preview for redpanda-connect ready!

Name Link
🔨 Latest commit 368cc1e
🔍 Latest deploy log https://app.netlify.com/projects/redpanda-connect/deploys/69496d746d5a160008dc2940
😎 Deploy Preview https://deploy-preview-347--redpanda-connect.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented Dec 22, 2025

📝 Walkthrough

Walkthrough

This pull request substantially revises the MCP Server developer guide documentation across multiple files. Changes include adding a new quickstart section, comprehensive examples, and a redesigned multi-step development workflow (Initialize, Design Contract, Implement, Test, Connect Client, Publish). The guide introduces a tabular Concepts and architecture section, updates troubleshooting content with observable guidance, reworks project scaffolding instructions with directory structure illustrations, and enhances YAML configuration examples and rules with common mistakes section. Related partials and pipeline patterns are also restructured for improved organization and consistency.

Estimated code review effort

🎯 3 (Moderate) | ⏱️ ~20 minutes

  • YAML examples: Verify syntax correctness and alignment with current product behavior (config-examples.adoc, developer-guide-IMPROVED.adoc)
  • Cross-references and partials: Confirm all includes and anchor links are valid and point to correct sections
  • Instructions alignment: Ensure step-by-step workflow guidance matches actual MCP server development process
  • Consistency: Check that terminology and examples are consistent across all documentation files (developer-guide.adoc, pipeline-patterns.adoc, yaml-config-rules-connect.adoc)

Possibly related PRs

Suggested reviewers

  • kbatuigas
  • micheleRP

Pre-merge checks and finishing touches

✅ Passed checks (3 passed)
Check name Status Explanation
Title check ✅ Passed The title directly corresponds to the main objective of the changeset: improving the developer experience of the MCP developer guide through better structure, quicker onboarding, and enhanced findability.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Description check ✅ Passed The pull request description clearly outlines changes to the MCP developer guide and pipeline patterns documentation, addressing specific developer experience issues with concrete before/after improvements.
✨ Finishing touches
  • 📝 Generate docstrings
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Post copyable unit tests in a comment
  • Commit unit tests in branch improve-devex

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

Copy link
Copy Markdown
Contributor

@coderabbitai coderabbitai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 4

Caution

Some comments are outside the diff and can’t be posted inline due to platform limitations.

⚠️ Outside diff range comments (1)
modules/ai-agents/pages/mcp-server/pipeline-patterns.adoc (1)

119-131: Resolve the unresolved merge conflict and consolidate overlapping content sections.

The documentation contains an unresolved merge conflict marker (>>>>>>> Stashed changes) at line 117, and two overlapping sections both covering outputs with processors (lines 100-131). While the two example files serve different purposes—redpanda-output-with-processors.yaml demonstrates LLM-based preprocessing, and redpanda-publish-with-processors.yaml demonstrates metadata enrichment and validation—they should be consolidated into a single well-organized section. Either combine both examples in one section with clear use case distinctions, or restructure to eliminate the duplication and clarify when to use each pattern.

📜 Review details

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Disabled knowledge base sources:

  • Jira integration is disabled by default for public repositories

You can enable these sources in your CodeRabbit configuration.

📥 Commits

Reviewing files that changed from the base of the PR and between da5aa1d and 87a8319.

📒 Files selected for processing (3)
  • modules/ai-agents/examples/resources/outputs/redpanda-publish-with-processors.yaml
  • modules/ai-agents/pages/mcp-server/developer-guide.adoc
  • modules/ai-agents/pages/mcp-server/pipeline-patterns.adoc
🧰 Additional context used
🧠 Learnings (1)
📚 Learning: 2025-11-25T10:26:50.930Z
Learnt from: CR
Repo: redpanda-data/rp-connect-docs PR: 0
File: .github/copilot-instructions.md:0-0
Timestamp: 2025-11-25T10:26:50.930Z
Learning: The Redpanda Connect reference documentation uses a two-tier approach combining autogenerated content from source code and schemas with overrides managed in a central DRY (Don't Repeat Yourself) system

Applied to files:

  • modules/ai-agents/pages/mcp-server/developer-guide.adoc
🪛 GitHub Actions: Test MCP Examples
modules/ai-agents/examples/resources/outputs/redpanda-publish-with-processors.yaml

[error] 26-26: rpk connect mcp-server lint failed: value object is not a valid option for this field. Exit code 1.

⏰ Context from checks skipped due to timeout of 90000ms. You can increase the timeout in your CodeRabbit configuration to a maximum of 15 minutes (900000ms). (3)
  • GitHub Check: Redirect rules - redpanda-connect
  • GitHub Check: Header rules - redpanda-connect
  • GitHub Check: Pages changed - redpanda-connect
🔇 Additional comments (4)
modules/ai-agents/pages/mcp-server/developer-guide.adoc (4)

12-68: Excellent quick reference section achieving PR objectives.

The new quick reference section successfully addresses the PR's stated goal of enabling "< 5 min to first tool":

  • Clear 6-step initialization workflow with actual commands
  • Inline common tool examples (weather API, database query, Redpanda consumer)
  • Examples use include directives for maintainability
  • Tip pointing to full pipeline patterns documentation

This is a significant improvement to developer experience and makes the guide much more actionable for first-time users.


83-137: Well-structured concepts and workflow tables.

The conversion from prose to scannable tables (concepts at lines 83-101, workflow at lines 105-137) significantly improves readability and navigation:

  • Concepts table clearly defines key terminology
  • Workflow table provides step-by-step progression with section anchors
  • Visual stepper diagram (lines 105-108) gives clear mental model

These changes align with the PR objective of creating "scannable tables and callouts" instead of "dense paragraphs."


404-453: Valuable troubleshooting section with concrete examples.

The new troubleshooting section addresses a common pain point with:

  • Clear explanation of "unable to infer component type" error (lines 415-427)
  • Side-by-side incorrect vs. correct YAML examples (lines 429-452)
  • Explanation of the subtle distinction between multiple top-level types vs. processors within outputs/inputs

This should significantly reduce developer frustration and support questions.


286-286: Ensure merge conflict resolution aligns with cross-reference in developer-guide.adoc.

Line 286 in developer-guide.adoc references the anchor [[outputs-with-processors]] via xref:ai-agents:mcp-server/pipeline-patterns.adoc#outputs-with-processors[]. This anchor exists only in the stashed changes section of the pipeline-patterns.adoc merge conflict (line 96). If the merge conflict is resolved in favor of the updated upstream version, the anchor will be removed and the cross-reference will break. Ensure both files are resolved consistently to preserve the cross-reference functionality.

Comment thread modules/ai-agents/pages/mcp-server/developer-guide.adoc Outdated
Comment thread modules/ai-agents/pages/mcp-server/developer-guide.adoc Outdated
Comment thread modules/ai-agents/pages/mcp-server/pipeline-patterns.adoc Outdated
@JakeSCahill
Copy link
Copy Markdown
Contributor Author

@coderabbitai review

@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented Dec 22, 2025

✅ Actions performed

Review triggered.

Note: CodeRabbit is an incremental review system and does not re-review already reviewed commits. This command is applicable only when automatic reviews are paused.

@JakeSCahill
Copy link
Copy Markdown
Contributor Author

closing in favor of #348

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant