Skip to content

Claude SDK and Google ADK supported-frameworks#1772

Open
svguruprasad wants to merge 9 commits into
awslabs:mainfrom
svguruprasad:feature/agentcore-harness
Open

Claude SDK and Google ADK supported-frameworks#1772
svguruprasad wants to merge 9 commits into
awslabs:mainfrom
svguruprasad:feature/agentcore-harness

Conversation

@svguruprasad

@svguruprasad svguruprasad commented Jul 11, 2026

Copy link
Copy Markdown

Amazon Bedrock AgentCore Samples Pull Request

Important

  1. We strictly follow a issue-first approach, please first open an issue relating to this Pull Request.
  2. Once this Pull Request is ready for review please attach review ready label to it. Only PRs with review ready will be reviewed.

Issue number: 1772

Concise description of the PR

Adds evaluation code samples for Google ADK and Claude Agent SDK under 02-evaluate/supported-frameworks/, because AgentCore Evaluations now supports these frameworks and we need working examples for the launch blog.

User experience

Before: No evaluation samples exist for Google ADK or Claude Agent SDK.
After: TAMs/developers can follow a step-by-step README to deploy an HR Assistant agent, run on-demand + online evaluations, and see quality scores — in < 15 minutes per framework.

Checklist

If your change doesn't seem to apply, please leave them unchecked.

  • I have reviewed the contributing guidelines
  • Add your name to CONTRIBUTORS.md
  • Have you checked to ensure there aren't other open Pull Requests for the same update/change?
  • Are you uploading a dataset?
  • Have you documented Introduction, Architecture Diagram, Prerequisites, Usage, Sample Prompts, and Clean Up steps in your example README?
  • I agree to resolve any issues created for this example in the future.
  • I have performed a self-review of this change
  • Changes have been tested
  • Changes are documented

Acknowledgment

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of the project license.

…de Agent SDK)

Add evaluation code samples for two newly-supported agent frameworks:

- google-adk/ — HR Assistant built with Google ADK + LiteLLM (routes to
  Bedrock, no external API key). Instrumented with
  openinference-instrumentation-google-adk >= 0.1.13.

- claude-agent-sdk/ — HR Assistant built with Claude Agent SDK. Instrumented
  with openinference-instrumentation-claude-agent-sdk >= 0.1.3.

Both samples:
- Implement the same HR Assistant (same 5 tools, shared mock data)
- Deploy to AgentCore Runtime as containers
- Run on-demand evaluation (Builtin.GoalSuccessRate, Correctness, Helpfulness
  + custom LLM-as-a-judge)
- Create online evaluation config for continuous monitoring
- Include idempotent cleanup scripts

Shared mock_data.py extracted for reuse across framework samples.
- Add 29 unit tests (mock data, tool logic, deploy/cleanup, Dockerfile validation)
- Fix Dockerfiles: remove invalid COPY ../ (use in-context shared/ copy)
- Add .env.example for both samples (template, no secrets)
- Validates: no real PII, tool correctness, eval scenario consistency
Claude Agent SDK (v0.2.115) uses ClaudeSDKClient + MCP tools, not a simple
Agent class. Rewritten to use:
- create_sdk_mcp_server() for tool registration
- @tool decorator with MCP-style input_schema
- ClaudeSDKClient with send_message() for invocation
- ResultMessage for response extraction

Verified locally: all imports resolve correctly for both google-adk and
claude-agent-sdk.
@svguruprasad svguruprasad changed the title Feature/agentcore harness Claude SDK and Google ADK supported-frameworks Jul 13, 2026
@BharathiSrini BharathiSrini self-requested a review July 13, 2026 18:02
@github-actions

github-actions Bot commented Jul 13, 2026

Copy link
Copy Markdown

Latest scan for commit: 0391fd8 | Updated: 2026-07-14 20:52:06 UTC

Security Scan Results

- Remove tests/ folder (reviewer request)
- Add AgentCore eval support explanation + docs links to both READMEs
- Add example trace JSON for both frameworks (AGENT, TOOL, LLM spans)
- Replace ASCII architecture diagrams with draw.io source files
  (export as PNG before merge — reviewer requested hand-drawn diagrams)
- READMEs now reference architecture.png (to be exported from .drawio)
@svguruprasad

Copy link
Copy Markdown
Author

@BharathiSrini — addressed all feedback:

Architecture diagrams added (AWS icons, draw.io)
Example traces for both frameworks
AgentCore eval support context + docs links
Tests folder removed
ruff format applied

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants