Skip to content

Update ADK doc according to issue #1587 - 11#1606

Open
adk-bot wants to merge 1 commit intomainfrom
agent-changes-20260409-202549
Open

Update ADK doc according to issue #1587 - 11#1606
adk-bot wants to merge 1 commit intomainfrom
agent-changes-20260409-202549

Conversation

@adk-bot
Copy link
Copy Markdown
Collaborator

@adk-bot adk-bot commented Apr 9, 2026

11. Eval Scenario Generation

Doc file: docs/evaluate/user-sim.md

Current state:

The docs/evaluate/user-sim.md document explains how to add eval cases manually using adk eval_set add_eval_case but does not mention automated generation.

Proposed Change:

Add documentation for the new adk eval_set generate_eval_cases command. Explain that this command uses the Vertex AI Eval SDK (ScenarioGenerator) to dynamically generate a suite of conversation scenarios and automatically adds them to the specified eval set based on a user simulation config file. Provide an example of how to use it: adk eval_set generate_eval_cases <agent_path> <eval_set_id> --user_simulation_config_I file <path>.

Reasoning:
This is a powerful new CLI capability that automates the tedious process of writing manual conversation scenarios for evaluation by leveraging an LLM to generate them.

Reference: src/google/adk/cli/cli_tools_click.py

@netlify
Copy link
Copy Markdown

netlify Bot commented Apr 9, 2026

Deploy Preview for adk-docs-preview ready!

Name Link
🔨 Latest commit 68a3794
🔍 Latest deploy log https://app.netlify.com/projects/adk-docs-preview/deploys/69d80b5281b3ca00081ced46
😎 Deploy Preview https://deploy-preview-1606--adk-docs-preview.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants