|
1 | | -# User Simulation |
| 1 | +# User simulation |
2 | 2 |
|
3 | 3 | <div class="language-support-tag"> |
4 | 4 | <span class="lst-supported">Supported in ADK</span><span class="lst-python">Python v1.18.0</span> |
@@ -54,7 +54,11 @@ While the conversation plan dictates what must be accomplished, the persona dict |
54 | 54 | You'll define a conversation scenario, run a "dry run" to check the |
55 | 55 | dialogue, and then perform a full evaluation to score the agent's responses. |
56 | 56 |
|
57 | | -## User Personas |
| 57 | +## User personas |
| 58 | + |
| 59 | +<div class="language-support-tag"> |
| 60 | + <span class="lst-supported">Supported in ADK</span><span class="lst-python">Python v1.26.0</span> |
| 61 | +</div> |
58 | 62 |
|
59 | 63 | A User Persona is a role that the simulated user adopts during the conversation. |
60 | 64 | It is defined by a set of **behaviors** that dictate how the user interacts with |
@@ -91,7 +95,7 @@ below summarizes the behaviors for each persona: |
91 | 95 | | **Troubleshoot Agent Errors** | Once | Never | Never | |
92 | 96 | | **Tone** | Professional | Conversational | Conversational | |
93 | 97 |
|
94 | | -## Example: Evaluating the [`hello_world`](https://github.com/google/adk-python/tree/main/contributing/samples/core/hello_world) agent with conversation scenarios |
| 98 | +## Example: Evaluate the [`hello_world`](https://github.com/google/adk-python/tree/main/contributing/samples/core/hello_world) agent with conversation scenarios |
95 | 99 |
|
96 | 100 | To add evaluation cases containing conversation scenarios to a new or existing |
97 | 101 | [`EvalSet`](https://github.com/google/adk-python/blob/main/src/google/adk/evaluation/eval_set.py), |
@@ -224,7 +228,7 @@ The below `EvalConfig` shows the default user simulator configuration: |
224 | 228 | * You can also access the `UserPersona` object through the `{{ persona }}` |
225 | 229 | placeholder. |
226 | 230 |
|
227 | | -## Custom Personas |
| 231 | +## Custom personas |
228 | 232 |
|
229 | 233 | You can define your own custom persona by providing a `UserPersona` object in |
230 | 234 | the `ConversationScenario`. |
@@ -256,7 +260,7 @@ Example of a custom persona definition: |
256 | 260 | } |
257 | 261 | ``` |
258 | 262 |
|
259 | | -## Generating Evaluation Cases via User Simulation |
| 263 | +## Generate evaluation cases via user simulation |
260 | 264 |
|
261 | 265 | Writing evaluation cases manually can be time-consuming and may not cover all potential failure modes. ADK provides a command to automatically generate diverse and realistic conversation scenarios based on your agent's definition using the Agent Platform Eval SDK. |
262 | 266 |
|
|
0 commit comments