Skip to content

Commit b143042

Browse files
AliMahmoudzadehAli Mahmoudzadeh
andauthored
added agent as category for csat (#5080)
Co-authored-by: Ali Mahmoudzadeh <amah@microsoft.com>
1 parent 187a157 commit b143042

2 files changed

Lines changed: 2 additions & 2 deletions

File tree

assets/evaluators/builtin/customer_satisfaction/spec.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ displayName: "Customer-Satisfaction-Evaluator"
55
description: "Evaluates the predicted customer satisfaction level of an AI agent interaction on a 1-5 Likert scale. This evaluator assesses whether the agent's response would likely result in a satisfied customer based on helpfulness, completeness, tone, and resolution of the user's needs. Useful for measuring customer support quality, chatbot effectiveness, and overall user experience."
66
evaluatorType: "builtin"
77
evaluatorSubType: "code"
8-
categories: ["business"]
8+
categories: ["agents", "business"]
99
tags:
1010
provider: "Microsoft"
1111
is_continuous_scenario: "true"

assets/evaluators/builtin/task_completion/evaluator/_task_completion.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -725,7 +725,7 @@ def validate_eval_input(self, eval_input: Dict[str, Any]) -> bool:
725725
if not has_text:
726726
raise EvaluationException(
727727
message=(
728-
"The last assistant message must contain text content, "
728+
"The last message must contain text content, "
729729
"not only tool calls. The conversation appears to be "
730730
"mid-execution — provide the agent's final text response."
731731
),

0 commit comments

Comments
 (0)