Skip to content

Commit 0f164d8

Browse files
committed
eval: adversarial test cases for retro
1 parent c506c4a commit 0f164d8

1 file changed

Lines changed: 14 additions & 0 deletions

File tree

retro/evals/test_cases.yaml

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6,3 +6,17 @@
66
- "Listed what went well"
77
- "Listed what needs improvement with root causes"
88
- "Produced actionable items"
9+
10+
- id: adversarial-empty-repo
11+
prompt: "retro"
12+
expectations:
13+
- "Detected no commits or very few commits to analyze"
14+
- "Reported insufficient data for a meaningful retro"
15+
- "Did not fabricate stats or improvements"
16+
17+
- id: adversarial-custom-period
18+
prompt: "retro for the last 3 days"
19+
expectations:
20+
- "Adjusted git log timeframe to 3 days instead of default 1 week"
21+
- "Produced stats scoped to the requested period"
22+
- "Still followed the standard retro output format"

0 commit comments

Comments
 (0)