Skip to content

Commit 50eef93

Browse files
christsoclaude
andcommitted
fix(evals): restore workspace.template for mock agent evals
- file-changes, file-changes-graders, functional-grading: added workspace.template to eval files (was previously in target config via the now-removed workspace_template field) - agent-skills-evals: removed broken echo provider — these evals need a real agent (skill-trigger), so they use root default target Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
1 parent 0dd936a commit 50eef93

5 files changed

Lines changed: 9 additions & 14 deletions

File tree

examples/features/agent-skills-evals/.agentv/providers/echo.ts

Lines changed: 0 additions & 11 deletions
This file was deleted.

examples/features/agent-skills-evals/.agentv/targets.yaml

Lines changed: 0 additions & 3 deletions
This file was deleted.

examples/features/file-changes-graders/evals/dataset.eval.yaml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -10,6 +10,9 @@
1010

1111
description: Verify file_changes diffs are accessible to LLM grader (rubrics, built-in, and copilot-cli)
1212

13+
workspace:
14+
template: ../workspace-template
15+
1316
execution:
1417
target: mock_agent
1518

examples/features/file-changes/evals/dataset.eval.yaml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -12,6 +12,9 @@
1212
name: file-changes
1313
description: Verify file_changes captures edits, creates, and deletes across multiple tests
1414

15+
workspace:
16+
template: ../workspace-template
17+
1518
execution:
1619
target: mock_agent
1720

examples/features/functional-grading/evals/dataset.eval.yaml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -13,6 +13,9 @@
1313
name: functional-grading
1414
description: Functional grading with workspace_path — deploy-and-test pattern
1515

16+
workspace:
17+
template: ../workspace-template
18+
1619
execution:
1720
target: mock_agent
1821

0 commit comments

Comments
 (0)