Skip to content

Commit 0e99e7d

Browse files
christsoclaude
andcommitted
refactor: consolidate targets.yaml to root .agentv/
Merge examples/features/.agentv/ and examples/showcase/.agentv/ into the root .agentv/ directory. Adds all missing targets (azure, azure-llm, claude, claude-sdk, pi with tools, codex with cwd/log_dir). Per-eval .agentv folders are preserved for eval-specific overrides. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
1 parent 45a7a91 commit 0e99e7d

5 files changed

Lines changed: 40 additions & 139 deletions

File tree

.agentv/targets.yaml

Lines changed: 40 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,6 @@
1-
# AgentV Self-Evaluation Targets
2-
# Used to evaluate proposed changes against AGENTS.md design principles
1+
# AgentV Evaluation Targets
2+
# Consolidated from root, examples/features, and examples/showcase.
3+
# Per-eval .agentv folders override these for specific eval cases.
34

45
targets:
56
- name: default
@@ -20,25 +21,51 @@ targets:
2021
grader_target: default
2122
log_format: json
2223

23-
- name: pi-cli
24-
provider: pi-cli
24+
- name: claude
25+
provider: claude
26+
grader_target: default
27+
log_format: json
28+
29+
- name: claude-sdk
30+
provider: claude-sdk
31+
grader_target: default
32+
log_format: json
33+
34+
- name: pi
35+
provider: pi-coding-agent
2536
subprovider: openrouter
26-
model: openai/gpt-5.1-codex
37+
model: openai/gpt-5.4
2738
api_key: ${{ OPENROUTER_API_KEY }}
28-
grader_target: gemini-flash
39+
grader_target: default
40+
tools: read,bash,edit,write
41+
log_format: json
2942

30-
- name: pi-coding-agent
31-
provider: pi-coding-agent
43+
- name: pi-cli
44+
provider: pi-cli
3245
subprovider: openrouter
33-
model: z-ai/glm-4.7
46+
model: openai/gpt-5.1-codex
3447
api_key: ${{ OPENROUTER_API_KEY }}
35-
system_prompt: "Answer directly based on the information provided."
36-
grader_target: gemini-flash
48+
grader_target: default
3749

3850
- name: codex
3951
provider: codex
40-
grader_target: gemini-llm
41-
log_format: json # Optional: 'summary' (default) or 'json' for raw event logs
52+
grader_target: default
53+
cwd: ${{ CODEX_WORKSPACE_DIR }}
54+
log_dir: ${{ CODEX_LOG_DIR }}
55+
log_format: json
56+
57+
- name: azure
58+
provider: azure
59+
endpoint: ${{ AZURE_OPENAI_ENDPOINT }}
60+
api_key: ${{ AZURE_OPENAI_API_KEY }}
61+
model: ${{ AZURE_DEPLOYMENT_NAME }}
62+
63+
- name: azure-llm
64+
provider: azure
65+
endpoint: ${{ AZURE_OPENAI_ENDPOINT }}
66+
api_key: ${{ AZURE_OPENAI_API_KEY }}
67+
model: ${{ AZURE_DEPLOYMENT_NAME }}
68+
version: ${{ AZURE_OPENAI_API_VERSION }}
4269

4370
- name: gemini-llm
4471
provider: gemini

examples/features/.agentv/targets.yaml

Lines changed: 0 additions & 100 deletions
This file was deleted.

examples/showcase/.agentv/config.yaml

Lines changed: 0 additions & 3 deletions
This file was deleted.

examples/showcase/.agentv/targets.yaml

Lines changed: 0 additions & 23 deletions
This file was deleted.

0 commit comments

Comments
 (0)