Skip to content

Commit 846e69f

Browse files
SmithSmith
authored andcommitted
feat: update CodeMapper model to Claude Sonnet 4.6 and adjust routing configurations for improved performance
1 parent c9439aa commit 846e69f

7 files changed

Lines changed: 40 additions & 11 deletions

File tree

CodeMapper-subagent.agent.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
description: Explore the codebase to find relevant files, usages, dependencies, and context for a given research goal or problem statement.
33
argument-hint: Find files, usages, dependencies, and context related to: <research goal or problem statement>
44
tools: ['search', 'usages', 'problems', 'changes', 'testFailure']
5-
model: GPT-5.4 mini (copilot)
5+
model: Claude Sonnet 4.6 (copilot)
66
model_role: fast-readonly
77
---
88
You are CodeMapper-subagent, a read-only discovery agent.

docs/agent-engineering/MODEL-ROUTING.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -43,7 +43,7 @@ While internal subagent dispatch resolves models dynamically, top-level user ent
4343

4444
- `Planner` is pinned to `GPT-5.5` so plan quality, decomposition, and risk framing use the strongest available planning model. The planner fallback ordering is governed by `governance/model-routing.json` via `roles.capable-planner` (primary: `GPT-5.5 (copilot)`, fallback 1: `Claude Opus 4.7 (copilot)`, fallback 2: `GPT-5.4 mini (copilot)`). This workflow preserves the scalar `model:` frontmatter in `Planner.agent.md` and does not imply list-valued frontmatter is required.
4545
- `CodeReviewer`, `PlanAuditor`, and `AssumptionVerifier` rely on premium adversarial reviewers (`Claude Opus 4.7`) for direct invocation and for `LARGE` or high-risk orchestrated dispatch; ordinary `TRIVIAL`, `SMALL`, and `MEDIUM` orchestrated dispatch is tier-aware as described in [Fallback semantics](#fallback-semantics).
46-
- `ExecutabilityVerifier`, `Orchestrator`, and the implementation agents typically resolve to cheaper defaults (`Claude Sonnet 4.6`, `GPT-5.4`, `GPT-5.4 mini`, `Gemini 3.1 Pro`) to contain premium usage.
46+
- `CodeMapper` is pinned to `Claude Sonnet 4.6` for capable, cost-effective codebase discovery (1× premium multiplier). `ExecutabilityVerifier`, `Orchestrator`, and the implementation agents typically resolve to contained defaults (`Claude Sonnet 4.6`, `GPT-5.4`, `GPT-5.4 mini`, `Gemini 3.1 Pro`) to balance capability and premium usage.
4747

4848
This yields a pragmatic split:
4949

evals/scenarios/orchestrator-model-resolution.json

Lines changed: 15 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -81,6 +81,20 @@
8181
"live_runtime_assertion": false
8282
}
8383
},
84+
{
85+
"case_id": "fast-readonly-codemapper-sonnet",
86+
"research_agent": "CodeMapper-subagent",
87+
"complexity_tier": "MEDIUM",
88+
"role": "fast-readonly",
89+
"resolution_mode": "inherit_from default",
90+
"dispatch_context": "Planner or Orchestrator research delegation to CodeMapper resolves through governance/model-routing.json agent_role_index.CodeMapper-subagent -> roles.fast-readonly and must pass the resolved primary model explicitly to agent/runSubagent.",
91+
"reference_expectation": {
92+
"resolved_primary_model": "Claude Sonnet 4.6 (copilot)",
93+
"resolution_source": "governance/model-routing.json roles.fast-readonly.primary",
94+
"agentName_field_used": "agentName",
95+
"live_runtime_assertion": false
96+
}
97+
},
8498
{
8599
"case_id": "executability-verifier-review-readonly-sonnet",
86100
"executor_agent": "ExecutabilityVerifier-subagent",
@@ -102,6 +116,6 @@
102116
"offline_harness_observes_live_runSubagent_model_parameters": false,
103117
"live_runtime_behavior_out_of_scope": true,
104118
"behavioral_runtime_assertions_present": false,
105-
"reference_cases_documented": 6
119+
"reference_cases_documented": 7
106120
}
107121
}

evals/tests/drift-detection.test.mjs

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -504,12 +504,12 @@ console.log('\n=== Check #6 — by_tier matrix shape ===');
504504
SMALL: { inherit_from: 'default' },
505505
MEDIUM: {
506506
primary: 'GPT-4o (copilot)',
507-
fallbacks: ['Claude Sonnet 4.5 (copilot)'],
507+
fallbacks: ['Claude Sonnet 4.6 (copilot)'],
508508
cost_tier: 'medium',
509509
latency_tier: 'medium',
510510
},
511511
LARGE: {
512-
primary: 'Claude Sonnet 4.5 (copilot)',
512+
primary: 'Claude Sonnet 4.6 (copilot)',
513513
fallbacks: ['GPT-4o (copilot)'],
514514
cost_tier: 'high',
515515
latency_tier: 'slow',

evals/tests/orchestration-handoff-contract.test.mjs

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -71,6 +71,7 @@ const _capablePlanner = resolveRoleModel('capable-planner', 'MEDIUM');
7171
const capablePlannerPrimary = _capablePlanner.primary; // GPT-5.5 (copilot)
7272
const capablePlannerFallback0 = _capablePlanner.fallbacks[0]; // Claude Opus 4.7 (copilot)
7373
const capablePlannerFallback1 = _capablePlanner.fallbacks[1]; // GPT-5.4 mini (copilot)
74+
const fastReadonlyPrimary = resolveRoleModel(modelRouting.agent_role_index['CodeMapper-subagent'], 'MEDIUM').primary;
7475

7576
let passed = 0;
7677
let failed = 0;
@@ -817,6 +818,20 @@ check(
817818
evCase?.reference_expectation?.live_runtime_assertion === false
818819
);
819820

821+
const codeMapperCase = allCases.find(c => c.case_id === 'fast-readonly-codemapper-sonnet');
822+
check(
823+
'Model resolution scenario: fast-readonly-codemapper-sonnet case exists',
824+
codeMapperCase !== undefined
825+
);
826+
check(
827+
`Model resolution scenario: CodeMapper resolves through fast-readonly to ${fastReadonlyPrimary}`, // Claude Sonnet 4.6 (copilot)
828+
codeMapperCase?.reference_expectation?.resolved_primary_model === fastReadonlyPrimary
829+
);
830+
check(
831+
'Model resolution scenario: CodeMapper live_runtime_assertion is false',
832+
codeMapperCase?.reference_expectation?.live_runtime_assertion === false
833+
);
834+
820835
const largeHighRiskCase = allCases.find(c => c.case_id === 'capable-reviewer-large-high-risk-override');
821836
check(
822837
'Model resolution scenario: capable-reviewer-large-high-risk-override case exists',

governance/model-routing.json

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -161,12 +161,12 @@
161161
}
162162
},
163163
"fast-readonly": {
164-
"primary": "GPT-5.4 mini (copilot)",
165-
"fallbacks": ["GPT-5.4 (copilot)", "Claude Sonnet 4.6 (copilot)"],
166-
"cost_tier": "low",
167-
"latency_tier": "fast",
164+
"primary": "Claude Sonnet 4.6 (copilot)",
165+
"fallbacks": ["GPT-5.4 mini (copilot)", "GPT-5.4 (copilot)"],
166+
"cost_tier": "medium",
167+
"latency_tier": "medium",
168168
"consumers": ["CodeMapper-subagent.agent.md"],
169-
"reasoning_effort_hint": "low",
169+
"reasoning_effort_hint": "medium",
170170
"by_tier": {
171171
"TRIVIAL": { "inherit_from": "default" },
172172
"SMALL": { "inherit_from": "default" },

plans/project-context.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ The following agents are available for Orchestrator phase dispatch. The `executo
66

77
| Agent | Role | Primary Use Case | Model Recommendation |
88
| --- | --- | --- | --- |
9-
| CodeMapper-subagent | Read-only discovery | Codebase exploration, file mapping | Fast model (mini) |
9+
| CodeMapper-subagent | Read-only discovery | Codebase exploration, file mapping | Capable read-only model (Sonnet 4.6) |
1010
| Researcher-subagent | Research & evidence | Deep investigation, evidence extraction | Fast model (mini) |
1111
| CoreImplementer-subagent | Backend implementation | Code creation, modification, testing | Capable model (Sonnet) |
1212
| UIImplementer-subagent | UI implementation | Components, styling, accessibility | Capable model (Sonnet) |

0 commit comments

Comments
 (0)