Commit 26987f7
committed
refactor(evals): migrate skill extraction to componentEvalTest
Replaces the evalTest approach (full CLI subprocess + loadCliConfig) with
componentEvalTest (in-process makeFakeConfig + direct startMemoryService).
Key changes:
- ComponentRig now creates an isolated homeDir and stubs GEMINI_CLI_HOME
after auth to isolate storage paths (sessions, skills, extraction state).
- ComponentRig.cleanup() calls config.dispose() and vi.unstubAllEnvs().
- Skill extraction evals pass approvalMode: YOLO to auto-approve tool
calls (write_file/read_file) in non-interactive mode.
- Removes ~100 lines of boilerplate (withRigStorage, waitForExtractionState,
loadCliConfig, loadSettings, process.chdir).1 parent ef522bb commit 26987f7
2 files changed
Lines changed: 102 additions & 200 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
16 | 16 | | |
17 | 17 | | |
18 | 18 | | |
| 19 | + | |
19 | 20 | | |
20 | 21 | | |
21 | 22 | | |
| |||
52 | 53 | | |
53 | 54 | | |
54 | 55 | | |
| 56 | + | |
55 | 57 | | |
56 | 58 | | |
57 | 59 | | |
| |||
61 | 63 | | |
62 | 64 | | |
63 | 65 | | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
64 | 69 | | |
65 | 70 | | |
66 | 71 | | |
| |||
89 | 94 | | |
90 | 95 | | |
91 | 96 | | |
92 | | - | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
93 | 100 | | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
| 106 | + | |
94 | 107 | | |
95 | 108 | | |
96 | 109 | | |
| 110 | + | |
| 111 | + | |
97 | 112 | | |
| 113 | + | |
98 | 114 | | |
99 | 115 | | |
100 | 116 | | |
| |||
0 commit comments