Commit 66793ab
docs(skill): backend test authoring rules — call the test fn + sandbox limits
Two authoring gaps surfaced while debugging CLI backend tests that silently passed:
1. The runner executes --code-file top-to-bottom (not pytest), so a defined-but-
uncalled test_* function never runs its assertions. Tell agents to call their
test function(s) at the end of the file.
2. The execution sandbox only has stdlib + requests + pytest + numpy + scipy.
Tests that import the project's own source modules or other packages (torch,
pandas, local app modules) fail to run. Tell agents to test the API over HTTP
with requests and not import app internals / unavailable packages.
Applies to testsprite-verify.skill.md (full note) + testsprite-verify.codex.md (bullets).
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>1 parent 18f6e6e commit 66793ab
2 files changed
Lines changed: 20 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
64 | 64 | | |
65 | 65 | | |
66 | 66 | | |
| 67 | + | |
| 68 | + | |
67 | 69 | | |
68 | 70 | | |
69 | 71 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
135 | 135 | | |
136 | 136 | | |
137 | 137 | | |
138 | | - | |
| 138 | + | |
| 139 | + | |
| 140 | + | |
| 141 | + | |
139 | 142 | | |
140 | 143 | | |
141 | 144 | | |
| |||
145 | 148 | | |
146 | 149 | | |
147 | 150 | | |
| 151 | + | |
| 152 | + | |
| 153 | + | |
148 | 154 | | |
149 | 155 | | |
| 156 | + | |
| 157 | + | |
| 158 | + | |
| 159 | + | |
| 160 | + | |
| 161 | + | |
| 162 | + | |
| 163 | + | |
| 164 | + | |
| 165 | + | |
| 166 | + | |
150 | 167 | | |
151 | 168 | | |
152 | 169 | | |
| |||
0 commit comments