Skip to content

Commit 68d9d3a

Browse files
committed
refactor(testing): simplify test runner invocation
1 parent 9c1a7d4 commit 68d9d3a

5 files changed

Lines changed: 671 additions & 647 deletions

File tree

docs/testing/test-report-output-spec.md

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -30,17 +30,18 @@ dstack-test package
3030
dstack-test render
3131
```
3232

33-
Options use kebab-case. Select an executor with `--agent codex` or `--agent claude`; do not introduce separate `--codex` or `--claude` switches.
33+
Options use kebab-case. Execution defaults to Codex; select Claude with
34+
`--agent claude`. Do not introduce separate `--codex` or `--claude` switches.
35+
`run-case` and `run-plan` generate a unique run ID when `--run-id` is omitted.
36+
Commands that operate on an existing run still require its ID.
3437

3538
<a id="report-run-case"></a>
3639
## 3. Case execution
3740

3841
```bash
3942
dstack-test run-case \
40-
--agent codex \
4143
--plan <plan> \
4244
--case <case-id-or-directory> \
43-
--run-id <run-id> \
4445
--workdir <repository> \
4546
-- "Additional execution constraints"
4647
```

tools/dstack-test/README.md

Lines changed: 3 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -12,16 +12,15 @@ self-contained interactive HTML report.
1212

1313
```bash
1414
tools/dstack-test/dstack-test run-case \
15-
--agent codex \
1615
--plan path/to/plan \
1716
--case tc-gw-pp-001 \
18-
--run-id run-20260723-001 \
1917
--workdir "$PWD" \
2018
-- "Do not restart the physical host"
2119
```
2220

23-
Use `--agent claude` for Claude Code. Additional CLI options may be passed with
24-
repeatable `--agent-arg`. The runner writes only below:
21+
The executor defaults to Codex; use `--agent claude` for Claude Code. The run ID
22+
is generated when `--run-id` is omitted. Additional CLI options may be passed
23+
with repeatable `--agent-arg`. The runner writes only below:
2524

2625
```text
2726
<case>/results/<run-id>/
@@ -38,9 +37,7 @@ repeatable `--agent-arg`. The runner writes only below:
3837

3938
```bash
4039
tools/dstack-test/dstack-test run-plan \
41-
--agent codex \
4240
--plan path/to/plan \
43-
--run-id run-20260723-001 \
4441
--context run-context.json \
4542
-- "Follow the environment restrictions in README.md"
4643
```

0 commit comments

Comments
 (0)