Skip to content

Commit 3425a5d

Browse files
committed
Update quarto-preview-test skill to support test matrix lookup
The skill now supports three invocation modes: - By test ID: /quarto-preview-test T17 T18 - By topic: /quarto-preview-test root URL (fuzzy match + confirm) - No args: ad-hoc preview testing workflow Also add tests/docs/manual/README.md documenting all manual test suites.
1 parent 15f5888 commit 3425a5d

2 files changed

Lines changed: 48 additions & 2 deletions

File tree

.claude/commands/quarto-preview-test/SKILL.md

Lines changed: 31 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -100,9 +100,38 @@ See `llm-docs/preview-architecture.md` for the full architecture.
100100
- Testing render output only (no live preview needed) — use `quarto render`
101101
- CI environments without browser access
102102

103-
## Test Fixtures and Cases
103+
## Test Matrix
104104

105-
Test fixtures live in `tests/docs/manual/preview/`. The full test matrix is in `tests/docs/manual/preview/README.md`.
105+
The full test matrix lives in `tests/docs/manual/preview/README.md`. Test fixtures live alongside it in `tests/docs/manual/preview/`.
106+
107+
### Running specific tests by ID
108+
109+
When invoked with test IDs (e.g., `/quarto-preview-test T17 T18`):
110+
111+
1. Read `tests/docs/manual/preview/README.md`
112+
2. Find each requested test by its ID (e.g., `#### T17:`)
113+
3. Parse the **Setup**, **Steps**, and **Expected** fields
114+
4. Execute each test following the steps, using the fixtures in `tests/docs/manual/preview/`
115+
5. Report PASS/FAIL for each test with the actual vs expected result
116+
117+
### Running tests by topic
118+
119+
When invoked with a topic description instead of IDs (e.g., `/quarto-preview-test root URL` or "run preview tests for single-file"):
120+
121+
1. Read `tests/docs/manual/preview/README.md`
122+
2. Search test titles and descriptions for matches (keywords, issue numbers, feature area)
123+
3. Present the matched tests to the user for confirmation before running:
124+
```
125+
Found these matching tests:
126+
- T17: Single-file preview — root URL accessible (#14298)
127+
- T18: Single-file preview — named output URL also accessible
128+
Run these? [Y/n]
129+
```
130+
4. Only execute after user confirms
131+
132+
### Running without arguments
133+
134+
When invoked without test IDs or topic (e.g., `/quarto-preview-test`), use the general Edit-Verify Cycle workflow described above for ad-hoc preview testing. The test matrix is for targeted regression testing.
106135

107136
## Baseline Comparison
108137

tests/docs/manual/README.md

Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
1+
# Manual Tests
2+
3+
Tests that require interactive sessions, external services, or browser access that cannot run in automated CI.
4+
5+
## Test Suites
6+
7+
| Directory / File | Area | Skill | Description |
8+
|-----------------|------|-------|-------------|
9+
| `preview/` | `quarto preview` | `/quarto-preview-test` | Live preview server behavior: URL routing, file watching, live reload, transient file cleanup |
10+
| `publish-connect-cloud/` | `quarto publish` || Posit Connect Cloud publishing with OAuth flow |
11+
| `mermaid-svg-pdf-tooling.qmd` | `quarto render` || Mermaid SVG rendering to PDF with external tooling (rsvg-convert) |
12+
13+
## Running Tests
14+
15+
Each suite has its own README with test matrix and execution instructions. Test fixtures live alongside the README in each directory.
16+
17+
For preview tests, use the `/quarto-preview-test` skill which automates the start-verify-cleanup cycle.

0 commit comments

Comments
 (0)