Commit b6d5c2d
test(stable-mir-ui): add external UI test harness with skip management (#968)
## Summary
- Add parametrized pytest harness running `kmir prove-rs` against every
entry in `stable-mir-json`'s `passing.tsv`
- Ship `skip.txt` (2859 entries) for known-failing cases, with
`--update-skip` mode to shrink it by re-proving skipped cases
- 300s per-test timeout via `pytest-timeout`; proof show output saved to
`tmp_path` on failure
## Usage
```bash
# Normal run (skipped cases are skipped)
RUST_DIR_ROOT=/path/to/rust make test-stable-mir-ui
# Shrink skip.txt by re-proving skipped cases
RUST_DIR_ROOT=/path/to/rust make test-stable-mir-ui TEST_ARGS="--update-skip"
```
## Test plan
- [x] `make check` passes (B011 lint fixed)
- [x] Single squashed commit, rebased on `origin/master`
---------
Co-authored-by: Daniel Cumming <124537596+dkcumming@users.noreply.github.com>
Co-authored-by: dkcumming <daniel.cumming@runtimeverification.com>1 parent 53e9dab commit b6d5c2d
6 files changed
Lines changed: 2987 additions & 2 deletions
File tree
- kmir
- src/tests/external
- data/stable-mir-ui
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
56 | 56 | | |
57 | 57 | | |
58 | 58 | | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
59 | 64 | | |
60 | 65 | | |
61 | 66 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
42 | 42 | | |
43 | 43 | | |
44 | 44 | | |
| 45 | + | |
45 | 46 | | |
46 | 47 | | |
47 | 48 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
0 commit comments