fix(conformance): make the pack generator runnable from a clean checkout by gHashTag · Pull Request #1576 · gHashTag/t27

gHashTag · 2026-07-31T09:36:28Z

conformance/vectors/gen_all_formats.py — the script that produces all 83 conformance packs — reads its catalog from a hardcoded path:

CATALOG_LINES = "/tmp/catalog_lines.txt"

That file is not in the repository. On a clean checkout the generator raises FileNotFoundError in parse_catalog() before producing anything, so the corpus can be read but not regenerated. For an artifact whose stated contribution is reproducible bit-exact conformance vectors, the generator not running from a fresh clone is the weakest link in the chain.

The catalog itself was never missing. specs/numeric/formats_catalog.t27 carries all 83 rows as trailing // CATALOG: id=... name=... bits=... comments — the same lines catalog-count-gate.yml counts to enforce the 83-format invariant, in exactly the format parse_catalog expects. The /tmp file was a second, unversioned copy of data the repository already holds.

Two further problems surfaced while fixing this.

Re-running the generator silently reverted the 2026-07-05 promotions. The SELFCONSISTENT branch hardcoded "kind": "bitexact_selfconsistent" with the comment "NOT promoted to bitexact (no independent second witness)". That was true when written, but the six wide rungs acquired independent second witnesses and were promoted in the pack files. A regeneration would have rewritten the index back to 69/6/8, undoing an honesty-rule-#10 promotion that the packs themselves record. The tier now derives from the pack, which is the artefact of record for its own status.

The index exposed no witness information. Fields were file, id, kind, n_vectors, sha256, source — so a consumer of INDEX_all_formats.json, the corpus's machine-readable summary, could not tell which packs carry a witness record without opening all 83 files. The data was already in the packs.

Verification

conformance/vectors/verify_regeneration.py (new) checks the corpus against the digests recorded at HEAD:

packs compared: 83
  digests unchanged : 83
  digests changed   : 0
  tier changed      : 0
OK: regeneration reproduces the committed corpus.

Index changes are strictly additive — 0 entry fields changed, 0 removed; added witnesses and n_vectors per entry plus a top-level witnessed_packs: 10. Both existing gates pass: wp18_selftest_gate.py all PASS, wp18_conformance_gate.py verdict CLEAN, failures [].

Closes #1575

gen_all_formats.py read its catalog from a hardcoded /tmp/catalog_lines.txt that was never committed, so on a fresh clone it raised FileNotFoundError before producing anything: the 83-pack corpus could be read but not regenerated. The catalog was never actually missing. specs/numeric/formats_catalog.t27 carries all 83 rows as trailing `// CATALOG: id=... ` comments -- the same lines catalog-count-gate.yml counts for the 83-format invariant, already in the format parse_catalog expects. The /tmp file was a second, unversioned copy of data the repository holds. The generator now reads the SSOT, and parse_catalog accepts the comment prefix while still taking a bare `id=` line. Two problems surfaced while fixing that. Re-running the generator silently reverted the 2026-07-05 promotions. The SELFCONSISTENT branch hardcoded kind bitexact_selfconsistent with the comment "NOT promoted to bitexact (no independent second witness)" -- true when written, but the six wide rungs since acquired independent second witnesses and were promoted in the pack files. A regeneration would have rewritten the index back to 69/6/8, undoing an honesty-rule-#10 promotion the packs themselves record. The tier now derives from the pack, which is the artefact of record for its own status, so a future promotion flows into the index by itself. The hand-written promotion rationales are kept verbatim in a PROMOTION_SOURCE registry rather than flattened to a generic string. The index also exposed no witness information: a consumer of INDEX_all_formats.json could not tell which packs carry a witness record without opening all 83 files. Each entry now carries a witnesses count, with a top-level witnessed_packs. verify_regeneration.py is added as the falsifiable half: it regenerates and compares against the digests recorded at HEAD. packs compared: 83 digests unchanged : 83 digests changed : 0 tier changed : 0 Index changes are strictly additive -- 0 entry fields changed or removed. Both gates pass: wp18_selftest_gate.py all PASS, wp18_conformance_gate.py CLEAN with no failures. Closes #1575

github-actions · 2026-07-31T09:36:43Z

📓 NotebookLM Notebook linked to this PR

Notebook ID: b83263109fb055dc
URL: https://notebooklm.google.com/notebook/b83263109fb055dc

This notebook contains session context, decisions, and artifacts for this work.

github-actions · 2026-07-31T09:36:47Z

PR Dashboard

Generated at: 2026-07-31 09:36:40 UTC

fix(conformance): make the pack generator runnable from a clean checkout #1576 fix(conformance): make the pack generator runnable from a clean checkout | Created: 2026-07-31 | Updated: 2026-07-31 | 14 failing / 22 total
feat(igla): Wave Loop 822 — module-scope [463][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1572 feat(igla): Wave Loop 822 — module-scope [463][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-30 | Updated: 2026-07-30 | 1 failing / 3 total
feat(igla): Wave Loop 821 — module-scope [461][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1571 feat(igla): Wave Loop 821 — module-scope [461][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-30 | Updated: 2026-07-30 | 1 failing / 3 total
feat(igla): Wave Loop 820 — module-scope [459][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1569 feat(igla): Wave Loop 820 — module-scope [459][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-30 | Updated: 2026-07-30 | 1 failing / 3 total
feat(igla): Wave Loop 819 — module-scope [457][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1567 feat(igla): Wave Loop 819 — module-scope [457][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-30 | Updated: 2026-07-30 | 1 failing / 3 total
feat(igla): Wave Loop 818 — module-scope [455][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1566 feat(igla): Wave Loop 818 — module-scope [455][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-30 | Updated: 2026-07-30 | 1 failing / 3 total
feat(igla): Wave Loop 817 — module-scope [453][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1563 feat(igla): Wave Loop 817 — module-scope [453][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-29 | Updated: 2026-07-29 | 1 failing / 3 total
feat(igla): Wave Loop 816 — module-scope [451][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1560 feat(igla): Wave Loop 816 — module-scope [451][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-29 | Updated: 2026-07-29 | 1 failing / 3 total
feat(igla): Wave Loop 815 — module-scope [449][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1557 feat(igla): Wave Loop 815 — module-scope [449][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-29 | Updated: 2026-07-29 | 5 failing / 25 total
feat(igla): Wave Loop 814 — module-scope [447][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1556 feat(igla): Wave Loop 814 — module-scope [447][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-29 | Updated: 2026-07-29 | 5 failing / 25 total
feat(igla): Wave Loop 813 — module-scope [445][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1555 feat(igla): Wave Loop 813 — module-scope [445][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-28 | Updated: 2026-07-28 | 7 failing / 25 total
feat(igla): Wave Loop 812 — module-scope [443][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1554 feat(igla): Wave Loop 812 — module-scope [443][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-28 | Updated: 2026-07-28 | 7 failing / 26 total
feat(igla): Wave Loop 811 — module-scope [441][2]^6 Pt packed AoS variable from call with indexed signed writes #1552 feat(igla): Wave Loop 811 — module-scope [441][2]^6 Pt packed AoS variable from call with indexed signed writes | Created: 2026-07-28 | Updated: 2026-07-28 | 6 failing / 26 total
feat(igla): Wave Loop 810 — module-scope [439][2]^6 Pt packed AoS variable from call with indexed signed writes #1550 feat(igla): Wave Loop 810 — module-scope [439][2]^6 Pt packed AoS variable from call with indexed signed writes | Created: 2026-07-27 | Updated: 2026-07-27 | 6 failing / 26 total
feat(igla): Wave Loop 809 — module-scope [437][2]^6 Pt packed AoS variable from call with indexed signed writes #1548 feat(igla): Wave Loop 809 — module-scope [437][2]^6 Pt packed AoS variable from call with indexed signed writes | Created: 2026-07-27 | Updated: 2026-07-27 | 6 failing / 26 total
feat(igla): Wave Loop 808 — [435][2]^6 Pt module-scope AoS variable from call with indexed signed writes #1546 feat(igla): Wave Loop 808 — [435][2]^6 Pt module-scope AoS variable from call with indexed signed writes | Created: 2026-07-26 | Updated: 2026-07-26 | 6 failing / 26 total
feat(igla): Wave Loop 807 — [433][2]^6 Pt module-scope AoS variable from call with indexed signed writes #1544 feat(igla): Wave Loop 807 — [433][2]^6 Pt module-scope AoS variable from call with indexed signed writes | Created: 2026-07-26 | Updated: 2026-07-26 | 6 failing / 26 total
feat(igla): Wave Loop 806 — [431][2]^6 Pt module-scope AoS variable from call with indexed signed writes #1542 feat(igla): Wave Loop 806 — [431][2]^6 Pt module-scope AoS variable from call with indexed signed writes | Created: 2026-07-26 | Updated: 2026-07-26 | 6 failing / 26 total
feat(igla): Wave Loop 805 — [429][2]^6 Pt AoS var call signed writes #1540 feat(igla): Wave Loop 805 — [429][2]^6 Pt AoS var call signed writes | Created: 2026-07-26 | Updated: 2026-07-26 | 6 failing / 26 total
feat(igla): Wave Loop 804 — [427][2]^6 Pt AoS var call signed writes #1538 feat(igla): Wave Loop 804 — [427][2]^6 Pt AoS var call signed writes | Created: 2026-07-26 | Updated: 2026-07-26 | 6 failing / 26 total
feat(igla): Wave Loop 803 — [425][2]^6 Pt AoS var call signed writes #1536 feat(igla): Wave Loop 803 — [425][2]^6 Pt AoS var call signed writes | Created: 2026-07-25 | Updated: 2026-07-25 | 5 failing / 26 total
feat(igla): Wave Loop 802 — [423][2]^6 Pt AoS var call signed writes #1534 feat(igla): Wave Loop 802 — [423][2]^6 Pt AoS var call signed writes | Created: 2026-07-25 | Updated: 2026-07-25 | 5 failing / 26 total
feat(igla): Wave Loop 801 — module-scope [421][2]^6 Pt non-power-of-two outer-dimension AoS variable from call with indexed signed writes #1532 feat(igla): Wave Loop 801 — module-scope [421][2]^6 Pt non-power-of-two outer-dimension AoS variable from call with indexed signed writes | Created: 2026-07-25 | Updated: 2026-07-25 | 5 failing / 25 total
feat(igla): Wave Loop 800 — module-scope [419][2]^6 Pt non-power-of-two outer-dimension AoS variable from call with indexed signed writes #1530 feat(igla): Wave Loop 800 — module-scope [419][2]^6 Pt non-power-of-two outer-dimension AoS variable from call with indexed signed writes | Created: 2026-07-25 | Updated: 2026-07-25 | 5 failing / 25 total
feat(igla): Wave Loop 799 — module-scope [417][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1528 feat(igla): Wave Loop 799 — module-scope [417][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-25 | Updated: 2026-07-25 | 0 failing / 8 total
feat(igla): Wave Loop 798 — module-scope [415][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1526 feat(igla): Wave Loop 798 — module-scope [415][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-25 | Updated: 2026-07-25 | 5 failing / 25 total
feat(igla): Wave Loop 797 — module-scope [413][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1524 feat(igla): Wave Loop 797 — module-scope [413][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-25 | Updated: 2026-07-25 | 4 failing / 25 total
feat(igla): Wave Loop 796 — module-scope [411][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1522 feat(igla): Wave Loop 796 — module-scope [411][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-25 | Updated: 2026-07-25 | 4 failing / 25 total
Wave Loop 795 — module-scope [409][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1520 Wave Loop 795 — module-scope [409][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-25 | Updated: 2026-07-25 | 4 failing / 25 total
Wave Loop 794 — module-scope [407][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1518 Wave Loop 794 — module-scope [407][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-24 | Updated: 2026-07-24 | 4 failing / 25 total
Wave Loop 793 — module-scope [405][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1516 Wave Loop 793 — module-scope [405][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-24 | Updated: 2026-07-24 | 4 failing / 25 total
docs(trinity): Wave Loop 792 closeout — [403][2]^6 Pt module-scope AoS (Closes #1513) #1514 docs(trinity): Wave Loop 792 closeout — [403][2]^6 Pt module-scope AoS (Closes #1513) | Created: 2026-07-24 | Updated: 2026-07-24 | 4 failing / 25 total
Wave Loop 791 — module-scope [401][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1512 Wave Loop 791 — module-scope [401][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-24 | Updated: 2026-07-24 | 4 failing / 25 total
feat(igla): Wave Loop 790 — module-scope [399][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1510 feat(igla): Wave Loop 790 — module-scope [399][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-24 | Updated: 2026-07-24 | 4 failing / 25 total
feat(igla): Wave Loop 789 — module-scope [397][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1508 feat(igla): Wave Loop 789 — module-scope [397][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-24 | Updated: 2026-07-24 | 4 failing / 25 total
feat(igla): Wave Loop 788 — module-scope [395][2]^6 Pt non-power-of-two outer-dimension AoS var from call #1506 feat(igla): Wave Loop 788 — module-scope [395][2]^6 Pt non-power-of-two outer-dimension AoS var from call | Created: 2026-07-24 | Updated: 2026-07-24 | 4 failing / 25 total
feat(igla): Wave Loop 787 — module-scope [393][2]^6 Pt non-power-of-two outer-dimension AoS var from call #1504 feat(igla): Wave Loop 787 — module-scope [393][2]^6 Pt non-power-of-two outer-dimension AoS var from call | Created: 2026-07-24 | Updated: 2026-07-24 | 4 failing / 25 total
Wave Loop 786: module-scope [391][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable #1502 Wave Loop 786: module-scope [391][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable | Created: 2026-07-24 | Updated: 2026-07-24 | 4 failing / 25 total
Wave Loop 785: module-scope [389][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable #1500 Wave Loop 785: module-scope [389][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable | Created: 2026-07-24 | Updated: 2026-07-24 | 4 failing / 25 total
feat(igla): Wave Loop 784 — module-scope [387][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1498 feat(igla): Wave Loop 784 — module-scope [387][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-24 | Updated: 2026-07-24 | 4 failing / 25 total
feat(igla): Wave Loop 783 — module-scope [385][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1496 feat(igla): Wave Loop 783 — module-scope [385][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-24 | Updated: 2026-07-24 | 4 failing / 25 total
feat(igla): Wave Loop 782 — module-scope [383][2]^6 Pt non-power-of-two outer-dimension AoS variable from call with indexed signed writes #1494 feat(igla): Wave Loop 782 — module-scope [383][2]^6 Pt non-power-of-two outer-dimension AoS variable from call with indexed signed writes | Created: 2026-07-24 | Updated: 2026-07-24 | 4 failing / 25 total
feat(igla): Wave Loop 777 — module-scope [373][2]^6 Pt non-power-of-two packed AoS variable with indexed signed writes #1491 feat(igla): Wave Loop 777 — module-scope [373][2]^6 Pt non-power-of-two packed AoS variable with indexed signed writes | Created: 2026-07-24 | Updated: 2026-07-24 | 3 failing / 25 total
Merge Wave Loop Ladder W774-W776 + README update #1489 Merge Wave Loop Ladder W774-W776 + README update | Created: 2026-07-24 | Updated: 2026-07-24 | 3 failing / 25 total
feat(igla): Wave Loop 776 — module-scope [371][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1488 feat(igla): Wave Loop 776 — module-scope [371][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-24 | Updated: 2026-07-24 | 3 failing / 25 total
feat(igla): Wave Loop 775 — module-scope [369][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1486 feat(igla): Wave Loop 775 — module-scope [369][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-24 | Updated: 2026-07-24 | 4 failing / 25 total
feat(igla): Wave Loop 774 — module-scope [367][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes #1484 feat(igla): Wave Loop 774 — module-scope [367][2]^6 Pt non-power-of-two outer-dimension array-of-struct variable from call with indexed signed writes | Created: 2026-07-24 | Updated: 2026-07-24 | 4 failing / 25 total
chore(deps)(deps): bump candle-core from 0.10.2 to 0.11.0 #1470 chore(deps)(deps): bump candle-core from 0.10.2 to 0.11.0 | Created: 2026-07-13 | Updated: 2026-07-13 | 3 failing / 25 total
chore(deps)(deps): bump ed25519-dalek from 2.2.0 to 3.0.0 #1469 chore(deps)(deps): bump ed25519-dalek from 2.2.0 to 3.0.0 | Created: 2026-07-13 | Updated: 2026-07-13 | 3 failing / 25 total
chore(deps)(deps): bump anyhow from 1.0.102 to 1.0.103 #1468 chore(deps)(deps): bump anyhow from 1.0.102 to 1.0.103 | Created: 2026-07-13 | Updated: 2026-07-13 | 3 failing / 25 total

Summary

Status	Count
Total Open PRs	50
PRs with Failing Checks	41
PRs with All Checks Green	9
READY	1
FAILING	41
PENDING	0

Seal Status

⚠️ STALE -- sha256(compiler.rs)=d6b51a3bcc20 != manifest seal=87e5cbd3ad94.
The committed NMSE numbers were certified against an older compiler.rs.
Run scripts/reseal-check.sh locally for the two-step reseal command (advisory; not a merge gate).

This was referenced Jul 31, 2026

No gate checks that INDEX_all_formats.json agrees with the packs it summarises #1577

Open

ci(conformance): gate INDEX_all_formats.json against the packs it summarises #1578

Open

This was referenced Jul 31, 2026

fix(witness): resolve the wide-rung pack defaults inside the repository #1582

Open

fix(ci): track the paper count the published version actually declares #1584

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

fix(conformance): make the pack generator runnable from a clean checkout - #1576

fix(conformance): make the pack generator runnable from a clean checkout#1576
gHashTag wants to merge 1 commit into
masterfrom
fix/conformance-generator-reproducible

gHashTag commented Jul 31, 2026

Uh oh!

github-actions Bot commented Jul 31, 2026

Uh oh!

github-actions Bot commented Jul 31, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

gHashTag commented Jul 31, 2026

Verification

Uh oh!

github-actions Bot commented Jul 31, 2026

Uh oh!

github-actions Bot commented Jul 31, 2026

PR Dashboard

Summary

Seal Status

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant