repro/numerics: schema-conforming certifying NMSE manifest + seal-hash honesty (Closes #1074) - #1075
Merged
Merged
Conversation
added 2 commits
June 14, 2026 11:37
Add repro/numerics/{nmse_gf16.py,nmse_manifest.json,README.md} and fill the
L4/L5 TBD cells in docs/NUMERICS_VALIDATION.md with measured, reproducible
round-trip NMSE/ULP numbers for GF16 (E6M9) vs bfloat16 and float16, per
docs/GF16_BFLOAT16_NMSE_PROTOCOL.md. Host-measured, unsealed => informational,
not a silicon certifying claim. D_PHI is an identity sanity check.
Closes #1072
…h honesty Adds a certifying-manifest mode to repro/numerics/nmse_gf16.py and a standalone validator repro/numerics/validate_manifest.py. Emits a second manifest nmse_manifest_protocol_v1.json strictly conforming to schemas/nmse-protocol-v1.json (additionalProperties:false; results limited to D_NORM/D_LOG/D_RELU/D_PHI/D_DEEP). --seal sets seal_hash to the FROZEN_HASH digest ONLY on an exact live-source match; otherwise it stays unsealed (no faked seal). New make -C repro repro-numerics-certify validates the manifest and enforces the seal-hash honesty rule. R5-HONEST: live compiler source does not match FROZEN_HASH on this unpinned host, so the committed seal_hash is honestly unsealed (informational, not a silicon certifying claim). Builds on #1072. Anchor: phi^2 + phi^-2 = 3. Closes #1074
Contributor
|
📓 NotebookLM Notebook linked to this PR
This notebook contains session context, decisions, and artifacts for this work. |
Contributor
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary (Closes #1074)
Delivers the certifying NMSE manifest named as the remaining step in
docs/NUMERICS_VALIDATION.mdsection 11 after the host oracle (#1072).repro/numerics/nmse_gf16.py: emits a SECOND manifestrepro/numerics/nmse_manifest_protocol_v1.jsonthat strictly conforms toschemas/nmse-protocol-v1.json(additionalProperties:false;resultsrestricted to the five schema distributionsD_NORM/D_LOG/D_RELU/D_PHI/D_DEEP; each entry isnmse_gf16/nmse_bf16/ratio).nmse_manifest.json(D_WIDE, ULP, overflow) as NOT schema-bound.repro/numerics/validate_manifest.pyand amake -C repro repro-numerics-certifytarget that validate the manifest against the schema AND enforce a seal-hash honesty rule.--sealre-hashesbootstrap/src/compiler.rsand setsseal_hashto thebootstrap/stage0/FROZEN_HASHdigest only on an exact match; otherwise it stays the literalunsealed.R5-HONEST
The live compiler source does not match
FROZEN_HASHon this unpinned host, so the committedseal_hashis honestlyunsealed-- informational, not a silicon certifying claim (protocol section 8). The script never fabricates a seal.D_WIDEis deliberately excluded from the certifying manifest (it is not a schema result key). The phiidentity_witnessis a sanity check, not a superiority claim.Dependency
Builds on #1073 (the host L4/L5 oracle); this branch is stacked on it. Both merge cleanly into master.
Anchor: phi^2 + phi^-2 = 3
Closes #1074