Add PRML manifest schema#5673
Merged
Merged
Conversation
PRML — Pre-Registered ML Manifest — is an open CC BY 4.0 specification
for committing machine-learning evaluation claims to a SHA-256 hash
before the experiment runs.
The schema validates the eight required PRML v0.1 fields plus optional
v0.2 RFC additions (streaming variant, runner attestation, revocation).
File patterns target *.prml.yaml, manifest.prml.yaml, and the
prml-manifest.{yml,yaml} convention.
Both schema versions are JSON Schema 2020-12 conformant and validated
against 32 locked conformance vectors (12 v0.1 + 8 v0.2 + 12 v0.1
inputs against v0.2 schema for backwards-compat). Detail at
https://spec.falsify.dev/schema/.
Spec author: Studio 11 Turkey Ltd. Şti. (hello@studio-11.co).
v0.1 stable; v0.2 RFC freeze 2026-05-22 23:59 UTC.
Contributor
|
Thanks for the PR! This section of the codebase is owned by @madskristensen and |
for more information, see https://pre-commit.ci
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Adds an entry for PRML - Pre-Registered ML Manifest to the SchemaStore catalog.
PRML is an open CC BY 4.0 specification for committing machine-learning evaluation claims to a SHA-256 hash before the experiment runs. It is used by researchers, audit firms, and AI evaluation programmes to make threshold and dataset commitments cryptographically verifiable.
Diff
src/api/json/catalog.json, alphabetically near.pre-commit-hooks.yml:{ "name": "PRML manifest", "description": "Pre-Registered ML Manifest - open spec for committing ML evaluation claims to a SHA-256 hash before the run (CC BY 4.0). https://spec.falsify.dev/v0.1", "fileMatch": ["*.prml.yaml", "*.prml.yml", "manifest.prml.yaml", "prml-manifest.yaml", "prml-manifest.yml"], "url": "https://spec.falsify.dev/schema/prml-v0.1.schema.json", "versions": { "v0.1": "https://spec.falsify.dev/schema/prml-v0.1.schema.json", "v0.2-rfc": "https://spec.falsify.dev/schema/prml-v0.2.schema.json" } }Schema verification
$idmatches URL: [OK] verifiedpython3 -c "import json; json.load(open('catalog.json'))"The schema URLs are served via Cloudflare Pages from a dedicated subdomain controlled by Studio 11. They have been live since 2026-05-09 and are part of the stable
spec.falsify.devdeployment.Where the schemas live
File pattern justification
All five patterns include the literal string
prmlto avoid collisions:*.prml.yaml,*.prml.yml- extension convention for PRML-formatted filesmanifest.prml.yaml- when paired with other manifests in the same projectprml-manifest.yaml,prml-manifest.yml- community convention for the canonical filenameNo overlap with existing entries in the catalog.
Maintainer commitment
I am the editor of the PRML specification and a co-founder of Studio 11 Turkey Ltd. Sti., which maintains the four reference implementations (Python, JS, Go, Rust). Contact: hello@studio-11.co. The schemas are CC BY 4.0; the reference implementations are MIT; an irrevocable patent non-assertion grant is published with the spec.
If the schema URLs ever need to be re-homed, I will submit a follow-up PR to update the catalog.
Disclosure
Self-submission per SchemaStore norm. Maintainer of the schemas, not affiliated with the SchemaStore project.
Happy to revise file patterns, description, or version-block structure based on reviewer preference.