Contributions must preserve deterministic, secretless execution.
- Add or update reviewable fixtures.
- Explain metric and threshold changes.
- Run
.\scripts\verify.ps1. - Regenerate release artifacts with
python -m cas_evals.releasewhen fixtures or evaluator behavior changes. - Do not include real secrets, customer data, or network-dependent tests.
Changes that alter result shape must update the suite schema, shared-contract validation, release artifacts, and compatibility notes.