Unit/Validation testing will be added to prevent inaccurate data from being released.
There should be two sets of tests —
- Set of tests run as a DAG right after CDM Data Generation -- validates output and prevents data issues upstream from being propagated into S3 deliverable
- Set of tests for validating data after merge into msk-impact -- more specific cases that may affect display on portal.
Effort also includes establishment of practices for logging said issues and adding to testing suite.
Unit/Validation testing will be added to prevent inaccurate data from being released.
There should be two sets of tests —
Effort also includes establishment of practices for logging said issues and adding to testing suite.