Skip to content

[Feature]: Add regression tests to CVMix CI #35

@mnlevy1981

Description

@mnlevy1981

Feature Description

CVMix runs several test cases through Github Actions, but pass / fall is based on successfully running rather than ensuring answers are maintained.

Use Case

We want to make sure code changes to CVMix do not change answers

Acceptance Criteria

  • New baselines directory with output from tests
  • New tool for comparing output from a test to what is in baselines/
  • CVMix_tools/run_test_suite.sh calls this new tool and reports pass / fail based on baseline comparison

Ideas

No response

Alternatives Considered

No response

Priority

None

Additional Context

No response

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type
No fields configured for issues without a type.

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions