verification report need type#660
Conversation
Adds the mod_ver_report need type to the metamodel with an evidence extra link, documents the tool requirement, and adds option tests. Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
License Check Results🚀 The license check job ran with the Bazel command: bazel run --lockfile_mode=error //src:license-checkStatus: Click to expand output |
|
The created documentation from the pull request is available at: docu-html |
aschemmel-tech
left a comment
There was a problem hiding this comment.
Made some remarks, not crucial for the PoC
| # req-Id: tool_req__docs_verification_report_need | ||
| verification_method: ^.*$ | ||
| optional_options: | ||
| requirements_coverage_percent: ^(100|[1-9]?[0-9])$ |
There was a problem hiding this comment.
not clear what can be seen here. maybe call it "requirements_tests_completely_passed_percent"
| verification_method: ^.*$ | ||
| optional_options: | ||
| requirements_coverage_percent: ^(100|[1-9]?[0-9])$ | ||
| structural_coverage_percent: ^(100|[1-9]?[0-9])$ |
There was a problem hiding this comment.
branch coverage is also structural coverage, so maybe call "line/block_coverage_percent" (depending what our selected tool supports)
| requirements_coverage_percent: ^(100|[1-9]?[0-9])$ | ||
| structural_coverage_percent: ^(100|[1-9]?[0-9])$ | ||
| branch_coverage_percent: ^(100|[1-9]?[0-9])$ | ||
| verdict: ^(pass|fail|open)$ |
There was a problem hiding this comment.
giving a verdict is not part of the process, who would give it? based on what ...? I think we had this more in the release note.
| structural_coverage_percent: ^(100|[1-9]?[0-9])$ | ||
| branch_coverage_percent: ^(100|[1-9]?[0-9])$ | ||
| verdict: ^(pass|fail|open)$ | ||
| report_version: ^.*$ |
There was a problem hiding this comment.
every needs element has a version attribute. What is special about this?
| branch_coverage_percent: ^(100|[1-9]?[0-9])$ | ||
| verdict: ^(pass|fail|open)$ | ||
| report_version: ^.*$ | ||
| release_baseline: ^.*$ |
There was a problem hiding this comment.
I would still prefer: "The verification report is valid for the module version tagged together with the report" as written in the template.
| verification_method: ^.*$ | ||
| optional_options: | ||
| requirements_coverage_percent: ^(100|[1-9]?[0-9])$ | ||
| structural_coverage_percent: ^(100|[1-9]?[0-9])$ |
There was a problem hiding this comment.
An overall value I do not think helpful
Relates to #611
Split out of #612 (verification part). The inspection-record part is in a separate PR.
📌 Description
Adds a machine-readable module verification report need type to the metamodel.
metamodel.yaml: newmod_ver_reportneed type (prefix: mod_vrep__) classifying a report bysafety,security,statusandverification_method, with optional coverage/verdict/version attributes; linksbelongs_toamodand optionallycontains/covers/evidence/realizes. Adds theevidenceextra link (evidence/evidence_for) it depends on.requirements.rst: new "Verification Evidence" section withtool_req__docs_verification_report_need, plus theVerifrow in the requirements overview table.rst/options/test_options_verification_report.rstcovering a valid report and an invalidverdictvalue.🚨 Impact Analysis
✅ Checklist
Frank Scholter Peres frank.scholter_peres@mercedes-benz.com, Mercedes-Benz Tech Innovation GmbH
Provider Information