Skip to content

feat(quality): add AI-assisted OSPS-QA-06.02 evaluation#4

Closed
vinayada1 wants to merge 1 commit into
mainfrom
feat/osps-qa-06-02-ai-validation
Closed

feat(quality): add AI-assisted OSPS-QA-06.02 evaluation#4
vinayada1 wants to merge 1 commit into
mainfrom
feat/osps-qa-06-02-ai-validation

Conversation

@vinayada1

Copy link
Copy Markdown
Owner

Adds AI-assisted evaluation for OSPS-QA-06.02 test execution documentation.

Summary:

  • Wires the OSPS-QA-06.02 control to the new AI-backed test execution documentation evaluator.
  • Collects repository documentation evidence and maps structured AI verdicts to Privateer results.
  • Writes SDK-backed AI evidence packets when AI evidence writing is enabled.
  • Adds focused tests for pass/fail behavior, fallback paths, packet writing, sanitization/redaction, duplicate execution caching, and provider failure handling.

Validation run locally before opening:

  • go build ./...
  • go vet ./...
  • go test ./...
  • make -B build
  • e2e compatibility run across supported OSPS baseline catalogs

@vinayada1 vinayada1 force-pushed the feat/osps-qa-06-02-ai-validation branch 2 times, most recently from ad4eb4f to 833cf87 Compare June 12, 2026 15:07
Signed-off-by: Vinaya Damle <vinayada1@users.noreply.github.com>
@vinayada1 vinayada1 force-pushed the feat/osps-qa-06-02-ai-validation branch from 833cf87 to ac70c26 Compare June 12, 2026 15:10
@vinayada1

Copy link
Copy Markdown
Owner Author

Superseded by upstream PR ossf#346. Closing this fork-targeted PR; the head branch is retained because it backs ossf#346.

@vinayada1 vinayada1 closed this Jun 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant