Skip to content

[GHA] Add Code Coverage workflow#4071

Draft
mkruszyx wants to merge 11 commits into
openvinotoolkit:developfrom
mkruszyx:coverage
Draft

[GHA] Add Code Coverage workflow#4071
mkruszyx wants to merge 11 commits into
openvinotoolkit:developfrom
mkruszyx:coverage

Conversation

@mkruszyx

@mkruszyx mkruszyx commented May 14, 2026

Copy link
Copy Markdown

DO NOT MERGE - WORK IN PROGRESS

Changes

The new workflow adds coverage collection for NNCF test scopes.
Uses composite-action from openvino repository for coverage-specific steps.

Related tickets

CVS-184859

Copilot AI review requested due to automatic review settings May 14, 2026 12:36
@mkruszyx mkruszyx requested a review from a team as a code owner May 14, 2026 12:36

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Note

Copilot was unable to run its full agentic suite in this review.

Adds a scheduled/manual GitHub Actions workflow to run Python test suites under coverage, collect artifacts, generate an aggregated summary, and upload coverage data to Codecov.

Changes:

  • Introduces a new coverage.yml workflow that runs multiple Python coverage lanes (core matrix, ExecuTorch, weight-compression split lanes) and publishes artifacts/summaries.
  • Adds .github/coverage/tests_python.yml describing the Python coverage suite commands and upload metadata for the coverage toolkit.

Reviewed changes

Copilot reviewed 1 out of 2 changed files in this pull request and generated 3 comments.

File Description
.github/workflows/coverage.yml New CI workflow to run coverage lanes, collect artifacts, build summary, and upload to Codecov.
.github/coverage/tests_python.yml New Python coverage suite definition (commands, artifacts, uploads) consumed by the coverage toolkit action.

schedule:
- cron: '0 0 * * *'

permissions: read-all
Comment thread .github/coverage/tests_python.yml Outdated
Comment thread .github/workflows/coverage.yml Outdated
uses: astral-sh/setup-uv@08807647e7069bb48b6ef5acd8ec9567f424441b # v8.1.0

- name: Install coverage Python dependencies
uses: mkruszyx/openvino/.github/actions/coverage_toolkit@composite-coverage
@codecov

codecov Bot commented May 14, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 91.23%. Comparing base (3695da7) to head (16a7b64).
⚠️ Report is 893 commits behind head on develop.

Additional details and impacted files

Impacted file tree graph

@@             Coverage Diff             @@
##           develop    #4071      +/-   ##
===========================================
- Coverage    91.29%   91.23%   -0.07%     
===========================================
  Files          496      294     -202     
  Lines        47676    29224   -18452     
===========================================
- Hits         43526    26662   -16864     
+ Misses        4150     2562    -1588     

see 790 files with indirect coverage changes

Flag Coverage Δ
COMMON ?
ONNX ?
OPENVINO ?
TENSORFLOW ?
TORCH ?
nncf-python-common 27.55% <ø> (?)
nncf-python-executorch 41.95% <ø> (?)
nncf-python-gptqmodel_cuda 26.23% <ø> (?)
nncf-python-onnx 50.83% <ø> (?)
nncf-python-openvino 56.43% <ø> (?)
nncf-python-tools 0.00% <ø> (?)
nncf-python-torch_cpu 61.36% <ø> (?)
nncf-python-torch_cuda 52.05% <ø> (?)
nncf-python-wc_1 39.58% <ø> (?)
nncf-python-wc_2 43.83% <ø> (?)
nncf-python-wc_3 41.93% <ø> (?)
nncf-python-wc_4 42.38% <ø> (?)
nncf-python-wc_5 40.76% <ø> (?)
nncf-python-wc_6 45.27% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

Components Coverage Δ
common ∅ <ø> (∅)
torch ∅ <ø> (∅)
tensorflow ∅ <ø> (∅)
onnx ∅ <ø> (∅)
openvino ∅ <ø> (∅)
ptq ∅ <ø> (∅)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@AlexanderDokuchaev

Copy link
Copy Markdown
Collaborator

Questions in JIRA was ignored, so close PR

@pgierasi pgierasi reopened this May 21, 2026
@mkruszyx mkruszyx marked this pull request as draft May 21, 2026 13:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants