Skip to content

[cov,ci] Collect test coverage on CI#29297

Merged
timothytrippel merged 5 commits into
lowRISC:earlgrey_1.0.0from
sasdf:mgTffdf510d
Feb 23, 2026
Merged

[cov,ci] Collect test coverage on CI#29297
timothytrippel merged 5 commits into
lowRISC:earlgrey_1.0.0from
sasdf:mgTffdf510d

Conversation

@sasdf

@sasdf sasdf commented Feb 11, 2026

Copy link
Copy Markdown
Contributor

This PR introduces code coverage collection for CI.
Reports will be available as GitHub Action artifacts and also published to GCS bucket.

Currently, several FPGA tests fail when running in coverage mode. To validate the CI setup, we have tagged a few passing tests with the coverage tag and only run those tagged tests. These coverage tags are temporary and will be removed later once all test failures are resolved or appropriately marked with "coverage_broken" tags.

To maximize collected coverage, the workflow utilizes the --keep-going flag, allowing it to proceed even if individual tests fail.

We expect all unit tests and OTBN tests to pass with the following two dependent PRs:

To showcase the post-submit coverage workflow, a test run is performed on previous version with PR trigger in the ci-coverage.yml.

Test run result: https://github.com/lowRISC/opentitan/actions/runs/22249013778

@sasdf sasdf force-pushed the mgTffdf510d branch 30 times, most recently from 4fd1763 to 6c2c9ca Compare February 11, 2026 11:03
@sasdf sasdf force-pushed the mgTffdf510d branch 3 times, most recently from 98e4ea9 to 6c81581 Compare February 11, 2026 19:57
@sasdf sasdf marked this pull request as ready for review February 11, 2026 20:05
@sasdf sasdf requested a review from rswarbrick as a code owner February 11, 2026 20:05
@sasdf sasdf changed the title [WIP][cov,ci] Collect test coverage on CI [cov,ci] Collect test coverage on CI Feb 11, 2026
@sasdf sasdf force-pushed the mgTffdf510d branch 2 times, most recently from ef304ce to 0c8abcd Compare February 12, 2026 11:12
@timothytrippel

Copy link
Copy Markdown
Contributor

We should wait for dependent PRs to merge first before rebasing and rerunning tests.

@sasdf sasdf requested a review from a team as a code owner February 20, 2026 08:08
@sasdf sasdf requested review from moidx and removed request for a team February 20, 2026 08:08
@sasdf sasdf requested a review from pamaury February 20, 2026 08:26
Change-Id: If7b15974a6f1c5a3786ab7b3075148f57e08e201
Signed-off-by: Yi-Hsuan Deng <yhdeng@google.com>
Change-Id: I9c33829bc72444078496993a45d224b76be91800
Signed-off-by: Yi-Hsuan Deng <yhdeng@google.com>
Change-Id: I276075ba17b709d0643e183f45f15b823a29a8d5
Signed-off-by: Yi-Hsuan Deng <yhdeng@google.com>
@sasdf sasdf force-pushed the mgTffdf510d branch 3 times, most recently from ee6befb to 3688165 Compare February 21, 2026 02:55
This commit introduces code coverage collection and reporting to the CI
pipeline.

Change-Id: Iffdf510d5cf714d6364e335fa494ea36ac4242b1
Signed-off-by: Yi-Hsuan Deng <yhdeng@google.com>
This commit adds the `coverage` tag to the `fpga_params` of several
smoke and functional tests. This allows these tests to be
automatically selected by the CI pipeline to validate the coverage
collection setup on FPGA targets.

Change-Id: I86d8e28ee885cf683d961dd5e1eaf44a100e8ad2
Signed-off-by: Yi-Hsuan Deng <yhdeng@google.com>
@timothytrippel timothytrippel merged commit a733dbb into lowRISC:earlgrey_1.0.0 Feb 23, 2026
66 of 72 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants