Skip to content

test: Add README.md in tmt folder for integration test local running#1357

Merged
jeckersb merged 1 commit into
bootc-dev:mainfrom
henrywang:test_readme
Jun 10, 2025
Merged

test: Add README.md in tmt folder for integration test local running#1357
jeckersb merged 1 commit into
bootc-dev:mainfrom
henrywang:test_readme

Conversation

@henrywang
Copy link
Copy Markdown
Collaborator

This PR adds a README file to explain how to run the integration tests on a local machine.

Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

The pull request adds a README file to the tmt folder, providing instructions on how to run integration tests locally. The instructions are clear and concise, which is helpful for developers. However, there are a few minor suggestions to improve clarity and completeness.

Summary of Findings

  • Clarity on tmt: Adding a brief explanation of what tmt is would be helpful for those unfamiliar with the tool.
  • Link to integration.fmf: Linking to the file on the main branch instead of a specific commit hash would make the link more robust.
  • Missing dependency: Mentioning the need for podman or docker would ensure users have the necessary tools installed.

Merge Readiness

The pull request is a valuable addition to the repository, providing clear instructions for running integration tests locally. Addressing the suggestions above would further enhance the README's clarity and completeness. I am unable to approve this pull request, and recommend that others review and approve this code before merging. I would recommend addressing the medium severity issues before merging.

Comment thread tmt/README.md

To run integration tests locally, you need to [install tmt](https://tmt.readthedocs.io/en/stable/guide.html#the-first-steps) first. Then, use `tmt run -vvvvv plans -n integration` command to run the all integration tests.

To run integration tests on different distros, just change `image: fedora-rawhide` in https://github.com/bootc-dev/bootc/blob/9d15eedea0d54a4dbc15d267dbdb055817336254/tmt/plans/integration.fmf#L6.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The link to the integration.fmf file is a direct link to the GitHub blob. It would be better to link to the file on the bootc-dev/bootc repository's main branch, so that the link remains valid even if the commit hash changes. Also, consider adding a brief explanation of what this file is and why it needs to be changed.

Comment thread tmt/README.md Outdated

In the bootc CI, integration tests are executed via Packit on the Testing Farm. In addition, the integration tests can also be run locally on a developer's machine, which is especially valuable for debugging purposes.

To run integration tests locally, you need to [install tmt](https://tmt.readthedocs.io/en/stable/guide.html#the-first-steps) first. Then, use `tmt run -vvvvv plans -n integration` command to run the all integration tests.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

Consider adding a note that the user needs to have podman or docker installed to run the integration tests locally, as tmt uses these tools to manage containers.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

or rather, the tests need tmt+provision-virtual, correct? Could be good to mention that.

Signed-off-by: Xiaofeng Wang <henrywangxf@me.com>
Copy link
Copy Markdown
Collaborator

@jeckersb jeckersb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@jeckersb jeckersb merged commit d0c9c0a into bootc-dev:main Jun 10, 2025
34 checks passed
@henrywang henrywang deleted the test_readme branch September 24, 2025 07:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants