Devtool automated integration tests failing

[rawaha-e]

Describe the bug
Several automated integration tests related to devtool functionality are currently failing due to low artifact server bandwidth.

The following tests are affected:

Unit Tests (client/src/__tests__/unit-tests/driver/scanner.test.ts)
Integration Tests (integration-tests/src/tests/bitbake-commands.test.ts)

To Reproduce
Steps to reproduce the behavior:

1. Run the test suite with npm test
2. Observe test failures in the BitBakeProjectScanner suite
3. Observe failures related to devtool commands

Expected behavior
All devtool related automated integration tests should pass successfully:

Screenshots
N/A

Desktop (please complete the following information):

• OS: Ubuntu 24.04
• VS Code version 1.108.1
• Extension version 2.8.0
• Yocto Version poky

Debug logs

1. The following tests fail due to time out:

BitBakeProjectScanner › can get the bitbake version
BitBakeProjectScanner › can get a list of layers
BitBakeProjectScanner › can get a list of recipes
BitBakeProjectScanner › can detected skipped recipes
BitBakeProjectScanner › can get recipes appends
BitBakeProjectScanner › can get recipes paths
BitBakeProjectScanner › can get tricky recipes paths
BitBakeProjectScanner › respects PREFERRED_VERSION
BitBakeProjectScanner › can get a list of classes
BitBakeProjectScanner › can get a list of overrides
BitBakeProjectScanner › can get a list of conf files
BitBakeProjectScanner › can get a list of devtool workspaces
BitBakeProjectScanner › can get the bitbake version
BitBakeProjectScanner › can get a list of layers
BitBakeProjectScanner › can get a list of recipes
BitBakeProjectScanner › can detected skipped recipes
BitBakeProjectScanner › can get recipes appends
BitBakeProjectScanner › can get recipes paths
BitBakeProjectScanner › can get tricky recipes paths
BitBakeProjectScanner › respects PREFERRED_VERSION
BitBakeProjectScanner › can get a list of classes
BitBakeProjectScanner › can get a list of overrides
BitBakeProjectScanner › can get a list of conf files
BitBakeProjectScanner › can get a list of devtool workspaces

The error returned is:

thrown: "Exceeded timeout of 600000 ms for a hook while waiting for `done()` to be called.
Add a timeout value to this test to increase the timeout, if this is a long-running test. See https://jestjs.io/docs/api#testname-fn-timeout."

2. Other tests fail due to file not found:

ENOENT: no such file or directory, unlink '/home/rawaha-e/vscode-bitbake/integration-tests/project-folder/sources/poky/meta/recipes-core/base-files/fixture-version_0.1.0.bb'

[deribaucourt]

Hi @rawaha-e , thanks for the list!

This indeed seems to be related to running devtool commands because they require to build actual yocto packages and not just parse. For instance, they need to build quilt-native.
The do_fetch steps take too much time on the GitHub runners, which times out most of the time.

We should set up a self-hosted runner for the long term.
In the mean time, I suggest to skip these tests and keep this issue open for tracking.

Please do try to skip the minimum amount of tests. Notably, for the unit test, you can skip the devtool steps in the suite set-up, while keeping most of the tests from this file.

[deribaucourt]

We now have a self-hosted runner with Yocto and Git mirrors.