Skip to content

Disposable integration tests (system_tests_dispvm) have repeated tests, making the run slower than it should #10749

@ben-grande

Description

@ben-grande

Qubes OS release

Qubes OS 4.3

Brief summary

These tests are run for every installed template, Debian, Fedora and Whonix, but they are not affected by the template running them:

  • test_011_preload_reject_max
  • test_012_preload_low_mem
  • test_015_preload_race_more *
  • test_016_preload_race_less
  • test_017_preload_autostart
  • test_018_preload_global
  • test_019_preload_discard_outdated_volumes
  • test_020_preload_discard_outdated_volume_size
  • test_021_preload_discard_outdated_setting

The test_015_preload_race_more test is affected by the OS as a template that is heavier, such as Whonix-Workstation, will sometimes timeout, thus showing that the OS is slow. But this was not the intention of this test, so I think it is okay to remove this test from being shared across templates and let system_tests_dispvm_perf@hw* decide.

Steps to reproduce

  1. Run integration tests for disposables
  2. Notice the repeated tests that are not covering more ground

Expected behavior

No repeated tests, faster run.

Actual behavior

Repated tests, slower run.

Additional information

No response

Metadata

Metadata

Assignees

Labels

C: testsThis issue pertains to tests for the codebase and infrastructure.P: defaultPriority: default. Default priority for new issues, to be replaced given sufficient information.affects-4.3This issue affects Qubes OS 4.3.devel-host-cur-testdiagnosedTechnical diagnosis of this issue has been performed.pr submittedA pull request has been submitted for this issue.r4.3-host-stabler4.3-stable

Type

No fields configured for Bug.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions