Skip to content

Speed disposable performance tests without a GUI#787

Merged
marmarek merged 1 commit intoQubesOS:mainfrom
ben-grande:preload-nogui-test
Apr 24, 2026
Merged

Speed disposable performance tests without a GUI#787
marmarek merged 1 commit intoQubesOS:mainfrom
ben-grande:preload-nogui-test

Conversation

@ben-grande
Copy link
Copy Markdown
Contributor

Without having a GUIVM or GUI feature disabled, appmenus are not handled. This can considerably speed up the tests and lead to a better performance overall.

For: QubesOS/qubes-issues#1512


This was already included in https://github.com/QubesOS/qubes-core-admin/pull/757/changes, but I was expecting it to be merged. As this fix was bundled with a feature PR, it wasn't solved.


Look how weird the creation stage is for nogui: https://openqa.qubes-os.org/tests/169531/file/system_tests-dispvm_perf-debian-13-xfce_graph_02_stage_stack_1_until_total.png.

Without having a GUIVM or GUI feature disabled, appmenus are not
handled. This can considerably speed up the tests and lead to a better
performance overall.

For: QubesOS/qubes-issues#1512
@ben-grande
Copy link
Copy Markdown
Contributor Author

openQArun TEST=system_tests_dispvm_perf TEST_TEMPLATES=debian-13-xfce

@codecov
Copy link
Copy Markdown

codecov Bot commented Mar 13, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 70.09%. Comparing base (53ca30f) to head (3b7a41a).
⚠️ Report is 33 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #787      +/-   ##
==========================================
- Coverage   70.15%   70.09%   -0.06%     
==========================================
  Files          61       61              
  Lines       13995    13995              
==========================================
- Hits         9818     9810       -8     
- Misses       4177     4185       +8     
Flag Coverage Δ
unittests 70.09% <ø> (-0.06%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@ben-grande
Copy link
Copy Markdown
Contributor Author

ben-grande commented Mar 13, 2026

openQArun TEST=system_tests_dispvm_perf TEST_TEMPLATES=debian-13-xfce

@qubesos-bot
Copy link
Copy Markdown

qubesos-bot commented Mar 13, 2026

OpenQA test summary

Complete test suite and dependencies: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2026031319-4.3-debian&flavor=pull-requests

Test run included the following:

New failures, excluding unstable

Compared to: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2026020304-devel&flavor=update

Failed tests

No failures!

Fixed failures

Compared to: https://openqa.qubes-os.org/tests/166096#dependencies
Nothing fixed

Unstable tests

Details

Performance Tests

Performance degradation:

No issues

Remaining performance tests:

13 tests
  • debian-13-xfce_dom0-dispvm-api (mean:6.539): 78.47 🟢 ( previous job: 79.83, improvement: 98.29%)
  • debian-13-xfce_dom0-dispvm-gui-api (mean:7.827): 93.92 🔻 ( previous job: 92.49, degradation: 101.55%)
  • debian-13-xfce_dom0-dispvm-preload-2-api (mean:3.149): 37.79 🟢 ( previous job: 44.94, improvement: 84.08%)
  • debian-13-xfce_dom0-dispvm-preload-2-delay-0-api (mean:2.917): 35.00 🟢 ( previous job: 41.46, improvement: 84.42%)
  • debian-13-xfce_dom0-dispvm-preload-2-delay-minus-1d2-api (mean:3.307): 39.69 🟢 ( previous job: 47.01, improvement: 84.43%)
  • debian-13-xfce_dom0-dispvm-preload-4-api (mean:2.284): 27.41 🟢 ( previous job: 37.67, improvement: 72.75%)
  • debian-13-xfce_dom0-dispvm-preload-4-delay-0-api (mean:2.809): 33.71 🟢 ( previous job: 36.76, improvement: 91.71%)
  • debian-13-xfce_dom0-dispvm-preload-4-delay-minus-1d2-api (mean:2.441): 29.29 🟢 ( previous job: 37.87, improvement: 77.36%)
  • debian-13-xfce_dom0-dispvm-preload-2-gui-api (mean:4.989): 59.87 🔻 ( previous job: 55.58, degradation: 107.71%)
  • debian-13-xfce_dom0-dispvm-preload-4-gui-api (mean:4.135): 49.62 🔻 ( previous job: 47.73, degradation: 103.97%)
  • debian-13-xfce_dom0-dispvm-preload-6-gui-api (mean:4.198): 50.38 🔻 ( previous job: 47.11, degradation: 106.93%)
  • debian-13-xfce_dom0-vm-api (mean:0.038): 0.45 🔻 ( previous job: 0.41, degradation: 109.93%)
  • debian-13-xfce_dom0-vm-gui-api (mean:0.039): 0.47 🟢 ( previous job: 0.48, improvement: 96.67%)

@ben-grande
Copy link
Copy Markdown
Contributor Author

It is missing this PR:

But still, it didn't respect TEST_TEMPLATES.

@ben-grande
Copy link
Copy Markdown
Contributor Author

openQArun PR_LABEL=openqa-group-2 TEST=system_tests_dispvm_perf TEST_TEMPLATES=debian-13-xfce

@ben-grande
Copy link
Copy Markdown
Contributor Author

Merge?

@marmarek marmarek merged commit 0290c9c into QubesOS:main Apr 24, 2026
4 of 5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants