Skip to content

Add startup mode to benchmarks#5571

Merged
pjBooms merged 2 commits intomasterfrom
pjBooms/startup-benchmark
Apr 7, 2026
Merged

Add startup mode to benchmarks#5571
pjBooms merged 2 commits intomasterfrom
pjBooms/startup-benchmark

Conversation

@pjBooms
Copy link
Copy Markdown
Contributor

@pjBooms pjBooms commented Apr 1, 2026

Introduced a new startup benchmark mode that measures application startup performance, from process start to the first frame and beyond.

Fixes CMP-9700

Release Notes

N/A

Copy link
Copy Markdown
Contributor

@ASalavei ASalavei left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Couple of notes:

  1. The measurement looks accurate, however it must be done with release mode and disabled debugger.
  2. Fist launch much slower then the following launches (cold vs hot launch) - this must be considered during launch tests.
  3. iOS device behaves differently with attached/detached cable. To ensure that the numbers measured correctly, I would recommend to do several launches of the app not from XCode, but with the standard way - by tapping an icon in both: cold and hot start.
  4. Would be great to collect these metrics on a regular bases from one of our apps (KotlinConf?)

@pjBooms
Copy link
Copy Markdown
Contributor Author

pjBooms commented Apr 7, 2026

LGTM. Couple of notes:

  1. The measurement looks accurate, however it must be done with release mode and disabled debugger.
  2. Fist launch much slower then the following launches (cold vs hot launch) - this must be considered during launch tests.
  3. iOS device behaves differently with attached/detached cable. To ensure that the numbers measured correctly, I would recommend to do several launches of the app not from XCode, but with the standard way - by tapping an icon in both: cold and hot start.

Sure. The purpose of the benchmarks is to be installed in the performance infrastructure to catch regressions/improvements. We will take into account these notes (/cc @PavelPunegov)

  1. Would be great to collect these metrics on a regular bases from one of our apps (KotlinConf?)

I don't think that real apps are ok to add to the benchmarking system, though I agree that we could measure similar way startup of them separately (as an additional task).

@pjBooms pjBooms merged commit d8abd1a into master Apr 7, 2026
4 checks passed
@pjBooms pjBooms deleted the pjBooms/startup-benchmark branch April 7, 2026 13:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants