Add Kotlin script for running benchmarks for all targets (#5566)

The `run_benchmarks.main.kts` script provides running benchmarks on all
supported platforms (macos, desktop, web, ios). It handles
platform-specific details like starting a background server for web
benchmarks or invoking iOS-specific scripts.

Also it handles running benchmarks in a separate process.

`compare_benchmarks.main.kts` and `find_degradations.main.kts` was also
updated to use the script.

Fixes [CMP-8273](https://youtrack.jetbrains.com/issue/CMP-8273)

## Release Notes
N/A

Author: pjBooms

benchmarks/multiplatform/README.md

@@ -43,6 +43,61 @@ You can configure benchmark runs using arguments passed to the Gradle task (via
 ./gradlew :benchmarks:run -PrunArguments="benchmarks=LazyGrid modes=REAL frameCount=200"
 ```
 
+## Running Benchmarks via Scripts
+
+There are several scripts provided to run benchmarks more conveniently, especially when you need to run multiple iterations or compare different versions.
+
+### `run_benchmarks.main.kts`
+
+This script is the main entry point for running benchmarks on all supported platforms (macos, desktop, web, ios). It handles platform-specific details like starting a background server for web benchmarks or invoking iOS-specific scripts.
+
+**Usage:**
+```bash
+./run_benchmarks.main.kts <platform> [runs=1] [benchmarks=<benchmarkName>] [version=<version>] [separateProcess=true|false] [any other gradle args]
+```
+
+**Platforms:** `macos`, `desktop`, `web`, `ios`
+
+**Arguments:**
+- `runs=<number>`: Number of iterations to run (default: 1).
+- `benchmarks=<name1,name2,...>`: Filter benchmarks to run.
+- `version=<version>`: Compose Multiplatform version to use. If specified, the script updates `gradle/libs.versions.toml` before running and restores it afterward.
+- `separateProcess=true`: Runs each benchmark in a separate process for better isolation (default: `false`).
+- Any other arguments (e.g., `modes=SIMPLE`) are forwarded to the benchmark execution.
+
+**Example:**
+```bash
+./run_benchmarks.main.kts macos benchmarks=LazyList runs=3 version=1.10.0
+```
+
+**Output:**
+JSON results are archived to: `benchmarks/build/benchmarks/archive/${platform}/${version}_run${runIndex}`
+
+### `compare_benchmarks.main.kts`
+
+Used to compare benchmark results between two different versions of Compose Multiplatform.
+
+**Usage:**
+```bash
+./compare_benchmarks.main.kts v1=<version1> v2=<version2> [runs=3] [platform=macos|desktop|web|ios] [benchmarks=<name>] [skipExisting=true] [separateProcess=true]
+```
+
+**Example:**
+```bash
+./compare_benchmarks.main.kts v1=1.9.0 v2=1.10.0 runs=3 platform=macos skipExisting=true
+```
+
+### `find_degradation.main.kts`
+
+Performs a binary search over a list of versions to find the first version where a performance degradation (defined as >5% increase in time) was introduced.
+
+**Usage:**
+```bash
+./find_degradation.main.kts benchmarks=<benchmarkName> versions=<versionsFile> [platform=macos|desktop|web] [skipExisting=true]
+```
+
+The `versionsFile` should be a plain text file with one version per line, sorted from oldest to newest.
+
 ## Run Desktop
 - `./gradlew :benchmarks:run`
 
@@ -63,9 +118,9 @@ Alternatively you may open `iosApp/iosApp` project in XCode and run the app from
 To run specific benchmarks:
 - `./run_ios_benchmarks.main.kts <DEVICE ID> benchmarks=AnimatedVisibility,LazyGrid`
 
-To run all benchmarks in a single process (faster but may be less reliable as some 
+To run each benchmark in a separate process (slower but more reliable as some 
 benchmarks may affect others within one process):
-- `./run_ios_benchmarks.main.kts <DEVICE ID> separateProcess=false`
+- `./run_ios_benchmarks.main.kts <DEVICE ID> separateProcess=true`
 
 4. Results are saved in `benchmarks/build/benchmarks/text-reports/` (when using `.main.kts`) or `benchmarks_result/` (when using `.sh`).
 

benchmarks/multiplatform/benchmarks/src/webMain/kotlin/Main.web.kt

@@ -35,7 +35,7 @@ fun mainBrowser() = MainScope().launch {
 
             runBenchmarks()
             println("Completed!")
-            if (Config.saveStats()) {
+            if (BenchmarksSaveServerClient.isServerAlive()) {
                 GlobalScope.launch {
                     BenchmarksSaveServerClient.stopServer()
                 }