Skip to content

Commit 814d835

Browse files
add documentation
1 parent 72d1277 commit 814d835

6 files changed

Lines changed: 32 additions & 2 deletions

File tree

β€ŽREADME.mdβ€Ž

Lines changed: 32 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,9 +8,39 @@
88

99
</div>
1010

11+
## πŸ“Š Available tools
12+
13+
This repository contains multiple scripts which can be run as is for reporting purposes, or serve as a baseline/guide for custom analysis scripts. Below we list all tools, with example outputs below. We also mention which command line argument should be passed to Evolve to generate the requested graphs.
14+
15+
- **`run_on_android.py`** Launches the Evolve benchmark on a connected Android device over ADB and pulls the result files back to your machine. This script requires ADB (Android Debug Bridge) to be installed.
16+
- **`compare_deep_analysis.py`** CLI tool that compares two deep-analysis exports and writes the top 20 passes with the largest mean / standard-deviation differences to CSV. Requires `--export-deep-analysis`.
17+
- **`scores_plotter.ipynb`** Bar chart comparing the Evolve scores per metric across benchmark runs or devices. Requires `--export-scores`.
18+
19+
<img src="./docs/images/tools/scores_plotter.png" width="700">
20+
21+
- **`per_frame_plotter.ipynb`** Line graph of the per score bucketed execution time/metric (frame time, ray tracing, rasterization, compute, driver, …) throughout the benchmark timeline. Can be used to compare between runs. Requires `--export-per-frame`.
22+
23+
<img src="./docs/images/tools/per_frame_plotter.png" width="700">
24+
<img src="./docs/images/tools/per_frame_metric.png" width="700">
25+
26+
- **`deep_analysis_plotter.ipynb`** Line graph of the execution time per render/compute/rt pass. Can be used to compare between runs. Requires `--export-deep-analysis`.
27+
28+
<img src="./docs/images/tools/deep_analysis_plotter.png" width="700">
29+
30+
- **`frame_breakdown_stackplot.ipynb`** Stacked area chart breaking down each frame's GPU time by render/compute/rt pass (top 20 passes + other). Requires `--export-deep-analysis`.
31+
32+
<img src="./docs/images/tools/frame_breakdown_stackplot.png" width="700">
33+
34+
## πŸ“ Capturing data
35+
36+
These scripts require specific custom Evolve outputs, which can be generated using the following command line arguments when launching evolve.
37+
38+
- `run-custom --export-scores scores.csv`
39+
- `run-custom --export-per-frame per_frame.csv`
40+
- `run-custom --export-deep-analysis deep_analysis.json`
41+
1142
## πŸ‘·β€β™€οΈ Requirements
1243

1344
Please ensure the following dependencies are installed before running scripts from this repository:
1445

15-
- Python 3.7
16-
- ADB (Android Debug Bridge)
46+
- Python 3.11+
156 KB
Loading
750 KB
Loading
116 KB
Loading
59 KB
Loading
44.7 KB
Loading

0 commit comments

Comments
Β (0)