Skip to content

Commit be90850

Browse files
Re-add resource contention caveat for parallel runs
1 parent d9abf0d commit be90850

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

AAE.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -127,6 +127,7 @@ Run the benchmark and collect results:
127127
```bash
128128
parallel --jobs 4 --results run_results/ './bench.sh --input {} > logs/run_{}.log 2>&1' ::: input1 input2 input3 input4
129129
```
130+
Only parallelize when runs are independent and the system has sufficient resources (CPU cores, memory, GPU slots) to avoid contention that would distort measurements.
130131

131132
**Aggregation**: When an experiment produces multiple measurements (e.g. across inputs or seeds), use the **geometric mean** as the default summary statistic. The geometric mean is appropriate for ratios and multiplicative quantities like speedups or normalized scores, and is less sensitive to outliers than the arithmetic mean. Compute it as:
132133
```

0 commit comments

Comments
 (0)