fix: Exclude setup time from benchmark in walltime mode (#114) #669
| Job | Run time |
|---|---|
| 1m 1s | |
| 2m 20s | |
| 5m 24s | |
| 5m 24s | |
| 2m 34s | |
| 2m 25s | |
| 5m 20s | |
| 1m 19s | |
| 1m 14s | |
| 5m 36s | |
| 5m 22s | |
| 1m 8s | |
| 2s | |
| 39m 9s |
| Job | Run time |
|---|---|
| 1m 1s | |
| 2m 20s | |
| 5m 24s | |
| 5m 24s | |
| 2m 34s | |
| 2m 25s | |
| 5m 20s | |
| 1m 19s | |
| 1m 14s | |
| 5m 36s | |
| 5m 22s | |
| 1m 8s | |
| 2s | |
| 39m 9s |