be more robust when destRobotsTxt == srcRobotsTxt #6497
| Job | Run time |
|---|---|
| 23s | |
| 10s | |
| 25m 50s | |
| 27m 43s | |
| 16m 33s | |
| 19m 16s | |
| 25m 2s | |
| 23m 42s | |
| 23m 38s | |
| 17m 19s | |
| 27m 37s | |
| 25m 38s | |
| 20m 22s | |
| 26m 16s | |
| 31m 56s | |
| 21m 36s | |
| 16m 43s | |
| 16m 36s | |
| 24m 51s | |
| 28m 31s | |
| 28m 6s | |
| 15m 37s | |
| 28m 0s | |
| 17m 19s | |
| 17m 42s | |
| 24m 15s | |
| 38m 27s | |
| 18m 41s | |
| 47m 21s | |
| 24m 41s | |
| 18m 3s | |
| 17m 41s | |
| 16m 25s | |
| 18m 34s | |
| 23m 49s | |
| 25m 47s | |
| 16m 51s | |
| 25m 34s | |
| 29m 44s | |
| 26m 30s | |
| 15m 15s | |
| 25m 25s | |
| 15h 39m 29s |