Fix auto test discovery to respect setting changes without reload #12204
| Job | Run time |
|---|---|
| 1m 10s | |
| 3m 22s | |
| 3m 25s | |
| 5m 48s | |
| 33s | |
| 7m 30s | |
| 1m 28s | |
| 48s | |
| 3m 29s | |
| 4m 19s | |
| 7m 11s | |
| 5m 35s | |
| 2m 59s | |
| 9m 23s | |
| 6m 17s | |
| 1m 1s | |
| 1m 4s | |
| 59s | |
| 9m 48s | |
| 1m 1s | |
| 59s | |
| 4m 12s | |
| 2m 7s | |
| 2m 43s | |
| 1m 0s | |
| 3m 38s | |
| 2m 8s | |
| 3m 16s | |
| 3m 21s | |
| 1m 3s | |
| 1m 2s | |
| 2m 2s | |
| 3m 20s | |
| 2m 6s | |
| 9m 45s | |
| 58s | |
| 2m 1s | |
| 4m 44s | |
| 7m 37s | |
| 2h 15m 12s |