Harden CI for self-hosted SLURM runners #4299

Job	Run time
Lint Gate	1m 13s
Detect File Changes	11s
Github (ubuntu, mpi, debug, true)	1h 24m 48s
Github (ubuntu, no-mpi, single, no-debug, false)	29m 6s
Oak Ridge \| Frontier (gpu-acc [2/2])	1s
Github (ubuntu, mpi, no-debug, false)	1h 43m 14s
Github (ubuntu, mpi, debug, false)	1h 43m 13s
Oak Ridge \| Frontier (gpu-omp [2/2])	1s
Oak Ridge \| Frontier (gpu-acc [1/2])	1s
Georgia Tech \| Phoenix (gpu-omp)	1h 26m 35s
Oak Ridge \| Frontier (AMD) (gpu-omp [1/2])	1s
Oak Ridge \| Frontier (AMD) (cpu)	1s
Oak Ridge \| Frontier (gpu-omp [1/2])	1h 26m 9s
Oak Ridge \| Frontier (cpu)	1s
Github (macos, mpi, no-debug, false)	1h 9m 36s
Georgia Tech \| Phoenix (gpu-acc)	1h 26m 8s
Oak Ridge \| Frontier (AMD) (gpu-omp [2/2])	1s
Github (ubuntu, mpi, no-debug, true)	1h 33m 36s
Github (macos, mpi, debug, false)	1h 2m 13s
Georgia Tech \| Phoenix (cpu)	1h 5m 33s
	14h 31m 42s

Provide feedback