Handle all modules being serialized during LTO #1628

Job	Run time
build (libgccjit12.so, gcc12, --no-default-features, TEST_FLAGS='-Cpanic=abort -Zpanic-abort-test...	1m 28s
build (libgccjit_without_int128.so, master-without-128bit-integers)	1m 30s
build (libgccjit.so, master)	2m 3s
success_failures	4s
	5m 5s

Provide feedback