Spirv builder cleanup #1464

Job	Run time
Test (windows-latest)	57s
Compiletest (macOS-latest)	49s
Difftest (ubuntu-latest)	58s
cargo-deny	56s
Difftest (macOS-latest)	47s
Compiletest (ubuntu-latest)	59s
Test (ubuntu-latest)	58s
Difftest (windows-latest)	56s
Test (macOS-latest)	53s
Compiletest (windows-latest)	53s
Lint	47s
Android (ubuntu-latest, aarch64-linux-android)	58s
test_success	4s
	10m 55s

Provide feedback