Per weight constant cache #3407

Job	Run time
test-vulkan / test-backend-linux (vulkan, models) / linux-job	20m 47s
test-vulkan / test-backend-linux (vulkan, operators) / linux-job	21m 18s
test-vulkan / test-backend-macos	-1s
test-vulkan / package-golden-artifacts	3m 40s
	45m 44s

Provide feedback