Per weight constant cache #3464

Job	Run time
test-xnnpack / test-backend-linux (xnnpack, operators) / linux-job	14m 41s
test-xnnpack / test-backend-linux (xnnpack, models) / linux-job	52m 39s
test-xnnpack / test-backend-macos	-7s
test-xnnpack / package-golden-artifacts	3m 44s
	1h 10m 57s

Provide feedback