Per weight constant cache #2475

Job	Run time
test-xnnpack / test-backend-linux (xnnpack, operators) / linux-job	14m 26s
test-xnnpack / test-backend-linux (xnnpack, models) / linux-job	50m 1s
test-xnnpack / test-backend-macos	0s
test-xnnpack / package-golden-artifacts	3m 57s
	1h 8m 24s

Provide feedback