Per weight constant cache #3520

Job	Run time
test-arm / test-backend-linux (arm_tosa_fp, operators) / linux-job	19m 30s
test-arm / test-backend-linux (arm_tosa_fp, models) / linux-job	31m 37s
test-arm / test-backend-linux (arm_vgf_fp, models) / linux-job	31m 41s
test-arm / test-backend-linux (arm_vgf_fp, operators) / linux-job	16m 48s
test-arm / test-backend-macos	-1s
test-arm / package-golden-artifacts	47s
	1h 40m 22s

Provide feedback