Reduce allocation overhead in quantized sdpa #7255

Job	Run time
generate-matrix / generate	7s
pytorch/executorch / build-wheel-py3_10-cpu	28m 32s
pytorch/executorch / upload / upload-wheel-py3_10-cpu	28s
pytorch/executorch / upload-r2	0s
	29m 7s

Provide feedback