[Executorch] Introduce caching cpu memory allocator #7351

Job	Run time
generate-matrix / generate	5s
pytorch/executorch / build-wheel-py3_10-cpu	20m 4s
pytorch/executorch / upload / upload-wheel-py3_10-cpu	31s
pytorch/executorch / upload-r2	0s
	20m 40s

Provide feedback