clean up some runtime potential bugs (#19447) #8340

Job	Run time
generate-matrix / generate	5s
pytorch/executorch / build-wheel-py3_10-cpu	27m 59s
pytorch/executorch / upload / upload-wheel-py3_10-cpu	26s
	28m 30s

Provide feedback