Enable TorchAO int4wo quantization tests on XPU #38307

Job	Run time
check_code_quality	32s
check_repository_consistency	29s
Hub tests for models, schedulers, and pipelines	2m 52s
LoRA tests with PEFT main	8m 23s
Fast PyTorch Models & Schedulers CPU tests	8m 5s
Fast PyTorch Pipeline CPU tests	16m 21s
PyTorch Example CPU tests	18m 54s
	55m 36s

Provide feedback