audio: crossover: Improve robustness for invalid configuration #23535

Job	Run time
manifest-check	2m 38s
build-windows (mnfst, mtl)	9m 3s
LP64-WIP	3m 50s
build-windows (mnfst, imx8m imx8ulp)	10m 59s
build-windows (mnfst, tgl)	9m 21s
build-windows (-d, mnfst, lnl)	9m 47s
build-linux (mnfst, ptl)	6m 16s
build-linux (mnfst, lnl)	4m 4s
build-windows (mnfst, imx8 imx8x)	10m 41s
build-linux (mnfst, tgl)	4m 17s
build-windows (mnfst, tgl-h)	9m 47s
build-linux (mnfst, imx8 imx8x)	5m 4s
build-linux (-d, mnfst, lnl)	4m 44s
build-linux (mnfst, wcl imx95)	7m 16s
build-windows (mnfst, lnl)	8m 53s
build-linux (mnfst, tgl-h)	4m 8s
build-linux (mnfst, imx8m imx8ulp)	4m 59s
build-windows (mnfst, ptl)	11m 57s
build-linux (mnfst, mtl)	4m 30s
compare-linux-win	26s
	2h 12m 40s

Provide feedback