fix(build): clear linker flags for WHISPER and MINIAUDIO when using H… #238

Job	Run time
linux-cpu-avx512-x86_64 build + test	29s
linux-cpu-avx2-x86_64 build + test	33s
linux-cpu-x86_64 build + test	33s
linux-vulkan-x86_64 build + test	1m 5s
linux-openblas-arm64 build + test	1m 57s
linux-cpu-arm64 build + test	40s
linux-opencl-x86_64 build + test	53s
linux-vulkan-arm64 build + test	3m 42s
linux-neon-arm64 build + test	39s
windows-cpu-avx512-x86_64 build + test	1m 37s
windows-cpu-x86_64 build + test	1m 36s
windows-cpu-avx-vnni-x86_64 build + test	1m 35s
windows-vulkan-x86_64 build + test	1m 37s
linux-opencl-arm64 build + test	1m 45s
macos build + test	42s
linux-openblas-x86_64 build + test	33s
windows-llamafile-x86_64 build + test	1m 38s
windows-openblas-x86_64 build + test	1m 37s
windows-sycl-x86_64 build + test	2m 49s
windows-cuda-x86_64 build + test	2m 37s
windows-opencl-x86_64 build + test	1m 37s
ios build	52s
windows-cpu-avx2-x86_64 build + test	1m 50s
android-x86_64 build + test	3m 41s
windows-hip-x86_64 build + test	2m 30s
android-arm64-v8a build	46s
isim build	49s
release	0s
	40m 42s

Provide feedback