Fix GGUF to Work Better with modules_to_not_convert / keep_in_fp32_modules#13697

dg845 wants to merge 2 commits intomainhuggingface/diffusers:mainfrom

gguf-fix-modules-not-to-converthuggingface/diffusers:gguf-fix-modules-not-to-convertCopy head branch name to clipboard