[Features]: Enable sitemap.xml-based crawling and following domain redirects#14

K-Mistele wants to merge 2 commits into

egoist:mainegoist/sitefetch:mainfrom

K-Mistele:mainK-Mistele/sitefetch:mainCopy head branch name to clipboard