Skip to content

Commit 1ceba7f

Browse files
committed
review(#1154): refactor, redirect, regex, stderr
1 parent 9bfbc67 commit 1ceba7f

9 files changed

Lines changed: 190 additions & 226 deletions

File tree

lib/ingestors/concerns/github_ingestor_material_helpers.rb

Lines changed: 0 additions & 142 deletions
This file was deleted.

lib/ingestors/concerns/github_ingestor_read_helpers.rb

Lines changed: 0 additions & 38 deletions
This file was deleted.

lib/ingestors/concerns/sitemap_helpers.rb

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,6 @@ def parse_xml_sitemap(url)
2121
urls = SitemapParser.new(
2222
url,
2323
recurse: true,
24-
url_regex: /(github\.com|github\.io)/i,
2524
headers: { 'User-Agent' => config[:user_agent] }
2625
).to_a.uniq.map(&:strip)
2726

0 commit comments

Comments
 (0)