File tree Expand file tree Collapse file tree
Discovery/Web-Content/trickest-robots-disallowed-wordlists Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -1535,10 +1535,10 @@ hp/video
15351535hpc/*/supported-applications.aspx?
15361536hpm
15371537hpmob
1538- http://de.wikipedia.org/robots.txt
1539- http://google-analytics.com/robots.txt
1540- http://npr.org/robots.txt
1538+ http://instagram.com/robots.txt
1539+ http://maps.app.goo.gl/robots.txt
15411540http://web.archive.org/robots.txt
1541+ http://wordpress.org/robots.txt
15421542hub?category=
15431543hz/contact-us/ajax/initiate-trusted-contact
15441544hz/help/contact/*/message/$
@@ -3225,7 +3225,7 @@ wiki/Wikipedia_Diskussion:Checkuser
32253225wiki/Wikipedia_Diskussion:Spam-Blacklist-Log
32263226wiki/Wikipedia_talk%3AAbuse_reports
32273227wiki/Wikipedia_talk%3AAbuse_response
3228- wiki/Wikipedia_talk%3AAdministrator_electionshttp://goo.gl /robots.txt
3228+ wiki/Wikipedia_talk%3AAdministrator_electionshttp://itunes.apple.com /robots.txt
32293229wiki/Wikipedia_talk%3AAdministrator_recall
32303230wiki/Wikipedia_talk%3AAdministrator_review
32313231wiki/Wikipedia_talk%3AAdministrators%27_noticeboard
You can’t perform that action at this time.
0 commit comments