File tree Expand file tree Collapse file tree
Discovery/Web-Content/trickest-robots-disallowed-wordlists Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -1535,11 +1535,11 @@ hp/video
15351535hpc/*/supported-applications.aspx?
15361536hpm
15371537hpmob
1538- http://amazon.co.uk /robots.txt
1539- http://amazon.de /robots.txt
1540- http://news.google.com /robots.txt
1541- http://web.archive.org /robots.txt
1542- http://wordpress.org /robots.txt
1538+ http://blog.google /robots.txt
1539+ http://m.youtube.com /robots.txt
1540+ http://maps.app.goo.gl /robots.txt
1541+ http://s3.amazonaws.com /robots.txt
1542+ http://wa.me /robots.txt
15431543hub?category=
15441544hz/contact-us/ajax/initiate-trusted-contact
15451545hz/help/contact/*/message/$
@@ -3228,7 +3228,7 @@ wiki/Wikipedia_Diskussion:Checkuser
32283228wiki/Wikipedia_Diskussion:Spam-Blacklist-Log
32293229wiki/Wikipedia_talk%3AAbuse_reports
32303230wiki/Wikipedia_talk%3AAbuse_response
3231- wiki/Wikipedia_talk%3AAdministrator_electionshttp://soundcloud.com /robots.txt
3231+ wiki/Wikipedia_talk%3AAdministrator_electionshttp://goo.gl /robots.txt
32323232wiki/Wikipedia_talk%3AAdministrator_recall
32333233wiki/Wikipedia_talk%3AAdministrator_review
32343234wiki/Wikipedia_talk%3AAdministrators%27_noticeboard
You can’t perform that action at this time.
0 commit comments