Skip to content

add google special crawler to good actors whitelist#1791

Closed
sabban wants to merge 4 commits into
masterfrom
test_add_google_special_crawlers
Closed

add google special crawler to good actors whitelist#1791
sabban wants to merge 4 commits into
masterfrom
test_add_google_special_crawlers

Conversation

@sabban
Copy link
Copy Markdown
Contributor

@sabban sabban commented May 7, 2026

Description

Checklist

  • I have read the contributing guide
  • I have tested my changes locally
  • For new parsers or scenarios, tests have been added
  • I have run the hub linter and no issues were reported (see contributing guide)
  • Automated tests are passing
  • AI was used to generate any/all content of this PR

Copilot AI review requested due to automatic review settings May 7, 2026 08:22
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds a new whitelist postoverflow to exempt Google “special crawlers” traffic (via curated IPv4/IPv6 range files hosted on hub-data) and includes it in the existing “good actors” whitelist collection.

Changes:

  • Introduced a new postoverflow whitelist: crowdsecurity/google-special-crawlers-whitelist.
  • Wired the new whitelist into crowdsecurity/whitelist-good-actors collection.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.

File Description
postoverflows/s01-whitelist/crowdsecurity/google-special-crawlers-whitelist.yaml New whitelist using IPv4/IPv6 CIDR lists from hub-data to exempt Google special crawler IP ranges.
collections/crowdsecurity/whitelist-good-actors.yaml Adds the new Google special crawlers whitelist to the “good actors” collection.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

name: crowdsecurity/google-special-crawlers-whitelist
description: "Whitelist events from Google special crawlers (e.g. Google-InspectionTool, GoogleOther)"
whitelist:
reason: "Google special crawlers ip range"
@sabban sabban closed this May 7, 2026
@sabban sabban deleted the test_add_google_special_crawlers branch May 7, 2026 11:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants