Skip to content

Add AI Crawler Bots#235

Open
matte97p wants to merge 1 commit into
serpapi:mainfrom
matte97p:add-ai-crawler-bots
Open

Add AI Crawler Bots#235
matte97p wants to merge 1 commit into
serpapi:mainfrom
matte97p:add-ai-crawler-bots

Conversation

@matte97p

Copy link
Copy Markdown

Hi! Adding AI Crawler Bots (npm: @geosuite/ai-crawler-bots), a free, open-source (MIT), zero-dependency Node CLI and GitHub Action that audits robots.txt for AI crawler access, computes an AI-visibility score, tests live reachability, and reads server access logs to see which AI bots crawled a site.

I appended it to the bottom of the Technical SEO section, per the contributing guide. Thanks for maintaining this list!

@matte97p

matte97p commented Jul 8, 2026

Copy link
Copy Markdown
Author

@hilmanski

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant