Create docs: clarify AI Crawl Control usage and metrics#40604

erifybot wants to merge 1 commit intogithub:maingithub/docs:mainfrom

erifybot:patch-1erifybot/docs:patch-1Copy head branch name to clipboard