Create docs: clarify AI Crawl Control usage and metrics

This update enhances the AI Crawl Control documentation by:

- Clarifying crawler purposes (Training, Search, User Action, Undeclared).
- Adding insights from recent ERIFY bot analytics (June–Sept 2025).
- Providing context on how AI services interact with domains.
- Preparing groundwork for community transparency and AI policy awareness.

Part of ERIFY’s mission to secure, monitor, and elevate AI-driven web ecosystems.

Author: ERIFY Bot 🤖🔥

docs: clarify AI Crawl Control usage and metrics

@@ -0,0 +1,6 @@
+This PR improves documentation on AI Crawl Control:
+- Adds breakdown of crawler purposes (Training, Search, User Action, Undeclared).
+- Includes insights from ERIFY bot analytics (June–Sept 2025).
+- Prepares docs for community awareness of AI bot monitoring.
+
+Part of ERIFY’s effort to improve AI transparency 🔥👑