chore: block /documents/ from search indexing, gitignore .mcp.json

caiopizzol · caiopizzol · commit 1aa46d8648b2 · 2026-04-02T18:29:34.000-03:00
Add Disallow: /documents/ to robots.txt so individual .docx files
don't compete with main pages in search results. Add .mcp.json to
.gitignore to prevent OAuth credentials from being committed.
diff --git a/.gitignore b/.gitignore
@@ -11,6 +11,7 @@ dist/
 .env
 .env.local
 .dev.vars
+.mcp.json
 
 # Local corpus cache
 corpus/
diff --git a/apps/web/robots.txt b/apps/web/robots.txt
@@ -2,6 +2,7 @@
 
 User-agent: *
 Allow: /
+Disallow: /documents/
 Sitemap: https://docxcorp.us/sitemap.xml
 
 # AI-friendly content available at /llms.txt
