feat: add robots.txt for SEO and bot management#535

Vaishnav88sk wants to merge 1 commit intomicrocks:mastermicrocks/microcks.io:masterfrom

Vaishnav88sk:feat/seo-robots-cleanVaishnav88sk/microcks.io:feat/seo-robots-cleanCopy head branch name to clipboard