Agents learn from docs with technical excellence

[todah-zg]

Changelog:

• automatically generate llms.txt --> short intro + map to the whole site
• auto generate llms-full.txt --> dumps the entire site into a single markdown file. Apparently agents love this.
• all pages accessible as pure markdown by appending '.md' to the original url