Create sitemap for site

[insectengine]

Used Bob to create a search engine, ai, human searchable sitemap for the site.

Resolves #2420

#2643 tracks the all-singing dynamically generated version.

[github-actions]

🙈 The PR is closed and the preview is expired.

[insectengine]

@maxandersen @cescoffier @gsmet @holly-cummins - Created this sitemap for better visibility for LLMs

[holly-cummins]

+1 on having a sitemap. It should help our SEO as well.

Longer term, let's find a way to generate it, but maybe not until post-Roq. :)

Is XML or HTML better for this? It's not my area, but a quick google suggested XML is more common.

[insectengine]

+1 on having a sitemap. It should help our SEO as well.

Longer term, let's find a way to generate it, but maybe not until post-Roq. :)

Is XML or HTML better for this? It's not my area, but a quick google suggested XML is more common.

@holly-cummins - Not my area of expertise either but my research says having booth is good. Use XML for SEO crawlers and HTML for humans and LLMs. I used Bob to create both that use a yaml file to make it easier for maintenance.