seo: exclude /search from sitemap + robots, enrich two thin descriptions

- Add sitemap ignorePatterns for /search (client-side search results page
  has no indexable content) and Disallow it in robots.txt.
- Expand the how-it-works and introduction meta descriptions from one-liners
  to fuller ~150-char summaries (better SERP snippets + llms.txt entries).
- Regenerate llms.txt / llms-full.txt to match (verified with --check).
- Ignore Python __pycache__.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

Author: bloxster

.gitignore

@@ -16,3 +16,7 @@ build/
 npm-debug.log*
 yarn-debug.log*
 yarn-error.log*
+
+# Python
+__pycache__/
+*.pyc

docs/basics/how-it-works.md

@@ -1,6 +1,6 @@
 ---
 title: How it works
-description: Technical details of the Zilkworm prover.
+description: How the Zilkworm prover works — the C++ EVM core runs as riscv32im firmware inside a zkVM that traces execution and proves it with a pluggable backend such as SP1.
 sidebar_position: 4
 ---
 

docs/basics/introduction.md

@@ -1,6 +1,6 @@
 ---
 title: Introduction
-description: The Zilkworm project at a glance.
+description: Zilkworm is an evolution of Erigon's C++ Silkworm client focused on zero-knowledge proofs — a RISC-V-targeted core that proves full Ethereum block state transitions.
 sidebar_position: 2
 ---
 

docusaurus.config.ts

@@ -79,6 +79,10 @@ const config: Config = {
         },
         blog: false as false,
         theme: {customCss: './src/css/custom.css'},
+        sitemap: {
+          // The client-side search results page has no indexable content.
+          ignorePatterns: ['/search'],
+        },
       } satisfies Preset.Options,
     ],
   ],

static/llms-full.txt

@@ -185,7 +185,7 @@ SP1_PROVER=cuda RUST_BACKTRACE=full RUST_LOG=info z6m_prover prove --n 1 --file-
 
 Source: https://zilkworm.erigon.tech/documentation/basics/how-it-works
 
-_Technical details of the Zilkworm prover._
+_How the Zilkworm prover works — the C++ EVM core runs as riscv32im firmware inside a zkVM that traces execution and proves it with a pluggable backend such as SP1._
 
 The actual code of Zilkworm acts as the guest program for a zkVM. In reality though, it's optimized for one or more provers and the minimal riscv32im ISA. The thing about integrating with a certain zkVM prover backend though is that one needs to be careful about its memory boundaries, hardware and environment limitations and provisions.
 
@@ -237,7 +237,7 @@ Cryptographic operations are heavy, and the RV32IM guest has no business carryin
 
 Source: https://zilkworm.erigon.tech/documentation/basics/introduction
 
-_The Zilkworm project at a glance._
+_Zilkworm is an evolution of Erigon's C++ Silkworm client focused on zero-knowledge proofs — a RISC-V-targeted core that proves full Ethereum block state transitions._
 
 ### The Naming
 

static/llms.txt

@@ -7,8 +7,8 @@
 - [Background](https://zilkworm.erigon.tech/documentation/basics/background) — Why Zilkworm exists — Ethereum scaling, ZK proofs, and the case for a native C++ ZKEVM core.
 - [FAQs](https://zilkworm.erigon.tech/documentation/basics/faqs) — Frequently asked questions about Zilkworm — benchmarks, team, timeline, integration plans, and prover backends.
 - [Getting Started](https://zilkworm.erigon.tech/documentation/basics/getting-started) — Run the Zilkworm prover via the pre-built Docker image — setup, block fetch, dry-run execute, prove, and CUDA acceleration.
-- [How it works](https://zilkworm.erigon.tech/documentation/basics/how-it-works) — Technical details of the Zilkworm prover.
-- [Introduction](https://zilkworm.erigon.tech/documentation/basics/introduction) — The Zilkworm project at a glance.
+- [How it works](https://zilkworm.erigon.tech/documentation/basics/how-it-works) — How the Zilkworm prover works — the C++ EVM core runs as riscv32im firmware inside a zkVM that traces execution and proves it with a pluggable backend such as SP1.
+- [Introduction](https://zilkworm.erigon.tech/documentation/basics/introduction) — Zilkworm is an evolution of Erigon's C++ Silkworm client focused on zero-knowledge proofs — a RISC-V-targeted core that proves full Ethereum block state transitions.
 
 ## Home
 

static/robots.txt

@@ -1,4 +1,5 @@
 User-agent: *
 Allow: /
+Disallow: /search
 
 Sitemap: https://zilkworm.erigon.tech/sitemap.xml