|
| 1 | +# Documentation State Review |
| 2 | +# 2026-06-04 |
| 3 | + |
| 4 | +## Purpose |
| 5 | + |
| 6 | +This review records the current state of TeaAgent's Markdown corpus and turns |
| 7 | +that state into concrete consolidation, governance, and UX recommendations. It |
| 8 | +is written as a current evidence snapshot, not as a replacement for historical |
| 9 | +audits. |
| 10 | + |
| 11 | +The central question is: |
| 12 | + |
| 13 | +> Can a daily user, maintainer, or future agent find the current truth quickly |
| 14 | +> without being misled by an older but plausible document? |
| 15 | +
|
| 16 | +## Scope And Method |
| 17 | + |
| 18 | +Reviewed: |
| 19 | + |
| 20 | +- Repository Markdown inventory and directory shape. |
| 21 | +- `cx overview docs --limit 120`. |
| 22 | +- `cx symbols --kind heading --name '*Status*' --limit 120`. |
| 23 | +- `cx symbols --kind heading --name '*Risk*' --limit 120`. |
| 24 | +- `cx symbols --kind heading --name '*Roadmap*' --limit 120`. |
| 25 | +- Current front doors: `docs/daily-driver-current-status.md`, |
| 26 | + `docs/analysis/daily-driver-review-INDEX-2026-06-01.md`, |
| 27 | + `docs/plans/ticket-plans/index.md`, `docs/roadmap-status.md`, |
| 28 | + `docs/modules/INDEX.md`, and `docs/governance/README.md`. |
| 29 | +- Current staged review package created on 2026-06-04. |
| 30 | + |
| 31 | +Not reviewed: |
| 32 | + |
| 33 | +- Every line of every Markdown file. |
| 34 | +- Full external competitor refresh. |
| 35 | +- Full link validation across all Markdown files. |
| 36 | +- Runtime truth of every risk row in module docs. |
| 37 | + |
| 38 | +## Inventory Snapshot |
| 39 | + |
| 40 | +| Signal | Current value | Evidence | |
| 41 | +| --- | ---: | --- | |
| 42 | +| Tracked Markdown files | 456 | `git ls-files '*.md'` | |
| 43 | +| Markdown files under `docs/` | 421 | `find docs -type f -name '*.md'` | |
| 44 | +| `docs/analysis` files | 62 | `cx overview docs --limit 120` | |
| 45 | +| `docs/plans` files | 43 | `cx overview docs --limit 120` | |
| 46 | +| `docs/modules` files | 103 | `cx overview docs --limit 120` | |
| 47 | +| `docs/governance` files | 15 | `cx overview docs --limit 120` | |
| 48 | +| Status-heading hits | 60 | `cx symbols --kind heading --name '*Status*' --limit 120` | |
| 49 | +| Risk-heading hits | 120 shown out of 133 | `cx symbols --kind heading --name '*Risk*' --limit 120` | |
| 50 | +| Roadmap-heading hits | 23 | `cx symbols --kind heading --name '*Roadmap*' --limit 120` | |
| 51 | +| Current collected tests | 3,379 | `/tmp/tea312/bin/python -m pytest --collect-only -q` | |
| 52 | +| Current acceptance collection | 441 | `/tmp/tea312/bin/python -m pytest tests/acceptance --collect-only -q` and acceptance collection guard | |
| 53 | + |
| 54 | +The counts differ from older docs because the corpus is growing quickly and |
| 55 | +because different commands include different scopes. Future reports must name |
| 56 | +the counting method. |
| 57 | + |
| 58 | +## Findings |
| 59 | + |
| 60 | +### DSR-001: The corpus is large but highly structured |
| 61 | + |
| 62 | +State: Active. |
| 63 | + |
| 64 | +The documentation tree is not random. It has recognizable families: user |
| 65 | +guides, analysis, governance, plans, module docs, security, reliability, specs, |
| 66 | +decisions, and operations. The problem is not lack of structure. The problem is |
| 67 | +that structure has outgrown the reader's ability to infer current truth from |
| 68 | +date alone. |
| 69 | + |
| 70 | +Recommendation: preserve dated evidence, add stronger front doors, and avoid |
| 71 | +mass merging historical reviews. |
| 72 | + |
| 73 | +### DSR-002: Current-truth docs and evidence docs are not visually distinct enough |
| 74 | + |
| 75 | +State: Active. |
| 76 | + |
| 77 | +Files such as `daily-driver-current-status.md` are current truth. Files such as |
| 78 | +dated audits and review packages are evidence snapshots. Both appear side by |
| 79 | +side in search and indexes, which means a reader can easily treat old evidence |
| 80 | +as a current instruction. |
| 81 | + |
| 82 | +Recommendation: use `docs/INDEX.md` and supersession notes to mark current |
| 83 | +truth surfaces clearly. |
| 84 | + |
| 85 | +### DSR-003: `docs/acceptance.md` had a high-trust contradiction |
| 86 | + |
| 87 | +State: Fixed in this documentation pass. |
| 88 | + |
| 89 | +The headline correctly said `441 passed`, but the body still stated an older |
| 90 | +full-suite failure result from 2026-06-03. This was dangerous because |
| 91 | +`docs/acceptance.md` is guarded by tests, and a reader could reasonably assume |
| 92 | +all status claims in that file were guarded. |
| 93 | + |
| 94 | +Change made: the stale failure paragraph now separates acceptance collection |
| 95 | +from the last recorded supported-interpreter full-suite evidence. |
| 96 | + |
| 97 | +Follow-up: add a prose-claim guard for full-suite status phrases. |
| 98 | + |
| 99 | +### DSR-004: The total-review package needed cleanup before becoming durable evidence |
| 100 | + |
| 101 | +State: Fixed in this documentation pass. |
| 102 | + |
| 103 | +The staged total-review package contained non-English labels and stray closing |
| 104 | +tags from generation. It also mixed measured-baseline facts with current-HEAD |
| 105 | +phrasing. |
| 106 | + |
| 107 | +Change made: the package now uses English headings, removes stray tags, and |
| 108 | +labels its `4695d46` full-suite evidence as a measured baseline while recording |
| 109 | +the current documentation-pass inventory separately. |
| 110 | + |
| 111 | +### DSR-005: `docs/modules/INDEX.md` was a useful generated map with stale status edges |
| 112 | + |
| 113 | +State: Partially fixed. |
| 114 | + |
| 115 | +The module index is valuable as a map, but its generated risk summary and old |
| 116 | +"known P0/P1 bugs" section can mislead readers if treated as live closure |
| 117 | +truth. |
| 118 | + |
| 119 | +Change made: added a supersession note and replaced the stale bug list with |
| 120 | +current front-door pointers. |
| 121 | + |
| 122 | +Follow-up: regenerate the module index or split it into "module map" and |
| 123 | +"module risk inventory" so generated historical risk rows do not masquerade as |
| 124 | +current status. |
| 125 | + |
| 126 | +### DSR-006: Status, risk, and roadmap claims are spread across many valid files |
| 127 | + |
| 128 | +State: Active. |
| 129 | + |
| 130 | +`cx` found 60 status-heading hits, 133 risk-heading hits, and 23 roadmap-heading |
| 131 | +hits. This is not automatically bad: ADRs, module risks, FMEA, roadmap, and |
| 132 | +ticket plans all need their own local views. It becomes bad when those local |
| 133 | +views compete to answer the same current-truth question. |
| 134 | + |
| 135 | +Recommendation: keep local views, but require upward links for P0/P1 risks and |
| 136 | +one canonical source of truth for each status question. |
| 137 | + |
| 138 | +### DSR-007: The current validators are necessary but insufficient |
| 139 | + |
| 140 | +State: Active. |
| 141 | + |
| 142 | +`validate_docs_consistency.py` and the acceptance-count guard catch important |
| 143 | +drift, but they do not parse most prose status claims. The `acceptance.md` |
| 144 | +contradiction proves the gap: a test can pass while a nearby paragraph is stale. |
| 145 | + |
| 146 | +Recommendation: add a small guarded-claim registry for volatile facts such as |
| 147 | +test counts, provider counts, dependency audit results, full-suite results, and |
| 148 | +release claims. |
| 149 | + |
| 150 | +### DSR-008: Roadmap status needs fresher connection to documentation work |
| 151 | + |
| 152 | +State: Active. |
| 153 | + |
| 154 | +`docs/roadmap-status.md` is canonical, but it was last updated before the June 4 |
| 155 | +documentation-state review. H0 claim and risk hygiene should explicitly include |
| 156 | +documentation-current-truth work. |
| 157 | + |
| 158 | +Recommendation: update H0 rows to link this documentation optimization package |
| 159 | +and add a doc-vs-HEAD guard as a named roadmap item. |
| 160 | + |
| 161 | +### DSR-009: More documentation is still useful, but only when it reduces future search |
| 162 | + |
| 163 | +State: Active. |
| 164 | + |
| 165 | +The user requested more plans, risks, surveys, and work items. That is useful |
| 166 | +only if each new document either becomes a front door, records dated evidence, |
| 167 | +or turns ambiguity into executable work. |
| 168 | + |
| 169 | +Recommendation: every new doc must declare whether it is current truth, |
| 170 | +evidence, plan, governance, or work log. |
| 171 | + |
| 172 | +## Current Front-Door Model |
| 173 | + |
| 174 | +| Reader question | Current front door | Needed improvement | |
| 175 | +| --- | --- | --- | |
| 176 | +| What should I use today? | `docs/daily-driver-current-status.md` | Keep short and current; avoid historical caveats. | |
| 177 | +| What happened in the daily-driver review? | `docs/analysis/daily-driver-review-INDEX-2026-06-01.md` | Link newer total-review and documentation-state packages. | |
| 178 | +| What is the current roadmap? | `docs/roadmap-status.md` | Add June 4 documentation work and H0 guard rows. | |
| 179 | +| What should be implemented next? | `docs/plans/ticket-plans/index.md` | Link non-ticket documentation optimization tasks. | |
| 180 | +| Which module owns a risk? | `docs/modules/INDEX.md` and module `risks.md` files | Regenerate or add stale-risk metadata. | |
| 181 | +| What rules govern docs? | `docs/governance/README.md` | Add this operating model to the top-level governance list. | |
| 182 | + |
| 183 | +## Recommended Consolidation |
| 184 | + |
| 185 | +Do not merge: |
| 186 | + |
| 187 | +- Dated reviews into a single mega-review. |
| 188 | +- Module risks into a single central risk register. |
| 189 | +- ADRs into roadmap rows. |
| 190 | +- Competitor surveys into product principles. |
| 191 | + |
| 192 | +Do merge or redirect: |
| 193 | + |
| 194 | +- Competing current-status pages that answer the same question. |
| 195 | +- Stale "known issue" lists into current-status pointers. |
| 196 | +- Repeated ticket-order narratives into the ticket index. |
| 197 | +- Long roadmap implementation steps into ticket links and exit evidence. |
| 198 | + |
| 199 | +## Review Verdict |
| 200 | + |
| 201 | +TeaAgent's documentation is a real project asset. It is also now large enough to |
| 202 | +become a trust liability if current truth is not guarded. The immediate path is |
| 203 | +not deletion. The path is: |
| 204 | + |
| 205 | +1. Curated front doors. |
| 206 | +2. Explicit claim classes. |
| 207 | +3. Supersession notes. |
| 208 | +4. Guarded volatile facts. |
| 209 | +5. Work-item ledgers with acceptance criteria. |
| 210 | +6. Regular re-anchoring after trust-sensitive code changes. |
0 commit comments