Release v0.6.1 with Netdata histogram metadata

Author: ktsaou

.agents/sow/SOW-status.md

@@ -1,6 +1,6 @@
 # SOW Status
 
-Last updated: 2026-06-08
+Last updated: 2026-06-09
 
 ## Current
 
@@ -43,6 +43,13 @@ Last updated: 2026-06-08
 
 ## Recently Closed Or Completed
 
+- SOW-0093 - Netdata Function Boundary Reader Comparison: completed after
+  2026-06-09 regression repair and `v0.6.1` patch release. Rust and Go Netdata
+  histogram responses now emit the libnetdata chart metadata tree, including
+  `histogram.chart.view.dimensions.names`; the comparator rejects missing
+  histogram chart schema and missing `sts` members; four requested reviewers
+  returned `PRODUCTION GRADE`; Rust crates were published to crates.io at
+  `0.6.1`; root and Go module tags are created on the close commit.
 - SOW-0100 - Consumer Docs And GitHub Wiki Publication: completed after
   regression repair. GitHub wiki navigation now uses `[[Target|Label]]` wiki
   links, the wiki has professional API overview plus Rust and Go language
@@ -72,15 +79,6 @@ Last updated: 2026-06-08
   tests cover 14 request/source/profile/progress/timeout/sampling/time
   behavior clusters, and all approved reviewers returned
   `PRODUCTION GRADE: YES`.
-- SOW-0093 - Netdata Function Boundary Reader Comparison: completed after
-  regression repair. The Rust SDK Netdata function boundary now has a broad
-  SDK-first everyday-use matrix with 20/20 stable-content passes after sampling
-  parity repairs and explicit non-content classification for known
-  installed-plugin `MESSAGE` corruption plus selected-and-faceted same-field
-  quirks. The post-review-fix five-repetition default full-analysis benchmark
-  shows SDK mean `3.950s`, plugin mean `12.678s`, and `3.21x` ratio of means.
-  Final six-model reviewer rerun returned `PRODUCTION GRADE` from all approved
-  reviewers.
 - SOW-0082 - Rust Optimized Journal Explorer API: completed after regression
   repair. Normal Netdata-shaped Explorer queries now use one candidate-row
   traversal for rows, facets, and histogram; the Netdata function wrapper keeps

.agents/sow/done/SOW-0093-20260605-netdata-function-boundary-reader-comparison.md

@@ -6,7 +6,8 @@ Status: completed
 
 `completed` is the successful terminal status. `done` is a directory name, not a status value. Do not use `Status: done` or `Status: complete`.
 
-Sub-state: completed after regression repair. Earlier strict SDK-first
+Sub-state: completed after 2026-06-09 regression repair and `v0.6.1` patch
+release. Earlier strict SDK-first
 content comparison passed locally for the large default-facets full-analysis
 request and for the repo-local matrix covering `info`, full priority, filtered
 priority, full default facets, low-budget sampling, data-only, data-only delta,
@@ -25,8 +26,14 @@ stable-content passes. The current default full-analysis speedup is
 approximately `3.21x` by ratio of means against the installed
 `systemd-journal.plugin`; profiling shows the remaining time is in Explorer
 traversal, not wrapper glue or JSON shaping. The final whole-SOW reviewer
-rerun returned production-grade votes from the six approved reviewers; SOW
-lifecycle closeout is pending.
+rerun returned production-grade votes from the six approved reviewers. A later
+SNMP traps Netdata function integration exposed a UI-breaking histogram chart
+metadata gap: the SDK emitted `chart.result` plus a shallow `chart.view`, while
+libnetdata facets emits the full chart metadata tree including
+`chart.view.dimensions.names`. The regression repair now emits the required
+histogram chart metadata in Rust and Go, the shared comparator rejects missing
+histogram chart schema, four requested reviewers returned `PRODUCTION GRADE`
+after hardening, and Rust packages were published to crates.io at `0.6.1`.
 
 ## Requirements
 
@@ -2141,3 +2148,236 @@ Reviewer findings and dispositions:
 - Test-name precision and explanatory comments suggested by reviewers are
   non-blocking and do not affect the shipped contract. No follow-up is
   required.
+
+## Regression - 2026-06-09
+
+### What Broke
+
+The Go SDK Netdata function response used by the SNMP traps integration
+returned a successful table response but omitted histogram chart view dimension
+metadata. The local authenticated request returned:
+
+- `status=200`;
+- `histogram.chart.result.labels=["time"]`;
+- `histogram.chart.view.dimensions=null`.
+
+The Netdata UI stack then failed while reading a `names` member from an
+undefined dimensions object. The raw browser cookies and tokens from the
+reported request were not copied into this SOW or any durable artifact.
+
+### Evidence
+
+Local response shape checked with a sanitized local request:
+
+- top-level `columns` exists as a Netdata table column map;
+- `columns.names` is not part of the table-column contract;
+- `histogram.chart.view.dimensions` is missing;
+- `available_histograms` is an empty array for the tested SNMP traps interval.
+
+Netdata/libnetdata source evidence:
+
+- `netdata/netdata @ local worktree checked read-only`
+- `src/libnetdata/facets/facets.c:1209` starts
+  `facets_histogram_generate()`.
+- `src/libnetdata/facets/facets.c:1253-1430` emits
+  `chart.summary`.
+- `src/libnetdata/facets/facets.c:1432-1463` emits
+  `chart.totals`.
+- `src/libnetdata/facets/facets.c:1465-1508` emits
+  `chart.result`.
+- `src/libnetdata/facets/facets.c:1510-1552` emits
+  `chart.db`.
+- `src/libnetdata/facets/facets.c:1554-1595` emits `chart.view`, including
+  `view.dimensions.grouped_by`, `ids`, `names`, `colors`, `units`, and `sts`.
+- `src/libnetdata/facets/facets.c:1597-1608` emits `chart.agents`.
+
+SDK evidence:
+
+- `go/journal/netdata.go:1509-1528` emits only `chart.result` and a shallow
+  `chart.view` without `view.dimensions`.
+- `rust/src/journal/src/netdata.rs:863-944` has the same omission in the Rust
+  reference path.
+- `tests/netdata_function/compare_function_json.py:329-369` normalized only
+  histogram `result.labels` and `result.data`, so it could not catch missing
+  UI-facing chart metadata.
+
+### Why Previous Validation Missed It
+
+The strict comparator intentionally normalized histogram content by bucket and
+label to tolerate presentation-order differences. That was valid for content
+equality, but incomplete for UI replacement. It did not assert the presence of
+Netdata chart metadata consumed by the dashboard.
+
+### Repair Plan
+
+1. Extend Rust and Go Netdata histogram builders to emit libnetdata-compatible
+   histogram chart metadata:
+   - `summary`;
+   - `totals`;
+   - `result`;
+   - `db`;
+   - `view`, including `dimensions.names`;
+   - `agents`.
+2. Keep row/facet/histogram traversal behavior unchanged.
+3. Add focused Rust and Go tests that assert empty-dimension histograms still
+   include the UI-facing dimension arrays and objects.
+4. Extend the shared comparator or schema checks so future Netdata function
+   parity cannot pass when required chart metadata is missing.
+5. Validate with the local SNMP traps request shape without writing sensitive
+   browser/session data to durable artifacts.
+
+### Validation Plan
+
+- Rust focused Netdata tests.
+- Go focused Netdata tests.
+- Shared Netdata comparator/schema tests.
+- Local sanitized request against the running SNMP traps function, checking
+  `histogram.chart.view.dimensions.names` exists as an array.
+- `git diff --check`.
+- `.agents/sow/audit.sh`.
+- Whole-SOW reviewer rerun after local implementation and validation.
+
+### Artifact Updates Required
+
+- Specs: update `.agents/sow/specs/systemd-journal-plugin-facets.md` with the
+  full histogram chart metadata contract.
+- End-user docs: update API docs if public Netdata function response examples
+  omit the required chart metadata.
+- SOW status: update `.agents/sow/SOW-status.md` after the repair outcome is
+  known.
+
+### Implementation Progress
+
+Local repair on 2026-06-09:
+
+- Rust and Go Netdata histogram builders now emit the libnetdata-compatible
+  histogram chart envelope:
+  - `chart.summary`;
+  - `chart.totals`;
+  - `chart.result`;
+  - `chart.db`;
+  - `chart.view`, including `view.dimensions.grouped_by`, `ids`, `names`,
+    `colors`, `units`, and `sts`;
+  - `chart.agents`.
+- Empty-dimension histograms preserve empty arrays/objects instead of omitting
+  the dimension metadata.
+- The shared Netdata function comparator now has a histogram chart schema gate,
+  so missing UI-facing chart metadata fails comparison independently from
+  normalized bucket content.
+- Specs and consumer docs now record the chart metadata contract.
+
+Focused hardening after reviewer observations:
+
+- Removed the unused Go `histogramLabels()` helper after the metadata builder
+  replaced it.
+- Strengthened the comparator schema gate to require `sts.min`, `sts.max`,
+  `sts.avg`, `sts.arp`, and `sts.con` arrays under both
+  `chart.db.dimensions.sts` and `chart.view.dimensions.sts`.
+- Added a Python regression test proving a missing `sts.con` member fails the
+  histogram schema check.
+
+### Local Validation
+
+Validation on 2026-06-09 after focused hardening:
+
+- `cd go && go test ./journal -run 'TestNetdataHistogramChartMetadata|TestNetdataFunctionQueryFilters' -count=1`:
+  passed.
+- `cd rust && cargo test -p systemd-journal-sdk netdata --lib`: passed, 51
+  tests.
+- `python3 -m unittest tests.netdata_function.test_compare_function_json`:
+  passed, 25 tests.
+- `python3 -m py_compile tests/netdata_function/compare_function_json.py
+  tests/netdata_function/test_compare_function_json.py`: passed.
+- `rg -n 'histogramLabels|histogram_labels' go/journal/netdata.go
+  rust/src/journal/src/netdata.rs`: no matches.
+- `git diff --check`: passed.
+- `.agents/sow/audit.sh`: passed with clean verdict.
+
+### Reviewer Batch
+
+First focused reviewer batch on 2026-06-09 used the current configured models
+from `~/.AGENTS.md` for the requested aliases:
+
+- `llm-netdata-cloud/glm-5.1`: `PRODUCTION GRADE`.
+- `llm-netdata-cloud/minimax-m3-coder`: `PRODUCTION GRADE`.
+- `llm-netdata-cloud/mimo-v2.5-pro`: `PRODUCTION GRADE`.
+- `llm-netdata-cloud/qwen3.7-plus`: `PRODUCTION GRADE`.
+
+Reviewer findings and dispositions:
+
+- Missing histogram metadata: all reviewers agreed the Rust and Go output now
+  emits the required chart metadata and fixes the UI-facing regression.
+- Rust/Go parity: all reviewers accepted the changed algorithms as equivalent
+  for the histogram metadata contract.
+- Dead Go helper: accepted and fixed by removing `histogramLabels()`.
+- Comparator `sts` subkey schema gap: accepted and fixed by requiring the
+  expected `sts` array members in the schema validator.
+- Empty-histogram `view.min` sentinel difference: accepted as non-blocking.
+  The SDK emits `0`; libnetdata initializes an internal empty sentinel as
+  `UINT32_MAX`. No shipped UI-facing requirement was found for reproducing the
+  sentinel, and reviewers did not treat it as a production blocker.
+
+Final focused reviewer rerun after hardening fixes:
+
+- `llm-netdata-cloud/glm-5.1`: `PRODUCTION GRADE`.
+- `llm-netdata-cloud/minimax-m3-coder`: `PRODUCTION GRADE`.
+- `llm-netdata-cloud/mimo-v2.5-pro`: `PRODUCTION GRADE`.
+- `llm-netdata-cloud/qwen3.7-plus`: `PRODUCTION GRADE`.
+
+Final reviewer findings and dispositions:
+
+- Empty-histogram `view.min`/`view.max` sentinel difference remains accepted as
+  non-blocking. The SDK emits `0` for no data; no UI-facing requirement was
+  found for reproducing libnetdata's internal empty sentinel.
+- Histogram summary point counting uses dimensions multiplied by bucket count,
+  matching the libnetdata summary-statistics shape; no change required.
+- The Python comparator fixture uses simplified `summary` arrays because the
+  comparator intentionally schema-checks metadata shape and compares histogram
+  content through normalized buckets; no change required.
+- Sensitive data gate: the reported browser request contained cookies and
+  bearer tokens, but this SOW records only sanitized response-shape evidence and
+  no raw credentials, tokens, cookies, or private endpoint data.
+
+### Patch Release Plan
+
+The Netdata integration needs a consumable release containing this regression
+repair. The selected patch release is `v0.6.1`:
+
+- Rust workspace version: `0.6.1`.
+- Rust internal publishable package dependency versions: `0.6.1`.
+- Root release tag: `v0.6.1`.
+- Go submodule release tag: `go/v0.6.1`.
+
+Tag check on 2026-06-09:
+
+- `git ls-remote --tags origin refs/tags/v0.6.1 refs/tags/v0.6.1^{}
+  refs/tags/go/v0.6.1 refs/tags/go/v0.6.1^{}` returned no rows, so there is no
+  remote tag collision before release.
+
+Release validation added after the version bump:
+
+- `cd rust && cargo metadata --format-version 1`: passed and refreshed
+  `rust/Cargo.lock`.
+- `cd go && go test ./journal -run 'TestNetdataHistogramChartMetadata|TestNetdataFunctionQueryFilters' -count=1`:
+  passed.
+- `cd rust && cargo test -p systemd-journal-sdk netdata --lib`: passed, 51
+  tests, compiling the changed packages at `0.6.1`.
+- `python3 -m unittest tests.netdata_function.test_compare_function_json`:
+  passed, 25 tests.
+- `python3 tests/docs/check_wiki_docs.py`: passed, 14 wiki markdown files.
+
+Rust crates.io publication on 2026-06-09:
+
+- `systemd-journal-sdk-common 0.6.1`: published.
+- `systemd-journal-sdk-registry 0.6.1`: published.
+- `systemd-journal-sdk-core 0.6.1`: published.
+- `systemd-journal-sdk-log-writer 0.6.1`: published.
+- `systemd-journal-sdk-index 0.6.1`: published.
+- `systemd-journal-sdk-engine 0.6.1`: published.
+- `systemd-journal-sdk 0.6.1`: published.
+
+Each crate was dry-run verified immediately before publishing. The first
+dependent-crate dry-run showed that crates.io requires each new internal
+dependency version to be published before the next dependent crate can resolve
+it, so the release used the dependency-ordered dry-run-then-publish sequence.
+No registry tokens or credential material were written to durable artifacts.

.agents/sow/specs/product-scope.md

@@ -19,7 +19,7 @@ alias it as `journal` in Cargo dependencies to keep the existing
 
 ```toml
 [dependencies]
-journal = { package = "systemd-journal-sdk", version = "0.6.0" }
+journal = { package = "systemd-journal-sdk", version = "0.6.1" }
 ```
 
 The Rust workspace also publishes lower-level project-prefixed packages for

.agents/sow/specs/systemd-journal-plugin-facets.md

@@ -630,6 +630,14 @@ Output:
 - histogram dimensions that occur in at least one bucket use numeric zero in
   buckets where that value is absent. Dimensions known only from the facet
   vocabulary use JSON `null` in every bucket where the value was not observed.
+- histogram chart metadata must preserve the libnetdata facets chart shape:
+  `chart.summary`, `chart.totals`, `chart.result`, `chart.db`, `chart.view`,
+  and `chart.agents` are part of the UI-facing contract. In particular,
+  `chart.view.dimensions.names` and the sibling `ids`, `colors`, `units`, and
+  `sts` members must exist as arrays/objects even when the selected time window
+  has no values for the histogram field. Missing these members is a Netdata
+  function compatibility bug even if `chart.result.labels` and bucket counts
+  are otherwise correct.
 
 Evidence: `facets.c:2817-2868`, `facets.c:1209-1609`.
 

README.md

@@ -73,7 +73,7 @@ dependency alias:
 
 ```toml
 [dependencies]
-journal = { package = "systemd-journal-sdk", version = "0.6.0" }
+journal = { package = "systemd-journal-sdk", version = "0.6.1" }
 ```
 
 Advanced Rust consumers that need lower-level building blocks can also depend

SOW-status.md

@@ -1,6 +1,6 @@
 # SOW Status
 
-Last updated: 2026-06-08
+Last updated: 2026-06-09
 
 This root file is a short convenience index. The canonical detailed SOW ledger
 is `.agents/sow/SOW-status.md`; if summaries differ, the canonical ledger wins.
@@ -23,6 +23,7 @@ is `.agents/sow/SOW-status.md`; if summaries differ, the canonical ledger wins.
 
 ## Done
 
+- `SOW-0093-20260605-netdata-function-boundary-reader-comparison.md` - completed after 2026-06-09 regression repair and `v0.6.1` patch release. Rust and Go Netdata histogram responses now emit the libnetdata chart metadata tree, the comparator rejects missing histogram chart schema, four requested reviewers returned `PRODUCTION GRADE`, and Rust crates were published to crates.io at `0.6.1`.
 - `SOW-0100-20260608-consumer-docs-github-wiki.md` - completed after regression repair. GitHub wiki navigation now uses `[[Target|Label]]` wiki links, the wiki has professional API overview plus Rust and Go language guides with examples, and the docs validator rejects production `*.md` wiki links while allowing fenced anti-pattern examples.
 - `SOW-0099-20260608-rust-crates-io-publication.md` - completed. Rust SDK packages were published to crates.io at `0.6.0` under `systemd-journal-sdk` plus project-prefixed internal package names; release tags are created on the SOW close commit.
 - `SOW-0096-20260607-codacy-metrics-and-coverage-hygiene.md` - completed. Go and Rust coverage reports now remove test/test-harness paths before Codacy upload, the Rust/Go Codacy metrics audit is committed, GitHub code scanning has zero open alerts on final implementation commit `7e3d3e5d`, Codacy reports `issuesCount = 0`, coverage `73%`, complexity `46%`, and duplication `30%`; remaining production metric debt is tracked by SOW-0097 and SOW-0098.

docs/Explorer-And-Netdata-Queries.md

@@ -118,4 +118,9 @@ That layer handles:
 - timeout behavior;
 - plugin-compatible response envelopes.
 
+Histogram responses include the libnetdata-style chart envelope used by the
+Netdata UI: `summary`, `totals`, `result`, `db`, `view`, and `agents`.
+`view.dimensions.names` and sibling dimension arrays are present even when the
+selected time window has no values for the histogram field.
+
 The generic SDK Explorer stays separate from Netdata-specific response shaping.

docs/Getting-Started.md

@@ -19,7 +19,7 @@ Use the public Rust package for normal integrations:
 
 ```toml
 [dependencies]
-journal = { package = "systemd-journal-sdk", version = "0.6.0" }
+journal = { package = "systemd-journal-sdk", version = "0.6.1" }
 ```
 
 The alias keeps imports short:
@@ -35,7 +35,7 @@ layout.
 ## Install Go
 
 ```sh
-go get github.com/netdata/systemd-journal-sdk/go@v0.6.0
+go get github.com/netdata/systemd-journal-sdk/go@v0.6.1
 ```
 
 Then import:

docs/Go-API.md

@@ -3,7 +3,7 @@
 Install the Go submodule:
 
 ```sh
-go get github.com/netdata/systemd-journal-sdk/go@v0.6.0
+go get github.com/netdata/systemd-journal-sdk/go@v0.6.1
 ```
 
 Import the journal package: