Skip to content

Commit 9a08ee9

Browse files
Record Lobu benchmark outreach
1 parent a55676d commit 9a08ee9

5 files changed

Lines changed: 60 additions & 0 deletions

File tree

marketing/README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -160,6 +160,8 @@ Launch and outreach materials for Tree Ring Memory.
160160
provider PR packet and validation notes.
161161
- `hxxd-ambient-benchmark-pr.md`: AMBIENT Benchmark Tree Ring CLI adapter PR
162162
packet and validation notes.
163+
- `lobu-agent-memory-benchmark-pr.md`: Lobu Agent Memory Benchmark Tree Ring
164+
adapter PR packet and validation notes.
163165
- `master-ai-finder-submission.md`: Master AI Finder free directory submission
164166
packet and accepted response notes.
165167
- `ghimiresunil-top-ai-tools-pr.md`: Top AI Tools PR packet, validation notes,
Lines changed: 55 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,55 @@
1+
# Lobu Agent Memory Benchmark PR
2+
3+
Date: 2026-07-08
4+
5+
Status: submitted as upstream PR #1.
6+
7+
URL: https://github.com/lobu-ai/agent-memory-benchmark/pull/1
8+
9+
Evidence comment: https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916736562
10+
11+
## Fit
12+
13+
The lobu-ai benchmark explicitly accepts new memory systems by PR and requires
14+
adapters to use public client surfaces only. Tree Ring Memory fits because its
15+
CLI exposes JSON write and recall paths without requiring direct SQLite access.
16+
17+
## Submission
18+
19+
The PR adds an optional Tree Ring Memory benchmark adapter:
20+
21+
- `adapters/tree_ring_adapter.py` implements the benchmark JSONL protocol.
22+
- Ingest uses `tree-ring remember --json`.
23+
- Retrieval uses `tree-ring recall --json --include-sensitive`.
24+
- Benchmark step IDs are stored as tags and mapped back from recalled events
25+
for retrieval and citation scoring.
26+
- Each benchmark run uses an isolated Tree Ring root.
27+
- Tree Ring policy refusals for secret-like synthetic inputs are counted as
28+
policy refusals instead of bypassed.
29+
- `configs/longmemeval-oracle-10.tree-ring.json` provides an opt-in smoke
30+
config and does not modify the target repo's default all-systems CI config.
31+
32+
## Validation
33+
34+
- `python3 -m py_compile adapters/tree_ring_adapter.py`
35+
- `bun install`
36+
- `bun run typecheck`
37+
- `git diff --check`
38+
- `TREE_RING_BIN=/Users/lazy/Projects/Tree_Ring_Memory/target/debug/tree-ring bun run scripts/run.ts --config configs/longmemeval-oracle-10.tree-ring.json`
39+
40+
Local smoke result on `longmemeval-oracle-10` with the deterministic extractive
41+
answerer:
42+
43+
- Answer: 30.0%
44+
- Retrieval: 95.0%
45+
- Citation: 48.3%
46+
- Average retrieval latency: 167ms
47+
48+
These are recorded as smoke evidence only, not as public leaderboard claims.
49+
50+
## GitHub State
51+
52+
- Fork: `TerminallyLazy/agent-memory-benchmark-1`
53+
- Branch: `add-tree-ring-adapter`
54+
- Commit: `46388cebefa015049741a441be73e852dbf6cdcc`
55+
- PR state at submission: open, ready, mergeable, no status checks reported.

marketing/outreach-crm.csv

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -329,3 +329,4 @@ Ammosu Awesome Claude Skills ZH-TW PR #7,3,submitted,yes,https://github.com/ammo
329329
ClaudierOrlandi Awesome Context Engineering PR #2,3,submitted,yes,https://github.com/ClaudierOrlandi/Awesome-Context-Engineering/pull/2,none,marketing/claudier-awesome-context-engineering-pr.md,monitor maintainer response,Adds Tree Ring Memory to Production Memory Systems as a GitHub implementation entry; duplicate PR issue README checks repo URL and diff whitespace passed; PR ready mergeable with no checks reported; evidence comment https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916346915.
330330
Vectorize Agent Memory Benchmark PR #25,3,submitted,yes,https://github.com/vectorize-io/agent-memory-benchmark/pull/25,none,marketing/vectorize-agent-memory-benchmark-pr.md,monitor maintainer response,Adds Tree Ring Memory as a runnable AMB provider adapter using local tree-ring CLI JSONL import project-scoped recall registry wiring and static catalog entry; compile provider list generated catalog local smoke and diff checks passed; PR ready mergeable with no checks reported; evidence comment https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916501736.
331331
AMBIENT Benchmark Tree Ring adapter PR #5,3,submitted,yes,https://github.com/H-XX-D/ambient-benchmark/pull/5,none,marketing/hxxd-ambient-benchmark-pr.md,monitor maintainer response,Adds Tree Ring Memory as an optional tree-ring-cli adapter with isolated roots JSON remember/recall provenance mapping policy-refusal handling and optional matrix/prereq wiring; no-dependency smoke syntax diff prereq probe and real Tree Ring focused matrix passed; PR ready mergeable with no checks reported; evidence comment https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916634939.
332+
Lobu Agent Memory Benchmark PR #1,3,submitted,yes,https://github.com/lobu-ai/agent-memory-benchmark/pull/1,none,marketing/lobu-agent-memory-benchmark-pr.md,monitor maintainer response,Adds Tree Ring Memory as an optional public-CLI benchmark adapter with isolated roots tag-based benchmark provenance stopword-window query retry policy-refusal handling and longmemeval-oracle-10 smoke config; py_compile Bun typecheck diff check and real Tree Ring smoke passed with 95.0% retrieval recall; PR ready mergeable with no checks reported; evidence comment https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916736562.

marketing/outreach-queue.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -173,6 +173,7 @@ posted unless the post exists publicly and the URL is recorded here.
173173
| MemoryStackBench PR | Submitted | https://github.com/aetna000/MemoryStackBench/pull/1 | Adds Tree Ring Memory as a pending adapter target in an agent-memory benchmark harness; duplicate PR/issue search, repo link, target-registry test, and diff whitespace checks passed; PR is mergeable and reports no checks; evidence comment: https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4910927711. |
174174
| Vectorize Agent Memory Benchmark PR | Submitted | https://github.com/vectorize-io/agent-memory-benchmark/pull/25 | Adds Tree Ring Memory as a runnable AMB provider adapter using the local `tree-ring` CLI, JSONL import, project-scoped recall, registry wiring, and static catalog entry; compile, provider-list, generated-catalog, local smoke, and diff checks passed; PR is ready, mergeable, and reports no checks; evidence comment: https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916501736. |
175175
| AMBIENT Benchmark Tree Ring adapter PR | Submitted | https://github.com/H-XX-D/ambient-benchmark/pull/5 | Adds Tree Ring Memory as an optional `tree-ring-cli` adapter with isolated roots, JSON `remember`/`recall`, provenance mapping, policy-refusal handling, and optional matrix/prereq wiring; no-dependency smoke, syntax, diff, prereq probe, and real Tree Ring focused matrix passed; PR is ready, mergeable, and reports no checks; evidence comment: https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916634939. |
176+
| Lobu Agent Memory Benchmark PR | Submitted | https://github.com/lobu-ai/agent-memory-benchmark/pull/1 | Adds Tree Ring Memory as an optional public-CLI benchmark adapter with isolated roots, tag-based benchmark provenance, stopword-window query retry, and policy-refusal handling; py_compile, Bun typecheck, diff check, and real Tree Ring `longmemeval-oracle-10` smoke passed with 95.0% retrieval recall; PR is ready, mergeable, and reports no checks; evidence comment: https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916736562. |
176177
| BigAI Awesome AI Memory PR | Submitted | https://github.com/bigai-nlco/Awesome-AI-Memory/pull/2 | Adds Tree Ring Memory to System Architecture in a survey-backed AI memory directory; duplicate PR/issue search, repo link, and diff whitespace checks passed; PR is mergeable and reports no checks; evidence comment: https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4910961825. |
177178
| Kongshan Agent Memory Frameworks Research PR | Submitted | https://github.com/kongshan001/agent-memory-frameworks-research/pull/1 | Adds Tree Ring Memory to Chinese agent-memory framework research as a local-first memory lifecycle layer; duplicate PR/issue search, repo and launch-page links, public fact checks, and diff whitespace checks passed; PR is mergeable and reports no checks; evidence comment: https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4910995877. |
178179
| AlexWang Awesome Agent Memory PR | Submitted | https://github.com/AlexWang959/Awesome-Agent-Memory/pull/2 | Adds Tree Ring Memory to the 2026 Paper / Project table as a GitHub project for local-first agent memory lifecycle work; duplicate PR/issue search, table-shape check, and diff whitespace passed; PR is mergeable and reports no checks; evidence comment: https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4911129545. |

marketing/submission-ledger.csv

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -331,3 +331,4 @@ Ammosu Awesome Claude Skills ZH-TW PR #7,submitted,GitHub account,https://github
331331
ClaudierOrlandi Awesome Context Engineering PR #2,submitted,GitHub account,https://github.com/ClaudierOrlandi/Awesome-Context-Engineering/pull/2,marketing/claudier-awesome-context-engineering-pr.md,none,monitor maintainer response,https://github.com/ClaudierOrlandi/Awesome-Context-Engineering/pull/2,Adds Tree Ring Memory to Production Memory Systems as a GitHub implementation entry; fork TerminallyLazy/Awesome-Context-Engineering-1 branch add-tree-ring-memory commit d6b1bba; duplicate PR issue README checks repo URL and diff whitespace passed; PR ready mergeable with no checks reported; evidence comment https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916346915.
332332
Vectorize Agent Memory Benchmark PR #25,submitted,GitHub account,https://github.com/vectorize-io/agent-memory-benchmark/pull/25,marketing/vectorize-agent-memory-benchmark-pr.md,none,monitor maintainer response,https://github.com/vectorize-io/agent-memory-benchmark/pull/25,Adds a real Tree Ring Memory provider adapter to AMB using the local tree-ring CLI JSONL import project-scoped recall and registry catalog wiring; fork TerminallyLazy/agent-memory-benchmark branch add-tree-ring-provider commit 00408ae; compile provider list generated catalog local smoke and diff checks passed; PR ready mergeable with no checks reported; evidence comment https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916501736.
333333
AMBIENT Benchmark Tree Ring adapter PR #5,submitted,GitHub account,https://github.com/H-XX-D/ambient-benchmark/pull/5,marketing/hxxd-ambient-benchmark-pr.md,none,monitor maintainer response,https://github.com/H-XX-D/ambient-benchmark/pull/5,Adds Tree Ring Memory as an optional tree-ring-cli adapter with isolated Tree Ring roots JSON remember/recall provenance mapping policy-refusal handling and optional matrix/prereq wiring; fork TerminallyLazy/ambient-benchmark branch add-tree-ring-adapter commit c51423c; no-dependency smoke syntax diff prereq probe and real Tree Ring focused matrix passed; PR ready mergeable with no checks reported; evidence comment https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916634939.
334+
Lobu Agent Memory Benchmark PR #1,submitted,GitHub account,https://github.com/lobu-ai/agent-memory-benchmark/pull/1,marketing/lobu-agent-memory-benchmark-pr.md,none,monitor maintainer response,https://github.com/lobu-ai/agent-memory-benchmark/pull/1,Adds Tree Ring Memory as an optional public-CLI benchmark adapter with isolated roots tag-based benchmark provenance stopword-window query retry policy-refusal handling and a longmemeval-oracle-10 smoke config; fork TerminallyLazy/agent-memory-benchmark-1 branch add-tree-ring-adapter commit 46388ce; py_compile Bun typecheck diff check and real Tree Ring smoke passed with 95.0% retrieval recall; PR ready mergeable with no checks reported; evidence comment https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916736562.

0 commit comments

Comments
 (0)