Construct reddit scrap foundation. (#280)

* Construct reddit scrap foundation.

* Fix CI lint fail.

* Update settings.py.

* Fix due to coderabbitai review.

Author: AuraMindNest

.env.example

@@ -287,6 +287,17 @@ DATABASE_URL=postgres://user:password@localhost:5432/boost_dashboard
 # PINECONE_DISCORD_APP_TYPE=discord
 # PINECONE_DISCORD_NAMESPACE=discord-messages
 
+# ==============================================================================
+# Reddit (reddit_activity_tracker)
+# ==============================================================================
+# Register a "script" app at https://www.reddit.com/prefs/apps
+# REDDIT_CLIENT_ID=your_client_id
+# REDDIT_CLIENT_SECRET=your_client_secret
+# REDDIT_USER_AGENT=r_cpp_scraper/1.0 by u/yourusername
+#
+# Optional: minimum seconds between API requests (default 1.0, ~60 req/min)
+# REQUEST_INTERVAL=1.0
+
 # ==============================================================================
 # YouTube (cppa_youtube_script_tracker)
 # ==============================================================================

CONTRIBUTING.md

@@ -69,6 +69,7 @@ Each Django app that has **models** provides a **`services.py`** module. This is
 | `clang_github_tracker` | `clang_github_tracker/services.py` | Clang/llvm GitHub issue, PR, and commit upserts; fetch watermarks. |
 | `boost_mailing_list_tracker` | `boost_mailing_list_tracker/services.py` | Mailing list messages and names. |
 | `cppa_slack_tracker` | `cppa_slack_tracker/services.py` | Slack teams, channels, messages, membership. |
+| `reddit_activity_tracker` | `reddit_activity_tracker/services.py` | Reddit submissions and comments. |
 | `wg21_paper_tracker` | `wg21_paper_tracker/services.py` | WG21 papers, authors, mailings. |
 
 For a full list of functions, parameter/return types, and validation (e.g. empty `name` raises `ValueError`), see **[docs/Service_API.md](docs/Service_API.md)** and the per-app docs in **[docs/service_api/](docs/service_api/)** (index: [docs/service_api/README.md](docs/service_api/README.md)). DTO protocols shared across trackers are documented in **[docs/service_api/core_protocols.md](docs/service_api/core_protocols.md)** (generated from `core/protocols.py`).

config/settings.py

@@ -69,6 +69,7 @@
     "clang_github_tracker",
     "cppa_slack_tracker",
     "discord_activity_tracker",
+    "reddit_activity_tracker",
     "wg21_paper_tracker",
     "cppa_youtube_script_tracker",
     "slack_event_handler",
@@ -162,6 +163,7 @@
     "boost_usage_tracker",
     "cppa_slack_tracker",
     "discord_activity_tracker",
+    "reddit_activity_tracker",
     "boost_mailing_list_tracker",
     "wg21_paper_tracker",
     "cppa_youtube_script_tracker",
@@ -524,6 +526,13 @@ def _slack_team_scope_from_env():
     or "discord-together-c-cpp"
 ).strip()
 
+# Reddit configuration (for reddit_activity_tracker)
+REDDIT_CLIENT_ID = (env("REDDIT_CLIENT_ID", default="") or "").strip()
+REDDIT_CLIENT_SECRET = (env("REDDIT_CLIENT_SECRET", default="") or "").strip()
+REDDIT_USER_AGENT = (env("REDDIT_USER_AGENT", default="") or "").strip()
+# Minimum seconds between API requests (default 1.0, ~60 req/min). Env: REQUEST_INTERVAL.
+REDDIT_REQUEST_INTERVAL = env.float("REQUEST_INTERVAL", default=1.0)
+
 # WG21 Paper Tracker Configuration
 WG21_GITHUB_DISPATCH_ENABLED = env.bool("WG21_GITHUB_DISPATCH_ENABLED", default=False)
 WG21_GITHUB_DISPATCH_REPO = (env("WG21_GITHUB_DISPATCH_REPO", default="") or "").strip()

config/test_settings.py

@@ -83,6 +83,7 @@
     "boost_library_tracker",
     "clang_github_tracker",
     "discord_activity_tracker",
+    "reddit_activity_tracker",
     "shared",
 ):
     (WORKSPACE_DIR / _slug).mkdir(parents=True, exist_ok=True)

core/_version.py

@@ -1,2 +1,2 @@
 # file generated by setuptools-scm; do not edit
-version = "0.1.1.dev2+g0dd532eaf.d20260527"
+version = "0.1.1.dev579+g8b4cba29b.d20260609"

docs/Schema.md

@@ -946,6 +946,51 @@ erDiagram
 
 ---
 
+### 12. Reddit Activity Tracker (`reddit_activity_tracker`)
+
+Subreddit posts and comments ingested from the Reddit OAuth API. Workspace JSON uses LangChain Document format (`page_content` + `metadata`); see PR2 workspace layout under `workspace/reddit_activity_tracker/{YYYY-MM}/`. No cross-app FKs — author identity is stored as plain strings (`author`, `author_id`).
+
+```mermaid
+erDiagram
+    direction LR
+    RedditSubmission ||--o{ RedditComment : "has"
+
+    RedditSubmission {
+        int id PK
+        string reddit_id "UK IX t3_*"
+        string subreddit "IX"
+        string author
+        string author_id
+        string title
+        text selftext
+        text selftext_html
+        string url
+        string permalink
+        int score
+        int num_comments
+        int created_utc "IX"
+        datetime fetched_at
+    }
+
+    RedditComment {
+        int id PK
+        string reddit_id "UK IX t1_*"
+        int submission_id FK
+        string parent_id "t3_* or t1_*"
+        string author
+        string author_id
+        text body
+        string url
+        int score
+        int created_utc "IX"
+        datetime fetched_at
+    }
+```
+
+**Note:** `reddit_id` on both tables is the Reddit fullname (`t3_*` for submissions, `t1_*` for comments) and is the natural key for idempotent upserts.
+
+---
+
 ## Appendix
 
 ### Appendix A: Table summary
@@ -1018,6 +1063,8 @@ erDiagram
 | **DiscordChannel**                   | Channel in a guild (channel_id UK, type, category, topic, sync/activity timestamps).                      | 11      |
 | **DiscordMessage**                   | Message (`message_id` UK, content, type, pin, reply_to, attachments JSON, soft-delete flags).             | 11      |
 | **DiscordReaction**                  | Emoji aggregate per message (unique on message + emoji).                                                | 11      |
+| **RedditSubmission**                 | Reddit post (`reddit_id` t3_* UK, subreddit, title, selftext, score, created_utc).                      | 12      |
+| **RedditComment**                    | Reddit comment (`reddit_id` t1_* UK, submission FK, parent_id, body, score, created_utc).                | 12      |
 | **BoostDocContent**                  | Globally unique scraped page by content hash (url, content_hash UK, first_version_id, last_version_id, is_upserted, scraped_at). One row per unique content hash across all versions.       | 10      |
 | **BoostLibraryDocumentation**        | Join table: BoostLibraryVersion × BoostDocContent. Records which pages belong to each (library, version) pair.                                                                              | 10      |
 

docs/Service_API.md

@@ -19,6 +19,7 @@ All writes to app models must go through the service layer. The API is documente
 | **clang_github_tracker** | `clang_github_tracker.services` | Upsert llvm issue/PR/commit rows; fetch watermarks. |
 | **boost_mailing_list_tracker** | `boost_mailing_list_tracker.services` | Mailing list messages and names. |
 | **cppa_slack_tracker** | `cppa_slack_tracker.services` | Slack teams, channels, messages, membership. |
+| **reddit_activity_tracker** | `reddit_activity_tracker.services` | Reddit submissions and comments. |
 | **wg21_paper_tracker** | `wg21_paper_tracker.services` | WG21 papers, authors, mailings. |
 
 ---
@@ -37,6 +38,7 @@ All writes to app models must go through the service layer. The API is documente
 - **[service_api/clang_github_tracker.md](service_api/clang_github_tracker.md)** – API for `clang_github_tracker.services`.
 - **[service_api/boost_mailing_list_tracker.md](service_api/boost_mailing_list_tracker.md)** – API for `boost_mailing_list_tracker.services`.
 - **[service_api/cppa_slack_tracker.md](service_api/cppa_slack_tracker.md)** – API for `cppa_slack_tracker.services`.
+- **[service_api/reddit_activity_tracker.md](service_api/reddit_activity_tracker.md)** – API for `reddit_activity_tracker.services`.
 - **[service_api/wg21_paper_tracker.md](service_api/wg21_paper_tracker.md)** – API for `wg21_paper_tracker.services`.
 - **[service_api/core_protocols.md](service_api/core_protocols.md)** – `core.protocols` DTO protocols (`TrackerResult`, `ActivityRecord`, `IncrementalState`).
 

docs/cross-app-dependencies.md

@@ -36,6 +36,7 @@ document.  `core` is excluded because it is shared infrastructure, not a peer tr
 | `clang_github_tracker` | Clang/LLVM GitHub activity | Yes |
 | `cppa_slack_tracker` | Slack teams, channels, messages | Yes |
 | `discord_activity_tracker` | Discord servers, channels, messages | Yes |
+| `reddit_activity_tracker` | Reddit subreddit submissions and comments | Yes |
 | `wg21_paper_tracker` | WG21 paper tracking | Yes |
 | `cppa_youtube_script_tracker` | YouTube video metadata and transcripts | Yes |
 | `slack_event_handler` | Slack event listener | No (no domain models) |

docs/service_api/README.md

@@ -18,6 +18,7 @@ Index of all app service modules. All writes to app models must go through the s
 | [clang_github_tracker.services](clang_github_tracker.md) | clang_github_tracker | Upsert llvm issue/PR/commit rows; DB watermarks for API fetch windows. |
 | [boost_mailing_list_tracker.services](boost_mailing_list_tracker.md) | boost_mailing_list_tracker | Mailing list messages and list names. |
 | [cppa_slack_tracker.services](cppa_slack_tracker.md) | cppa_slack_tracker | Slack teams, channels, messages, and membership changes. |
+| [reddit_activity_tracker.services](reddit_activity_tracker.md) | reddit_activity_tracker | Reddit submissions and comments (upsert helpers in PR2). |
 | [wg21_paper_tracker.services](wg21_paper_tracker.md) | wg21_paper_tracker | WG21 papers, authors, and mailings. |
 | [core.protocols](core_protocols.md) | core | Runtime-checkable DTO protocols (`TrackerResult`, `ActivityRecord`, `IncrementalState`); see also [Core public API](../Core_public_API.md). |
 
@@ -37,6 +38,7 @@ Index of all app service modules. All writes to app models must go through the s
 - **clang_github_tracker** – Upsert `ClangGithubIssueItem` / `ClangGithubCommit` during sync or backfill; read `Max(github_updated_at)` / `Max(github_committed_at)` for fetch cursors.
 - **boost_mailing_list_tracker** – Mailing list message and name helpers.
 - **cppa_slack_tracker** – Slack team/channel/message persistence and membership sync.
+- **reddit_activity_tracker** – Reddit submission and comment persistence (service functions added in PR2).
 - **wg21_paper_tracker** – WG21 paper and author persistence.
 - **core.protocols** – Structural contracts for sync outcomes and activity payloads (see [core_protocols.md](core_protocols.md)).
 

docs/service_api/reddit_activity_tracker.md

@@ -0,0 +1,22 @@
+# reddit_activity_tracker.services
+
+**Module path:** `reddit_activity_tracker.services`
+**Description:** Service layer for Reddit submissions and comments. All creates/updates/deletes for this app's models must go through functions here.
+
+**Type notation:** Model types refer to `reddit_activity_tracker.models`.
+
+---
+<!-- SERVICE_API:GENERATED:START -->
+
+## Public API (generated)
+
+| Function | Parameters | Return type | Summary |
+| --- | --- | --- | --- |
+
+<!-- SERVICE_API:GENERATED:END -->
+
+## Related
+
+- [Service API index](README.md)
+- [Schema.md](../Schema.md) – Section 12: Reddit Activity Tracker.
+- [CONTRIBUTING.md](../../CONTRIBUTING.md)