You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: backlog/docs/architecture/transcript-import.md
+25Lines changed: 25 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -13,6 +13,31 @@ id: doc-008
13
13
14
14
# Transcript Import
15
15
16
+
## Automated YouTube Transcription (Async)
17
+
18
+
For missing transcripts of videos hosted on YouTube, we use a local asynchronous pipeline powered by `zdots-ctx` and `whisper.cpp`.
19
+
20
+
1.**Enqueue Pending Videos:**
21
+
Identify all pending `video_assets` with a YouTube ID and enqueue them to the local `zdots-ctx` worker.
22
+
```bash
23
+
./bin/batch_ztranscribe.rb
24
+
```
25
+
2.**Start the Background Worker:**
26
+
Ensure the worker is running to process the queue asynchronously.
27
+
```bash
28
+
zdots-ctx worker --type transcription
29
+
```
30
+
3.**Stage Completed Transcripts:**
31
+
As the worker finishes downloading and transcribing to `~/Downloads/transcripts/`, map them back to their canonical `video_asset_id` and stage them for ingestion.
32
+
```bash
33
+
./bin/stage_completed_transcripts.rb
34
+
```
35
+
4.**Ingest Staged Transcripts:**
36
+
Use the standard pipeline to ingest the staged files into `_data/transcripts/`.
0 commit comments