Skip to content

[codex] docs: add long-form audio cutting guide #2136

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
lbliii merged 8 commits into from
Jul 16, 2026
Merged

[codex] docs: add long-form audio cutting guide #2136

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
5247783
docs: add long-form audio cutting guide
lbliii Jun 29, 2026
9010d05
docs: clarify audio pretrain finalization
lbliii Jul 2, 2026
6d5ce88
Merge branch 'main' into codex/docs-long-form-audio-cutting
lbliii Jul 2, 2026
0631b01
Merge branch 'main' into codex/docs-long-form-audio-cutting
lbliii Jul 6, 2026
dcfcc1f
docs: address reviewer feedback on long-form audio cutting guide
lbliii Jul 8, 2026
78c1f30
Merge branch 'main' into codex/docs-long-form-audio-cutting
lbliii Jul 10, 2026
61f94ee
Merge branch 'main' into codex/docs-long-form-audio-cutting
lbliii Jul 13, 2026
16f6622
Merge branch 'main' into codex/docs-long-form-audio-cutting
lbliii Jul 15, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions fern/versions/main.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -474,6 +474,9 @@ navigation:
- page: ALM Tutorial
path: ./main/pages/curate-audio/tutorials/alm.mdx
slug: alm
- page: Long-Form Audio Cutting for ALM Pretraining
path: ./main/pages/curate-audio/tutorials/audio-pretrain.mdx
slug: audio-pretrain
- page: ReadSpeech Tutorial
path: ./main/pages/curate-audio/tutorials/readspeech.mdx
slug: readspeech
Expand Down
7 changes: 7 additions & 0 deletions fern/versions/main/pages/curate-audio/index.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -140,4 +140,11 @@ quality-filtering
basic-workflow
</Card>

<Card title="Long-Form Audio Cutting" href="/curate-audio/tutorials/audio-pretrain">
Turn long-form diarized recordings into mono, resampled snippet archives and manifests for audio language model pretraining
alm-pretraining
long-form-audio
webdataset
</Card>

</Cards>
1 change: 1 addition & 0 deletions fern/versions/main/pages/curate-audio/process-data/alm/data-builder.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -124,3 +124,4 @@ The `stats` dictionary contains the following counters:
- **[ALM Overlap Filtering](/curate-audio/process-data/alm/overlap-filtering)**: Next stage in the ALM pipeline
- **[ALM Pipeline Concepts](/about/concepts/audio/alm-pipeline)**: Architectural overview
- **[ALM Tutorial](/curate-audio/tutorials/alm)**: End-to-end walkthrough with sample data
- **[Long-Form Audio Cutting](/curate-audio/tutorials/audio-pretrain)**: Cut selected diarized time ranges into reusable snippet audio and tar manifests
1 change: 1 addition & 0 deletions fern/versions/main/pages/curate-audio/process-data/alm/overlap-filtering.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -101,3 +101,4 @@ Monitor the yield by comparing `filtered_dur` to `total_dur_window` in the outpu
- **[ALM Data Builder](/curate-audio/process-data/alm/data-builder)**: Previous stage in the ALM pipeline
- **[ALM Pipeline Concepts](/about/concepts/audio/alm-pipeline)**: Architectural overview
- **[ALM Tutorial](/curate-audio/tutorials/alm)**: End-to-end walkthrough with sample data
- **[Long-Form Audio Cutting](/curate-audio/tutorials/audio-pretrain)**: Filter diarization overlap before extracting physical ALM pretraining snippets
1 change: 1 addition & 0 deletions fern/versions/main/pages/curate-audio/tutorials/alm.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -297,6 +297,7 @@ The `ALMManifestReader` discovers all `.jsonl` and `.json` files in the director

After completing this tutorial, explore:

- **[Long-Form Audio Cutting](/curate-audio/tutorials/audio-pretrain)**: Extract, resample, and package bounded audio snippets when you need physical audio assets rather than metadata windows
- **[ALM Data Builder](/curate-audio/process-data/alm/data-builder)**: Detailed reference for window construction
- **[ALM Overlap Filtering](/curate-audio/process-data/alm/overlap-filtering)**: Detailed reference for overlap filtering
- **[ALM Pipeline Concepts](/about/concepts/audio/alm-pipeline)**: Architectural overview
Expand Down
396 changes: 396 additions & 0 deletions fern/versions/main/pages/curate-audio/tutorials/audio-pretrain.mdx
View file
Open in desktop

Large diffs are not rendered by default.

7 changes: 7 additions & 0 deletions fern/versions/main/pages/curate-audio/tutorials/index.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,4 +34,11 @@ windowing
speaker-diarization
</Card>

<Card title="Long-Form Audio Cutting" href="/curate-audio/tutorials/audio-pretrain">
Extract bounded mono and resampled snippets from long-form diarized audio, then package them as a training manifest and WebDataset-compatible tar.
alm-pretraining
snippet-extraction
webdataset
</Card>

</Cards>
Loading