Skip to content

Commit f3d43e0

Browse files
committed
Merge branch 'main'
2 parents 0139d8e + b4bb42b commit f3d43e0

4 files changed

Lines changed: 7 additions & 5 deletions

File tree

README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
Readme Test

_config.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ baseurl: ""
66

77
# Author
88
author:
9-
name: "Forgather Team"
9+
name: "Jason dinAlt"
1010
email: "joedkloss@gmail.com"
1111

1212
# Jekyll settings

google08b12df22521a379.html

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
google-site-verification: google08b12df22521a379.html

index.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -6,12 +6,12 @@ description: "Alpha-stage ML framework bringing distributed pipeline parallelism
66

77
# Democratizing Large Model Training
88

9-
**Forgather** is an alpha-stage ML framework that aims to make large model training accessible to hobbyists and researchers with consumer hardware.
9+
[**Forgather**](https://github.com/jdinalt/forgather) is an alpha-stage ML framework that aims to make large model training accessible to hobbyists and researchers with consumer hardware.
1010

1111
## The Vision
1212

1313
### 🚀 **Pipeline Parallelism for Consumer GPUs**
14-
Enable training of models larger than single GPU memory by distributing them across multiple consumer-grade cards. Our goal is to make 7B+ parameter full model training accessible without enterprise hardware.
14+
Enable training of models larger than single GPU memory by distributing them across multiple consumer-grade cards using [Torch Distributed Pipeline Parallelism](https://docs.pytorch.org/docs/main/distributed.pipelining.html) Our goal is to make 7B+ parameter full model training accessible without enterprise hardware.
1515

1616
### 📝 **End Configuration Duplication**
1717
Eliminate the copy-paste cycle of ML experiments through a powerful template inheritance system. Specify only what changes between experiments, not entire configurations.
@@ -48,9 +48,9 @@ Contribute to framework architecture, code generation, and template systems.
4848

4949
## What We're Building
5050

51-
- **Accessible Training**: 7B+ models on consumer RTX setups
51+
- **Accessible Training**: 7B+ models on consumer setups
5252
- **Template-Driven**: Systematic experimentation without configuration chaos
53-
- **Pipeline Parallelism**: Multiple efficient scheduling algorithms
53+
- **Pipeline Parallelism**: Much faster than FSDP on hardware lacking a fast interconnect
5454
- **Framework Freedom**: Generated models work independently
5555
- **Research Focus**: Built for exploration and comparison
5656

0 commit comments

Comments
 (0)