Skip to content

Commit d4797fc

Browse files
committed
Simplify the introduction of the grouping example
1 parent c9ff9db commit d4797fc

1 file changed

Lines changed: 3 additions & 4 deletions

File tree

docs/source/examples/grouping.rst

Lines changed: 3 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,9 @@
11
Grouping
22
========
33

4-
When applying a conflict-resolving aggregator such as :class:`~torchjd.aggregation.GradVac` in
5-
multi-task learning, the cosine similarities between task gradients can be computed at different
6-
granularities. The [Gradient Vaccine paper](https://arxiv.org/pdf/2010.05874) introduces four
7-
strategies, each partitioning the shared parameter vector differently:
4+
The aggregation can be made independently on groups of parameters, at different granularities. The
5+
[Gradient Vaccine paper](https://arxiv.org/pdf/2010.05874) introduces four strategies to partition
6+
the parameters:
87

98
1. **Together** (baseline): one group covering all shared parameters. Corresponds to the
109
`whole_model` stategy in the paper.

0 commit comments

Comments
 (0)