You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The :code:`mlx.nn.layers.distributed` package contains helpful routines for creating sharded layers easily from existing :class:`Modules <mlx.nn.Module>`.
10
+
11
+
.. currentmodule:: mlx.nn.layers.distributed
12
+
.. autosummary::
13
+
:toctree: _autosummary
14
+
15
+
shard_linear
16
+
shard_inplace
17
+
18
+
Layers
19
+
^^^^^^
20
+
21
+
The :code:`mlx.nn` package contains helpful layers for creating distributed models with sharded parameters.
0 commit comments