Skip to content

Commit 13e74f7

Browse files
Merge pull request #1 from pjordanandrsn/feature/experts-4bit-training
Experts trainability: bit-exact recompute-in-backward + ExpertsNbit (8/16-bit storage)
2 parents 2748d76 + 0315ebf commit 13e74f7

4 files changed

Lines changed: 532 additions & 70 deletions

File tree

bitsandbytes/nn/__init__.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
#
33
# This source code is licensed under the MIT license found in the
44
# LICENSE file in the root directory of this source tree.
5-
from .experts import Experts4bit
5+
from .experts import Experts4bit, ExpertsNbit
66
from .modules import (
77
Embedding,
88
Embedding4bit,

0 commit comments

Comments
 (0)