We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 0a92f65 commit 1270b2fCopy full SHA for 1270b2f
1 file changed
plugins/accelerated-peft/requirements.txt
@@ -5,10 +5,9 @@
5
accelerate >= 0.29
6
7
# bitsandbytes for the BNB plugin
8
-# - lower bound is because bnb is missing quant_state
9
-# - upper bound is because of segmentation faults
10
-# see https://github.com/foundation-model-stack/fms-acceleration/issues/17
11
-bitsandbytes >=0.41,<=0.43.3
+# exact version is needed 0.45.1 for torch upgrade to 2.6
+
+bitsandbytes == 0.45.1
12
13
# Used to manage the thread limit in functions for converting old
14
# GPTQ models to new GPTQ model format that support symmetrical=False
0 commit comments