Skip to content

Commit be25217

Browse files
authored
chore(transformers): bump to >5.0 and generically load models (#9097)
* chore(transformers): bump to >5.0 Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore: refactor to use generic model loading Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 parent b74111f commit be25217

7 files changed

Lines changed: 185 additions & 228 deletions

File tree

backend/python/transformers/backend.py

Lines changed: 167 additions & 222 deletions
Large diffs are not rendered by default.

backend/python/transformers/requirements-cpu.txt

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,9 @@ torch==2.7.1
22
llvmlite==0.43.0
33
numba==0.60.0
44
accelerate
5-
transformers
5+
transformers>=5.0.0
66
bitsandbytes
77
sentence-transformers==5.2.3
8+
diffusers
9+
soundfile
810
protobuf==6.33.5

backend/python/transformers/requirements-cublas12.txt

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,9 @@ torch==2.7.1
22
accelerate
33
llvmlite==0.43.0
44
numba==0.60.0
5-
transformers
5+
transformers>=5.0.0
66
bitsandbytes
77
sentence-transformers==5.2.3
8+
diffusers
9+
soundfile
810
protobuf==6.33.5

backend/python/transformers/requirements-cublas13.txt

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,9 @@
22
torch==2.9.0
33
llvmlite==0.43.0
44
numba==0.60.0
5-
transformers
5+
transformers>=5.0.0
66
bitsandbytes
77
sentence-transformers==5.2.3
8+
diffusers
9+
soundfile
810
protobuf==6.33.5
Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,11 @@
11
--extra-index-url https://download.pytorch.org/whl/rocm6.4
22
torch==2.8.0+rocm6.4
33
accelerate
4-
transformers
4+
transformers>=5.0.0
55
llvmlite==0.43.0
66
numba==0.60.0
77
bitsandbytes
88
sentence-transformers==5.2.3
9+
diffusers
10+
soundfile
911
protobuf==6.33.5

backend/python/transformers/requirements-intel.txt

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,9 @@ torch
33
optimum[openvino]
44
llvmlite==0.43.0
55
numba==0.60.0
6-
transformers
6+
transformers>=5.0.0
77
bitsandbytes
88
sentence-transformers==5.2.3
9+
diffusers
10+
soundfile
911
protobuf==6.33.5

backend/python/transformers/requirements-mps.txt

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,9 @@ torch==2.7.1
22
llvmlite==0.43.0
33
numba==0.60.0
44
accelerate
5-
transformers
5+
transformers>=5.0.0
66
bitsandbytes
77
sentence-transformers==5.2.3
8+
diffusers
9+
soundfile
810
protobuf==6.33.5

0 commit comments

Comments
 (0)