Skip to content

Commit 9fe79bd

Browse files
committed
remove duplication of spawn set
1 parent 3be22a9 commit 9fe79bd

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

text_preprocessing/preprocessor.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -279,7 +279,6 @@ def process_texts(
279279

280280
def process_string(self, text: str, keep_all: bool = True) -> Tokens:
281281
"""Take a string and return a list of preprocessed tokens"""
282-
mp.set_start_method("spawn")
283282
with mp.Pool(1) as pool:
284283
for tokens in pool.apply(
285284
process_batch_texts,

0 commit comments

Comments
 (0)