Skip to content

Commit a896e12

Browse files
committed
another fix to process strings
1 parent 028f201 commit a896e12

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

text_preprocessing/preprocessor.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -280,6 +280,7 @@ def process_texts(
280280
def process_string(self, text: str, keep_all: bool = True) -> Tokens:
281281
"""Take a string and return a list of preprocessed tokens"""
282282
progress_info = {"count": 0, "doc_count": 0, "progress": False, "progress_prefix": ""}
283+
self.text_fetcher_args["is_philo_db"] = False # Ensure string processing does not expect PhiloLogic format
283284
result = self.__process_batch([text], keep_all, progress_info)
284285
return next(result)
285286

0 commit comments

Comments
 (0)