Skip to content

Commit 069d4e6

Browse files
Revert "set doc loader to use threading by default"
This reverts commit 564cc28.
1 parent fce5ea8 commit 069d4e6

2 files changed

Lines changed: 3 additions & 4 deletions

File tree

DocToolsLLM/DocToolsLLM.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -118,7 +118,7 @@ def __init__(
118118
notification_callback: Optional[Callable] = None,
119119
chat_memory: Union[bool, int] = True,
120120
disable_llm_cache: Union[bool, int] = False,
121-
file_loader_parallel_backend: str = "threading",
121+
file_loader_parallel_backend: str = "loky",
122122
private: Union[bool, int] = False,
123123
llms_api_bases: Optional[Union[dict, str]] = None,
124124
DIY_rolling_window_embedding: Union[bool, int] = False,

DocToolsLLM/docs/USAGE.md

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -195,10 +195,9 @@
195195
cache folder for your system. This does not disable caching
196196
for documents.
197197

198-
* `--file_loader_parallel_backend`: str, default `"threading"`
198+
* `--file_loader_parallel_backend`: str, default `"loky"`
199199
* joblib.Parallel backend to use when loading files. loky means
200-
multiprocessing while `threading` means multithreading. Note
201-
that multiprocessing can lead to issues in some cases.
200+
multiprocessing while `threading` means multithreading.
202201
The number of jobs can be specified with `file_loader_n_jobs`
203202
but it's a loader specific kwargs.
204203

0 commit comments

Comments
 (0)