feat: Added the scan path for CUDA 13.0+ dynamic link libraries under Windows system ($env:CUDA_PATH\bin\x64)

JamePeng · JamePeng · commit e5e19e8a8065 · 2025-12-07T23:34:20.000+08:00
Signed-off-by: JamePeng &lt;jame_peng@sina.com&gt;
diff --git a/llama_cpp/_ctypes_extensions.py b/llama_cpp/_ctypes_extensions.py
@@ -56,6 +56,7 @@ def load_shared_library(lib_base_name: str, base_path: pathlib.Path):
             cuda_path = os.environ["CUDA_PATH"]
             sub_dirs_to_add = [
                 "bin",
+                os.path.join("bin", "x64"),  # CUDA 13.0+
                 "lib",
                 os.path.join("lib", "x64")
             ]

Original file line number	Diff line number	Diff line change
`@@ -56,6 +56,7 @@ def load_shared_library(lib_base_name: str, base_path: pathlib.Path):`
`56`	`56`	`cuda_path = os.environ["CUDA_PATH"]`
`57`	`57`	`sub_dirs_to_add = [`
`58`	`58`	`"bin",`
	`59`	`+ os.path.join("bin", "x64"), # CUDA 13.0+`
`59`	`60`	`"lib",`
`60`	`61`	`os.path.join("lib", "x64")`
`61`	`62`	`]`