You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/FAQ.md
+3-9Lines changed: 3 additions & 9 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -68,19 +68,13 @@ The differences between modes may lead to much different behaviours under the sa
68
68
This error means the model's architecture is not supported by the version of
69
69
llama.cpp that the current LLamaSharp backend is built against.
70
70
71
-
The most common cause is using a model that was released after your installed
72
-
version of LLamaSharp. Newer model families (e.g. Gemma, Qwen)
73
-
require a backend built against a newer llama.cpp commit.
71
+
The most common cause is using a model that was released after your installed version of LLamaSharp. Newer model families require a backend built against a newer llama.cpp commit.
74
72
75
73
**Solutions, in order of preference:**
76
74
77
-
1.**Update LLamaSharp** to the latest version and reinstall the matching backend
78
-
package. Check the version table at the bottom of the README to confirm which
79
-
model families are verified for each release.
75
+
1.**Update LLamaSharp** to the latest version and reinstall the matching backend package. Check the version table at the bottom of the README to confirm which model families are verified for each release.
80
76
81
-
2.**Check the model's publishing date** on Hugging Face. If it predates your
82
-
LLamaSharp version, the architecture may not yet be supported - open an issue
83
-
on the repository to request support.
77
+
2.**Check the model's publishing date** on Hugging Face. If it was published after your LLamaSharp version, the architecture may not yet be supported - open an issue on the repository to request support.
84
78
85
79
3.**Compile the compatible llama.cpp build yourself**, then point LLamaSharp to it with NativeLibraryConfig.All.WithLibrary()
0 commit comments