Skip to content

Commit 0650652

Browse files
fix(cachyllama): link SSD cache implementation
CachyLLaMA splits persistent prompt-cache support into separate source files. Include those implementations in the monolithic LocalAI gRPC adapter when the fork provides them so the ARM64 fallback build resolves the page-manager symbols. Assisted-by: Codex:gpt-5 [Codex]
1 parent 0a063c5 commit 0650652

1 file changed

Lines changed: 9 additions & 0 deletions

File tree

backend/cpp/llama-cpp/grpc-server.cpp

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -43,6 +43,15 @@
4343
#if __has_include("server-stream.cpp")
4444
#include "server-stream.cpp"
4545
#endif
46+
// CachyLLaMA splits its persistent prompt-cache implementation out of
47+
// server-context.cpp. Pull both implementation files into this monolithic
48+
// adapter TU when present; older llama.cpp pins do not ship them.
49+
#if __has_include("server-context-ssd-cache.cpp")
50+
#include "server-context-ssd-cache.cpp"
51+
#endif
52+
#if __has_include("server-context-page-manager.cpp")
53+
#include "server-context-page-manager.cpp"
54+
#endif
4655
#include "server-context.cpp"
4756

4857
// LocalAI

0 commit comments

Comments
 (0)