Replies: 1 comment
-
|
How can it be made easier? Do you know you can swap models at runtime using the admin endpoint? You can just throw all the gguf files into one directory and swap between them using a single baseconfig. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Model switching is still not friendly in Koboldcpp? Yes, I know that we can create those .kcpps files, but trying new models is still a pain in the ass. It frustrates me because this project is constantly up to date, but man, I really wish they would improve this one feature.
Beta Was this translation helpful? Give feedback.
All reactions