feat: integrate Llama.cpp and enhance engine stability for cross-platform usage#616

Open

krishjp wants to merge 19 commits intoPrunaAI:mainfrom

krishjp:feat/llama-cpp

Commits on Apr 20, 2026

feat: implement llama.cpp algorithm
krishjp
committed
feat: llama.cpp conversion by forcing f16 for tiny models and bypass device checks for llama-cpp models due to a lack of model.parameters() support
krishjp
committed
fix: preserve enum membership for callables in engine to support Python 3.13
krishjp
committed
feat: integrate Llama.cpp and enhance engine stability for cross-platform usage
krishjp
committed
fix: integrity verification of remote scripts
krishjp
committed
fix: ruff typechecking and shutil.move on GGUF file handling
krishjp
committed
feat: updated llama support with rebased head branch commits
krishjp
committed
fix: ruff check fixes and llama_cpp updates
krishjp
committed
refactor: llama_cpp code length update and extra comments for visibility
krishjp
committed
refactor: code complexity
krishjp
committed
refactor: removed dead code from save_model_llama_cpp in save.py
krishjp
committed

Commits on Apr 21, 2026