You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
- Nullify additional attributes (`tokenizer_`, `model_params`, etc.) in `Llama.close()` to guarantee immediate garbage collection during unload.
23
+
- Add todo comment to LoRA process logic, the current LoRa loading logic is outdated and needs to be refactored.
24
+
25
+
- feat: add memory breakdown and sampler performance timings APIs
26
+
27
+
- feat: Search system paths for shared libraries(`by @benniekiss`)
28
+
29
+
- Optimize `longest_token_prefix` to use zero-copy NumPy arrays and drop .tolist() overhead
30
+
31
+
- Free _candidates and large numpy arrays during explicit close()
32
+
33
+
- fix: resolve memory leaks in sampling context lifecycle
34
+
- Safely close temporary `LlamaSamplingContext` in `sample()` using a try-finally block.
35
+
- Explicitly release the previous `_sampling_ctx` in `generate()` before re-assignment to prevent orphaned pointers.
36
+
- Ensure `_sampling_ctx` is properly freed in `Llama.close()`.
37
+
38
+
- Fix custom sampler memory cleanup and improve lifecycle management
39
+
- Add explicit `close()` and `__del__()` to CustomSampler to safely free C resources and break Python reference cycles
40
+
- Ensure custom samplers are properly detached and freed in `LlamaSampler.close()`
41
+
- Add minor documentation comments for clarity
42
+
43
+
- feat: Update llama.cpp to [ggml-org/llama.cpp/commit/cacc371f99fb3b5b431d3fa89ac0c752bbd62a3b](https://github.com/ggml-org/llama.cpp/commit/cacc371f99fb3b5b431d3fa89ac0c752bbd62a3b)
44
+
45
+
- feat: Sync llama.cpp llama/mtmd API Binding 20260223
46
+
47
+
More information see: https://github.com/JamePeng/llama-cpp-python/compare/3d0fd1b75ee564361a4babf21f88855225ba1fe0...1f8341ee74a2fea15a1008487cbecaccf918c755
0 commit comments