Skip to content

Releases: ddh0/llama.cpp

b6795

Choose a tag to compare

@github-actions github-actions released this 18 Oct 21:25
ee09828
HIP: fix GPU_TARGETS (#16642)

b6791

Choose a tag to compare

@github-actions github-actions released this 17 Oct 18:02
66b0dbc
llama-model: fix insonsistent ctxs <-> bufs order (#16581)

b6782

Choose a tag to compare

@github-actions github-actions released this 16 Oct 19:34
1bb4f43
mtmd : support home-cooked Mistral Small Omni (#14928)

b6775

Choose a tag to compare

@github-actions github-actions released this 16 Oct 02:20
7adc79c
gguf-py : add support for endian conversion of BF16 data (#16594)

BF16 requires special handling in this script
while it's a 2-bytes data, but view is 1-byte by default.
Switch to correct view before attempting byteswapping.

With this change correctly byteswapping models like
Meta-Llama-3-8B-Instruct-bf16-GGUF
should be possible.

b6773

Choose a tag to compare

@github-actions github-actions released this 15 Oct 18:31
0cb7a06
opencl: add q8_0 mm support (#16469)

* opencl: add mm_q8_0_f32

* opencl: fix data loading for incomplete tile

* opencl: use q8_0 mm for larger matrix

* opencl: add some tests to cover the path

b6772

Choose a tag to compare

@github-actions github-actions released this 15 Oct 18:19
d93f843
opencl: fix FA for f32 (#16584)

b6765

Choose a tag to compare

@github-actions github-actions released this 14 Oct 19:42
fa882fd
metal : avoid using Metal's gpuAddress property (#16576)

* metal : avoid using Metal's gpuAddress property

* metal : fix rope kernels buffer check

b6756

Choose a tag to compare

@github-actions github-actions released this 14 Oct 06:45
bc07349
server : dynamic token limit for prompt cache (#16560)

* server : dynamic token limit for prompt cache

* cont : print estimated token limit

b6724

Choose a tag to compare

@github-actions github-actions released this 09 Oct 21:00
1deee0f
cpu : optimize the ggml NORM operation (#15953)

* ggml-cpu: optimize norm operation to use intrinsics or Accelerate

          rename function

          add endif macro comment

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Co-authored-by: Aaron Teo <taronaeo@gmail.com>

* implement s390x SIMD suggested by @taronaeo

* add TODO comment

* tidy up spaces

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Co-authored-by: Aaron Teo <taronaeo@gmail.com>

b6714

Choose a tag to compare

@github-actions github-actions released this 08 Oct 19:31
9d08828
Disable CUDA host buffers on integrated GPUs (#16308)