Ollama acceleration on macOS

[srid]

The docs, https://community.flake.parts/services-flake/ollama#acceleration are not clear as to whether the GPU is used on macOS. This should be clarified.

By default Ollama uses the CPU for inference. [..]

So it doesn't use GPU on macbooks?

[shivaraj-bh]

Ollama’s GPU guide doesn’t specify any extra steps other than having an Apple device with Metal API, see https://github.com/ollama/ollama/blob/main/docs/gpu.md#metal-apple-gpus.

I will test this and update the doc.