flux.1 kontext won't do image edits

[eyecreate]

LocalAI version:

4.0.0

Environment, CPU architecture, OS, and Version:

x86_64 Ubuntu using docker container

Describe the bug

I installed the flux.1 kontext model from gallery that uses stablediffusion.cpp. If I attach any reference images(or img2img), it fails and says Error: rpc error: code = Unavailable desc = error reading from server: EOF. If I don't use a reference image, it generates an image fine.

To Reproduce

localai 4.0.0 with vulkan

1. install flux.1 kontext
2. add reference image and prompt
3. click generate

Expected behavior

Logs

Additional context

[mudler]

Does it work via API ? https://localai.io/features/image-generation/index.html#-flux-kontext-with-stable-diffusioncpp

[thelittlefireman]

No, i can confirms it does not same issue:

curl http://localhost:8080/v1/images/generations -H "Content-Type: application/json" -d '{
  "model": "flux.1-kontext-dev",
  "prompt": "change 'flux.cpp' to 'LocalAI'",
  "size": "256x256",
  "ref_images": [
        "https://raw.githubusercontent.com/leejet/stable-diffusion.cpp/master/assets/flux/flux1-dev-q8_0.png"
  ]
}'
{"error":{"code":500,"message":"rpc error: code = Unavailable desc = error reading from server: EOF","type":""}}