Could you share the change if the project support RTX4080 16GB?

[BingLiHanShuang]

Hello, this is a great work for desktop device. Could you share the change if the project support RTX4080 16GB?

[davide221]

Hello! Thank you. You can try to fit this quantized version of qwen Qwen3.6-27B-Q3_K_S.gguf, but it will probably go OOM because the drafter is around 3.5gb