alexpinel/Dot

llama.cpp vulkan

Opened this issue · 0 comments

Can you add support for llama.cpp Vulkan? This would allow users with AMD and Intel GPUs to get hardware acceleration. This would allow you to expand your user base.
Thanks.