Experts-Volunteers needed for Vulkan on ik_llama.cpp
·
0 reactions
·
0 comments
·
2 views
ik_llama.cpp is great for both CPU & CUDA. Need legends to make Vulkan better as well. So, after bringing the Vulkan back-end up to speed some time ago, I felt that I simply don't have the bandwidth to also maintain it. In llama.cpp there are two maintainers who do nothing else but Vulkan. But if you are willing to do that, we can try to resurrect Vulkan. Of particular interest would be to implement the graph parallel stuff in the Vulkan back-end (after porting quite a few missing ops that have
Original article
Reddit
Anonymous · no account needed