ROCm backend support #61
marcussacana
started this conversation in
Ideas
Replies: 1 comment
Vulkan backend (ggml_vulkan) is already supported and you can try AMD GPU on it. I don't have AMD GPU, but tested it on Nvidia and Intel GPU and they work. |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
I would love test this project on my AMD GPU, but no support yet, consider supporting in future.
All reactions