#438·llamafile

Is it possible for llamafile to use Vulkan or OpenCL Acceleration?

Author: Ff-c109Created May 23, 2024Updated Jul 24, 2026
Labelsrequest to lend support

I want to use llamas on Intel's devices. If it is possible for it to use Vulkan or OpenCL, I think I may able to use Intel's GPU to accelerate it.

I have seen "README" file, and it says that it support AMD and Nvidia, But nothing about OpenCL or Vulkan. And I've notice that not every AMD GPU has ROCm support. I have read about the document of AMD Radeon Pro W6500. But It only says support OpenCL, but nothing about ROCm were found. I wander if this GPU is supported.