Description
Provides Ollama with Vulkan support for running large language models through compatible GPU drivers. Vulkan acceleration can broaden hardware support beyond a single vendor stack.
Use it when CUDA or ROCm is not the right path and the system has suitable Vulkan support. Performance and compatibility depend on the driver, GPU, model size, and memory available.