Description
Local language models can use Vulkan acceleration from a development build of Ollama. This helps users test GPU-backed inference on systems where Vulkan support is useful or experimental.
It may download large models, use heavy GPU resources, and expose a local API. Review driver compatibility and prompt privacy before use.