Description
Provides Ollama with ROCm support for running large language models on compatible AMD GPUs. GPU acceleration can improve local inference speed when hardware and drivers are supported.
Use it when the system has a compatible AMD GPU, ROCm stack, and enough VRAM for the selected models. Unsupported hardware or large models can fail or consume significant resources.