Description
Provides Ollama with CUDA support for running large language models on compatible NVIDIA GPUs. GPU acceleration can make local model inference faster than CPU-only execution.
Use it when the system has a supported NVIDIA driver and enough GPU memory for the selected models. Mismatched drivers, large models, or heavy workloads can cause failures or high power use.