Description
Local AI chat workflows can run on the user's computer as an open-source alternative to cloud-first assistants with multiple engine support such as llama.cpp and TensorRT-LLM.
It is useful for experimenting with local models, private drafting, coding help, or offline-style AI sessions when models are available. AI output can be wrong, and local models may use significant disk, memory, and GPU resources.