Description
Local text-generation models in GGML or GGUF format can be served with a KoboldAI-compatible interface.
It is useful for running chat, writing, and roleplay models on your own machine instead of depending only on hosted services. Local AI still processes prompts and files you provide, and model output can be inaccurate or unsuitable for children.