Local LLM Chat Interface with n8n and Ollama

This n8n workflow creates a seamless chat interface that connects to local large language models (LLMs) managed through Ollama. The purpose is to enable users to send prompts and receive AI-generated responses directly within n8n, facilitating integration with local AI models for private, secure processing.

The workflow starts with a webhook trigger that captures incoming chat messages. These messages are then sent to a locally hosted Ollama LLM via the ‘Ollama Chat Model’ node, which interfaces with Ollama’s API. The prompt is processed by the LLM, and the generated response is sent back through the chain, allowing for real-time conversational exchanges.

This setup is ideal for developers or organizations that want to leverage local AI models without relying on third-party cloud services, ensuring data privacy and control. It can be used for building custom chatbots, AI assistants, or conversational interfaces for private enterprise solutions.