This n8n workflow enables comprehensive evaluation of AI responses based on retrieved documents, specifically focusing on how well the answer is grounded in source material. Triggered manually, the workflow fetches a PDF document (e.g., Bitcoin Whitepaper), processes it through natural language embeddings, and stores it in a vector store for efficient retrieval. When a user submits a question, the system retrieves relevant documents, generates an AI response grounded in this information, and assesses the alignment between the response and the source documents using an embedded evaluation model. The outcome includes a score indicating the response’s groundedness, which is recorded in Google Sheets. This workflow is particularly useful for ensuring high-quality, factually accurate AI outputs in knowledge-based applications, FAQs, or technical support scenarios.
AI-Powered Document Evaluation with n8n
Node Count | >20 Nodes |
---|---|
Nodes Used | @n8n/n8n-nodes-langchain.agent, @n8n/n8n-nodes-langchain.chainLlm, @n8n/n8n-nodes-langchain.chatTrigger, @n8n/n8n-nodes-langchain.documentDefaultDataLoader, @n8n/n8n-nodes-langchain.embeddingsOpenAi, @n8n/n8n-nodes-langchain.lmChatOpenAi, @n8n/n8n-nodes-langchain.outputParserStructured, @n8n/n8n-nodes-langchain.textSplitterRecursiveCharacterTextSplitter, @n8n/n8n-nodes-langchain.vectorStoreInMemory, evaluation, evaluationTrigger, httpRequest, manualTrigger, noOp, set, stickyNote |
Reviews
There are no reviews yet.