AI-Powered Website Content Scraper and Analyzer Workflow

This n8n workflow enables automated scraping and AI-based analysis of website content. It starts with an execution trigger from another workflow, receiving input parameters such as URL, number of pages to scrape, and a custom prompt. The workflow then uses an Apify actor to fetch website content (metadata and Markdown) across multiple pages. Each page’s data is processed in a loop, where an AI agent (using LangChain and OpenRouter models) analyzes the content based on the user-defined prompt, such as extracting contact details or summarizing content. The outputs are then aggregated and further processed by additional AI models for comprehensive insights. This workflow is ideal for tasks like lead generation, content summarization, competitor analysis, or extracting structured information from websites, providing a flexible and automated approach to gather intelligence from the web.