This n8n workflow automates the process of extracting content from websites, managing customer interactions, and updating relevant data stores. It begins with a scheduling trigger that initiates various web scraping and data extraction tasks, including fetching sitemaps and webpage HTML content. The workflow uses BrightData (formerly BrightData) nodes for web scraping, allowing it to gather links, HTML content, and sitemap data efficiently.
The extracted links are filtered, corrected, and merged to form a comprehensive list of URLs. This list is then processed in batches, where each page is scraped for content, which is subsequently stored in a simple in-memory vector database for fast retrieval. The workflow also leverages OpenAI’s embeddings to create vector representations of page content, enabling intelligent search and similarity comparisons.
A key feature involves customer interaction via SMS, triggered by webhook events from GoHighLevel (GHL). When an inbound message is received, the workflow looks up contact details, retrieves relevant website content, and employs AI agents with GPT-4 to generate helpful responses. Responses are sent back via GHL’s SMS API, facilitating real-time, automated customer support. Additionally, the workflow stores chat history in Redis for maintaining context and supports multiple API integrations for web scraping and data management.
This workflow is highly practical for digital marketing, customer support automation, or content monitoring, providing a seamless way to scrape data, analyze content, and engage customers through SMS dynamically.
Reviews
There are no reviews yet.