Automated Web Page Content Extraction Workflow

This n8n workflow automates the process of fetching and extracting content from a web page via a URL provided by a trigger, making it highly useful for data scraping, content analysis, or SEO insights. The workflow begins with an execution trigger that listens for incoming requests containing a URL. Once triggered, it sends a POST request to the FireCrawl API, passing the URL for crawling and requesting the content in Markdown format. The response from FireCrawl, which contains the extracted webpage content, is then processed and the Markdown is stored in a response variable for further use or analysis. A sticky note within the workflow explains how external agents or users can initiate this process by sending a simple JSON payload containing the URL to crawl. This setup enables seamless, automated content extraction for various applications such as monitoring website changes, gathering data for research, or automating content updates.