This comprehensive n8n workflow automates web data extraction, combining Selenium browser automation with GPT-4 analysis. It starts by capturing URLs from a target website, then performs Google searches to find relevant pages related to a subject. The workflow creates Selenium sessions to navigate, capture screenshots, inject cookies for authenticated browsing, and analyze page content and images with OpenAI’s GPT-4. It handles proxies, manages browser sessions with precise control, and responds dynamically to webhooks. Ideal for advanced web scraping, sentiment analysis, or research automation, this workflow streamlines data retrieval from complex websites requiring login or proxies.
Selenium Ultimate Scraper Workflow
Node Count | >20 Nodes |
---|---|
Nodes Used | @n8n/n8n-nodes-langchain.informationExtractor, @n8n/n8n-nodes-langchain.lmChatOpenAi, @n8n/n8n-nodes-langchain.openAi, code, convertToFile, html, httpRequest, if, limit, respondToWebhook, set, stickyNote, webhook |
Reviews
There are no reviews yet.