Automated Web Data Extraction and Analysis via Telegram

This n8n workflow automates the process of collecting, analyzing, and sharing web data through Telegram. It is triggered by user requests received via a Telegram webhook, which include URLs and the number of pages to scrape. The workflow begins by extracting user input and determining if multiple pages need scraping. Depending on the request, it either crawls multiple pages or scrapes a single page using specified endpoints. After waiting for the scraping process to complete, the collected content is processed through language models (Google Gemini and LangChain’s LLM chains) for summarization or analysis. The resulting insights or data are then converted into files and sent back to the user via Telegram, enabling seamless, automated information retrieval and sharing. This workflow is highly practical for cases like competitive analysis, content aggregation, or automated research updates, where real-time data collection and processing are essential.