Automated Daily Web Data Extraction & Telegram Notification

somdn_product_page

This n8n workflow automates the process of scraping structured data from specific web pages daily and sending the insights directly to a Telegram chat. It starts with a scheduled trigger set for 6 PM every day, initiating a POST request to the Firecrawl API to extract targeted information from predefined URLs using a custom prompt and schema. After sending the request, the workflow waits for 30 seconds to allow processing, then fetches the results with a GET request. If no results are returned, it waits an additional 15 seconds and retries, ensuring data retrieval. Once data is retrieved, it formats the information for readability and sends it as a message to Telegram. This automation is ideal for monitoring niche websites, gathering intelligence, or receiving real-time alerts. Useful in scenarios such as tracking notable trades, product updates, or market changes, this workflow minimizes manual effort and ensures timely notifications.

Node Count

11 – 20 Nodes

Nodes Used

httpRequest, if, scheduleTrigger, set, stickyNote, telegram, wait

Reviews

There are no reviews yet.

Be the first to review “Automated Daily Web Data Extraction & Telegram Notification”

Your email address will not be published. Required fields are marked *