Automated Upwork Job Scraping and Daily Email Reporting

This n8n workflow automates the process of scraping Upwork job listings based on specified keywords, cleaning and deduplicating the data, updating Google Sheets with the latest job information, and generating a comprehensive daily email report. The workflow begins with a manual trigger to start the scraping cycle, which involves fetching keywords from Google Sheets, triggering an Apify scraper via HTTP request, and waiting for the dataset to be ready. It then processes the scraped data by filtering jobs posted within the last 24 hours, removes duplicates based on job titles and descriptions, and saves the clean data into a Google Sheet. Additionally, it updates keyword-specific job counts and compiles summary statistics. Finally, it generates an email body with the latest job counts and links to the data, and sends a detailed daily report to designated recipients. This workflow is ideal for recruiters or project managers who want to stay updated with the latest freelance opportunities without manual effort.