Automated Data Fetch and Upload to Snowflake

somdn_product_page

This workflow automates the process of fetching a CSV file from an Azure Blob Storage, extracting specific data fields, and uploading the processed data into a Snowflake database. Triggered manually via the ‘Execute Workflow’ button, it is designed to streamline data integration tasks without manual intervention.

Step-by-step, the workflow begins with a manual trigger that allows users to initiate the process. Once triggered, it makes an HTTP request to download a CSV file stored in Azure Blob Storage. The downloaded file is then parsed as a spreadsheet file within n8n. Data from the CSV, specifically ‘first_name’, ‘last_name’, and ‘id’, is selected and structured via a ‘Set’ node for consistency and clarity. Finally, this structured data is sent to a Snowflake database, where it is inserted into the ‘users’ table, updating or adding records accordingly.

This workflow is highly practical for maintaining synchronized user data between external storage and a Snowflake data warehouse, making it ideal for scenarios like periodic data imports, automated data pipeline updates, or integration tasks in data-driven applications or analytics environments.

Node Count

0 – 5 Nodes

Nodes Used

httpRequest, manualTrigger, set, snowflake, spreadsheetFile

Reviews

There are no reviews yet.

Be the first to review “Automated Data Fetch and Upload to Snowflake”

Your email address will not be published. Required fields are marked *