snowpipe
There are 23 repositories under snowpipe topic.
Snowflake-Labs/sfguide-twitter-auto-ingest
Learn how to auto-ingest streaming data into Snowflake using Snowpipe.
enfazz/aws_snowflake_pbi
AWS S3, Snowflake (Snowpipe, Snowpark) and PowerBi.
phdata/snowpipe-cli
CLI script for interacting with Snowpipe REST APIs
arunp77/Database-datapipeline-ETL
SQL, Databases, warehouses, Data lake, cloud storage, MYSQL, Data Pipeline
pedrogfleming/Snowflake-Scripts
SQL Scripts related to my learning on the Snowflake data cloud provider
Snowflake-Labs/simstreamer
Generating Streaming Data for Snowpipe Streaming
arunp77/SQL
SQL, Databases, warehouses, Data lake, cloud storage, MYSQL, Data Pipeline
dominicho97/Snowpipe
Automatically move data from AWS S3 to Snowflake datawarehouse continuously with snowpipe
psy-pri/aws-realtime-tweets-streaming
❄️ Stream real-time data into Snowflake with Amazon Kinesis Firehose
SirNicholas1st/Snowflake-Datapipe
The goal is to build an example of a simple data collection pipeline which collects data from multiple customers and uploads the data to Snowflake could look like. The OpenMeteo Api acts as the "customer system" in this case.
alejlatorre/kafka-spark-smartcity-realtime-pipeline
Realtime data pipeline using Kafka + Spark + AWS S3 (Terraform) + Snowflake
amoghkori/retail_data_analysis
Retail data analysis pipeline utilizing AWS S3, Snowflake, Python, SQL, and Tableau. It demonstrates data transformation and setup in Jupyter Notebook, integrates real-time retail insights via an automated Tableau dashboard with Snowflake, and employs a CRON job in Jupyter Lab connected to Amazon SQS for consistent data updates.
nagavenkateshgavini/spotify_data_pipeline
Spotify ETL pipeline on AWS
sarutlaa/AWS-Snowflake-Music-Insights-Pipeline
Building a Seamless Data Pipeline with AWS and Snowpipe
areesha-s/Redfin-Data-Pipeline-with-AWS-Apache-Airflow-Snowflake-and-PowerBI
This project showcases a scalable ETL pipeline that automates the extraction, transformation, and storage of Redfin housing market data using AWS, Apache Airflow, and Snowflake, with Power BI for data visualization. The pipeline is configured to run monthly, ensuring your data remains up-to-date.
dogukannulu/snowpipe-aws-stream-processing
Get the streaming data from the S3 bucket with SQS queue. Load into Snowflake with Snowpipe and modify the data with Snowflake task
gakas14/Event-driven-architecture-with-S3-Lambda-snwoflake
ETL with AWS Lambda and Snowflake with automation using Snowpipe.
Srilekha-1106/Snowflake-Project
Implemented Snowflake project on AWS for efficient data storage and transformation. Utilized JSON-to-CSV conversion, Snowpipe for real-time ingestion, and reader accounts for secure data access. Employed streams, tasks, and materialized views for data synchronization and optimization. Implemented masking policies for enhanced data security.