Pinned Repositories
azureml-mlops-example-scenarios
Prescriptive MLOps scenarios for building, deploying and monitoring machine learning models with Azure Machine Learning.
sgouda0412's Repositories
sgouda0412/airflow-dags
Airflow DAG code for all projects.
sgouda0412/Airflow-MySQL-To-BigQuery
sgouda0412/airflow_sandbox_template
Airflow basic and general functionalities to get started on airflow
sgouda0412/alaska-etl
ETL webscraping pipeline to compare NWS forecasts for Alaska against USCRN weather data. Python, Airflow, SQL, BigQuery. Currently migrating to Cloud Functions and Cloud Scheduler.
sgouda0412/Algorithm-Problems
sgouda0412/ankit_youtube_sql
In this repo I have solved all the complex Sql interview question playlist that are presented by Ankit on YouTube: https://www.youtube.com/playlist?list=PLBTZqjSKn0IeKBQDjLmzisazhqQy4iGkb.
sgouda0412/Apache-Airflow-Training
Airflow Training A to Z
sgouda0412/aws_end_to_end_streaming_pipeline
An AWS Data Engineering End-to-End Project (Glue, Lambda, Kinesis, Redshift, QuickSight, Athena, EC2, S3)
sgouda0412/AzurePipeLine-Student-Teacher-
an Azure Data Factory project for processing two Excel files (student details and teacher details).
sgouda0412/BookStore-ETL-Pipeline-using-Airflow
Building an ETL pipeline for a book store using Airflow.
sgouda0412/Cheap_flights_Airflow
sgouda0412/Creating-Streaming-Data-Pipelines-using-Airflow
sgouda0412/crypto-pipeline
This is the code to do the full proccess from obtaining data from an API to get it into BigQuery (Data Warehouse)
sgouda0412/Customer-Churn-Data-Analytics-Data-Pipeline
Customer Churn Data Analytics Data Pipeline using Apache Airflow, Glue, S3, Redshift, PowerBI
sgouda0412/DBT_Data_Transformation_Validation
the objective of this project is to implement data transformations and validation using DBT
sgouda0412/ETL-Pipeline--Orchestration-with-Apache-Airflow
This GitHub repository contains an Apache Airflow DAG script for orchestrating AWS Glue ETL jobs. It automates the execution of Glue jobs , with defined dependencies and waiting periods. Also includes setting up and how to use DAG on Apache Airflow
sgouda0412/ETL-Pipeline-glue_S3_Redshift_BI
Building Data Pipeline using Apache Airflow, Glue, S3, Redshift, PowerBI . Performing Customer Churn Data Analytics
sgouda0412/ETL-With-Apache-Airflow
ETL Process with Apache Airflow fetching data from Ministerio de Salud de la Nación Argentina
sgouda0412/ETL_import_financial_data_to_postgresql
Simple ETL script with Apache Airflow , downloading financial data from alphavantage trought API , trasform into pandas dataframe and uplod to PostgreSQL
sgouda0412/gh-traffic
Using GH Traffic Data to learn about our users.
sgouda0412/hotel_booking_cancellation_prediction
Hotel Booking Cancellation Prediction: A machine learning model that predicts the likelihood of hotel booking cancellations, deployed as a real-time web service using FastAPI and Docker. Enhance your hotel's operational efficiency, revenue optimization, and customer experience with data-driven decisions.
sgouda0412/leetcode_interviews_prep
leetcode Blind75 solutions grinding
sgouda0412/merch-store-DE-Task
This is an end-to-end data engineering task which includes the use of PostgreSQL database, Apache Airflow, Google Cloud Storage bucket , Google Big Query and Google Looker studio. The aim to automate ETL process for the E-commerce store, Merch-store.
sgouda0412/MUST_HAVE_SKILLS
This repo consists of all important concepts for data engineers.
sgouda0412/Online-Retail-airflow
sgouda0412/Online-Transaction-ETL-Pipeline
End2End Pipeline + Dashboard + Analysis
sgouda0412/python-gcp-101
This is a small data engineering project using python, mysql, mongodb, airflow, docker and gcp services.
sgouda0412/Redfin-AWS-Apache-Airflow-Data-Pipeline
In this comprehensive guide, we'll take you through the process of setting up a data pipeline using AWS EC2, Apache Airflow, Snowflake Data Warehouse, and Power BI. Our primary objective is to extract Redfin housing market data, process it, and store it in Snowflake for analytics and reporting.
sgouda0412/snowshovel
A Streamlit App for loading data into Snowflake for grandmas
sgouda0412/Youtube_data_pipe