azuredatafactory

Nikhil-Pickle/End-to-End-Azure-Data-Engineering

Local SQL Database ---> Azure ---> Power BI

Mimetis/ProjectY

Project Y is a straightforward Landing Zones automated deployment tool dedicated to data processing.

Profisee/azuredatafactory

Everything you need to know about cloning, importing and using the Profisee Azure Data Factory templates.

jeroenterheerdt/dutchdatadude

Code samples as published on blog

ThirdEyeData/Anomaly-Detections-Microsoft-Azure

This solution performs analytics and outlier detections on Apache compliant web server logs. This is based on Microsoft Azure technologies & PowerBI.

helenamin/databricks_PerthProperties

A Re-do of Perth City Properties project using Azure Data Engineering technologies such as Azure Data Factory (ADF), Azure Data Lake Storage Gen2, Azure Blob Storage, Azure Databricks.

DataCounsel/Azure-Data-Engineering

Transform data from on-premises SQL Server to Azure Delta Lake Storage for Analytics and Visualization

fabricioasn/EnemInData_TCC_Unicarioca

This repository is designed for a data science project aimed to education, wich uses a public database from brazilian educational research institute about the nationam highschool exam and applies ETL and datamining association rules to this dataset.

MuhammadHasaanWahid/Csv-To-Parquet-And-Data-Reporting-Pipeline

This project extracts data having 800k records from CSV in the data factory and convert it to parquet based data and finally create a PowerBI report of that parquet based data.

salineroa/formula-1-racing-data-pipeline

Azure-based solution for ingesting and analyzing Formula 1 data using Azure Data Lake Storage Gen2 and Databricks

Shashi42/Azure-End-to-End-Sales-Data-Analytics-Pipeline

This project builds an End-to-End Azure Data Engineering Pipeline, performing ETL and Analytics Reporting on the AdventureWorks2022LT Database.

yogitasn/Springboard-Capstone

Springboard Open Ended Capstone

dataninsight/Fitbit_AzureStreaming

This project exemplifies a robust Azure streaming data solution tailored for fitness data analysis, leveraging Azure's powerful ecosystem to deliver actionable insights and drive informed decisions in health and wellness management.

iOS00/SynapseAnalytics_Databricks

Practice with Azure Synapse Analytics/Databricks Pipeline

Kirolos00Daniel/Tokyo-Olympic-Analysis-2020-Azure

Tokyo Olympics Analysis Using AZURE platform

manjunathg88/adf-teams-channel-notification

This Azure Data Factory (ADF) pipeline will be automatically triggered whenever a CSV file is dropped in a specific location within the Storage Account Container. The pipeline reads the contents of the CSV file, converts it into an HTML table, and then sends a notification containing the newly created table to the designated Microsoft Teams channel

profiseedev/azuredatafactory

Everything you need to know about cloning, importing and using the Profisee Azure Data Factory templates.

raghul3/Azure-Olympic-Data-Engineering

sairajindroju/TokyoOlympicDataAnalytics-Azure

Ingested Tokyo Olympic data into Azure Data Lake using Azure Data Factory. Enhanced data quality with Apache Spark on Azure Databricks. Optimized SQL queries on Synapse Analytics, reducing execution time. Developed engaging Power BI dashboards, boosting user engagement creating KPI's with DAX.

SharadChoudhury/Azure_Covid19_Analysis

Covid ETL Project using Azure Data Engineering Stack

skalskibukowa/Project_Azure_Data_Engineer

The data engineering project aims to migrate a company's on-premises database to Azure, leveraging Azure Data Factory for data ingestion, transformation, and storage. The project will implement a three-stage storage strategy, consisting of bronze, silver, and gold data layers (Medalion architecture). Documentation of the project is in PDF file.

skmahaboob/AzureDataFactory

This repository contains resources for mastering Azure Data Factory from scratch, specifically designed for data engineers. The repository includes pipelines, datasets, linked services, data flows, and an input file that can be used as a practical guide to understand and implement various data engineering tasks in Azure Data Factory.

sparkprvn/Azure-data-factory

This repository is connected to the Azure data factory to store all the pipelines built.

fnu-ankit/meta-data-driven-data-migration

Azure data migration project to migrate data from on-prem SQL Server to Azure cloud using meta-data driven approach.

kaushikrohida/Tokyo-Olympic-Analysis-2021-Azure-DE

Tokyo Olympic 2021 Analysis Using Microsoft Azure platform

krthiak/data-engineer-portfolio

This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Artificial Intelligence topics.

Punam918/FootballAnalysis_DataEngineering

This Python-based project extracts data from Wikipedia using Apache Airflow, cleans it and pushes it Azure Data Lake for processing and further processing and visualization is done on Azure Data Factory, Azure Synapse and Tableau.

ShreevaniRao/Azure

Azure projects - End to End Data Engineering Project with medallion architecture using Azure Data Factory & Azure Databricks. Azure Serverless/Logical DataWarehouse using Azure Synapse Analystics to demo CETAS, Data Modeling, Incremental loading, CDC and Sql Monitoring the data processing connected to Power BI

ashusolanki3010/AZURE-mfdataengineering_project

This project creates an end-to-end data pipeline and interactive dashboard for analyzing mutual funds' performance using Microsoft Azure and Power BI. It leverages Azure Data Factory, Data Lake Storage, SQL Database, and Databricks to build a scalable, efficient pipeline, providing real-time insights and data-driven decision-making.

ashusolanki3010/Sales_Analytics

This repository contains a full setup for a Snowflake and Azure Data Factory pipeline, including a detailed README, a sample sales dataset for data ingestion and transformation, and Snowflake-generated analysis charts. It's ideal for learning Snowflake-Azure integration and automating data workflows.

buneshka/Data-Pipeline-for-Customer-Account-Analysis

This project demonstrates the end-to-end process of building a data pipeline using Azure Synapse Analytics, Azure Data Factory (ADF), Databricks, and Delta Lake to ingest, clean, transform, and store data.

GsrSanthosh/Azure-End-to-End-Data-Engineering-Project

This is an End to End Azure Data Engineering project copying data from Rest API to Azure cloud.

Jacob-withnoskills/etl_pipeline_test

Naveen018/azure-lendingclub

Data files for azure cloud data engineering project

shanukatiyar111/AzureProject1

END TO END DATA ENGINEERING PROJECT