datafactory

rlevchenko/terraform-azure-data

Terraform script to deploy almost all Azure Data Services

DataTech-Solutions/Threat-Detection-and-Visualization

Threat Detection and Visualization

guderkar/ACIProxy

Azure Container Instances Proxy implemented in Azure Function App (Consumption Plan)

NandanHegde15/Azure-DataFactory-Generic-Pipelines

Generic Pipelines / Templates for Data Factory / Synapse Pipelines w.r.t Different MSFT Offering Integrations / Use Cases

mehroosali/databricks-F1-Project

A data pipeline project build on databricks and azure to demostrate lifecycle of a cloud data project.

aessing/demo-mdwh

Modern Dataware House Demos with Azure Databricks, Azure Data Factory & Azure Dedicated SQL pool (formerly SQL DW)

camposvinicius/azure-etl

This pipeline is an ETL application, which aims to collect data for a few minutes from Binance's open API for cryptocurrencies: BTCUSDT, ADAUSDT, ETHUSDT, BNBUSDT and LTCUSDT.

federicopfund/data-engineer

Proceso ETL

shubhammirajkar/tokyo_olympics_de_project

Explore the Tokyo Olympics data journey! We ingested a GitHub CSV into Azure via Data Factory, stored it in Data Lake Storage Gen2, performed transformations in Databricks, conducted advanced analytics in Azure Synapse, and visualized insights in Synapse or Power BI.

SixGod191001/azure-adf-framework

The ADF Universal Framework is an open-source project designed to provide a comprehensive and flexible solution for building scalable and efficient data integration workflows using Azure Data Factory (ADF).

snhaider9977/Datafactory-CI-CD

This repository serves as a sample demonstration of implementing CI/CD practices on Azure Data Factory using Azure DevOps. It provides an example approach to configure a pipeline for continuous integration and continuous deployment (CI/CD) workflows on Azure Data Factory

3amory99/Olympic-Data-Analytics-End-to-End-Project

akfincode/azure-powershell

PowerShell Tools

armdev/rethinkdb-jsf

rethinkdb jsf 2.3 project

ayanhussain81/Olympics-Data-ETL

Tokyo Olympic Azure Data Engineering Project

bennyaustin/ADFCustomActivity-AASPartition

Repository for Azure Data Factory (ADF) Custom Activity to dynamically create and process Azure Analysis Service (AAS) Tabular Model Partitions

bennyaustin/logicapp-azure-resourcemgmt

Logic App that calls Azure Resource Management REST API to get information about resources in a subscription

BrioGit/DataFactoryAutomation

This application shows how to use the Azure .NET library to create and execute Azure Data Factory from C# code.

liliankotvan/Azure-ADF-RefreshPBI

Azure Data Factory template to refresh Power BI Dataset

MuhammadHasaanWahid/Data-Filtering-Pipeline-ETL

This Project Extracts supply chain data from csv file having 180k records and more than 40 columns from the Azure Datalake Gen2 storage account and do some dataanalysis with Python(Pandas) to find the top 3 countries and filtered the data for top 3 countries and finally transferred it to 3 files in datalake again by creating ETL pipeline in ADF.

sandman153/WWLogs

KQL Queries for WWLogs Presentation

tknishh/olympic-data-analysis-azure

End-to-End data engineering project with Azure Databricks as cloud service and Tokyo olympic data

tuancamtbtx/Azure-LandingZone-Demo

Azure Data Landing Zone - IAC , Config, Code

venkatakamaiah46/Python

Interesting_programs_written_in_Python_language

ecaras/EmpowerID-Lab

This project showcase the following: 1. REST Connection to CHAT GPT 2. Logging system to Azure file system, storage app and insights. 3. Azure Data Factory Rest implementation using MS Graph client.

hannah0wang/end-to-end-data-reporting

End to end data reporting project using Azure services like Azure Data Factory for data orchestration, Azure Synapse Analytics for data warehousing, Databricks for data transformations, and Power BI for intuitive data visualization and reporting.

MekWiset/Medallion_DataLakehouse

Building a Data Lakehouse using the Medallion architecture.

micvet/data-eng-project-amazon

O objetivo deste projeto foi aplicar os conhecimentos nas ferramentas de extração e tratamento de dados da plataforma Azure.

nazish555/Tokyo-Olympics-Azure-Data-Engineering-Project

This project leverages Azure Cloud services like Azure Data Factory, Azure Databricks, and Synapse Analytics to execute a data engineering workflow. Utilizing data sourced from the Olympic API on GitHub, it involves extracting raw data into Azure Data Lake Storage, transforming it with PySpark on Azure Databricks, and analyzing the transformed data

SonuRepo/paris_olympic_azure_project

Explore the Paris Olympics data journey! We ingested a GitHub CSV into Azure via Data Factory, stored it in Data Lake Storage Gen2, performed transformations in Databricks, conducted analytics in Azure Synapse, and visualized insights in Synapse.

vasanthakumar70/AdventureWorksProject

This project demonstrates a data migration from SQL server On-premises to cloud Synapse using Azure Data Factory, Azure Data Lake Storage, and Azure Databricks to process and analyze sales data from the AdventureWorks database. The pipeline follows a medallion architecture to ensure data quality and provide valuable business insights

epomatti/az-e2e-data-eng-proj

Data engineering with Azure services

jugi92/add_servicebus_ips_for_shir_to_nsg

This script resolves the Azure Service Bus IP addresses used by an integration runtime and adds them to the network security group (NSG) rule for the Synapse / Data Factory self-hosted integration runtime (SHIR).

Kokit0/Tokyo-Olympics-Azure-Data-Eng-Project

Datas Engineer Exploration of the 2021 Tokyo Olympic data using a variety of tools and technologies, with a primary focus on Azure services, Leveraging Azure Data Factory, Data Lake Gen 2, Synapse Analytics, and Azure Databricks to perform data engineering tasks, analysis, and visualization.

sanogotech/modern-data-warehouse-dataops

DataOps for the Modern Data Warehouse on Microsoft Azure. https://aka.ms/mdw-dataops.