rebremer

adfv2_cdm_metadata

Azure Data Factory (ADFv2) copy pipeline adding metadata using Common Data Model (CDM) structure

azure-function-selenium

Azure Function running selenium webdriver using a custom docker image

azure-functions-datalake-recovery-pitr

Scalable point-in-time recovery solution for an ADLSgen2 account with hierarchical namespace enabled using Azure Durable Functions

azure-synapseserverless-python-rest-api

Creating a REST API with Python on Synapse Serverless pools using external tables

blog-adfv2unittest-git

Data Factory unit test using Azure DevOps. ARM is used to deploy ADFv2, BACPAC SQLDB to standardize input/output data and pytest to run tests

blog-datapipeline-cicd

Data pipeline project using Data Factory, Databricks and Cosmosdb Graph, deployed using Azure DevOps, secured using firewalls and Azure AD

blog-mlopsapim-git

devopsai_databricks

DevOps for AI project using Azure Databricks, Azure DevOps and Azure Machine Learning Service

expose-deltatable-via-restapi

ms-identity-python-webapp-backend

Python web app using delegated permissions from signed-in user or application permissions to authenticate to backend. Backend can be Azure Function or SQLDB.

rebremer/azure-function-selenium

Azure Function running selenium webdriver using a custom docker image

rebremer/azure-synapseserverless-python-rest-api

Creating a REST API with Python on Synapse Serverless pools using external tables

rebremer/ms-identity-python-webapp-backend

Python web app using delegated permissions from signed-in user or application permissions to authenticate to backend. Backend can be Azure Function or SQLDB.

rebremer/blog-datapipeline-cicd

Data pipeline project using Data Factory, Databricks and Cosmosdb Graph, deployed using Azure DevOps, secured using firewalls and Azure AD

rebremer/adfv2_cdm_metadata

Azure Data Factory (ADFv2) copy pipeline adding metadata using Common Data Model (CDM) structure

rebremer/blog-adfv2unittest-git

Data Factory unit test using Azure DevOps. ARM is used to deploy ADFv2, BACPAC SQLDB to standardize input/output data and pytest to run tests

rebremer/expose-deltatable-via-restapi

rebremer/realtime_video_processing

Realtime video processing project using IoT Hub, Azure Functions, Cognitive Services and Power BI

rebremer/azure-functions-datalake-recovery-pitr

Scalable point-in-time recovery solution for an ADLSgen2 account with hierarchical namespace enabled using Azure Durable Functions

rebremer/blog-snapshotbackup-azuredatalake

Datalake snapshots and incremental backups to different storage account

rebremer/databricks-mlflow-azureml-moe-vnet

Develop models in Databricks, use MLFlow to register models in AzureML with public access disabled, deploy models as private managed online endpoints

rebremer/data-factory-managed-identity-connection-aws-s3

Repository that uses ADF MI to connect to AWS S3 without need of storing credentials in key vault

rebremer/azure-miscellaneous-scripts

Miscellaneous scripts to get things done on azure

rebremer/blog-mlopsapim-git

rebremer/databricks_aad_token

Azure Databricks client script in Python using Service Principals

rebremer/managed_identity_authentication

Authentication from Azure Data Factory to Azure Function using Managed Identity

rebremer/adf-deltalake-ingestion-consumption

Git repo to ingest data to delta lake using ADF and consume data from delta lake using ADF, Synapse, Databricks

rebremer/ADF_Labs_rbr

rebremer/adfv2-parquet-sql

ADFv2 pipeline writing parquet file to SQL using staging table, stored procedure and event trigger

rebremer/azure-cli

Azure Command-Line Interface

rebremer/azure-cosmosdb-graph-bulkexecutor-spnX509

Cosmos DB graph bulk executor project that uses an SPN with .X509 certificate to authenticate to key vault to retrieve Cosmos DB keys. Project can be used to run bulk executor as custom activity in Azure Data Factory using Azure Batch.

rebremer/azure-data-factory-cicd-feature-release

Azure Data Factory project using utilities library to create ARM templates and feature releases

rebremer/azure-monitor-detect-exfiltration-databricks

Kusto script to detect data exfiltration from Databricks

rebremer/azure-private-link

Illustrates how to configure Azure Private Links to access resources through private networks

rebremer/azure-synapse_mask-data_format-preserved-encryption

Azure Synapse capability to mask PII data using format preserved encryption at scale

rebremer/data-factory-copy-skewed-data-lake

rebremer/demo30-ignitemdw-git

Extended git repo of MS Ignite demo 30 in track Modern Data Warehouse (MDW)

rebremer/msft-fabric-test

rebremer/securely-connect-synapse-to-azure-functions

Using Synapse data exfiltration prevention, private endpoints and Azure AD authentication

rebremer/test-synapse-git

Git repo in which my Synapse notebooks/scripts/pipelines are collected to "get your hands dirty"