magrathj

Age-and-Gender-Recognition-App

Deploying Age and Gender Recognition Model to an Edge App

arduino_devops

Arduino github actions workflow to validate changes

Azure-Devops-Deploying-Web-Service-With-Load-Balancing

For this project, I have written a Packer template and a Terraform template to deploy a customizable, scalable web server in Azure.

bdd-pyspark

Simple demo using "behave" and "pyspark" libraries to test data transformations in a human-readable way

delta-migrations

Pyspark package to handle schema migrations in larger scale projects where incremental changes to tables are required.

Disaster-Response-NLP-Pipeline

Building a ML pipeline using the figure eight Corporate messaging dataset

event-driven-hackathon

using event driving architecture for geo-location based promotios

IoT-Edge-ML-App

Python Flask Dockerized App with Intels Openvino Inference Engine

NYC-Taxi-Analysis

Big data project to analyse 1.1 billion taxi trips in NYC and create a forecasting model

Pyspark-Docker-Image-With-Azure-Gen2-Connection

Building a docker image with Pyspark and Azure Gen2 storage connector so enable local testing your lake

magrathj/Pyspark-Docker-Image-With-Azure-Gen2-Connection

Building a docker image with Pyspark and Azure Gen2 storage connector so enable local testing your lake

magrathj/NYC-Taxi-Analysis

Big data project to analyse 1.1 billion taxi trips in NYC and create a forecasting model

magrathj/delta-migrations

Pyspark package to handle schema migrations in larger scale projects where incremental changes to tables are required.

magrathj/Disaster-Response-NLP-Pipeline

Building a ML pipeline using the figure eight Corporate messaging dataset

magrathj/arduino_devops

Arduino github actions workflow to validate changes

magrathj/arduino_iot_device

arduino uno with GPS and Bluetooth

magrathj/event-driven-hackathon

using event driving architecture for geo-location based promotios

magrathj/automated-gcp-databricks-deployments

Automated deployments with Databricks GCP

magrathj/Azure-Container-MLFlow-Model-Registry

Project looks to create a stand-alone MLflow model registry which sits on its own Azure Container Registry, using an image, connected to a blob storage (artifact store) and internal sqlite db (registry store).

magrathj/Azure-Devops-ML-Flask-WebApp

Machine learning web app with CI/CD component using agile framework to build out the project.

magrathj/Azure-Devops-Terraform-CI-CD-App-Service

Building out an Azure CI/CD pipeline to create disposable test environments and run automated tests on a published Web App

magrathj/Azure-FlaskWebApp

Deploy An Article CMS To Azure

magrathj/azure-web-form

magrathj/Data-Integration-Pipelines-for-NYC-Payroll-Data-Analytics

The City of New York would like to develop a Data Analytics platform

magrathj/Data-Modeling-with-Cassandra

Create a build and load process for a single VM with Cassandra

magrathj/Data-Modeling-with-Postgres

Create a build and load process for a single VM with Postgres

magrathj/Data-Science-Challenge

This challenge looks at using linux, docker, postgres and python to analyse interesting trends in transcational banking data.

magrathj/databricks-dbt-gcp

Using dbt on GCP Databricks

magrathj/DataOps

Example code for doing DataOps

magrathj/dbt-snowflake

dbt snowflake set up demo

magrathj/delta-live-tables-poc

PoC to test out Delta Live Tables with CI/CD pipeline deployments

magrathj/delta-migrations-template

magrathj/Deploying-Databricks-Notebooks-CI-CD

Using docker to deploy packages and notebooks using docker to an Azure Databricks workspace

magrathj/fire

Framework to provide schemas and constraints for Delta Live Table code

magrathj/Github-Network-Analysis-Web-App

Python app that uses oauth to query github api and returns a network graph of the users repos

magrathj/migrate

Scripts to help customers with one-off migrations between Databricks workspaces.

magrathj/snowflake-warehouse

Snowflake warehouse which uses weather and restaurants (YELP) datasets

magrathj/snowflake_ci_cd

magrathj/strava_app

Web app to display strava user data

magrathj/Synapse-Warehouse

Example of Synapse data warehouse which pulls data from Azure SQL DB