NHSX AU-Data Engineering - Azure Databricks Analytics

Azure Databricks Analytics

NHSX Analytics Unit - Data Engineering Team
Explore the docs »

Report Bug · Request Feature

About The Project
- Built With
Getting Started
- Installation
Usage
Roadmap
Contributing
License
Contact

About The Project

NHSX Analytics Unit - Data Engineering Team. Databricks analytics repository. Contains ETL pipeline notebooks for NHSX analytics projects.

Note: No data, public or private are shared in this repository.

Folder Stucture

Name	Link	Description
Orchestrator Notebooks	[Link]	Azure Data Factory notebooks for running ephemeral job clusters
Function Notebooks	[Link]	Helper functions used across all notebooks
Analytics Notebooks	[Link]	Analytical pipeline specific code
Ingestion Notebooks	[Link]	Data ingestion pipeline specific code
Debug Notebooks	[Link]	For testing new code and reference

Built With

Getting Started

To get a local copy up and running follow these simple steps.

Installation

Clone the repo

git clone https://github.com/nhsx/au-azure-databricks.git

Link to Azure Databricks, see databricks documentation

Usage

Please refer to our Read the Docs site

Roadmap

See the open issues for a list of proposed features (and known issues).

Contributing

Contributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.

Fork the Project
Create your Feature Branch (git checkout -b feature/AmazingFeature)
Commit your Changes (git commit -m 'Add some AmazingFeature')
Push to the Branch (git push origin feature/AmazingFeature)
Open a Pull Request

See CONTRIBUTING.md for detailed guidance.

License

Distributed under the MIT License. See LICENSE.md for more information.

About

Project contact email: nhsx.data@england.nhs.uk

To find out more about the Analytics Unit visit our project website or get in touch at england.tdau@nhs.net

nhsx/au-azure-databricks-cicd