/databricksStreaming

Notebooks for streaming jobs on Databricks and Azure

Primary LanguageJupyter Notebook

databricksStreaming

Notebooks for streaming jobs on Databricks and Azure

Prerequistes

  1. Azure Subscription
  2. Azure Resource Group
  3. Databricks workspace with a cluster running and notebook attached
  4. Azure Storage account with 2 container (one for raw JSON adn second for written Delta)

In the notebook

Change all the paths necessary to how you've structed your Azure storage accounts.

The key for the storage can be retreived from the the Azure Portal > YOUR STORAGE ACCOUNT > under Security + Netwroking > Access Keys > Copy Key 1