The codebase creates an end-to-end ADF to databricks pipeline with fully integrated logging.
Terraform
ARM
DataFactory
Application Insights
Log Analytics
terraform plan -var-file="../secret.tfvars" -out=plan.tfplan
terraform apply plan.tfplan
Not included secrets.tfvars
- you need to supply your own.## Requirements
Name | Version |
---|---|
azurerm | 3.30.0 |
databricks | 1.6.2 |
external | 2.2.2 |
local | 2.2.3 |
random | 3.4.3 |
template | 2.2.0 |
Name | Version |
---|---|
azurerm | 3.30.0 |
databricks | 1.6.2 |
local | 2.2.3 |
random | 3.4.3 |
template | 2.2.0 |
Name | Source | Version |
---|---|---|
core_logging | ./core_logging | n/a |
data_storage_external | ./module_storage | n/a |
data_storage_internal | ./module_storage | n/a |
databricks_logging | ./databricks_logging | n/a |
Name | Description | Type | Default | Required |
---|---|---|---|---|
client_id | n/a | string |
"Invalid" |
no |
client_secret | n/a | string |
"Invalid" |
no |
instance | n/a | number |
3 |
no |
location | Common resource group to target | string |
"centralus" |
no |
log_retention_days | n/a | number |
30 |
no |
prefix | n/a | string |
"demo" |
no |
subscription_id | n/a | string |
"Invalid" |
no |
suffix | n/a | string |
"logging" |
no |
tenant_id | n/a | string |
"Invalid" |
no |
No outputs.