TECHNEWBI5Z

Pinned Repositories

• Databricks_Lending_Club_Project

  Lending_Club_Project a publicly accessible datasets. developer notebook configured for client mode. and, as well as you can go through python script for spark job.

  Language:Jupyter Notebook20

• Azure_end_to_end_project

  Language:Jupyter Notebook10

• delta_architechtechture

  Construction of delta architecture using community edition databricks

  Language:Jupyter Notebook10

• TECHNEWBI5Z

  Config files for my GitHub profile.

  10

• Accenture_DA_Job_Stimulation_Project

  a San Francisco-based platform founded in 2010, focuses on user anonymity and diverse content reactions. With over 500 million monthly users, they seek advisory support for their upcoming IPO. The engagement will include a big data audit, IPO recommendations, and content analysis, with tasks like stress testing technology and documenting practices.

  00

• Augmented-analysis-using-R

  The R script is designed to analyse the agricultural parameters through Augmented designed experiments

  Language:R00

• autoloader

  spark structured streaming using autoloader utility file listing from AWS s3 bucket

  Language:Jupyter Notebook00

• Automated_Tier_Transitions_of-DataLake_Container

  00

• dynamic_processing

  In order to smooth flow of ETL pipeline in databricks in a cloud platform. Dynamic processing of activities are very necessary. branch out the repo for more.

  Language:Jupyter Notebook00

• Incremental_And_Batch_Load

  This pipeline extracts data from MS SQL Server 2022 and REST APIs using Azure Data Factory, storing it in Azure SQL Server. Data is then processed in Databricks using two notebooks: one for full data loads and another for incremental updates, with the final data stored in Databricks Delta Tables.

  Language:Jupyter Notebook00

TECHNEWBI5Z's Repositories