Pinned Repositories
CDC-Debezium-Azure
Solution for capturing changes in SQL Server based on CDC, ingesting them to Azure Event Hub using Debezium CDC Connector and handling the data using Spark Structured Streaming in Azure Synapse Analytics. Project relies on Microsoft's sample WideWorldImporters SQL Server database instance.
CDC-Debezium-SchemaBuilder
Module for building schema for Spark Structured Streaming deserialization of inboud CDC Debezium streams based on provided datapoints
data-engineering-with-databricks
DocTools
Program for scanning supported document files in a given catalog (or in program's root catalog if no path provided) and supporting: providing OpenAI powered summary, extracting containing tables and file removing.
Pandas-Cookbook-Second-Edition
Pandas Cookbook Second Edition, published by Packt
vod-mdag-movie-ratings
Script used for scraping movie titles from VOD.MDAG.PL (https://vod.mdag.pl/pl/filmy) webpage and assigning to them basic details obtained from IMDb database using Cinemagoer package.
kknczny's Repositories
kknczny/CDC-Debezium-Azure
Solution for capturing changes in SQL Server based on CDC, ingesting them to Azure Event Hub using Debezium CDC Connector and handling the data using Spark Structured Streaming in Azure Synapse Analytics. Project relies on Microsoft's sample WideWorldImporters SQL Server database instance.
kknczny/DocTools
Program for scanning supported document files in a given catalog (or in program's root catalog if no path provided) and supporting: providing OpenAI powered summary, extracting containing tables and file removing.
kknczny/CDC-Debezium-SchemaBuilder
Module for building schema for Spark Structured Streaming deserialization of inboud CDC Debezium streams based on provided datapoints
kknczny/vod-mdag-movie-ratings
Script used for scraping movie titles from VOD.MDAG.PL (https://vod.mdag.pl/pl/filmy) webpage and assigning to them basic details obtained from IMDb database using Cinemagoer package.
kknczny/Pandas-Cookbook-Second-Edition
Pandas Cookbook Second Edition, published by Packt
kknczny/data-engineering-with-databricks