/Measuring_Performance_of_Photon_on_Lakehouse

The real benefit of using Photon is when running longer jobs/queries on large dataset which is typically 10s millions of rows. This repository contains an implementation of the a Data Engineering exercise with/without Photon highlighting its advantage.

Primary LanguageJupyter Notebook

Measuring_Performance_of_Photon_on_Lakehouse

The real benefit of using Photon is when running longer jobs/queries on large dataset which is typically 10s millions of rows. This repository contains an implementation of the a Data Engineering exercise with/without Photon highlighting its advantage.