AbsaOSS/pramen

Add a Spark Catalog Source that takes data from spark.table()

Closed this issue · 0 comments

Background

This can be helpful if input data is already in the Spark Catalog. This can significantly improve the performance of ingestion when used instead of Hive.

Feature

Add a Spark Catalog Source that takes data from spark.table().