datafold/data-diff

Will Spark be supported?

metasavvy opened this issue · 1 comments

Currently, data diff cannot use Spark. Most of my usage scenarios still use Hadoop storage and Spark engine. Will Spark be supported?

@metasavvy could you share a bit more about the Spark setup? E.g. AWS EMR / Databricks / Cloudera etc.