commoncrawl/cc-pyspark

Avoid to set Spark configuration properties in code

sebastian-nagel opened this issue · 0 comments

Cf. the discussion in #10

In sparkcc.py Spark configuration props are set explicitly in the code which makes it impossible to set them from outside. Remove these settings or implement setting the properties in a configurable way if necessary.