cylondata/twister2

Overwriting configuration parameters from command line

Opened this issue · 0 comments

When we submit Twister2 jobs, we should be able to overwrite configuration parameters from command line. Many similar systems support this with double dash characters. For example Spark supports it with "--conf" as follows:
bin/spark-submit
--master k8s://https://:6443
--deploy-mode cluster
--name spark-pi
--class org.apache.spark.examples.SparkPi
--conf spark.executor.instances=5
--conf spark.kubernetes.container.image=twister2/spark:latest
--conf spark.kubernetes.authenticate.driver.serviceAccountName=spark
local:/opt/spark/examples/jars/spark-examples_2.11-2.4.0.jar