/wos-spark-manager-api

A Flask based application that facilitates IBM Watson OpenScale to read/write files from/to remote HDFS, run and get details about a job running in remote Spark cluster.

Primary LanguagePythonApache License 2.0Apache-2.0

Spark Manager API for IBM Watson OpenScale

A Python based Flask application that facilitates IBM Watson OpenScale to read/write files from/to remote HDFS, run and get details about a job running in remote Spark cluster.

Please refer to the wiki page for more details on setting up the Spark Manager API and using it.