claimed-framework/c3

grid wrapper for notebooks

blumenstiel opened this issue · 2 comments

Grid wrapper for notebook is not working. The code imports the converted notebook. Therefore, every code in the notebook is executed.

@blumenstiel I think there is a solution

The grid wrapper can call the notebook in the following way

os.environ["source_folder"] = '/data/provided/by/gridwrapper/'
os.environ["target_folder"] = '/data/read/by/gridwrapper'
os.system('ipython wrapped_operator.ipynb')

This way, wrapped_operator.ipynb doesn't even have to know anything of it running in a grid computing context

This assumes that the notebook follows a specific notation. Another solution could be that each wrapped notebook needs a batch (str) env input and needs to adjust the other variables based on this input.