grid wrapper for notebooks
blumenstiel opened this issue · 2 comments
blumenstiel commented
Grid wrapper for notebook is not working. The code imports the converted notebook. Therefore, every code in the notebook is executed.
romeokienzler commented
@blumenstiel I think there is a solution
The grid wrapper can call the notebook in the following way
os.environ["source_folder"] = '/data/provided/by/gridwrapper/'
os.environ["target_folder"] = '/data/read/by/gridwrapper'
os.system('ipython wrapped_operator.ipynb')
This way, wrapped_operator.ipynb doesn't even have to know anything of it running in a grid computing context
blumenstiel commented
This assumes that the notebook follows a specific notation. Another solution could be that each wrapped notebook needs a batch
(str) env input and needs to adjust the other variables based on this input.