A library for launching python programs on different machines. Currently supports running locally and over EC2 and SSH (via Docker) with minimal (if any) modification to your existing program.
EC2 code is based on rllab's code.
- Add this repo to your pythonpath.
export PYTHONPATH=$PYTHONPATH:/path/to/this/repo
- Install dependencies
pip install -r requirements.txt
- (Optional) Set up EC2
python scripts/ec2_setup.py
- (Optional) Set up Docker. This is required on the target machine if running in a Docker-enabled mode.
See ec2_launch_test.py for an example on how to run scripts on EC2, over SSH, or locally.
See the wiki
- Add support for automatic experiment restarting (will require the user to write a save_state and restore_state function, or use something like CRIU)
- Fix output directories when using docker showing up as root permissions.