pcingola/BigDataScript

`task` executing on a cloud

Opened this issue · 0 comments

Improved task statement that can be executed on a cloud instance, cloud docker, etc.

  • Create a startup script for the instance

  • Create a queue (SQS) to listen to instance messages

  • Spin an instance

  • Startup script invokes bds to execute the commands

  • bds sends messages (SQS) with STDERR, STDOUT and exit code

  • At the end of the execution, the queue is deleted

  • How do we handle Ctrl-C in the parent process?