insitro/redun

Task-specific code packaging

Opened this issue · 1 comments

Hey there redun team!

This one is a bit of a corner case. I would like to disable code packaging for a particular task in a pipeline, but keep it enabled for the rest. I think having a task option to disable code packaging would be the most natural way to do this. As it stands, I have to use two separate executors, one without code packaging and one with.

The use case- I'm using redun to orchestrate some end-to-end tests. In the tasks where I actually run the tests, I want it to use the exact code built into the image (so code packaging disabled). For the rest of the tasks that set up and process the test results, code packaging should still be fine and handy (so enabled).

Cheers,
Dan Spitz

Thanks @spitz-dan-l for sharing this use case. Creating two executors is the currently support way to do this. However, creating a new task-level option for code_packaging should not be hard to add support for.