astronomer/astro-provider-ray

Ability to run specific Ray jobs on specific nodes

Opened this issue · 0 comments

This feature may already be possible using two method --

  1. Labelling the node group while spinning up the K8 clyster and using the resources dictionary input parameter in the SubmitRayJob operator
  2. Using placement groups in Ray

We need to research and try out both