iterative/dvc

experiments: submit to studio

dberenbaum opened this issue · 0 comments

Similar to #9641, studio now has the ability to run experiments. DVC should be able to submit experiments to studio as long as the studio token is set.

This can be invoked in the CLI like this:

$ dvc queue start --task studio_task_id

See here for a demo of how to register a task in studio. The above command should:

  • Create a special ref for each queued experiment (this will create an additional commit for each experiment)
  • For each experiment, push the ref to the git remote and the dvc-tracked data to the dvc remote
  • Call Studio API and provide the refs and the task ID
  • Mark each queued experiment as submitted to studio

This should provide everything studio needs to run the experiment using the provided task ID.