mit-han-lab/inter-operator-scheduler

What should I do if I want to run IOS system on a specific gpu?

Closed this issue · 2 comments

Hi,

If I want to run IOS system on my server, which has more than one GPUs and I would like to specify a gpu for it, what should I do? :)

Hi @KAIWEILIUCC,

You can try setting the CUDA_VISIBLE_DEVICES envrioment variable. See here.

Thank you!