abhishekkrthakur/tez

how to use multi gpu

zhangatao opened this issue · 6 comments

zhangatao commented

Hello, how to specify multiple GPUs during model fit?

ingbeeedd commented

method???

abhishekkrthakur commented

ill add multi gpu support this week

  • 👍2
Syavaprd commented

ill add multi gpu support this week

Hello, did you add it?

Caizifen commented

ill add multi gpu support this week

@abhishekkrthakur Have you finished it? I think it is very useful and necessary to train with multiple GPUs.

i-mein commented

ill add multi gpu support this week

@abhishekkrthakur any progress on that?
or maybe some advice where we ned to modify to use nn.dataparallel()

abhishekkrthakur commented

its not as straight forward as i thought it was. anyways, the changes will require major api changes. thus, its better to do a new release with brand new api