How to use accelerate to multi gpu train and encode?

Question

WanBenLe opened this issue 7 months ago · 2 comments

It seems to be will rasie error..

Answer 1 · 2024-02-08T07:53:30.000Z

File "/AnglE-main/angle_emb/angle.py", line 459, in call
input_ids = feature['input_ids']
KeyError: 'input_ids'

Answer 2 · 2024-02-14T12:31:07.000Z

hi @WanBenLe , sorry for the delay. I tested training using multiGPU, it works fine.

Could you enclose your training script here? So that I can reproduce your issue.