Hi, may I ask a question about DDP?
I notice that you use model.model.module
to get access some customized attributes like get_embedding()
. Nevertheless, as far as I know, the right way ought to be model.module
.
Interestingly, model.model.module
works well in your original version.