`PreTrainedModel` will NOT inherit from `GenerationMixin`, and this model will lose the ability to call `generate`.
Closed this issue · 1 comments
I got prompted with the following warning when I was trying to train the child model for relational generation, and the training process got killed. Could you please let me know how to solve this issue? Thank you!
EncoderDecoderModel has generative capabilities, as prepare_inputs_for_generation
is explicitly overwritten. However, it doesn't directly inherit from GenerationMixin
. From 👉v4.50👈 onwards, PreTrainedModel
will NOT inherit from GenerationMixin
, and this model will lose the ability to call generate
and other related functions.
-
If you're using
trust_remote_code=True
, you can get rid of this warning by loading the model with an auto class. See https://huggingface.co/docs/transformers/en/model_doc/auto#auto-classes -
If you are the owner of the model architecture code, please modify your model class such that it inherits from
GenerationMixin
(afterPreTrainedModel
, otherwise you'll get an exception). -
If you are not the owner of the model architecture class, please contact the model code owner to update it.
Killed
I found that this warning did not cause any issues. The reason that the training was killed was due to CUDA OOM.