TypeError: prepare_model_for_kbit_training() got an unexpected keyword argument 'output_embedding_layer_name'
ILG2021 opened this issue · 4 comments
ILG2021 commented
maybe prepare_model_for_8bit_training is deprecated.
nrshoudi commented
Hey
I faced the same issue.
Did you find any solution?
ILG2021 commented
Hey I faced the same issue. Did you find any solution?
prepare_model_for_kbit_training is the new function.
bastiansurya77 commented
Did it had solution to it?, I also face the same problems
QvQKing commented
from peft import prepare_model_for_int8_training, prepare_model_for_kbit_training
#model = prepare_model_for_int8_training(model, output_embedding_layer_name="proj_out")
model = prepare_model_for_kbit_training(model)
Using the new function prepare_model_for_kbit_training(model) can solve this problem.