Assistance Request for Creating 'all_sequences_esm1b_ts_mean.pt
Closed this issue · 1 comments
Dear Authors
I hope that you are doing well.
I have calculated ESM1b_ts
and ESM1b
vectors . in next setp I want to create all_sequences_esm1b_ts_mean.pt
, However, I am uncertain about the steps involved in this process.
Could you kindly provide guidance on how to proceed with this task?
Your assistance is greatly appreciated.
Best regards,
Vahid
Dear Vahid,
I uploaded the python file "training_ESM1b_taskspecific_mean.py" to the folder "notebooks_and_code". It can be executed in the same way as the "training_ESM1b_taskspecific.py" to train the task-specific ESM-1b model. Does this answer your question?
Please note that the model ts_mean model is not very important for the overall process as it results in comparable but slightly worse results compared to the ESM-1b_ts model with classification token.
Best,
Alex