Query about trainable parameters initialization
Closed this issue · 3 comments
Thanks for your interesting work. As mentioned in the experimental settings of the paper, the trainable prompt learning parameters are initialized with xavier uniform initialization scheme. Where is the code that initializes the trainable parameters?
If you can reply my queries, I would appreciate it very much.
Thanks for your interesting work. As mentioned in the experimental settings of the paper, the trainable prompt learning parameters are initialized with xavier uniform initialization scheme. Where is the code that initializes the trainable parameters? If you can reply my queries, I would appreciate it very much.
Did you solve this problem, I had the same problem as you, I didn't find the setting in the code for the trainable parameter. Looking forward to hearing from you, thanks.
The function get_optimizer_scheduler located in lib/train/base_functions.py determines which parameters are trainable. Hope this helps.
It helps! Thanks for your reply. I hope you have a wonderful day!