Specific methods about lisa
Opened this issue · 1 comments
orderer0001 commented
Excuse me, I want to know what layers Lisa is frozen in and his freezing strategy. Which file code should I look at?
research4pan commented
Thanks for your interest in LMFlow and LISA! LISA is fronze in a sampling fashion, i.e. randomly. You may check the [paper] (https://arxiv.org/abs/2403.17919) and code here. Hope this information can be helpful 😄