OptimalScale/LMFlow

Specific methods about lisa

Opened this issue · 1 comments

Excuse me, I want to know what layers Lisa is frozen in and his freezing strategy. Which file code should I look at?

Thanks for your interest in LMFlow and LISA! LISA is fronze in a sampling fashion, i.e. randomly. You may check the [paper] (https://arxiv.org/abs/2403.17919) and code here. Hope this information can be helpful 😄