How to freeze bert layers?

Question

How to freeze bert layers?

Closed this issue 4 years ago · 2 comments

heretree commented 4 years ago

I am using this repo on my Bert project and I hope to freeze some layers of Bert. May I know how to do it?
Thanks!

Answer 1 · 2021-03-09T15:33:47.000Z

I am using this repo on my Bert project and I hope to freeze some layers of Bert. May I know how to do it?
Thanks!

This might help you :)
REF: google-research/bert#637

Answer 2 · 2021-06-07T14:14:55.000Z

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.