allenai/bilm-tf

how to freeze some layers during training

renukachittimalla opened this issue · 1 comments

I am trying to train ELMO on small dataset and want to freeze all the top layers i.e., cnn,highway network layers and 1st LSTM. I am using restart.py to retrain and i don't have a clue how to freeze these layers. Can you please help me . Thanks

To freeze a layer is to fix the weights. This can be done with trainable=False when setting a variable. It`s a clue.