Transfer learning or Append new training dataset
Closed this issue · 1 comments
mudasar477 commented
Is there a way that we perform transfer learning or save weights of 1 training and next time append these weights with new dataset.
I am facing issue while training large amount of data it gives me memory error.
Thanks in advance
srp98 commented
transfer learning is possible but the network structure for the saved weights in new model should be same.
When large amount of data, you would wanna make it into batches and feed into the network. If you are using pandas for reading data, change the formats of features to save memory and after performing some transformations convert it to feather format for faster reading of said files.