/progressive-neural-network

Progressive Neural Networks (PNNs) are a fundamental architecture-based continual learning concept that offer explicit support for transferring knowledge across incremental tasks, creating dedicated sub-networks for each task and enabling lateral knowledge transfer.

Primary LanguageJupyter Notebook

progressive-neural-network

Progressive Neural Networks (PNNs) are a fundamental architecture-based continual learning concept that offer explicit support for transferring knowledge across incremental tasks, creating dedicated sub-networks for each task and enabling lateral knowledge transfer.

Detailed algorithms can be found below:

ANN

Screenshot 2023-11-27 at 12 35 41 PM

PNN

Screenshot 2023-11-27 at 12 35 57 PM

FNN

Screenshot 2023-11-27 at 12 36 07 PM

REPEAT

The REPEAT continual learning algorithm is defined below:

Screenshot 2023-11-27 at 12 40 24 PM