/Elastic-Weights-Consolidation

Pytorch implementations of Elastic Weight Consolidation (EWC)

Primary LanguagePythonMIT LicenseMIT

EWC

Pytorch implementations of Elastic Weights Consolidation (EWC) and "Online" EWC.

Usage (Linux Platform)

1. Install Visdom

pip install visdom

2. Run Visdom

Enter 'visdom' in the command line

3. Run main.py

Without EWC

python main.py

EWC

python main.py --consolidate

"Online" EWC

python main.py --consolidate --online

Results

Online EWC

Performance

image

Loss

image

Reference

https://github.com/kuc2477/pytorch-ewc

https://github.com/ruinanzhang/Rotated_MNIST_Continual_Learning

DeepMind's paper Overcoming Catastrophic Forgetting, PNAS 2017.