Loss of Plasticity in Deep Continual Learning
This repository contains the implementation of three continual supervised learning problems. In our forthcoming paper Maintaining Plasticity in Deep Continual Learning, we show the loss of plasticity in deep learning in these problems.
A talk about this work can be found here, and the paper is available on arxiv.
Installation
virtualenv --python=/usr/bin/python3.8 loss-of-plasticity/
source loss-of-plasticity/bin/activate
cd loss-of-plasticity
pip3 install -r requirements.txt
pip3 install -e .Add these lines in your .zshrc
source PATH_TO_DIR/loss-of-plasticity/lop/bin/activate
export PYTHONPATH=$PATH:PATH_TO_DIR/lop