This repository contains the code for the ECML-PKDD 2020 Paper Continual Learning with Knowledge Transfer for Sentiment Classification by Zixuan Ke, Bing Liu, Hao Wang and Lei Shu.
[11/2021] KAN has been intergrated into PyContinual. Check it out! [11/2020] Interested in Lifelong Learning/Continual Learning? Check our latest NeurIPS 2020 paper Continual Learning of a Mixed Sequence of Similar and Dissimilar Tasks and the code
This paper studies continual learning (CL) for sentiment classification (SC). In this setting, the CL system learns a sequence of SC tasks incrementally in a neural network, where each task builds a classifier to classify the sentiment of reviews of a particular product category or domain. Two natural questions are: Can the system transfer the knowledge learned in the past from the previous tasks to the new task to help it learn a better model for the new task? And, can old models for previous tasks be improved in the process as well? This paper proposes a novel technique called KAN to achieve these objectives. KAN can markedly improve the SC accuracy of both the new task and the old tasks via forward and backward knowledge transfer. The effectiveness of KAN is demonstrated through extensive experiments
/res: all results saved in this folder
/dat: processed toy dataset
/dataloader: contained dataloader for the toy dataset
/reference: additional code for baselines (specifically SRK and OWM)
/approaches: code for training
/networks: code for network architecture
run_train_[network]_[approach_specification]_[approach].sh
[network]: lstm/gru
[approch_specification]: optional, e.g. hat
[approah]: ncl/one/mtl/
[more options please refere to .sh files, run.py and config.py]
run_train_bert_gru_kan_ncl.sh #Run KAN with GRU backbone
The asc (aspect-level sentiment classification), ae (aspect extraction) and dsc (document-level sentiment classification) datasets are given in ./dat.
If using this code, parts of it, or developments from it, please cite the reference bellow.
@inproceedings{ke2020continual,
author= {Zixuan Ke and Bing Liu and Hao Wang and Lei Shu},
title= {Continual Learning with Knowledge Transfer for Sentiment Classification},
booktitle = {ECML-PKDD},
year = {2020}}
Please drop an email to Zixuan Ke if you have any questions.