Neural Citation Network

PyTorch reimplementation of the neural citation network.

Author's source code:
https://github.com/tebesu/NeuralCitationNetwork.

Travis Ebesu, Yi Fang. Neural Citation Network for Context-Aware Citation Recommendation. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2017. PDF

Requirements

The neural_citation.yml file contains a list of packages used to implement this model. Of particular importance are:

python==3.7.3
pytorch==1.1.0
torchtext==0.3.1
tensorboard==1.14.0
spacy==2.1.6
gensim==3.8.0
nltk==3.4.4
pandas==0.25.0
tqdm==4.32.2

For training the model it is recommended to use the GPU version of Pytorch instead.

Getting started

Install dependencies and clone the repo. The training notebook contains a training template. The evaluation notebook shows an example of how model evaluations can be run. Note that both training and evaluation functions are optimized for use in notebooks as they use tqdm_notebook progress bars. When running these functions from a script this needs to be changed.

spaCy can't find the language model

If you can't fetch the language model with

python -m spacy download en_core_web_sm

please try to download and install the model via pip. This has worked for me when reproducing the environment.

pip install https://github.com/explosion/spacy-models/releases/download/en_core_web_lg-2.1.0/en_core_web_lg-2.1.0.tar.gz --no-deps

Project structure:

.
├── assets  # experiments in the EACL paper
|   ├── various images # used for the NCN presentation
│   ├── title_to_aut_cited # pickled dictionary: tokenized title -> cited authors
│   └── title_tokenized_to_full # pickled dictionary: tokenized titles -> full cited paper titles
│      
├── docs    # documentation for the ncn modules
|    └── ncn # doc folder for the module
│       └── xxx.html # doc html files
|
├── ncn    # main folder containing the NCN implementation
│   ├── core # contains core data types and constants
│   ├── data # preprocessing pipeline for the dataset
│   ├── evaluation # evaluator class for evaluation and inference
│   ├── model # Neural Citation Network pytorch model
│   └── training # low level pytorch training loops
|
├── runs    # Example tensorboard training log 
│   └── log folders # Folders containing a training run's logs
|       └── train logs # tensorboard log files
|
├── README.md     # This file
├── NCN_evaluation.ipynb # notebook for performing evaluation tasks
├── NCN_presentation.ipynb # presentation given about project, contains small inference demo
├── NCN_training.ipynb # training containing the high level training script
├── generate_dicts.ipynb # notebook to generate title_to_aut_cited and title_tokenized_to_full dicts for inference
└── neural_citation.yml # CPU conda environment

Data

The preprocessed dataset can be found here: https://drive.google.com/open?id=1qwBIXBsWp0ODrm91pVgBOwelJ5baGr-9.
Statistics about the dataset can be found in the NCN_presentation.ipynb file.

Weights

The model trained with the original settings by Ebesu and Fang can be found here: https://drive.google.com/open?id=1mT7kUb415wy0i1raXTPMcrXcWSgRC2pk.

The model trained with our best configuration can be found here: https://drive.google.com/open?id=1xhupsNpSzDSS3_C-IJpMAPnts3kXdg-5.

Results

Link to the workshop paper: https://www.aifb.kit.edu/images/8/82/CiteRec_Repro_BIR2020.pdf.

Use this work

Feel free to use our source code and results.

@inproceedings{FaerberKleinSigloch2020_1000119469,
    author       = {Färber, M. and Klein, T. and Sigloch, J.},
    year         = {2020},
    title        = {Neural citation recommendation: A reproducibility study},
    pages        = {66-74},
    eventtitle   = {10th International Workshop on Bibliometric-enhanced Information Retrieval},
    eventtitleaddon = {2020},
    eventdate    = {2020-04-14/},
    venue        = {Lissabon, Portugal},
    booktitle    = {Bibliometric-enhanced Information Retrieval : Proceedings of the 10th International Workshop
co-located with 42nd European Conference on Information Retrieval (ECIR 2020), Lisbon, Portugal (online only), April 14th, 2020. Ed.: G. Cabanac},
    publisher    = {{CEUR-WS}},
    issn         = {1613-0073},
    series       = {CEUR Workshop Proceedings},
    url          = {http://ceur-ws.org/Vol-2591/paper-07.pdf},
    language     = {english},
    volume       = {2591}
}

timoklein/neural_citation