/pna

Implementation of Principal Neighbourhood Aggregation for Graph Neural Networks in PyTorch, DGL and PyTorch Geometric

Primary LanguagePythonMIT LicenseMIT

Principal Neighbourhood Aggregation

Implementation of Principal Neighbourhood Aggregation for Graph Nets arxiv.org/abs/2004.05718 in PyTorch, DGL and PyTorch Geometric.

symbol

Overview

We provide the implementation of the Principal Neighbourhood Aggregation (PNA) in PyTorch, DGL and PyTorch Geometric frameworks, along with scripts to generate and run the multitask benchmarks, scripts for running real-world benchmarks, a flexible PyTorch GNN framework and implementations of the other models used for comparison. The repository is organised as follows:

  • models contains:
    • pytorch contains the various GNN models implemented in PyTorch:
      • the implementation of the aggregators, the scalers and the PNA layer (pna)
      • the flexible GNN framework that can be used with any type of graph convolutions (gnn_framework.py)
      • implementations of the other GNN models used for comparison in the paper, namely GCN, GAT, GIN and MPNN
    • dgl contains the PNA model implemented via the DGL library: aggregators, scalers, and layer.
    • pytorch_geometric contains the PNA model implemented via the PyTorch Geometric library: aggregators, scalers, and layer.
    • layers.py contains general NN layers used by the various models
  • multi_task contains various scripts to recreate the multi_task benchmark along with the files used to train the various models. In multi_task/README.md we detail the instructions for the generation and training hyperparameters tuned.
  • real_world contains various scripts from Benchmarking GNNs to download the real-world benchmarks and train the PNA on them. In real_world/README.md we provide instructions for the generation and training hyperparameters tuned.

results

Reference

@article{corso2020principal,
  title={Principal Neighbourhood Aggregation for Graph Nets},
  author={Corso, Gabriele and Cavalleri, Luca and Beaini, Dominique and Li{\`o}, Pietro and Veli{\v{c}}kovi{\'c}, Petar},
  journal={arXiv preprint arXiv:2004.05718},
  year={2020}
}

License

MIT

Acknowledgements

The authors would like to thank Saro Passaro for running some of the tests presented in this repository and Giorgos Bouritsas, Fabrizio Frasca, Leonardo Cotta, Zhanghao Wu and Zhanqiu Zhang for pointing out some issues with the code.