/NRLPapers

Must-read papers on network representation learning (NRL) / network embedding (NE)

Primary LanguageTeX

Must-read papers on NRL/NE.

NRL: network representation learning. NE: network embedding.

Contributed by Cunchao Tu, Yuan Yao and Zhengyan Zhang.

We release OpenNE, an open source toolkit for NE/NRL. This repository provides a standard NE/NRL(Network Representation Learning）training and testing framework. Currently, the implemented models in OpenNE include DeepWalk, LINE, node2vec, GraRep, TADW and GCN.

Survey papers:

  1. Representation Learning on Graphs: Methods and Applications. William L. Hamilton, Rex Ying, Jure Leskovec. 2017. paper

  2. Graph Embedding Techniques, Applications, and Performance: A Survey. Palash Goyal, Emilio Ferrara. 2017. paper

  3. A Comprehensive Survey of Graph Embedding: Problems, Techniques and Applications. Hongyun Cai, Vincent W. Zheng, Kevin Chen-Chuan Chang. 2017. paper

  4. Network Representation Learning: A Survey. Daokun Zhang, Jie Yin, Xingquan Zhu, Chengqi Zhang. 2018. paper

  5. A Tutorial on Network Embeddings. Haochen Chen, Bryan Perozzi, Rami Al-Rfou, Steven Skiena. 2018. paper

  6. Network Representation Learning: An Overview.(In Chinese) Cunchao Tu, Cheng Yang, Zhiyuan Liu, Maosong Sun. 2017. paper

  7. Relational inductive biases, deep learning, and graph networks. Peter W. Battaglia, Jessica B. Hamrick, Victor Bapst, Alvaro Sanchez-Gonzalez, Vinicius Zambaldi, Mateusz Malinowski, Andrea Tacchetti, David Raposo, Adam Santoro, Ryan Faulkner, Caglar Gulcehre, Francis Song, Andrew Ballard, Justin Gilmer, George Dahl, Ashish Vaswani, Kelsey Allen, Charles Nash, Victoria Langston, Chris Dyer, Nicolas Heess, Daan Wierstra, Pushmeet Kohli, Matt Botvinick, Oriol Vinyals, Yujia Li, Razvan Pascanu. 2018. paper

Journal and Conference papers:

  1. DeepWalk: Online Learning of Social Representations. Bryan Perozzi, Rami Al-Rfou, Steven Skiena. KDD 2014. paper code

  2. Learning Latent Representations of Nodes for Classifying in Heterogeneous Social Networks. Yann Jacob, Ludovic Denoyer, Patrick Gallinar. WSDM 2014. paper

  3. Non-transitive Hashing with Latent Similarity Componets. Mingdong Ou, Peng Cui, Fei Wang, Jun Wang, Wenwu Zhu. KDD 2015. paper

  4. GraRep: Learning Graph Representations with Global Structural Information. Shaosheng Cao, Wei Lu, Qiongkai Xu. CIKM 2015. paper code

  5. LINE: Large-scale Information Network Embedding. Jian Tang, Meng Qu, Mingzhe Wang, Ming Zhang, Jun Yan, Qiaozhu Me. WWW 2015. paper code

  6. Network Representation Learning with Rich Text Information. Cheng Yang, Zhiyuan Liu, Deli Zhao, Maosong Sun, Edward Y. Chang. IJCAI 2015. paper code

  7. PTE: Predictive Text Embedding through Large-scale Heterogeneous Text Networks. Jian Tang, Meng Qu, Qiaozhu Mei. KDD 2015. paper code

  8. Heterogeneous Network Embedding via Deep Architectures. Shiyu Chang, Wei Han, Jiliang Tang, Guo-Jun Qi, Charu C. Aggarwal, Thomas S. Huang. KDD 2015. paper

  9. Deep Neural Networks for Learning Graph Representations. Shaosheng Cao, Wei Lu, Xiongkai Xu. AAAI 2016. paper code

  10. Asymmetric Transitivity Preserving Graph Embedding. Mingdong Ou, Peng Cui, Jian Pei, Ziwei Zhang, Wenwu Zhu. KDD 2016. paper

  11. Revisiting Semi-supervised Learning with Graph Embeddings. Zhilin Yang, William W. Cohen, Ruslan Salakhutdinov. ICML 2016. paper

  12. node2vec: Scalable Feature Learning for Networks. Aditya Grover, Jure Leskovec. KDD 2016. paper code

  13. Max-Margin DeepWalk: Discriminative Learning of Network Representation. Cunchao Tu, Weicheng Zhang, Zhiyuan Liu, Maosong Sun. IJCAI 2016. paper code

  14. Tri-Party Deep Network Representation. Shirui Pan, Jia Wu, Xingquan Zhu, Chengqi Zhang, Yang Wang. IJCAI 2016. paper

  15. Discriminative Deep RandomWalk for Network Classification. Juzheng Li, Jun Zhu, Bo Zhang. ACL 2016. paper

  16. Structural Deep Network Embedding. Daixin Wang, Peng Cui, Wenwu Zhu. KDD 2016. paper

  17. Structural Neighborhood Based Classification of Nodes in a Network. Sharad Nandanwar, M. N. Murty. KDD 2016. paper

  18. Community Preserving Network Embedding. Xiao Wang, Peng Cui, Jing Wang, Jian Pei, Wenwu Zhu, Shiqiang Yang. AAAI 2017. paper

  19. Semi-supervised Classification with Graph Convolutional Networks. Thomas N. Kipf, Max Welling. ICLR 2017. paper code

  20. CANE: Context-Aware Network Embedding for Relation Modeling. Cunchao Tu, Han Liu, Zhiyuan Liu, Maosong Sun. ACL 2017. paper code

  21. Fast Network Embedding Enhancement via High Order Proximity Approximation. Cheng Yang, Maosong Sun, Zhiyuan Liu, Cunchao Tu. IJCAI 2017. paper code

  22. TransNet: Translation-Based Network Representation Learning for Social Relation Extraction. Cunchao Tu, Zhengyan Zhang, Zhiyuan Liu, Maosong Sun. IJCAI 2017. paper code

  23. metapath2vec: Scalable Representation Learning for Heterogeneous Networks. Yuxiao Dong, Nitesh V. Chawla, Ananthram Swami. KDD 2017. paper code

  24. Learning from Labeled and Unlabeled Vertices in Networks. Wei Ye, Linfei Zhou, Dominik Mautz, Claudia Plant, Christian Böhm. KDD 2017. paper

  25. Unsupervised Feature Selection in Signed Social Networks. Kewei Cheng, Jundong Li, Huan Liu. KDD 2017. paper

  26. struc2vec: Learning Node Representations from Structural Identity. Leonardo F. R. Ribeiro, Pedro H. P. Saverese, Daniel R. Figueiredo. KDD 2017. paper code

  27. Label Informed Attributed Network Embedding. Xiao Huang, Jundong Li, Xia Hu. WSDM 2017. paper code

  28. Accelerated Attributed Network Embedding. Xiao Huang, Jundong Li, Xia Hu. SDM 2017. paper code

  29. Inductive Representation Learning on Large Graphs. William L. Hamilton, Rex Ying, Jure Leskovec. NIPS 2017. paper code

  30. Variation Autoencoder Based Network Representation Learning for Classification. Hang Li, Haozheng Wang, Zhenglu Yang, Masato Odagaki. ACL 2017. paper

  31. Preserving Proximity and Global Ranking for Node Embedding. Yi-An Lai, Chin-Chi Hsu, Wenhao Chen, Mi-Yen Yeh, Shou-De Lin. NIPS 2017.

  32. Learning Graph Embeddings with Embedding Propagation. Alberto Garcia Duran, Mathias Niepert. NIPS 2017. paper

  33. Name Disambiguation in Anonymized Graphs using Network Embedding. Baichuan Zhang, Mohammad Al Hasan. CIKM 2017. paper

  34. Enhancing the Network Embedding Quality with Structural Similarity. Tianshu Lyu, Yuan Zhang, Yan Zhang. CIKM 2017. paper

  35. Attributed Signed Network Embedding. Suhang Wang, Charu Aggarwal, Jiliang Tang, Huan Liu. CIKM 2017. paper

  36. Attributed Network Embedding for Learning in a Dynamic Environment. Jundong Li, Harsh Dani, Xia Hu, Jiliang Tang, Yi Chang, Huan Liu. CIKM 2017. paper

  37. HIN2Vec: Explore Meta-paths in Heterogeneous Information Networks for Representation Learning. Tao-yang Fu, Wang-Chien Lee, Zhen Lei. CIKM 2017. paper code

  38. From Properties to Links: Deep Network Embedding on Incomplete Graphs. Dejian Yang, Senzhang Wang, Chaozhuo Li, Xiaoming Zhang, Zhoujun Li. CIKM 2017. paper

  39. An Attention-based Collaboration Framework for Multi-View Network Representation Learning. Meng Qu, Jian Tang, Jingbo Shang, Xiang Ren, Ming Zhang, Jiawei Han. CIKM 2017. paper

  40. On Embedding Uncertain Graphs. Jiafeng Hu, Reynold Cheng, Zhipeng Huang, Yixang Fang, Siqiang Luo. CIKM 2017. paper

  41. Multi-view Clustering with Graph Embedding for Connectome Analysis. Guixiang Ma, Lifang He, Chun-Ta Lu, Weixiang Shao, Philip S Yu, Alex D Leow, Ann B Ragin. CIKM 2017. paper

  42. Learning Node Embeddings in Interaction Graphs. Yao Zhang, Yun Xiong, Xiangnan Kong, Yangyong Zhu. CIKM 2017. paper

  43. Learning Community Embedding with Community Detection and Node Embedding on Graphs. Sandro Cavallari, Vincent W. Zheng, Hongyun Cai, Kevin ChenChuan Chang, Erik Cambria. CIKM 2017. paper code

  44. Network Embedding as Matrix Factorization: Unifying DeepWalk, LINE, PTE, and node2vec. Jiezhong Qiu, Yuxiao Dong, Hao Ma, Jian Li, Kuansan Wang, Jie Tang. WSDM 2018. paper code

  45. Exploring Expert Cognition for Attributed Network Embedding. Xiao Huang, Qingquan Song, Jundong Li, Xia Ben Hu. WSDM 2018. paper

  46. SHINE: Signed Heterogeneous Information Network Embedding for Sentiment Link Prediction. Hongwei Wang, Fuzheng Zhang, Min Hou, Xing Xie, Minyi Guo, Qi Liu. WSDM 2018. paper

  47. Multidimensional Network Embedding with Hierarchical Structures. Yao Ma, Zhaochun Ren, Ziheng Jiang, Jiliang Tang, Dawei Yin. WSDM 2018. paper

  48. Curriculum Learning for Heterogeneous Star Network Embedding via Deep Reinforcement Learning. Meng Qu, Jian Tang, Jiawei Han. WSDM 2018. paper

  49. Adversarial Network Embedding. Quanyu Dai, Qiang Li, Jian Tang, Dan Wang. AAAI 2018. paper

  50. COSINE: Community-Preserving Social Network Embedding from Information Diffusion Cascades. Yuan Zhang, Tianshu Lyu, Yan Zhang. AAAI 2018.

  51. Dynamic Network Embedding by Modeling Triadic Closure Process. Lekui Zhou, Yang Yang, Xiang Ren, Fei Wu, Yueting Zhuang. AAAI 2018. paper

  52. Multi-facet Network Embedding: Beyond the General Solution of Detection and Representation. Liang Yang, Xiaochun Cao, Yuanfang Guo. AAAI 2018.

  53. RSDNE: Exploring Relaxed Similarity and Dissimilarity from Completely-imbalanced Labels for Network Embedding. Zheng Wang, Xiaojun Ye, Chaokun Wang, YueXin Wu, Changping Wang, Kaiwen Liang. AAAI 2018. paper code

  54. Link Prediction via Subgraph Embedding-Based Convex Matrix Completion. Zhu Cao, Linlin Wang, Gerard De melo. AAAI 2018.

  55. Generative Adversarial Network based Heterogeneous Bibliographic Network Representation for Personalized Citation Recommendation. J. Han, Xiaoyan Cai, Libin Yang. AAAI 2018.

  56. DepthLGP: Learning Embeddings of Out-of-Sample Nodes in Dynamic Networks. Jianxin Ma, Peng Cui, Wenwu Zhu. AAAI 2018. paper

  57. Structural Deep Embedding for Hyper-Networks. Ke Tu, Peng Cui, Xiao Wang, fei Wang, Wenwu Zhu. AAAI 2018. paper

  58. TIMERS: Error-Bounded SVD Restart on Dynamic Networks. Ziwei Zhang, Peng Cui, Jian Pei, Xiao Wang, Wenwu Zhu. AAAI 2018. paper

  59. Community Detection in Attributed Graphs: An Embedding Approach. Ye Li, Chaofeng Sha, Xin Huang, Yanchun Zhang. AAAI 2018.

  60. Bernoulli Embeddings for Graphs. Vinith Misra, Sumit Bhatia. AAAI 2018. paper

  61. Distance-aware DAG Embedding for Proximity Search on Heterogeneous Graphs. Zemin Liu, Vincent W. Zheng, Zhou Zhao, Fanwei Zhu, Kevin Chen-Chuan Chang, Minghui Wu, Jing Ying. AAAI 2018.

  62. GraphGAN: Graph Representation Learning with Generative Adversarial Nets. Hongwei Wang, jia Wang, jialin Wang, MIAO ZHAO, Weinan Zhang, Fuzheng Zhang, Xie Xing, Minyi Guo. AAAI 2018. paper

  63. HARP: Hierarchical Representation Learning for Networks. Haochen Chen, Bryan Perozzi, Yifan Hu, Steven Skiena. AAAI 2018. paper code

  64. Representation Learning for Scale-free Networks. Rui Feng, Yang Yang, Wenjie Hu, Fei Wu, Yueting Zhuang. AAAI 2018. paper

  65. Social Rank Regulated Large-scale Network Embedding. Yupeng Gu, Yizhou Sun, Yanen Li, Yang Yang. WWW 2018. paper

  66. Co-Regularized Deep Multi-Network Embedding. Jingchao Ni, Shiyu Chang, Xiao Liu, Wei Cheng, Haifeng Chen, Dongkuan Xu, Xiang Zhang. WWW 2018.

  67. On Exploring Semantic Meanings of Links for Embedding Social Networks. Linchuan Xu, Xiaokai Wei, Jiannong Cao, Philip S Yu. WWW 2018. paper

  68. SIDE: Representation Learning in Signed Directed Networks. Junghwan Kim, Haekyu Park, Ji-Eun Lee, U Kang. WWW 2018. paper

  69. Semi-supervised embedding in attributed networks with outliers. Jiongqian Liang, Peter Jacobs, Jiankai Sun, and Srinivasan Parthasarathy. SDM 2018, paper code

  70. NetGAN: Generating Graphs via Random Walks. Aleksandar Bojchevski, Oleksandr Shchur, Daniel Zügner, Stephan Günnemann. ICML 2018. paper

  71. Anonymous Walk Embeddings. Sergey Ivanov, Evgeny Burnaev. ICML 2018. paper

  72. Relational inductive bias for physical construction in humans and machines. Jessica B. Hamrick, Kelsey R. Allen, Victor Bapst, Tina Zhu, Kevin R. McKee, Joshua B. Tenenbaum, Peter W. Battaglia. CogSci 2018. paper

  73. Graph Networks as Learnable Physics Engines for Inference and Control. Alvaro Sanchez-Gonzalez, Nicolas Heess, Jost Tobias Springenberg, Josh Merel, Martin Riedmiller, Raia Hadsell, Peter Battaglia . ICML 2018. paper

  74. Arbitrary-Order Proximity Preserved Network Embedding. Ziwei Zhang, Peng Cui, Xiao Wang, Jian Pei, Xuanrong Yao, Wenwu Zhu. KDD 2018. paper

  75. NetWalk: A Flexible Deep Embedding Approach for Anomaly Detection in Dynamic Networks. Wenchao Yu, Wei Cheng, Charu Aggarwal, Kai Zhang, Haifeng Chen, Wei Wang. KDD 2018.

  76. Dynamic Embeddings for User Profiling in Twitter. Shangsong Liang, Xiangliang Zhang, Zhaochun Ren, Evangelos Kanoulas. KDD 2018.

  77. Deep Variational Network Embedding in Wasserstein Space. Dingyuan Zhu, Peng Cui, Daixin Wang, Wenwu Zhu. KDD 2018. paper

  78. Embedding Temporal Network via Neighborhood Formation. Yuan Zuo, Guannan Liu, Hao Lin, Jia Guo, Xiaoqian Hu, Junjie Wu. KDD 2018. paper

  79. Hierarchical Taxonomy Aware Network Embedding. Jianxin Ma, Peng Cui, Xiao Wang, Wenwu Zhu. KDD 2018. paper

  80. Deep Recursive Network Embedding with Regular Equivalence. Ke Tu, Peng Cui, Xiao Wang, Philip S. Yu, Wenwu Zhu. KDD 2018. paper

  81. PME: Projected Metric Embedding on Heterogeneous Networks for Link Prediction. Hongxu Chen, Hongzhi Yin, Weiqing Wang, Hao Wang, Quoc Viet Hung Nguyen, Xue Li. KDD 2018.

  82. Content to Node: Self-translation Network Embedding. Jie Liu, Zhicheng He, Lai Wei, Yalou Huang. KDD 2018.

  83. On Interpretation of Network Embedding via Taxonomy Induction. Ninghao Liu, Xiao Huang, Jundong Li, Xia Hu. KDD 2018. paper

  84. Easing Embedding Learning by Comprehensive Transcription of Heterogeneous Information Networks. Yu Shi, Qi Zhu, Fang Guo, Chao Zhang, Jiawei Han. KDD 2018. paper

  85. Learning Structural Node Embeddings via Diffusion Wavelets. Claire Donnat, Marinka Zitnik, David Hallac, Jure Leskovec. KDD 2018. paper

  86. Self-Paced Network Embedding. Hongchang Gao, Heng Huang. KDD 2018.

  87. Scalable Optimization for Embedding Highly-Dynamic and Recency-Sensitive Data. Xumin Chen, Peng Cui, Shiqiang Yang. KDD 2018.

  88. Expressive Graph Comparison via Multi-Scale Representations. Anton Tsitsulin, Davide Mottin, Panagiotis Karras, Alexander Bronstein, Emmanuel M. KDD 2018.

  89. Learning Deep Network Representations with Adversarially Regularized Autoencoders. Wenchao Yu, Cheng Zheng, Wei Cheng, Charu Aggarwal, Dongjin Song, Bo Zong, Haifeng Chen, Wei Wang. KDD 2018.

  90. SPARC: Self-Paced Network Representation for Few-Shot Rare Category Characterization. Dawei Zhou, Jingrui He, Hongxia Yang, Wei Fan. KDD 2018.

  91. Large-Scale Learnable Graph Convolutional Networks. Hongyang Gao, Zhengyang Wang, Shuiwang Ji. KDD 2018.

  92. Graph Convolutional Neural Networks for Web-Scale Recommender Systems. Rex Ying, Ruining He, Kaifeng Chen, Pong Eksombatchai, William L. Hamilton, Jure Leskovec. KDD 2018. paper

  93. Semi-supervised User Geolocation via Graph Convolutional Networks. Afshin Rahimi, Trevor Cohn, Timothy Baldwin. ACL 2018. paper

  94. Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Ranking. Aleksandar Bojchevski, Stephan Günnemann. ICLR 2018. paper

  95. FastGCN: Fast Learning with Graph Convolutional Networks via Importance Sampling. Jie Chen, Tengfei Ma, Cao Xiao. ICLR 2018. paper

  96. Graph Attention Networks. Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, Yoshua Bengio. ICLR 2018. paper

  97. Out-of-sample extension of graph adjacency spectral embedding. Keith Levin, Farbod Roosta-Khorasani, Michael W. Mahoney, Carey E. Priebe. ICML 2018. paper

  98. Stochastic Training of Graph Convolutional Networks with Variance Reduction. Jianfei Chen, Jun Zhu, Le Song. ICML 2018. paper

  99. Efficient Attributed Network Embedding via Recursive Randomized Hashing. Wei Wu, Bin Li, Ling Chen, Chengqi Zhang. IJCAI 2018.

  100. MASTER: across Multiple social networks, integrate Attribute and STructure Embedding for Reconciliation. Sen Su, Li Sun, Zhongbao Zhang, Gen Li, Jielun Qu. IJCAI 2018.

  101. Integrative Network Embedding via Deep Joint Reconstruction. Di Jin, Meng Ge, Liang Yang, Dongxiao He, Longbiao Wang, Weixiong Zhang. IJCAI 2018.

  102. Scalable Multiplex Network Embedding. Hongming Zhang, Liwei Qiu, Lingling Yi, Yangqiu Song. IJCAI 2018. paper

  103. Adversarially Regularized Graph Autoencoder for Graph Embedding. Shirui Pan, Ruiqi Hu, Guodong Long, Jing Jiang, Lina Yao, Chengqi Zhang. IJCAI 2018.

  104. Dynamic Network Embedding : An Extended Approach for Skip-gram based Network Embedding. Lun Du, Yun Wang, Guojie Song, Zhicong Lu, Junshan Wang. IJCAI 2018.

  105. Discrete Network Embedding. Xiaobo Shen, Shirui Pan, Weiwei Liu, Yew-Soon Ong, Quan-Sen Sun. IJCAI 2018.

  106. Deep Attributed Network Embedding. Hongchang Gao, Heng Huang. IJCAI 2018.

  107. Active Discriminative Network Representation Learning. Li Gao, Hong Yang, Chuan Zhou, Jia Wu, Shirui Pan, Yue Hu. IJCAI 2018.

  108. ANRL: Attributed Network Representation Learning via Deep Neural Networks. Zhen Zhang, Hongxia Yang, Jiajun Bu, Sheng Zhou, Pinggang Yu, Jianwei Zhang, Martin Ester, Can Wang. IJCAI 2018.

  109. Feature Hashing for Network Representation Learning. Qixiang Wang, Shanfeng Wang, Maoguo Gong, Yue Wu. IJCAI 2018.

  110. Constructing Narrative Event Evolutionary Graph for Script Event Prediction. Zhongyang Li, Xiao Ding, Ting Liu. IJCAI 2018. paper code

  111. Deep Inductive Network Representation Learning. Ryan A. Rossi, Rong Zhou, Nesreen K. Ahmed. WWW 2018. paper

  112. A Unified Framework for Community Detection and Network Representation Learning. Cunchao Tu, Xiangkai Zeng, Hao Wang, Zhengyan Zhang, Zhiyuan Liu, Maosong Sun, Bo Zhang, Leyu Lin. TKDE 2018. paper

Preprints

This section contains promising recent preprints.

  1. MolGAN: An implicit generative model for small molecular graphs. Nicola De Cao, Thomas Kipf. paper

  2. Relational recurrent neural networks. Adam Santoro, Ryan Faulkner, David Raposo, Jack Rae, Mike Chrzanowski, Theophane Weber, Daan Wierstra, Oriol Vinyals, Razvan Pascanu, Timothy Lillicrap. paper

  3. MILE: A Multi-Level Framework for Scalable Graph Embedding. Jiongqian Liang, Saket Gurukar, Srinivasan Parthasarathy. paper