/Awesome-Hyperbolic-Graph-Representation-Learning

Paper list about hyperbolic embedding, hyperbolic models,hyperbolic applications

Introduction

Recently, hyperbolic spaces have emerged as a promising alternative for processing graph data with tree-like structure or power-law distribution, owing to its exponential growth property. Different from the Euclidean space which expands polynomially, the hyperbolic space grows exponentially which makes it gains natural advantages in abstracting tree-like or scale-free graphs with hierarchical organizations. In this repository, we categorize papers related to hyperbolic representation learning into different types to facilitate researcher studies and to promote the development of the community. We will keep updating this repository with latest research developments. We are aware that there will inevitable be some mistakes and oversights, so if you have any questions and suggestions, please feel free to contact us (mlyang@link.cuhk.edu.hk).

1. Lastest Update
2. Surveys, Books, Tools and Tutorials
 2.1 Surveys  2.2 Books
 2.3 Tools  2.4 Tutorials
3. Methods
 3.1 Hyperbolic Shallow Model  3.2 Hyperbolic Neural Network
 3.3 Hyperbolic Graph Neural Network  3.4 Mixed Curvature Learning
 3.5 Ultrahyperbolic Learning  3.6 Hyperbolic Operations
4. Applications
 4.1 Recommender Systems  4.2 Knowledge Graphs
 4.3 Molecular Learning  4.4 Dynamic Graphs
 4.4 Code Representation  4.5 Graph Embedding
 4.6 Word Embedding  4.7 Multi-label Learning
 4.8 Computer Vision  4.9 Natural Language Processing

Hyperbolic Machine Learning Groups:

Latest update

  1. Lorentz Equivariant Model for Knowledge-Enhanced Collaborative Filtering

  2. FFHR: Fully and Flexible Hyperbolic Representation for Knowledge Graph Completion

  3. Dimensionality Selection for Hyperbolic Embeddings using Decomposed Normalized Maximum Likelihood Code-Length

  4. Hyperbolic Contrastive Learning

  5. CO-SNE: Dimensionality Reduction and Visualization for Hyperbolic Data for embedding visualization, CVPR 2022

  6. HICF: Hyperbolic Informative Collaborative Filtering for recommender systems, KDD 2022

  7. HyperAid: Denoising in hyperbolic spaces for tree-fitting and hierarchical clustering for clustering, KDD 2022

  8. Wrapped Distributions on homogeneous Riemannian manifolds for hyperbolic sampling, arxiv 2022

  9. Contrastive Multi-view Hyperbolic Hierarchical Clustering for clustering, IJCAI 2022

  10. Hyperbolic Relevance Matching for Neural Keyphrase Extraction for key phrases matching, Naacl 2022

  11. Cross-lingual Word Embeddings in Hyperbolic Space for word embedding, arxiv 2022

  12. Geometry Interaction Knowledge Graph Embeddings for KG embedding, AAAI 2022

Surveys, Books, Tools, Tutorials

Surveys

  1. Hyperbolic Graph Neural Networks: A Review of Methods and Application, arxiv 2022. GitHub
    Menglin Yang, Min Zhou, Zhihao Li, Jiahong Liu, Lujia Pan, Hui Xiong, Irwin King

  2. Hyperbolic Deep Neural Networks: A Survey, TPAMI 2022. GitHub
    Wei Peng, Tuomas Varanka, Abdelrahman Mostafa, Henglin Shi, Guoying Zhao

Books

  1. Hyperbolic Geometry, 2020.
    Brice Loustau

  2. Manifolds and Differential Geometry, 2009.
    Jeffrey M. Lee

Tools

  1. Geoopt: Riemannian Adaptive Optimization Methods ICLR 2019
    Max Kochurov and Rasul Karimov and Serge Kozlukov

  2. Curvature Learning Framework
    Alibaba

  3. GraphZoo: A Development Toolkit for Graph Neural Networks with Hyperbolic Geometries WWW 2022
    Anoushka Vyas, Nurendra Choudhary, Mehrdad Khatir, Chandan K. Reddy

Tutorials

  1. Hyperbolic Representation Learning for Computer Vision. Tutorial 2022
    Pascal Mettes, Mina Ghadimi Atigh, Martin Keller-Ressel, Jeffrey Gu, Serena Yeung@ECCV2022
    https://hyperbolic-representation-learning.readthedocs.io/en/latest/

  2. Hyperbolic Graph Representation Learning. Tutorial 2022
    Min Zhou, Menglin Yang, Lujia Pan, Irwin King @ ECML-PKDD 2022

  3. Hyperbolic Neural Network. Tutorial 2022
    Nurendra Choudhary, Nikhil Rao, Karthik Subbian, Srinivasan Sengamedu, Chandan Reddy @ KDD 2022

  4. Hyperbolic Hyperbolic embeddings in machine learning and deep learning. Tutorial 2020
    Octavian Ganea 2020.

Methods

Hyperbolic Shallow Model

  1. Learning Continuous Hierarchies in the Lorentz Model of Hyperbolic Geometry, ICML 2018
    Maximilian Nickel, Douwe Kiela

  2. Poincaré Embeddings for Learning Hierarchical Representations, NeurIPS 2017
    Maximilian Nickel, Douwe Kiela

Hyperbolic Neural Network

  1. Fully Hyperbolic Neural Networks, ACL 2022
    Weize Chen, Xu Han, Yankai Lin, Hexu Zhao, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou

  2. Hyperbolic Neural Network++, ICLR 2021
    Ryohei Shimizu, Yusuke Mukuta, Tatsuya Harada

  3. Hyperbolic Attention Networks, ICLR 2019
    Caglar Gulcehre, Misha Denil, Mateusz Malinowski, Ali Razavi, Razvan Pascanu, Karl Moritz Hermann, Peter Battaglia, Victor Bapst, David Raposo, Adam Santoro, Nando de Freitas

  4. Hyperbolic Neural Networks, NeurIPS 2018
    Octavian-Eugen Ganea, Gary Bécigneul, Thomas Hofmann

Hyperbolic Graph Neural Network

  1. Hyperbolic Graph Convolutional Neural Networks, NeurIPS 2019
    Ines Chami*, Rex Ying*, Christopher Ré, Jure Leskovec

  2. Hyperbolic Graph Neural Network, NeurIPS 2019
    Qi Liu, Maximilian Nickel, Douwe Kiela

  3. Lorentzian Graph Convolutional Networks, WWW 2021
    Yiding Zhang, Xiao Wang, Chuan Shi, Nian Liu, Guojie Song

  4. A Hyperbolic-to-Hyperbolic Graph Convolutional Network, CVPR 2021
    Jindou Dai, Yuwei Wu, Zhi Gao, Yunde Jia

  5. Hyperbolic Graph Attention Network, Transcations on Big Data 2021
    Yiding Zhang, Xiao Wang, Xunqiang Jiang, Chuan Shi, Yanfang Ye

  6. Unsupervised Hyperbolic Representation Learning via Message Passing Auto-Encoders, CVPR 2021
    Jiwoong Park, Junho Cho, Hyung Jin Chang, Jin Young Choi

Mixed Curvature Learning

  1. A Self-supervised Mixed-curvature Graph Neural Network, AAAI 2022
    Li Sun, Zhongbao Zhang, Junda Ye, Hao Peng, Jiawei Zhang, Sen Su, Philip S. Yu

  2. Enhancing Hyperbolic Graph Embeddings via Contrastive Learning, NeurIPS 2021 SSL Workshop
    Jiahong Liu, Menglin Yang, Min Zhou, Shanshan Feng, Philippe Fournier-Viger

  3. Geometry Interaction Learning, NeurIPS 2020
    Shichao Zhu, Shirui Pan, Chuan Zhou, Jia Wu, Yanan Cao, Bin Wang

  4. Constant Curvature Graph Convolutional Networks, ICML 2020
    Gregor Bachmann, Gary Bécigneul, Octavian-Eugen Ganea

Ultrahyperbolic Learning

  1. Semi-Riemannian Graph Convolutional Networks, NeurIPS 2022
    Bo Xiong, Shichao Zhu, Nico Potyka, Shirui Pan, Chuan Zhou, Steffen Staab

  2. Ultrahyperbolic Neural Networks, NeurIPS 2021
    Marc T Law

  3. Ultrahyperbolic Representation Learning, NeurIPS 2020
    Marc T. Law, Jos Stam

Hyperbolic Operations

  1. Mean Computation and BatchNorm
    Differentiating through the Fréchet Mean, ICML 2022
    Aaron Lou, Isay Katsman, Qingxuan Jiang, Serge Belongie, Ser-Nam Lim, Christopher De Sa

  2. Normalizing Flow
    Latent Variable Modelling with Hyperbolic Normalizing Flows, ICML 2020
    Avishek Joey Bose, Ariella Smofsky, Renjie Liao, Prakash Panangaden, William L. Hamilton

  3. Sampling
    Wrapped Distributions on homogeneous Riemannian manifolds, 2022
    Fernando Galaz-Garcia, Marios Papamichalis, Kathryn Turnbull, Simon Lunagomez, Edoardo Airoldi

  4. MixUp
    HYPMIX: Hyperbolic Interpolative Data Augmentation, EMNLP 2021
    Ramit Sawhney, Megh Thakkar, Shivam Agarwal, Di Jin, Diyi Yang, Lucie Flek

  5. PCA
    HoroPCA: Hyperbolic Dimensionality Reduction via Horospherical Projections, ICML 2021
    Ines Chami*, Albert Gu*, Dat Nguyen, Christopher Ré

Applications

Recommender Systems

Hyperbolic Graph Neural Network for Recommender Systems

  1. HICF: Hyperbolic Informative Collaborative Filtering, KDD 2022
    Menglin Yang, Zhihao Li, Min Zhou, Jiahong Liu, Irwin King

  2. HRCF: Enhancing Collaborative Filtering via Hyperbolic Geometric Regularization, WWW 2022
    Menglin Yang, Min Zhou, Jiahong Liu, Defu Lian, Irwin King

  3. HAKG: Hierarchy-Aware Knowledge Gated Network for Recommendation, SIGIR 2022
    Yuntao Du, Xinjun Zhu, Lu Chen, Baihua Zheng, and Yunjun Gao

  4. Geometric Inductive Matrix Completion: A Hyperbolic Approach with Unified Message Passing, WSDM 2022
    Chengkun Zhang , Hongxu Chen , Sixiao Zhang , Guandong Xu , Junbin Gao

  5. Modeling Scale-free Graphs with Hyperbolic Geometry for Knowledge-aware Recommendation, WSDM 2022
    Yankai Chen, Menglin Yang, Yingxue Zhang, Mengchen Zhao, Ziqiao Meng, Jianye Hao, Irwin King

  6. HGCF: Hyperbolic Graph Convolution Networks for Collaborative Filtering, WWW 2021
    Jianing Sun,Zhaoyue Cheng,Saba Zuberi,Felipe Perez,Maksims Volkovs

  7. Hypersorec: Exploiting hyperbolic user and item representations with multiple aspects for social-aware recommendation, TOIS 2021
    Hao Wang, Defu Lian, Hanghang Tong, Qi Liu, Zhenya Huang and Enhong Chen

  8. Knowledge Based Hyperbolic Propagation, SIGIR short paper 2021
    Chang-You Tai, Chien-Kun Huang, Liang-Ying Huang, Lun-Wei Ku

  9. HSR: hyperbolic social recommender, Information Sciences 2022
    Anchen Li, Bo Yang

  10. HCGR: Hyperbolic Contrastive Graph Representation Learning for Session-based Recommendation, arxiv 2021
    Naicheng Guo, Xiaolei Liu, Shaoshuai Li, Qiongxu Ma, Yunan Zhao, Bing Han, Lin Zheng, Kaixin Gao, Xiaobo Guo

  11. Hyperbolic Hypergraphs for Sequential Recommendation, CIKM 2021
    Yicong Li, Hongxu Chen, Xiangguo Sun, Zhenchao Sun, Lin Li, Lizhen Cui, Philip S. Yu, Guandong Xu

Hyperbolic Neural Network for Recommender Systems

  1. Where are we in embedding spaces? A Comprehensive Analysis on Network Embedding Approaches for Recommender Systems KDD 2021
    Sixiao Zhang, Hongxu Chen, Xiao Ming, Lizhen Cui, Hongzhi Yin, Guandong Xu

  2. Learning Feature Interactions with Lorentzian Factorization Machine, AAAI 2020
    Canran Xu, Ming Wu

  3. HyperML: A Boosting Metric Learning Approach in Hyperbolic Space for Recommender Systems, WSDM 2020
    Lucas Vinh Tran, Yi Tay, Shuai Zhang, Gao Cong, Xiaoli Li

  4. Scalable Hyperbolic Recommender Systems, WSDM 2020
    Benjamin Paul Chamberlain, Stephen R. Hardwick, David R. Wardrope, Fabon Dzogang, Fabio Daolio, Saúl Vargas

  5. A hyperbolic metric embedding approach for next-poi recommendation, SIGIR 2020
    Shanshan Feng , Lucas Vinh Tran , Gao Cong , Lisi Chen , Jing Li , Fan Li

  6. Node2LV: Squared Lorentzian Representations for Node Proximity， ICDE 2021
    Shanshan Feng, Lisi Chen, Kaiqi Zhao, Wei Wei, Fan Li, Shuo Shang

Knowledge Graphs

Hyperbolic Graph Neural Network for Knowledge Graphs

  1. Knowledge Association with Hyperbolic Knowledge Graph Embeddings, EMNLP 2020
    Zequn Sun, Muhao Chen, Wei Hu, Chengming Wang, Jian Dai, Wei Zhang

  2. Knowledge Graph Representation via Hierarchical Hyperbolic Neural Graph Embedding, IEEE Big Data
    Shen Wang, Xiaokai Wei, Cicero Nogueira Dos Santos, Zhiguo Wang, Ramesh Nallapati, Andrew Arnold, Philip S. Yu

  3. Mixed-Curvature Multi-relational Graph Neural Network for Knowledge Graph Completion, WWW 2021
    Shen Wang , Xiaokai Wei , Cicero Nogueira Nogueira dos Santos , Zhiguo Wang , Ramesh Nallapati , Andrew Arnold , Bing Xiang , Philip S. Yu , Isabel F. Cruz

Hyperbolic Translational Models for KG

  1. Low-Dimensional Hyperbolic Knowledge Graph Embeddings, ACL 2019
    Ines Chami, Adva Wolf, Da-Cheng Juan, Frederic Sala, Sujith Ravi, Christopher Ré

  2. Multi-relational Poincaré Graph Embeddings, NeurIPS 2019
    Ivana Balažević, Carl Allen, Timothy Hospedales

  3. Modeling Heterogeneous Hierarchies with Relation-specific Hyperbolic Cones， NeurIPS 2021
    Yushi Bai, Rex Ying, Hongyu Ren, Jure Leskovec

  4. Hyperbolic Temporal Knowledge Graph Embeddings with Relational and Time Curvatures, ACL 2021
    Sebastien Montella, Lina Rojas-Barahona, Johannes Heinecke

  5. Self-supervised hyperboloid representations from logical queries over knowledge graphs, WWW 2021
    Nurendra Choudhary, Nikhil Rao, Sumeet Katariya, Karthik Subbian, Chandan K. Reddy

  6. HyperKG: Hyperbolic Knowledge Graph Embeddings for Knowledge Base Completion, arxiv
    Prodromos Kolyvakis, Alexandros Kalousis, Dimitris Kiritsis

  7. Hyperbolic Hierarchy-Aware Knowledge Graph Embedding for Link Prediction. EMNLP findings 2021
    Zhe Pan, Peng Wang

Molecular Learning

Hyperbolic Graph Neural Network for Molecular Learning

  1. Hyperbolic relational graph convolution networks plus: a simple but highly efficient QSAR-modeling method, Briefings in Bioinformatics 2021
    Zhenxing Wu, Dejun Jiang, Chang-Yu Hsieh, Guangyong Chen, Ben Liao, Dongsheng Cao, Tingjun Hou

  2. Semi-supervised hierarchical drug embedding inhyperbolic space, J. Chem. Inf. Model 2020
    Ke Yu*, Shyam Visweswaran*, and Kayhan Batmanghelich

Hyperbolic Neural Network models for Molecular Learning

  1. HiG2Vec: hierarchical representations of Gene Ontology and genes in the Poincaré ball, Bioinformatics, 2021
    Jaesik Kim, Dokyoon Kim, Kyung-Ah Sohn

Dynamic Graphs

  1. Discrete-time Temporal Network Embedding via Implicit Hierarchical Learning in Hyperbolic Space, KDD 2021
    Menglin Yang, Min Zhou, Marcus Kalander, Zengfeng Huang, Irwin King

  2. Hyperbolic Variational Graph Neural Network for Modeling Dynamic Graphs, AAAI 2021
    Li Sun, Zhongbao Zhang, Jiawei Zhang, Feiyang Wang, Hao Peng, Sen Su, Philip S. Yu

  3. Exploring the Scale-Free Nature of Stock Markets: Hyperbolic Graph Learning for Algorithmic Trading, WWW 2021
    Ramit Sawhney , Shivam Agarwal , Arnav Wadhwa , Rajiv Shah

Code Representation

  1. Hyperbolic Representations of Source Code AAAI 2022
    Raiyan Khan, Thanh V. Nguyen, Sengamedu H. Srinivasan

Graph Embeddings

Hyperbolic Geometry for Heterogeneous Network Embedding

  1. Hyperbolic Heterogeneous Information Network Embedding, AAAI 2020
    Xiao Wang, Yiding Zhang, Chuan Shi

  2. Embedding Heterogeneous Information Network in Hyperbolic Spaces, TKDD 2022
    Yiding Zhang, Xiao Wang, Nian Liu, Chuan Shi

Hyperbolic Geometry for Directed Graph Embedding

  1. Hyperbolic Disk Embeddings for Directed Acyclic Graphs，ICML 2019
    Ryota Suzuki, Ryusuke Takahama, Shun Onoda

  2. A hyperbolic Embedding Model for Directed Networks
    Zongning Wu, Zengru Di, Ying Fan (this paper includes many errors)

Hyperbolic Geometry for Signed Graph Embedding

  1. Hyperbolic Node Embedding for Signed Networks, Neurcomputing 2021
    Wenzhuo Song, Hongxu Chen, Xueyan Liu, Hongzhe Jiang, Shengsheng Wang

Hyperbolic Geometry for Attributed Graph Embedding

  1. HEAT: Hyperbolic Embedding of Attributed Networks, IDEAL 2020
    David McDonald, Shan He

Word Embeddings

  1. Poincare Glove: Hyperbolic Word Embeddings, ICLR 2019
    Alexandru Tifrea and Gary Becigneul and Octavian-Eugen Gane

  2. Skip-gram word embeddings in hyperbolic space, ACL 2018
    Matthias Leimeister, Benjamin J. Wilson

  3. Embedding text in hyperbolic spaces, ACL 2018
    Bhuwan Dhingra, Christopher J. Shallue, Mohammad Norouzi, Andrew M. Dai, George E. Dahl

  4. Representation Tradeoffs for Hyperbolic Embeddings, ICML 2018
    Christopher De Sa, Albert Gu, Christopher Ré, Frederic Sala

  5. Hyperbolic entailment cones for learning hierarchical embeddings, ICML 2018
    Octavian-Eugen Ganea, Gary Bécigneul, Thomas Hofmann

  6. Low-rank approximations of hyperbolic embeddings
    Pratik Jawanpuria, Mayank Meghwanshi, Bamdev Mishra

  7. Hyperbolic Multiplex Network Embedding with Maps of Random Walk
    Peiyuan Sun

Multi-label Learning

  1. Hyperbolic interaction model for hierarchical multi-label classification, AAAI 2021
    Boli Chen, Xin Huang, Lin Xiao, Zixin Cai, Liping Jing

  2. Hyperbolic Capsule Networks for Multi-Label Classification, ACL 2020
    Boli Chen, Xin Huang, Lin Xiao, Liping Jing

  3. Joint Learning of Hyperbolic Label Embeddings for Hierarchical Multi-label Classification, EACL 2021
    Soumya Chatterjee, Ayush Maheshwari, Ganesh Ramakrishnan, Saketha Nath Jagaralpudi

  4. Hyperbolic Embeddings for Hierarchical Multi-label Classification, 2020
    Tomaž StepišnikEmail, Dragi Kocev

  5. A Fully Hyperbolic Neural Model for Hierarchical Multi-Class Classification, EMNLP findings
    Federico López, Michael Strube

Computer Vision

  1. Hyperbolic Vision Transformers: Combining Improvements in Metric Learning,CVPR 2022
    Aleksandr Ermolov, Leyla Mirvakhabova, Valentin Khrulkov, Nicu Sebe, Ivan Oseledets

  2. Clipped Hyperbolic Classifiers Are Super-Hyperbolic Classifiers, CVPR 2022
    Yunhui Guo, Xudong Wang, Yubei Chen, Stella X. Yu

  3. Hyperbolic Image Segmentation, CVPR 2022
    Mina GhadimiAtigh, Julian Schoep, Erman Acar, Nanne van Noord, Pascal Mettes

  4. Capturing implicit hierarchical structure in 3D biomedical images with self-supervised hyperbolic representations NeurIPS 2021
    Joy Hsu, Jeffrey Gu, Gong-Her Wu, Wah Chiu, Serena Yeung

  5. Learning Hyperbolic Representations of Topological Features ICLR 2021
    Panagiotis Kyriakis, Iordanis Fostiropoulos, Paul Bogdan

  6. Curvature Generation in Curved Spaces for Few-Shot Learning, ICCV 2021
    Zhi* Gao, Yuwei Wu*, Yunde Jia, Mehrtash Harandi

  7. Unsupervised Discovery of the Long-Tail in Instance Segmentation Using Hierarchical Self-Supervision, CVPR 2021
    Zhenzhen Weng, Mehmet Giray Ogut, Shai Limonchik, Serena Yeung

  8. Searching for Actions on the Hyperbole, CVPR 2020
    Teng Long, Pascal Mettes, Heng Tao Shen, Cees Snoek

  9. Mix Dimension in Poincaré Geometry for 3D Skeleton-based Action Recognition, ACM MM 2020
    Wei Peng, Jingang Shi, Zhaoqiang Xia, Guoying Zhao

  10. Hyperbolic Image Embedding, CVPR 2020
    Valentin Khrulkov, Leyla Mirvakhabova, Evgeniya Ustinova, Ivan Oseledets, Victor Lempitsky

  11. Meta Hyperbolic Networks for Zero-Shot Learning, Neurocomputing
    Yan Xu, Lifu Mu, ZhongJi, Xiyao Liu, JungongHan

Natural Language Processing

  1. Medical Triage Chatbot Diagnosis Improvement via Multi-relational Hyperbolic Graph Neural Network. SIGIR short paper 2021
    Zheng Liu , Xiaohan Li , Zeyu You , Tao Yang , Wei Fan , Philip Yu

  2. ANTHEM: Attentive Hyperbolic Entity Model for Product Search. WSDM 2022
    Nurendra Choudhary , Nikhil Rao , Sumeet Katariya , Karthik Subbian , Chandan K. Reddy

Hyperbolic Metric Learning

  1. Hyperbolic Busemann Learning with Ideal Prototypes, NeurIPS 2021
    Mina Ghadimi Atigh, Martin Keller-Ressel, Pascal Mettes

  2. Unsupervised Hyperbolic Metric Learning, CVPR 2021
    Jiexi Yan, Lei Luo, Cheng Deng, Heng Huang

Contributed by: Menglin Yang, Min Zhou