“世有伯乐，然后有千里马。千里马常有，而伯乐不常有。”——韩愈《马说》
RecBole 1.0 | HomePage | Datasets | Paper
Based on a popular recommendation framework RecBole, we develop an extended recommendation library called RecBole 2.0, consisting of benchmarking packages for up-to-date topics and architectures.
RecBole 2.0 includes 8 packages covering the up-to-date research topic in recommender system:
- Data augmentation (RecBole-DA)
- Meta recommendation (RecBole-MetaRec)
- Debiased recommendation (RecBole-Debias)
- Fairness-aware recommendation (RecBole-FairRec)
- Cross-domain recommendation (RecBole-CDR)
- Graph-based recommendation (RecBole-GNN)
- Transformer-based recommendation (RecBole-TRM)
- Person-job fit (RecBole-PJF)
For each package, we provide complete implementations from data loading, experimental setup, evaluation and algorithm implementation. This library is of great value to facilitate the up-to-date research in recommender systems.
RecBole-DA is a library built upon PyTorch and RecBole for reproducing and developing data augmentation for sequential recommendation.
- Easy-to-use API: Our library provides extensive API based on common data augmentation strategies, users can further develop own new models based on our library.
- Full Coverage of Classic Methods: We provide seven data augmentation methods based on recommender systems in three major categories.
Our library includes algorithms covering three major categories:
- Heuristic-based Methods: CL4SRec, DuoRec
- Model-based Methods: MMInfoRec, CauseRec
- Hybird Methods: CASR, CCL, CoSeRec
RecBole-DA is developed and maintained by members from RUCAIBox, the developer is Shuqing Bian (@fancybian).
RecBole-MetaRec is an extended package for RecBole, which aims to help researchers to compare and develop their own models in the field of meta learning recommendation.
The package can mainly provide researchers with the following advantages:
- Conveniently develop new meta learning recommendation models with the general meta learning framework.
- Conveniently learn and compare the meta learning recommendation models that we have implemented.
- Conveniently use the advantages and features of RecBole.
Moreover, we provide a document in detail for researchers.
Our package includes three main types of algorithms:
- Meta learn to predict: MeLU, MAMO
- Meta learn to parameterize: LWA, NLBA, TaNP
- Meta learn to embed: MetaEmb, MWUF
(1) MetaDataset: the meta learning task splitter. (2) MetaDataLoader: the meta learning task translator. (3) MetaRecommender: the template for meta learning models. (4) MetaTrainer: the base trainer for meta learning training process. (5) MetaCollector: the evaluation class for meta learning tasks. (6) MetaUtils: the toolkit for meta learning.
RecBole-MetaRec is developed and maintained by Zeyu Zhang (@Zeyu Zhang).
RecBole-Debias is a toolkit built upon RecBole for reproducing and developing debiased recommendation algorithms.
-
Unified
A unified framework, which includes several algorithms for different kinds of biases. Meanwhile, three datasets with the different distributions of training set and test set are provided for training and evaluation.
-
Adaptive
Adaptive to many base recommendation models. For simplicity, the current implementation is only based on MF model.
-
Closely
Closely related to Recbole. The toolkit fully adopts the functions of Recbole, except that certain algorithms need to design unique components like trainer.
We list currently supported models according to category:
- Base Model: MF
- Selection Bias: MF-IPS
- Popularity Bias: PDA, MACR, DICE, CausE
- Exposure Bias: Rel-MF
RecBole-Debias is developed and maintained by members from RUCAIBox, the main developers is Jingsen Zhang (@Jingsen Zhang).
RecBole-FairRec is a library toolkit built upon PyTorch and RecBole for reproducing and developing fairness-aware recommendation algorithms.
- Easy-to-use: Our library shares unified API and input(atomic files) as RecBole.
- Conveniently learn and compare: Our library provides several fairess-metrics and frameworks for learning and comparing.
- Extensive FairRec library: Recently proposed fairness-aware algorithms can be easily equipped in our library.
We list the models and fairness-metrics that we have implemented up to now:
- Models: FOCF, PFCN(including PFCN_MLP, PFCN_BiasedMF, PFCN_DMF, PFCN_PMF), FairGo(including FairGo_PMF_WAP, FairGo_PMF_LBA, FairGo_PMF_LVA, FairGo_GCN_WAP, FairGo_GCN_LBA, FairGo_GCN_LVA), NFCF
- Fairness-Metrics:
- Item-Oriented: GiniIndex, PopularityPercentage
- User-Oriented: DifferentialFairness,ValueUnfairness, AbsoluteUnfairness, UnderUnfairness, OverUnfairness, NonParityUnfairness
RecBole-FairRec is developed and maintained by Jiakai Tang (@Jiakai Tang).
RecBole-CDR is a library built upon RecBole for reproducing and developing cross-domain recommendation algorithms.
- Automatic and compatible data processing for cross-domain recommendation: Our library designs a unified data structure for cross-domain recommendation, which inherits all the data pre-processing strategies in RecBole. The overlapped data in different domains can be matched automatically.
- Flexible and customized model training strategies: Our library provides four basic training modes for cross-domain recommendation, which can be combined arbitrarily by users. It is also easy to customize training strategy in original way.
- Extensive cross-domain recommendation algorithms: Based on unified data structure and flexible training strategies, several cross-domain recommendation algorithms are implemented and compared with others fairly.
Our library includes algorithms covering three major categories:
- Algorithms based on the collective matrix factorization, such as CMF and CLFM.
- Algorithms that share or combine the representations of the overlapped data, for example, DTCDR, DeepAPF and NATR.
- Algorithms that transfer or map knowledge between different domains, such as CoNet, BiTGCF, EMCDR, SSCDR and DCDCSR.
RecBole-CDR is developed and maintained by members from RUCAIBox, the main developers are Zihan Lin (@linzihan-backforward), Gaowei Zhang (@Wicknight) and Shanlei Mu (@ShanleiMu).
RecBole-GNN is a library built upon PyTorch and RecBole for reproducing and developing recommendation algorithms based on graph neural networks (GNNs).
- Easy-to-use and unified API: Our library shares unified API and input (atomic files) as RecBole.
- Efficient and reusable graph processing: We provide highly efficient and reusable basic datasets, dataloaders and layers for graph processing and learning.
- Extensive graph library: Graph neural networks from widely-used library like PyG are incorporated. Recently proposed graph algorithms can be easily equipped and compared with existing methods.
Our library includes algorithms covering three major categories:
- General Recommendation: NGCF, LightGCN, SGL, HMLET, NCL, SimGCL
- Sequential Recommendation: SR-GNN, GC-SAN, NISER, LESSR, TAGNN, GCE-GNN, SGNN-HN
- Social Recommendation: DiffNet, MHCN, SEPT
RecBole-GNN is developed and maintained by members from RUCAIBox, the main developers are Yupeng Hou (@hyp1231), Lanling Xu (@Sherry-XLL) and Changxin Tian (@ChangxinTian).
RecBole-TRM is a library built upon PyTorch and RecBole for reproducing and developing recommendation algorithms based on Transformers (TRMs).
- Easy-to-use API: Our library shares unified API and input (atomic files) as RecBole.
- Fair reproducibility and comparison: Our library provides fair reproducibility and comparison in a systematic mechanism.
- Extensive Transformer library: Our library provides extensive API based on common Transformer layers, one can further develop new models easily based on our library.
Our library includes algorithms covering two major categories:
- Sequential Recommendation: TiSASRec, SSE-PT, LightSANs, gMLP, CORE
- News Recommendation: NRMS, NAML, NPA
RecBole-TRM is developed and maintained by members from RUCAIBox, the main developers are Wenqi Sun (@wenqisun) and Xinyan Fan (@BELIEVEfxy).
RecBole-PJF is a library built upon PyTorch and RecBole for reproducing and developing recommendation algorithms for person-job fit (PJF).
- Unified framework: Our library build a unified framework for different methods, including collaborative methods, content-based methods and hybrid methods;
- Evaluate from two perspective: Our library evaluate for both candidates and employers, which is not contained in previous frameworks;
- Easy to extend: Models for person-job fit can be easily extend to our library, as we provide multiple input interfaces for both interaction and text data.
Our library includes algorithms covering three major categories:
-
CF-based Models: LFRR and other models in RecBole
-
Content-based Models: PJFNN, BPJFNN, APJFNN, BERT
-
Hybrid Models: IPJF, PJFFF, SHPJF
RecBole-PJF is developed and maintained by members from RUCAIBox, the main developers are Chen Yang (@flust), Yupeng Hou (@hyp1231), Shuqing Bian (@fancybian).
With the rapid advancement of recommender systems, we are receiving an increasing number of requests from RecBole users for support the most recent advances (like debiased, fairness and GNNs). Meanwhile, members of our team are conducting research on these emerging topics or models. As a result, we build up this extended library based on RecBole 1.0 and we believe this extension is a significant contribution to RecBole, which is a valuable resource to the research community.
In order to facilitate the retrieval of models based on RecBole, we have summarized all implemented model information and see model list for details.
As a one-stop framework from data processing, model development, algorithm training to scientific evaluation, RecBole has a total of 11 related GitHub projects including
- two versions of RecBole (RecBole 1.0 and RecBole 2.0);
- 8 benchmarking packages (RecBole-MetaRec, RecBole-DA, RecBole-Debias, RecBole-FairRec, RecBole-CDR, RecBole-TRM, RecBole-GNN and RecBole-PJF);
- dataset repository (RecSysDatasets).
In the following table, we summarize the open source contributions of GitHub projects based on RecBole.
| Projects | Stars | Forks | Issues | Pull requests |
|---|---|---|---|---|
| RecBole |  |
 |
 |
 |
| RecBole2.0 |  |
 |
 |
 |
| RecBole-DA |  |
 |
 |
 |
| RecBole-MetaRec |  |
 |
 |
 |
| RecBole-Debias |  |
 |
 |
 |
| RecBole-FairRec |  |
 |
 |
 |
| RecBole-CDR |  |
 |
 |
 |
| RecBole-GNN |  |
 |
 |
 |
| RecBole-TRM |  |
 |
 |
 |
| RecBole-PJF |  |
 |
 |
 |
| RecSysDatasets |  |
 |
 |
 |
If you find RecBole useful for your research or development, please cite the following papers: RecBole and RecBole2.0.
@inproceedings{recbole,
author = {Wayne Xin Zhao and Shanlei Mu and Yupeng Hou and Zihan Lin and Yushuo Chen and Xingyu Pan and Kaiyuan Li and Yujie Lu and Hui Wang and Changxin Tian and Yingqian Min and Zhichao Feng and Xinyan Fan and Xu Chen and Pengfei Wang and Wendi Ji and Yaliang Li and Xiaoling Wang and Ji{-}Rong Wen},
title = {RecBole: Towards a Unified, Comprehensive and Efficient Framework for Recommendation Algorithms},
booktitle = {{CIKM}},
pages = {4653--4664},
publisher = {{ACM}},
year = {2021}
}
@article{recbole2.0,
author = {Wayne Xin Zhao and Yupeng Hou and Xingyu Pan and Chen Yang and Zeyu Zhang and Zihan Lin and Jingsen Zhang and Shuqing Bian and Jiakai Tang and Wenqi Sun and Yushuo Chen and Lanling Xu and Gaowei Zhang and Zhen Tian and Changxin Tian and Shanlei Mu and Xinyan Fan and Xu Chen and Ji{-}Rong Wen},
title = {RecBole 2.0: Towards a More Up-to-Date Recommendation Library},
journal = {arXiv preprint arXiv:2206.07351},
year = {2022}
}