/Recommender_system_via_deep_RL

The implemetation of Deep Reinforcement Learning based Recommender System from the paper Deep Reinforcement Learning based Recommendation with Explicit User-Item Interactions Modeling by Liu et al.

Primary LanguageJupyter Notebook

Deep Reinforcement Learning based Recommender System in Tensorflow

The implemetation of Deep Reinforcement Learning based Recommender System from the paper Deep Reinforcement Learning based Recommendation with Explicit User-Item Interactions Modeling by Liu et al. Build recommender system with DDPG algorithm. Add state representation module to produce trainable state for RL algorithm from data.

Dataset

MovieLens 1M Datset

unzip ./ml-1m.zip

Procedure

Trying to improve performance of RL based recommender system. The report contains the result of Using the actor network with embedding layer, reducing overestimated Q value, using several pretrained embedding and applying PER.

Result

Please check here - Experiment Report (Korean)


image

  • for evalutation data
    • precision@5 : 0.479, ndcg@5 : 0.471
    • precision@10 : 0.444, ndcg@10 : 0.429

Usage

Training

python train.py

Evalutation

Follow evaluation.ipynb

requirements

tensorflow==2.2.0
scikit-learn==0.23.2
matplotlib==3.3.3

reference

https://github.com/LeejwUniverse/RL_Rainbow_Pytorch

https://github.com/kyunghoon-jung/MacaronRL

https://github.com/pasus/Reinforcement-Learning-Book