Path-guided intelligent switching over knowledge graphs with deep reinforcement learning for recommendation
Abstract Online recommendation systems process large amounts of information to make personalized recommendations. There has been some progress in research on incorporating knowledge graphs in reinforcement learning for recommendation; however, some challenges still remain. First, in these approaches...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Springer
2023-06-01
|
| Series: | Complex & Intelligent Systems |
| Subjects: | |
| Online Access: | https://doi.org/10.1007/s40747-023-01124-1 |
| _version_ | 1797647114977673216 |
|---|---|
| author | Shaohua Tao Runhe Qiu Yan Cao Guoqing Xue Yuan Ping |
| author_facet | Shaohua Tao Runhe Qiu Yan Cao Guoqing Xue Yuan Ping |
| author_sort | Shaohua Tao |
| collection | DOAJ |
| description | Abstract Online recommendation systems process large amounts of information to make personalized recommendations. There has been some progress in research on incorporating knowledge graphs in reinforcement learning for recommendation; however, some challenges still remain. First, in these approaches, an agent cannot switch paths intelligently, because of which, the agent cannot cope with multi-entities and multi-relations in knowledge graphs. Second, these methods do not have predefined targets and thus cannot discover items that are closely related to user-interacted items and latent rich semantic relationships. Third, contemporary methods do not consider long rational paths in knowledge graphs. To address these problems, we propose a deep knowledge reinforcement learning (DKRL) framework, in which path-guided intelligent switching was implemented over knowledge graphs incorporating reinforcement learning; this model integrates predefined target and long logic paths over knowledge graphs for recommendation systems. Specifically, the designed novel path-based intelligent switching algorithm with predefined target enables an agent to switch paths intelligently among multi-entities and multi-relations over knowledge graphs. In addition, the weight of each path is calculated, and the agent switches paths between multiple entities according to path weights. Furthermore, the long logic path has better recommendation performance and interpretability. Extensive experiments with actual data demonstrate that our work improves upon existing methods.The experimental results indicated that DKRL improved the baselines of NDCG@10 by 3.7%, 9.3%, and 4.7%; of HR@10 by 12.39%, 20.8%, and 13.86%; of Prec@10 by 5.17%, 3.57%, 6.2%; of Recall@10 by 3.01%, 4.2%, and 3.37%. The DKRL model achieved more effective recommendation performance using several large benchmark data sets compared with other advanced methods. |
| first_indexed | 2024-03-11T15:11:40Z |
| format | Article |
| id | doaj.art-531784be634c40f8b0b145db36225414 |
| institution | Directory Open Access Journal |
| issn | 2199-4536 2198-6053 |
| language | English |
| last_indexed | 2024-03-11T15:11:40Z |
| publishDate | 2023-06-01 |
| publisher | Springer |
| record_format | Article |
| series | Complex & Intelligent Systems |
| spelling | doaj.art-531784be634c40f8b0b145db362254142023-10-29T12:41:12ZengSpringerComplex & Intelligent Systems2199-45362198-60532023-06-01967305731910.1007/s40747-023-01124-1Path-guided intelligent switching over knowledge graphs with deep reinforcement learning for recommendationShaohua Tao0Runhe Qiu1Yan Cao2Guoqing Xue3Yuan Ping4College of Information Sciences and Technology, Donghua UniversityCollege of Information Sciences and Technology, Donghua UniversitySchool of Information Engineering, XuChang UniversityHenan 863 Software Incubator Co., Ltd.School of Information Engineering, XuChang UniversityAbstract Online recommendation systems process large amounts of information to make personalized recommendations. There has been some progress in research on incorporating knowledge graphs in reinforcement learning for recommendation; however, some challenges still remain. First, in these approaches, an agent cannot switch paths intelligently, because of which, the agent cannot cope with multi-entities and multi-relations in knowledge graphs. Second, these methods do not have predefined targets and thus cannot discover items that are closely related to user-interacted items and latent rich semantic relationships. Third, contemporary methods do not consider long rational paths in knowledge graphs. To address these problems, we propose a deep knowledge reinforcement learning (DKRL) framework, in which path-guided intelligent switching was implemented over knowledge graphs incorporating reinforcement learning; this model integrates predefined target and long logic paths over knowledge graphs for recommendation systems. Specifically, the designed novel path-based intelligent switching algorithm with predefined target enables an agent to switch paths intelligently among multi-entities and multi-relations over knowledge graphs. In addition, the weight of each path is calculated, and the agent switches paths between multiple entities according to path weights. Furthermore, the long logic path has better recommendation performance and interpretability. Extensive experiments with actual data demonstrate that our work improves upon existing methods.The experimental results indicated that DKRL improved the baselines of NDCG@10 by 3.7%, 9.3%, and 4.7%; of HR@10 by 12.39%, 20.8%, and 13.86%; of Prec@10 by 5.17%, 3.57%, 6.2%; of Recall@10 by 3.01%, 4.2%, and 3.37%. The DKRL model achieved more effective recommendation performance using several large benchmark data sets compared with other advanced methods.https://doi.org/10.1007/s40747-023-01124-1Knowledge graph embeddingDeep reinforcement learningRecommendationIntelligent path-switching |
| spellingShingle | Shaohua Tao Runhe Qiu Yan Cao Guoqing Xue Yuan Ping Path-guided intelligent switching over knowledge graphs with deep reinforcement learning for recommendation Complex & Intelligent Systems Knowledge graph embedding Deep reinforcement learning Recommendation Intelligent path-switching |
| title | Path-guided intelligent switching over knowledge graphs with deep reinforcement learning for recommendation |
| title_full | Path-guided intelligent switching over knowledge graphs with deep reinforcement learning for recommendation |
| title_fullStr | Path-guided intelligent switching over knowledge graphs with deep reinforcement learning for recommendation |
| title_full_unstemmed | Path-guided intelligent switching over knowledge graphs with deep reinforcement learning for recommendation |
| title_short | Path-guided intelligent switching over knowledge graphs with deep reinforcement learning for recommendation |
| title_sort | path guided intelligent switching over knowledge graphs with deep reinforcement learning for recommendation |
| topic | Knowledge graph embedding Deep reinforcement learning Recommendation Intelligent path-switching |
| url | https://doi.org/10.1007/s40747-023-01124-1 |
| work_keys_str_mv | AT shaohuatao pathguidedintelligentswitchingoverknowledgegraphswithdeepreinforcementlearningforrecommendation AT runheqiu pathguidedintelligentswitchingoverknowledgegraphswithdeepreinforcementlearningforrecommendation AT yancao pathguidedintelligentswitchingoverknowledgegraphswithdeepreinforcementlearningforrecommendation AT guoqingxue pathguidedintelligentswitchingoverknowledgegraphswithdeepreinforcementlearningforrecommendation AT yuanping pathguidedintelligentswitchingoverknowledgegraphswithdeepreinforcementlearningforrecommendation |