Neural Collaborative Embedding From Reviews for Recommendation
This paper mainly studies the personalized rating prediction task based on review texts for the recommendation. Recently, most of the related researches use convolutional neural networks to capture local context information, but it loses word frequency and global context information. In addition, th...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2019-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/8782556/ |
_version_ | 1818642897585569792 |
---|---|
author | Xingjie Feng Yunze Zeng |
author_facet | Xingjie Feng Yunze Zeng |
author_sort | Xingjie Feng |
collection | DOAJ |
description | This paper mainly studies the personalized rating prediction task based on review texts for the recommendation. Recently, most of the related researches use convolutional neural networks to capture local context information, but it loses word frequency and global context information. In addition, they simply equate the user (item) embedding to review embedding, which brings some irrelevant information of the review text into user preference or item property. Moreover, they only consider the low-order interactions, which remain the fine-grained user-item interactions to be explored. To solve these problems, we propose a novel method neural collaborative embedding model (NCEM). We first adopt pre-trained BERT model, which has been proven to improve most of the downstream NLP tasks, to simultaneously capture the global context and word frequency information. In addition, a self-attention mechanism is introduced to learn the contribution of each review. Next, we develop a neural form of standard factorization machine, which can model first-order and second-order user-item interactions by stacking multiple layers. The extensive experiments on four public datasets showed that NCEM consistently outperforms the state-of-the-art recommendation approaches. Furthermore, the recommendation interpretability can be improved by showing users the high score reviews accompanied recommended item. |
first_indexed | 2024-12-16T23:50:22Z |
format | Article |
id | doaj.art-744ef9536dc64b1fbcb5ba11824ba501 |
institution | Directory Open Access Journal |
issn | 2169-3536 |
language | English |
last_indexed | 2024-12-16T23:50:22Z |
publishDate | 2019-01-01 |
publisher | IEEE |
record_format | Article |
series | IEEE Access |
spelling | doaj.art-744ef9536dc64b1fbcb5ba11824ba5012022-12-21T22:11:22ZengIEEEIEEE Access2169-35362019-01-01710326310327410.1109/ACCESS.2019.29313578782556Neural Collaborative Embedding From Reviews for RecommendationXingjie Feng0Yunze Zeng1https://orcid.org/0000-0003-2081-0505College of Computer Science and Technology, Civil Aviation University of China, Tianjin, ChinaCollege of Computer Science and Technology, Civil Aviation University of China, Tianjin, ChinaThis paper mainly studies the personalized rating prediction task based on review texts for the recommendation. Recently, most of the related researches use convolutional neural networks to capture local context information, but it loses word frequency and global context information. In addition, they simply equate the user (item) embedding to review embedding, which brings some irrelevant information of the review text into user preference or item property. Moreover, they only consider the low-order interactions, which remain the fine-grained user-item interactions to be explored. To solve these problems, we propose a novel method neural collaborative embedding model (NCEM). We first adopt pre-trained BERT model, which has been proven to improve most of the downstream NLP tasks, to simultaneously capture the global context and word frequency information. In addition, a self-attention mechanism is introduced to learn the contribution of each review. Next, we develop a neural form of standard factorization machine, which can model first-order and second-order user-item interactions by stacking multiple layers. The extensive experiments on four public datasets showed that NCEM consistently outperforms the state-of-the-art recommendation approaches. Furthermore, the recommendation interpretability can be improved by showing users the high score reviews accompanied recommended item.https://ieeexplore.ieee.org/document/8782556/Recommender systemcollaborative filteringdeep learningfactorization machine |
spellingShingle | Xingjie Feng Yunze Zeng Neural Collaborative Embedding From Reviews for Recommendation IEEE Access Recommender system collaborative filtering deep learning factorization machine |
title | Neural Collaborative Embedding From Reviews for Recommendation |
title_full | Neural Collaborative Embedding From Reviews for Recommendation |
title_fullStr | Neural Collaborative Embedding From Reviews for Recommendation |
title_full_unstemmed | Neural Collaborative Embedding From Reviews for Recommendation |
title_short | Neural Collaborative Embedding From Reviews for Recommendation |
title_sort | neural collaborative embedding from reviews for recommendation |
topic | Recommender system collaborative filtering deep learning factorization machine |
url | https://ieeexplore.ieee.org/document/8782556/ |
work_keys_str_mv | AT xingjiefeng neuralcollaborativeembeddingfromreviewsforrecommendation AT yunzezeng neuralcollaborativeembeddingfromreviewsforrecommendation |