Neural Collaborative Embedding From Reviews for Recommendation

This paper mainly studies the personalized rating prediction task based on review texts for the recommendation. Recently, most of the related researches use convolutional neural networks to capture local context information, but it loses word frequency and global context information. In addition, th...

Full description

Bibliographic Details
Main Authors: Xingjie Feng, Yunze Zeng
Format: Article
Language:English
Published: IEEE 2019-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8782556/
_version_ 1818642897585569792
author Xingjie Feng
Yunze Zeng
author_facet Xingjie Feng
Yunze Zeng
author_sort Xingjie Feng
collection DOAJ
description This paper mainly studies the personalized rating prediction task based on review texts for the recommendation. Recently, most of the related researches use convolutional neural networks to capture local context information, but it loses word frequency and global context information. In addition, they simply equate the user (item) embedding to review embedding, which brings some irrelevant information of the review text into user preference or item property. Moreover, they only consider the low-order interactions, which remain the fine-grained user-item interactions to be explored. To solve these problems, we propose a novel method neural collaborative embedding model (NCEM). We first adopt pre-trained BERT model, which has been proven to improve most of the downstream NLP tasks, to simultaneously capture the global context and word frequency information. In addition, a self-attention mechanism is introduced to learn the contribution of each review. Next, we develop a neural form of standard factorization machine, which can model first-order and second-order user-item interactions by stacking multiple layers. The extensive experiments on four public datasets showed that NCEM consistently outperforms the state-of-the-art recommendation approaches. Furthermore, the recommendation interpretability can be improved by showing users the high score reviews accompanied recommended item.
first_indexed 2024-12-16T23:50:22Z
format Article
id doaj.art-744ef9536dc64b1fbcb5ba11824ba501
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-16T23:50:22Z
publishDate 2019-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-744ef9536dc64b1fbcb5ba11824ba5012022-12-21T22:11:22ZengIEEEIEEE Access2169-35362019-01-01710326310327410.1109/ACCESS.2019.29313578782556Neural Collaborative Embedding From Reviews for RecommendationXingjie Feng0Yunze Zeng1https://orcid.org/0000-0003-2081-0505College of Computer Science and Technology, Civil Aviation University of China, Tianjin, ChinaCollege of Computer Science and Technology, Civil Aviation University of China, Tianjin, ChinaThis paper mainly studies the personalized rating prediction task based on review texts for the recommendation. Recently, most of the related researches use convolutional neural networks to capture local context information, but it loses word frequency and global context information. In addition, they simply equate the user (item) embedding to review embedding, which brings some irrelevant information of the review text into user preference or item property. Moreover, they only consider the low-order interactions, which remain the fine-grained user-item interactions to be explored. To solve these problems, we propose a novel method neural collaborative embedding model (NCEM). We first adopt pre-trained BERT model, which has been proven to improve most of the downstream NLP tasks, to simultaneously capture the global context and word frequency information. In addition, a self-attention mechanism is introduced to learn the contribution of each review. Next, we develop a neural form of standard factorization machine, which can model first-order and second-order user-item interactions by stacking multiple layers. The extensive experiments on four public datasets showed that NCEM consistently outperforms the state-of-the-art recommendation approaches. Furthermore, the recommendation interpretability can be improved by showing users the high score reviews accompanied recommended item.https://ieeexplore.ieee.org/document/8782556/Recommender systemcollaborative filteringdeep learningfactorization machine
spellingShingle Xingjie Feng
Yunze Zeng
Neural Collaborative Embedding From Reviews for Recommendation
IEEE Access
Recommender system
collaborative filtering
deep learning
factorization machine
title Neural Collaborative Embedding From Reviews for Recommendation
title_full Neural Collaborative Embedding From Reviews for Recommendation
title_fullStr Neural Collaborative Embedding From Reviews for Recommendation
title_full_unstemmed Neural Collaborative Embedding From Reviews for Recommendation
title_short Neural Collaborative Embedding From Reviews for Recommendation
title_sort neural collaborative embedding from reviews for recommendation
topic Recommender system
collaborative filtering
deep learning
factorization machine
url https://ieeexplore.ieee.org/document/8782556/
work_keys_str_mv AT xingjiefeng neuralcollaborativeembeddingfromreviewsforrecommendation
AT yunzezeng neuralcollaborativeembeddingfromreviewsforrecommendation