Enumerative feature subset based ranking system for learning to rank in presence of implicit user feedback
This paper proposed a new method for learning to rank documents using enumerative feature subsetting in the presence of the implicit user feedback of the various classes of users. The objective of this research was to provide an alternative method for learning ranking functions using important subse...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2020-10-01
|
| Series: | Journal of King Saud University: Computer and Information Sciences |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S1319157817302847 |
| _version_ | 1818147821387251712 |
|---|---|
| author | Mohd Wazih Ahmad M.N. Doja Tanvir Ahmad |
| author_facet | Mohd Wazih Ahmad M.N. Doja Tanvir Ahmad |
| author_sort | Mohd Wazih Ahmad |
| collection | DOAJ |
| description | This paper proposed a new method for learning to rank documents using enumerative feature subsetting in the presence of the implicit user feedback of the various classes of users. The objective of this research was to provide an alternative method for learning ranking functions using important subsets of the LETOR (Learning to Rank) features based on the feedback of various classes of the users identified from active subsets of the features. This research, unlike other feature engineering approaches, do not force the learner to drop the inactive features permanently; instead, it allows to learn ranking function on currently active feature subsets while keeping inactive subsets of the features in the training process. The proposed model allows the search engine to dynamically utilize the implicit user feedback of the various classes of the users in learning ranking models repeatedly. The experiments performed on the LETOR MQ2008 dataset shows that the proposed model gives better NDCG (Normalized Discounted Cumulative Gain) scores for the subsets of users in the ensemble settings. Results also show that the variance of the predicted ranking can be controlled by controlling the hyper-parameters like the probability of the selection of a subset, feedback on the subsets and the weights of each subset used in training the low-level ranker. We have used cross-entropy pairwise learner RankNet and the maximum margin type svmRank as low-level rankers, but their objective functions are modified for the feature subsets. Results obtained by bagging and boosting based ensemble methods shows that the proposed method is flexible enough to model a family of the feedback weights on the individual models and can be used to provide personalized rank learning functions to the selected subsets of the users. |
| first_indexed | 2024-12-11T12:41:20Z |
| format | Article |
| id | doaj.art-37d5532a78644f22bf01786b55745dc7 |
| institution | Directory Open Access Journal |
| issn | 1319-1578 |
| language | English |
| last_indexed | 2024-12-11T12:41:20Z |
| publishDate | 2020-10-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Journal of King Saud University: Computer and Information Sciences |
| spelling | doaj.art-37d5532a78644f22bf01786b55745dc72022-12-22T01:06:58ZengElsevierJournal of King Saud University: Computer and Information Sciences1319-15782020-10-01328965976Enumerative feature subset based ranking system for learning to rank in presence of implicit user feedbackMohd Wazih Ahmad0M.N. Doja1Tanvir Ahmad2Department of Computer Engineering, Jamia Millia Islamia, New Delhi, IndiaDepartment of Computer Engineering, Jamia Millia Islamia, New Delhi, IndiaCorresponding author.; Department of Computer Engineering, Jamia Millia Islamia, New Delhi, IndiaThis paper proposed a new method for learning to rank documents using enumerative feature subsetting in the presence of the implicit user feedback of the various classes of users. The objective of this research was to provide an alternative method for learning ranking functions using important subsets of the LETOR (Learning to Rank) features based on the feedback of various classes of the users identified from active subsets of the features. This research, unlike other feature engineering approaches, do not force the learner to drop the inactive features permanently; instead, it allows to learn ranking function on currently active feature subsets while keeping inactive subsets of the features in the training process. The proposed model allows the search engine to dynamically utilize the implicit user feedback of the various classes of the users in learning ranking models repeatedly. The experiments performed on the LETOR MQ2008 dataset shows that the proposed model gives better NDCG (Normalized Discounted Cumulative Gain) scores for the subsets of users in the ensemble settings. Results also show that the variance of the predicted ranking can be controlled by controlling the hyper-parameters like the probability of the selection of a subset, feedback on the subsets and the weights of each subset used in training the low-level ranker. We have used cross-entropy pairwise learner RankNet and the maximum margin type svmRank as low-level rankers, but their objective functions are modified for the feature subsets. Results obtained by bagging and boosting based ensemble methods shows that the proposed method is flexible enough to model a family of the feedback weights on the individual models and can be used to provide personalized rank learning functions to the selected subsets of the users.http://www.sciencedirect.com/science/article/pii/S1319157817302847Learning to rankSubset rankingFeature based rankingEnsemble rank learning |
| spellingShingle | Mohd Wazih Ahmad M.N. Doja Tanvir Ahmad Enumerative feature subset based ranking system for learning to rank in presence of implicit user feedback Journal of King Saud University: Computer and Information Sciences Learning to rank Subset ranking Feature based ranking Ensemble rank learning |
| title | Enumerative feature subset based ranking system for learning to rank in presence of implicit user feedback |
| title_full | Enumerative feature subset based ranking system for learning to rank in presence of implicit user feedback |
| title_fullStr | Enumerative feature subset based ranking system for learning to rank in presence of implicit user feedback |
| title_full_unstemmed | Enumerative feature subset based ranking system for learning to rank in presence of implicit user feedback |
| title_short | Enumerative feature subset based ranking system for learning to rank in presence of implicit user feedback |
| title_sort | enumerative feature subset based ranking system for learning to rank in presence of implicit user feedback |
| topic | Learning to rank Subset ranking Feature based ranking Ensemble rank learning |
| url | http://www.sciencedirect.com/science/article/pii/S1319157817302847 |
| work_keys_str_mv | AT mohdwazihahmad enumerativefeaturesubsetbasedrankingsystemforlearningtorankinpresenceofimplicituserfeedback AT mndoja enumerativefeaturesubsetbasedrankingsystemforlearningtorankinpresenceofimplicituserfeedback AT tanvirahmad enumerativefeaturesubsetbasedrankingsystemforlearningtorankinpresenceofimplicituserfeedback |