Inverse Feature Learning: Feature Learning Based on Representation Learning of Error
This paper proposes inverse feature learning (IFL) as a novel supervised feature learning technique that learns a set of high-level features for classification based on an error representation approach. The key contribution of this method is to learn the representation of error as high-level feature...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2020-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9143092/ |
| _version_ | 1818727519690424320 |
|---|---|
| author | Behzad Ghazanfari Fatemeh Afghah Mohammadtaghi Hajiaghayi |
| author_facet | Behzad Ghazanfari Fatemeh Afghah Mohammadtaghi Hajiaghayi |
| author_sort | Behzad Ghazanfari |
| collection | DOAJ |
| description | This paper proposes inverse feature learning (IFL) as a novel supervised feature learning technique that learns a set of high-level features for classification based on an error representation approach. The key contribution of this method is to learn the representation of error as high-level features, while current representation learning methods interpret error by loss functions which are obtained as a function of differences between the true labels and the predicted ones. One advantage of this error representation is that the learned features for each class can be obtained independently of learned features for other classes; therefore, IFL can learn simultaneously meaning that it can learn new classes' features without retraining. Error representation learning can also help with generalization and reduce the chance of over-fitting by adding a set of impactful features to the original data set which capture the relationships between each instance and different classes through an error generation and analysis process. This method can be particularly effective in data sets, where the instances of each class have diverse feature representations or the ones with imbalanced classes. The experimental results show that the proposed IFL results in better performance compared to the state-of-the-art classification techniques for several popular data sets. We hope this paper can open a new path to utilize the proposed perspective of error representation learning in different feature learning domains. |
| first_indexed | 2024-12-17T22:15:24Z |
| format | Article |
| id | doaj.art-d9342804335f4d418722fe4c05c03288 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-17T22:15:24Z |
| publishDate | 2020-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-d9342804335f4d418722fe4c05c032882022-12-21T21:30:38ZengIEEEIEEE Access2169-35362020-01-01813293713294910.1109/ACCESS.2020.30099029143092Inverse Feature Learning: Feature Learning Based on Representation Learning of ErrorBehzad Ghazanfari0https://orcid.org/0000-0003-3004-0823Fatemeh Afghah1https://orcid.org/0000-0002-2315-1173Mohammadtaghi Hajiaghayi2School of Informatics, Computing, and Cyber Systems, Northern Arizona University, Flagstaff, AZ, USASchool of Informatics, Computing, and Cyber Systems, Northern Arizona University, Flagstaff, AZ, USADepartment of Computer Science, University of Maryland, College Park, MD, USAThis paper proposes inverse feature learning (IFL) as a novel supervised feature learning technique that learns a set of high-level features for classification based on an error representation approach. The key contribution of this method is to learn the representation of error as high-level features, while current representation learning methods interpret error by loss functions which are obtained as a function of differences between the true labels and the predicted ones. One advantage of this error representation is that the learned features for each class can be obtained independently of learned features for other classes; therefore, IFL can learn simultaneously meaning that it can learn new classes' features without retraining. Error representation learning can also help with generalization and reduce the chance of over-fitting by adding a set of impactful features to the original data set which capture the relationships between each instance and different classes through an error generation and analysis process. This method can be particularly effective in data sets, where the instances of each class have diverse feature representations or the ones with imbalanced classes. The experimental results show that the proposed IFL results in better performance compared to the state-of-the-art classification techniques for several popular data sets. We hope this paper can open a new path to utilize the proposed perspective of error representation learning in different feature learning domains.https://ieeexplore.ieee.org/document/9143092/Representation learning of errorinverse feature learningclassification |
| spellingShingle | Behzad Ghazanfari Fatemeh Afghah Mohammadtaghi Hajiaghayi Inverse Feature Learning: Feature Learning Based on Representation Learning of Error IEEE Access Representation learning of error inverse feature learning classification |
| title | Inverse Feature Learning: Feature Learning Based on Representation Learning of Error |
| title_full | Inverse Feature Learning: Feature Learning Based on Representation Learning of Error |
| title_fullStr | Inverse Feature Learning: Feature Learning Based on Representation Learning of Error |
| title_full_unstemmed | Inverse Feature Learning: Feature Learning Based on Representation Learning of Error |
| title_short | Inverse Feature Learning: Feature Learning Based on Representation Learning of Error |
| title_sort | inverse feature learning feature learning based on representation learning of error |
| topic | Representation learning of error inverse feature learning classification |
| url | https://ieeexplore.ieee.org/document/9143092/ |
| work_keys_str_mv | AT behzadghazanfari inversefeaturelearningfeaturelearningbasedonrepresentationlearningoferror AT fatemehafghah inversefeaturelearningfeaturelearningbasedonrepresentationlearningoferror AT mohammadtaghihajiaghayi inversefeaturelearningfeaturelearningbasedonrepresentationlearningoferror |