Unsupervised Deep Feature Learning With Iteratively Refined Pseudo Classes for Scene Representation
Recently, more and more attention has been focused on the remote sensing scenes since they contain plentiful spectral and spatial information. In order to obtain good performance for scene representation, a proper model for feature extraction and large amounts of labeled training samples are require...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2019-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/8760240/ |
| _version_ | 1818665674802724864 |
|---|---|
| author | Zhiqiang Gong Ping Zhong Weidong Hu |
| author_facet | Zhiqiang Gong Ping Zhong Weidong Hu |
| author_sort | Zhiqiang Gong |
| collection | DOAJ |
| description | Recently, more and more attention has been focused on the remote sensing scenes since they contain plentiful spectral and spatial information. In order to obtain good performance for scene representation, a proper model for feature extraction and large amounts of labeled training samples are required. However, in real-world applications, it usually cannot provide enough labeled samples since labeling is always time-consuming. To overcome this problem, this work develops a novel unsupervised deep feature learning framework with iteratively refined pseudo-classes for remote sensing scene representation. First, we introduce the center points to construct the pseudo-classes and assign the pseudo labels to the training samples. Then, a pseudo-center loss is developed by decreasing the intra-class variance between the learned features of the samples and the corresponding center points to iteratively refine the pseudo classes with the training samples in the training process. Moreover, to increase the inter-class variance between different pseudo classes and further improve the performance of the unsupervised learning, this work imposes the diversity-promoting priors over the center points. Finally, the unsupervised learning framework is developed by joint learning of the diversified pseudo-center loss and pseudo-class-based softmax loss where the pseudo-class-based softmax loss is to update the convolutional neural network (CNN) with the pseudo-classes and the diversified pseudo-center loss is to iteratively refine the pseudo-classes with the features learned from the CNN. Experiments are conducted over three real-world remote sensing scene datasets to validate the effectiveness of the proposed method and the experimental results show the superiority of the method when compared with other state-of-the-art methods. |
| first_indexed | 2024-12-17T05:52:24Z |
| format | Article |
| id | doaj.art-29317d5fee2847c79166fe8673258f9b |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-17T05:52:24Z |
| publishDate | 2019-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-29317d5fee2847c79166fe8673258f9b2022-12-21T22:01:08ZengIEEEIEEE Access2169-35362019-01-017947799479210.1109/ACCESS.2019.29283288760240Unsupervised Deep Feature Learning With Iteratively Refined Pseudo Classes for Scene RepresentationZhiqiang Gong0https://orcid.org/0000-0001-7999-3014Ping Zhong1Weidong Hu2National Key Laboratory of Science and Technology on ATR, College of Electronic Science and Technology, National University of Defense Technology, Changsha, ChinaNational Key Laboratory of Science and Technology on ATR, College of Electronic Science and Technology, National University of Defense Technology, Changsha, ChinaNational Key Laboratory of Science and Technology on ATR, College of Electronic Science and Technology, National University of Defense Technology, Changsha, ChinaRecently, more and more attention has been focused on the remote sensing scenes since they contain plentiful spectral and spatial information. In order to obtain good performance for scene representation, a proper model for feature extraction and large amounts of labeled training samples are required. However, in real-world applications, it usually cannot provide enough labeled samples since labeling is always time-consuming. To overcome this problem, this work develops a novel unsupervised deep feature learning framework with iteratively refined pseudo-classes for remote sensing scene representation. First, we introduce the center points to construct the pseudo-classes and assign the pseudo labels to the training samples. Then, a pseudo-center loss is developed by decreasing the intra-class variance between the learned features of the samples and the corresponding center points to iteratively refine the pseudo classes with the training samples in the training process. Moreover, to increase the inter-class variance between different pseudo classes and further improve the performance of the unsupervised learning, this work imposes the diversity-promoting priors over the center points. Finally, the unsupervised learning framework is developed by joint learning of the diversified pseudo-center loss and pseudo-class-based softmax loss where the pseudo-class-based softmax loss is to update the convolutional neural network (CNN) with the pseudo-classes and the diversified pseudo-center loss is to iteratively refine the pseudo-classes with the features learned from the CNN. Experiments are conducted over three real-world remote sensing scene datasets to validate the effectiveness of the proposed method and the experimental results show the superiority of the method when compared with other state-of-the-art methods.https://ieeexplore.ieee.org/document/8760240/Unsupervised deep learningpseudo classdiversityCNNscene classification |
| spellingShingle | Zhiqiang Gong Ping Zhong Weidong Hu Unsupervised Deep Feature Learning With Iteratively Refined Pseudo Classes for Scene Representation IEEE Access Unsupervised deep learning pseudo class diversity CNN scene classification |
| title | Unsupervised Deep Feature Learning With Iteratively Refined Pseudo Classes for Scene Representation |
| title_full | Unsupervised Deep Feature Learning With Iteratively Refined Pseudo Classes for Scene Representation |
| title_fullStr | Unsupervised Deep Feature Learning With Iteratively Refined Pseudo Classes for Scene Representation |
| title_full_unstemmed | Unsupervised Deep Feature Learning With Iteratively Refined Pseudo Classes for Scene Representation |
| title_short | Unsupervised Deep Feature Learning With Iteratively Refined Pseudo Classes for Scene Representation |
| title_sort | unsupervised deep feature learning with iteratively refined pseudo classes for scene representation |
| topic | Unsupervised deep learning pseudo class diversity CNN scene classification |
| url | https://ieeexplore.ieee.org/document/8760240/ |
| work_keys_str_mv | AT zhiqianggong unsuperviseddeepfeaturelearningwithiterativelyrefinedpseudoclassesforscenerepresentation AT pingzhong unsuperviseddeepfeaturelearningwithiterativelyrefinedpseudoclassesforscenerepresentation AT weidonghu unsuperviseddeepfeaturelearningwithiterativelyrefinedpseudoclassesforscenerepresentation |