Progressive Feature Fusion Framework Based on Graph Convolutional Network for Remote Sensing Scene Classification
Remote sensing (RS) scene classification plays an important role in the intelligent interpretation of RS data. Recently, convolutional neural network (CNN)-based and attention-based methods have become the mainstream of RS scene classification with impressive results. However, existing CNN-based met...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2024-01-01
|
| Series: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10381852/ |
| _version_ | 1827370984297988096 |
|---|---|
| author | Chongyang Zhang Bin Wang |
| author_facet | Chongyang Zhang Bin Wang |
| author_sort | Chongyang Zhang |
| collection | DOAJ |
| description | Remote sensing (RS) scene classification plays an important role in the intelligent interpretation of RS data. Recently, convolutional neural network (CNN)-based and attention-based methods have become the mainstream of RS scene classification with impressive results. However, existing CNN-based methods do not utilize long-range information, and existing attention-based methods do not fully exploit multiscale information, although both aspects of information are essential for a comprehensive understanding of RS scene images. To overcome the above limitations, we propose a progressive feature fusion (PFF) framework based on graph convolutional network (GCN), namely PFFGCN for RS scene classification in this article, which has a strong ability to learn both multiscale and contextual (local/long-range) information in RS scene images. It mainly consists of two modules: a multilayer feature extraction module and a multiscale contextual information fusion (MCIF) module. The MFE module is utilized to extract multilevel features and global features, and the MCIF module is constructed to capture rich contextual information from multilevel features and fuse them in a progressive manner. In MCIF, GCN is adopted to explore intrinsic attributes (including the topological structure and the contextual information) hidden in each feature map. Through the PFF strategy, the graph features at each level are fused with the next-level features to reduce the semantic gap between nonadjacent features and enhance the multiscale representation of the model. Besides, grouped GCN based on channel grouping is further proposed to improve the efficiency of PFFGCN. The proposed method is extensively evaluated on various RS scene classification datasets, and the experimental results demonstrate that the proposed method outperforms current state-of-the-art methods. |
| first_indexed | 2024-03-08T10:31:33Z |
| format | Article |
| id | doaj.art-83e8070373064b938266cdbfdc954aa3 |
| institution | Directory Open Access Journal |
| issn | 2151-1535 |
| language | English |
| last_indexed | 2024-03-08T10:31:33Z |
| publishDate | 2024-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| spelling | doaj.art-83e8070373064b938266cdbfdc954aa32024-01-27T00:00:59ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2151-15352024-01-01173270328410.1109/JSTARS.2024.335012910381852Progressive Feature Fusion Framework Based on Graph Convolutional Network for Remote Sensing Scene ClassificationChongyang Zhang0https://orcid.org/0009-0007-8830-0903Bin Wang1https://orcid.org/0000-0003-4748-6426Key Laboratory for Information Science of Electromagnetic Waves (MoE), Fudan University, Shanghai, ChinaKey Laboratory for Information Science of Electromagnetic Waves (MoE), Fudan University, Shanghai, ChinaRemote sensing (RS) scene classification plays an important role in the intelligent interpretation of RS data. Recently, convolutional neural network (CNN)-based and attention-based methods have become the mainstream of RS scene classification with impressive results. However, existing CNN-based methods do not utilize long-range information, and existing attention-based methods do not fully exploit multiscale information, although both aspects of information are essential for a comprehensive understanding of RS scene images. To overcome the above limitations, we propose a progressive feature fusion (PFF) framework based on graph convolutional network (GCN), namely PFFGCN for RS scene classification in this article, which has a strong ability to learn both multiscale and contextual (local/long-range) information in RS scene images. It mainly consists of two modules: a multilayer feature extraction module and a multiscale contextual information fusion (MCIF) module. The MFE module is utilized to extract multilevel features and global features, and the MCIF module is constructed to capture rich contextual information from multilevel features and fuse them in a progressive manner. In MCIF, GCN is adopted to explore intrinsic attributes (including the topological structure and the contextual information) hidden in each feature map. Through the PFF strategy, the graph features at each level are fused with the next-level features to reduce the semantic gap between nonadjacent features and enhance the multiscale representation of the model. Besides, grouped GCN based on channel grouping is further proposed to improve the efficiency of PFFGCN. The proposed method is extensively evaluated on various RS scene classification datasets, and the experimental results demonstrate that the proposed method outperforms current state-of-the-art methods.https://ieeexplore.ieee.org/document/10381852/Feature fusiongraph convolutional network (GCN)graph learningremote sensing (RS)scene classification |
| spellingShingle | Chongyang Zhang Bin Wang Progressive Feature Fusion Framework Based on Graph Convolutional Network for Remote Sensing Scene Classification IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Feature fusion graph convolutional network (GCN) graph learning remote sensing (RS) scene classification |
| title | Progressive Feature Fusion Framework Based on Graph Convolutional Network for Remote Sensing Scene Classification |
| title_full | Progressive Feature Fusion Framework Based on Graph Convolutional Network for Remote Sensing Scene Classification |
| title_fullStr | Progressive Feature Fusion Framework Based on Graph Convolutional Network for Remote Sensing Scene Classification |
| title_full_unstemmed | Progressive Feature Fusion Framework Based on Graph Convolutional Network for Remote Sensing Scene Classification |
| title_short | Progressive Feature Fusion Framework Based on Graph Convolutional Network for Remote Sensing Scene Classification |
| title_sort | progressive feature fusion framework based on graph convolutional network for remote sensing scene classification |
| topic | Feature fusion graph convolutional network (GCN) graph learning remote sensing (RS) scene classification |
| url | https://ieeexplore.ieee.org/document/10381852/ |
| work_keys_str_mv | AT chongyangzhang progressivefeaturefusionframeworkbasedongraphconvolutionalnetworkforremotesensingsceneclassification AT binwang progressivefeaturefusionframeworkbasedongraphconvolutionalnetworkforremotesensingsceneclassification |