An Improved 3D-2D Convolutional Neural Network Based on Feature Optimization for Hyperspectral Image Classification
As a new technology in the field of remote sensing, hyperspectral remote sensing has been widely used in land classification, mineral exploration, environmental monitoring, and other areas. In recent years, deep learning has achieved outstanding results in hyperspectral image classification tasks. H...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10056137/ |
| _version_ | 1797859058397478912 |
|---|---|
| author | Yamei Ma Shuangting Wang Weibing Du Xiaoqian Cheng |
| author_facet | Yamei Ma Shuangting Wang Weibing Du Xiaoqian Cheng |
| author_sort | Yamei Ma |
| collection | DOAJ |
| description | As a new technology in the field of remote sensing, hyperspectral remote sensing has been widely used in land classification, mineral exploration, environmental monitoring, and other areas. In recent years, deep learning has achieved outstanding results in hyperspectral image classification tasks. However, problems such as low classification accuracy for small sample classes in unbalanced datasets and lack of robustness of the models usually lead to unstable classification performance of hyperspectral images. Therefore, from the perspective of feature optimization, we propose an improved hybrid convolutional neural network for hyperspectral image feature extraction and classification. Different from the current simple multi-scale feature extraction, we first optimize the features of each scale, and then perform multi-scale feature fusion. To this end, we use 3D dilated convolution to design a multi-level feature extraction block (MFB), which can be used to extract features with different correlation strengths at a fixed scale. Then, we construct a spatial multi-scale interactive attention (SMIA) module in the spatial feature enhancement phase, which can refine the multi-scale features through the attention weights of multi-scale feature interaction, and further improve the quality of spatial features. Finally, experiments were performed on different datasets, including balanced and unbalanced samples. The results show that the proposed model is more accurate and the extracted features are more robust. |
| first_indexed | 2024-04-09T21:23:21Z |
| format | Article |
| id | doaj.art-02c6640892f04227b3d9480045c09b4e |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-09T21:23:21Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-02c6640892f04227b3d9480045c09b4e2023-03-27T23:00:25ZengIEEEIEEE Access2169-35362023-01-0111282632827910.1109/ACCESS.2023.325044710056137An Improved 3D-2D Convolutional Neural Network Based on Feature Optimization for Hyperspectral Image ClassificationYamei Ma0https://orcid.org/0000-0002-2958-4543Shuangting Wang1Weibing Du2https://orcid.org/0000-0002-3005-2819Xiaoqian Cheng3School of Surveying and Land Information Engineering, Henan Polytechnic University, Jiaozuo, ChinaSchool of Surveying and Land Information Engineering, Henan Polytechnic University, Jiaozuo, ChinaSchool of Surveying and Land Information Engineering, Henan Polytechnic University, Jiaozuo, ChinaSchool of Surveying and Land Information Engineering, Henan Polytechnic University, Jiaozuo, ChinaAs a new technology in the field of remote sensing, hyperspectral remote sensing has been widely used in land classification, mineral exploration, environmental monitoring, and other areas. In recent years, deep learning has achieved outstanding results in hyperspectral image classification tasks. However, problems such as low classification accuracy for small sample classes in unbalanced datasets and lack of robustness of the models usually lead to unstable classification performance of hyperspectral images. Therefore, from the perspective of feature optimization, we propose an improved hybrid convolutional neural network for hyperspectral image feature extraction and classification. Different from the current simple multi-scale feature extraction, we first optimize the features of each scale, and then perform multi-scale feature fusion. To this end, we use 3D dilated convolution to design a multi-level feature extraction block (MFB), which can be used to extract features with different correlation strengths at a fixed scale. Then, we construct a spatial multi-scale interactive attention (SMIA) module in the spatial feature enhancement phase, which can refine the multi-scale features through the attention weights of multi-scale feature interaction, and further improve the quality of spatial features. Finally, experiments were performed on different datasets, including balanced and unbalanced samples. The results show that the proposed model is more accurate and the extracted features are more robust.https://ieeexplore.ieee.org/document/10056137/Hybrid convolutional neural networkfeature extractionattention mechanismspectral-spatial classificationunbalanced dataset |
| spellingShingle | Yamei Ma Shuangting Wang Weibing Du Xiaoqian Cheng An Improved 3D-2D Convolutional Neural Network Based on Feature Optimization for Hyperspectral Image Classification IEEE Access Hybrid convolutional neural network feature extraction attention mechanism spectral-spatial classification unbalanced dataset |
| title | An Improved 3D-2D Convolutional Neural Network Based on Feature Optimization for Hyperspectral Image Classification |
| title_full | An Improved 3D-2D Convolutional Neural Network Based on Feature Optimization for Hyperspectral Image Classification |
| title_fullStr | An Improved 3D-2D Convolutional Neural Network Based on Feature Optimization for Hyperspectral Image Classification |
| title_full_unstemmed | An Improved 3D-2D Convolutional Neural Network Based on Feature Optimization for Hyperspectral Image Classification |
| title_short | An Improved 3D-2D Convolutional Neural Network Based on Feature Optimization for Hyperspectral Image Classification |
| title_sort | improved 3d 2d convolutional neural network based on feature optimization for hyperspectral image classification |
| topic | Hybrid convolutional neural network feature extraction attention mechanism spectral-spatial classification unbalanced dataset |
| url | https://ieeexplore.ieee.org/document/10056137/ |
| work_keys_str_mv | AT yameima animproved3d2dconvolutionalneuralnetworkbasedonfeatureoptimizationforhyperspectralimageclassification AT shuangtingwang animproved3d2dconvolutionalneuralnetworkbasedonfeatureoptimizationforhyperspectralimageclassification AT weibingdu animproved3d2dconvolutionalneuralnetworkbasedonfeatureoptimizationforhyperspectralimageclassification AT xiaoqiancheng animproved3d2dconvolutionalneuralnetworkbasedonfeatureoptimizationforhyperspectralimageclassification AT yameima improved3d2dconvolutionalneuralnetworkbasedonfeatureoptimizationforhyperspectralimageclassification AT shuangtingwang improved3d2dconvolutionalneuralnetworkbasedonfeatureoptimizationforhyperspectralimageclassification AT weibingdu improved3d2dconvolutionalneuralnetworkbasedonfeatureoptimizationforhyperspectralimageclassification AT xiaoqiancheng improved3d2dconvolutionalneuralnetworkbasedonfeatureoptimizationforhyperspectralimageclassification |