Multiview Hierarchical Network for Hyperspectral and LiDAR Data Classification
In recent times, multisource remote sensing technology [e.g., hyperspectral image (HSI) and light detection and ranging (LiDAR) data] has been widely used in urban land-use recognition owing to its high classification effectiveness compared to using only single-source data. In this study, a multivie...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2022-01-01
|
| Series: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9690008/ |
| _version_ | 1818331541825126400 |
|---|---|
| author | Yishu Peng Yuwen Zhang Bing Tu Chengle Zhou Qianming Li |
| author_facet | Yishu Peng Yuwen Zhang Bing Tu Chengle Zhou Qianming Li |
| author_sort | Yishu Peng |
| collection | DOAJ |
| description | In recent times, multisource remote sensing technology [e.g., hyperspectral image (HSI) and light detection and ranging (LiDAR) data] has been widely used in urban land-use recognition owing to its high classification effectiveness compared to using only single-source data. In this study, a multiview hierarchical network (MVHN) technique is developed for HSI and LiDAR data classification, which conducts the following execution procedures. First, based on the a preset band step length, the original HSI is sampled and divided into multiple groups with exactly the same number of bands to obtain spectral features. Then, principal components analysis is performed on the raw HSI to extract the first principal components (PCs) that meet the size of the LiDAR image. The Gabor filters are applied to the PCs and LiDAR to capture spatial details (i.e., textural features) of scenes. Specifically, a stacking mechanism is employed to generate fusion features once the above features are available. Next, a three-dimensional ResNet-like deep CNN is designed to extract the spectral–spatial information of the fusion feature. Finally, majority-voting is introduced into the classification results of the network trained using each fusion feature to achieve high-confidence final results. Experiments on three well-known HSI and LiDAR datasets (i.e., Houston, MUUFL, and Trento datasets) demonstrate the effectiveness of the proposed MVHN method compared to state-of-the-art comparable classification methods. |
| first_indexed | 2024-12-13T13:21:30Z |
| format | Article |
| id | doaj.art-3563a107ff474716915a30593a0c5ff3 |
| institution | Directory Open Access Journal |
| issn | 2151-1535 |
| language | English |
| last_indexed | 2024-12-13T13:21:30Z |
| publishDate | 2022-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| spelling | doaj.art-3563a107ff474716915a30593a0c5ff32022-12-21T23:44:23ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2151-15352022-01-01151454146910.1109/JSTARS.2022.31443129690008Multiview Hierarchical Network for Hyperspectral and LiDAR Data ClassificationYishu Peng0https://orcid.org/0000-0003-3942-978XYuwen Zhang1Bing Tu2https://orcid.org/0000-0001-5802-9496Chengle Zhou3https://orcid.org/0000-0003-3107-5446Qianming Li4https://orcid.org/0000-0001-9293-9629School of Information Science and Engineering, Hunan Institute of Science and Technology, Yueyang, ChinaSchool of Information Science and Engineering, Hunan Institute of Science and Technology, Yueyang, ChinaSchool of Information Science and Engineering, Hunan Institute of Science and Technology, Yueyang, ChinaSchool of Information Science and Engineering, Hunan Institute of Science and Technology, Yueyang, ChinaSchool of Information Science and Engineering, Hunan Institute of Science and Technology, Yueyang, ChinaIn recent times, multisource remote sensing technology [e.g., hyperspectral image (HSI) and light detection and ranging (LiDAR) data] has been widely used in urban land-use recognition owing to its high classification effectiveness compared to using only single-source data. In this study, a multiview hierarchical network (MVHN) technique is developed for HSI and LiDAR data classification, which conducts the following execution procedures. First, based on the a preset band step length, the original HSI is sampled and divided into multiple groups with exactly the same number of bands to obtain spectral features. Then, principal components analysis is performed on the raw HSI to extract the first principal components (PCs) that meet the size of the LiDAR image. The Gabor filters are applied to the PCs and LiDAR to capture spatial details (i.e., textural features) of scenes. Specifically, a stacking mechanism is employed to generate fusion features once the above features are available. Next, a three-dimensional ResNet-like deep CNN is designed to extract the spectral–spatial information of the fusion feature. Finally, majority-voting is introduced into the classification results of the network trained using each fusion feature to achieve high-confidence final results. Experiments on three well-known HSI and LiDAR datasets (i.e., Houston, MUUFL, and Trento datasets) demonstrate the effectiveness of the proposed MVHN method compared to state-of-the-art comparable classification methods.https://ieeexplore.ieee.org/document/9690008/ClassificationGabor featurehyperspectral image (HSI)light detection and ranging (LiDAR)multisource remote sensingresidual network |
| spellingShingle | Yishu Peng Yuwen Zhang Bing Tu Chengle Zhou Qianming Li Multiview Hierarchical Network for Hyperspectral and LiDAR Data Classification IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Classification Gabor feature hyperspectral image (HSI) light detection and ranging (LiDAR) multisource remote sensing residual network |
| title | Multiview Hierarchical Network for Hyperspectral and LiDAR Data Classification |
| title_full | Multiview Hierarchical Network for Hyperspectral and LiDAR Data Classification |
| title_fullStr | Multiview Hierarchical Network for Hyperspectral and LiDAR Data Classification |
| title_full_unstemmed | Multiview Hierarchical Network for Hyperspectral and LiDAR Data Classification |
| title_short | Multiview Hierarchical Network for Hyperspectral and LiDAR Data Classification |
| title_sort | multiview hierarchical network for hyperspectral and lidar data classification |
| topic | Classification Gabor feature hyperspectral image (HSI) light detection and ranging (LiDAR) multisource remote sensing residual network |
| url | https://ieeexplore.ieee.org/document/9690008/ |
| work_keys_str_mv | AT yishupeng multiviewhierarchicalnetworkforhyperspectralandlidardataclassification AT yuwenzhang multiviewhierarchicalnetworkforhyperspectralandlidardataclassification AT bingtu multiviewhierarchicalnetworkforhyperspectralandlidardataclassification AT chenglezhou multiviewhierarchicalnetworkforhyperspectralandlidardataclassification AT qianmingli multiviewhierarchicalnetworkforhyperspectralandlidardataclassification |