MSCDUNet: A Deep Learning Framework for Built-Up Area Change Detection Integrating Multispectral, SAR, and VHR Data
Built-up area change detection (CD) plays an important role in city management, which always uses very high spatial resolution (VHR) remote sensing data to extract refined spatial information. Recently, many CD models based on deep learning with VHR data have been proposed. However, due to the compl...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2022-01-01
|
| Series: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9791854/ |
| _version_ | 1811338366861443072 |
|---|---|
| author | Haoyang Li Fangjie Zhu Xiaoyu Zheng Mengxi Liu Guangzhao Chen |
| author_facet | Haoyang Li Fangjie Zhu Xiaoyu Zheng Mengxi Liu Guangzhao Chen |
| author_sort | Haoyang Li |
| collection | DOAJ |
| description | Built-up area change detection (CD) plays an important role in city management, which always uses very high spatial resolution (VHR) remote sensing data to extract refined spatial information. Recently, many CD models based on deep learning with VHR data have been proposed. However, due to the complex background information and natural landscape changes, VHR with optical RGB features is hard to extract changes exactly. To this end, we tend to explore the abundant channel information of multispectral and SAR data as a supplement to the refined spatial features of VHR images. We propose a new deep learning framework called multisource CD UNet++ (MSCDUNet), integrating multispectral, SAR, and VHR data for built-up area CD. First, we label and reform two new built-up area CD datasets containing multispectral, SAR, and VHR data: multisource built-up change (MSBC) and multisource OSCD (MSOSCD) datasets. Second, a feature selection method based on random forest is introduced to choose effective features from multispectral and SAR images. Finally, a multilevel heterogeneous feature fusion module is embedded in MSCDUNet to combine multifeatures for CD. Experiments are conducted on both the MSOSCD and the MSBC datasets. Compared to other CD methods based on VHR images, our proposal achieves the highest accuracy on both datasets and proves the effectiveness of multispectral, SAR, and VHR data fusion for CD. The dataset in the article will be available for download from the following link.<sup>1</sup> |
| first_indexed | 2024-04-13T18:08:47Z |
| format | Article |
| id | doaj.art-e7e452fdca864a68b05e2d2cf3513184 |
| institution | Directory Open Access Journal |
| issn | 2151-1535 |
| language | English |
| last_indexed | 2024-04-13T18:08:47Z |
| publishDate | 2022-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| spelling | doaj.art-e7e452fdca864a68b05e2d2cf35131842022-12-22T02:35:58ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2151-15352022-01-01155163517610.1109/JSTARS.2022.31811559791854MSCDUNet: A Deep Learning Framework for Built-Up Area Change Detection Integrating Multispectral, SAR, and VHR DataHaoyang Li0https://orcid.org/0000-0001-8725-342XFangjie Zhu1Xiaoyu Zheng2Mengxi Liu3https://orcid.org/0000-0001-5237-4758Guangzhao Chen4https://orcid.org/0000-0001-7537-2288Guangdong Provincial Key Laboratory of Urbanization and Geo-Simulation, School of Geography and Planning, Sun Yat-sen University, Guangzhou, ChinaGuangdong Provincial Key Laboratory of Urbanization and Geo-Simulation, School of Geography and Planning, Sun Yat-sen University, Guangzhou, ChinaGuangdong Provincial Key Laboratory of Urbanization and Geo-Simulation, School of Geography and Planning, Sun Yat-sen University, Guangzhou, ChinaGuangdong Provincial Key Laboratory of Urbanization and Geo-Simulation, School of Geography and Planning, Sun Yat-sen University, Guangzhou, ChinaDivision of Landscape Architecture, Faculty of Architecture, The University of Hong Kong, Hong Kong SAR, ChinaBuilt-up area change detection (CD) plays an important role in city management, which always uses very high spatial resolution (VHR) remote sensing data to extract refined spatial information. Recently, many CD models based on deep learning with VHR data have been proposed. However, due to the complex background information and natural landscape changes, VHR with optical RGB features is hard to extract changes exactly. To this end, we tend to explore the abundant channel information of multispectral and SAR data as a supplement to the refined spatial features of VHR images. We propose a new deep learning framework called multisource CD UNet++ (MSCDUNet), integrating multispectral, SAR, and VHR data for built-up area CD. First, we label and reform two new built-up area CD datasets containing multispectral, SAR, and VHR data: multisource built-up change (MSBC) and multisource OSCD (MSOSCD) datasets. Second, a feature selection method based on random forest is introduced to choose effective features from multispectral and SAR images. Finally, a multilevel heterogeneous feature fusion module is embedded in MSCDUNet to combine multifeatures for CD. Experiments are conducted on both the MSOSCD and the MSBC datasets. Compared to other CD methods based on VHR images, our proposal achieves the highest accuracy on both datasets and proves the effectiveness of multispectral, SAR, and VHR data fusion for CD. The dataset in the article will be available for download from the following link.<sup>1</sup>https://ieeexplore.ieee.org/document/9791854/Benchmark datasetbuilt-upchange detection (CD)deep learning (DL)multispectral data fusionvery high resolution (VHR) |
| spellingShingle | Haoyang Li Fangjie Zhu Xiaoyu Zheng Mengxi Liu Guangzhao Chen MSCDUNet: A Deep Learning Framework for Built-Up Area Change Detection Integrating Multispectral, SAR, and VHR Data IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Benchmark dataset built-up change detection (CD) deep learning (DL) multispectral data fusion very high resolution (VHR) |
| title | MSCDUNet: A Deep Learning Framework for Built-Up Area Change Detection Integrating Multispectral, SAR, and VHR Data |
| title_full | MSCDUNet: A Deep Learning Framework for Built-Up Area Change Detection Integrating Multispectral, SAR, and VHR Data |
| title_fullStr | MSCDUNet: A Deep Learning Framework for Built-Up Area Change Detection Integrating Multispectral, SAR, and VHR Data |
| title_full_unstemmed | MSCDUNet: A Deep Learning Framework for Built-Up Area Change Detection Integrating Multispectral, SAR, and VHR Data |
| title_short | MSCDUNet: A Deep Learning Framework for Built-Up Area Change Detection Integrating Multispectral, SAR, and VHR Data |
| title_sort | mscdunet a deep learning framework for built up area change detection integrating multispectral sar and vhr data |
| topic | Benchmark dataset built-up change detection (CD) deep learning (DL) multispectral data fusion very high resolution (VHR) |
| url | https://ieeexplore.ieee.org/document/9791854/ |
| work_keys_str_mv | AT haoyangli mscdunetadeeplearningframeworkforbuiltupareachangedetectionintegratingmultispectralsarandvhrdata AT fangjiezhu mscdunetadeeplearningframeworkforbuiltupareachangedetectionintegratingmultispectralsarandvhrdata AT xiaoyuzheng mscdunetadeeplearningframeworkforbuiltupareachangedetectionintegratingmultispectralsarandvhrdata AT mengxiliu mscdunetadeeplearningframeworkforbuiltupareachangedetectionintegratingmultispectralsarandvhrdata AT guangzhaochen mscdunetadeeplearningframeworkforbuiltupareachangedetectionintegratingmultispectralsarandvhrdata |