MDFENet: A Multiscale Difference Feature Enhancement Network for Remote Sensing Change Detection
The main task of remote sensing change detection (CD) is to identify object differences in bitemporal remote sensing images. In recent years, methods based on deep convolutional neural networks have made great progress in remote sensing CD. However, due to illumination changes and seasonal changes i...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10078073/ |
| _version_ | 1797850962516246528 |
|---|---|
| author | Hao Li Xiaoyong Liu Huihui Li Ziyang Dong Xiangling Xiao |
| author_facet | Hao Li Xiaoyong Liu Huihui Li Ziyang Dong Xiangling Xiao |
| author_sort | Hao Li |
| collection | DOAJ |
| description | The main task of remote sensing change detection (CD) is to identify object differences in bitemporal remote sensing images. In recent years, methods based on deep convolutional neural networks have made great progress in remote sensing CD. However, due to illumination changes and seasonal changes in the images acquired by the same sensor, the problem of “pseudo change” in the change map is still difficult to solve. In this article, in order to reduce “pseudo changes,” we propose a multiscale difference feature enhancement network (MDFENet) to extract the most discriminative features from bitemporal remote sensing images. MDFENet contains three procedures: first, multiscale bitemporal features are generated by a shared weighted Siamese encoder. Then features of each scale are fed into a difference enhancement module to generate refined difference features. Finally, they are combined and reconstructed by a decoder to generate change map. The difference enhancement module includes multiple layers of difference enhancement encoder and transformer decoder. They are applied to features of different scales to establish long-range relationships of pixels semantic changes, while high-level difference features participate in the generation of low-level difference features to enhance information transmission among features of different scales, reducing “pseudo changes.” Compared with state-of-the-art methods, the proposed method achieved the best performance on two datasets, with F1 of 81.15% on the SYSU-CD dataset and 90.85% on the LEVIR-CD dataset. |
| first_indexed | 2024-04-09T19:10:03Z |
| format | Article |
| id | doaj.art-3c56f135a57a4394831ade5da71f8c03 |
| institution | Directory Open Access Journal |
| issn | 2151-1535 |
| language | English |
| last_indexed | 2024-04-09T19:10:03Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| spelling | doaj.art-3c56f135a57a4394831ade5da71f8c032023-04-06T23:00:13ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2151-15352023-01-01163104311510.1109/JSTARS.2023.326000610078073MDFENet: A Multiscale Difference Feature Enhancement Network for Remote Sensing Change DetectionHao Li0Xiaoyong Liu1https://orcid.org/0000-0002-0795-841XHuihui Li2https://orcid.org/0000-0003-0463-8178Ziyang Dong3Xiangling Xiao4https://orcid.org/0000-0001-6226-5459School of Computer Science, Guangdong Polytechnic Normal University, Guangzhou, ChinaSchool of Data Science and Engineering, Guangdong Polytechnic Normal University, Guangzhou, ChinaSchool of Computer Science and Guangdong Provincial Key Laboratory of Intellectual Property and Big Data, Guangdong Polytechnic Normal University, Guangzhou, ChinaSchool of Computer Science, Guangdong Polytechnic Normal University, Guangzhou, ChinaSchool of Computer Science, Guangdong Polytechnic Normal University, Guangzhou, ChinaThe main task of remote sensing change detection (CD) is to identify object differences in bitemporal remote sensing images. In recent years, methods based on deep convolutional neural networks have made great progress in remote sensing CD. However, due to illumination changes and seasonal changes in the images acquired by the same sensor, the problem of “pseudo change” in the change map is still difficult to solve. In this article, in order to reduce “pseudo changes,” we propose a multiscale difference feature enhancement network (MDFENet) to extract the most discriminative features from bitemporal remote sensing images. MDFENet contains three procedures: first, multiscale bitemporal features are generated by a shared weighted Siamese encoder. Then features of each scale are fed into a difference enhancement module to generate refined difference features. Finally, they are combined and reconstructed by a decoder to generate change map. The difference enhancement module includes multiple layers of difference enhancement encoder and transformer decoder. They are applied to features of different scales to establish long-range relationships of pixels semantic changes, while high-level difference features participate in the generation of low-level difference features to enhance information transmission among features of different scales, reducing “pseudo changes.” Compared with state-of-the-art methods, the proposed method achieved the best performance on two datasets, with F1 of 81.15% on the SYSU-CD dataset and 90.85% on the LEVIR-CD dataset.https://ieeexplore.ieee.org/document/10078073/Attention mechanismchange detection (CD)convolutional neural networks (CNNs)feature enhancementpseudo changesremote sensing |
| spellingShingle | Hao Li Xiaoyong Liu Huihui Li Ziyang Dong Xiangling Xiao MDFENet: A Multiscale Difference Feature Enhancement Network for Remote Sensing Change Detection IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Attention mechanism change detection (CD) convolutional neural networks (CNNs) feature enhancement pseudo changes remote sensing |
| title | MDFENet: A Multiscale Difference Feature Enhancement Network for Remote Sensing Change Detection |
| title_full | MDFENet: A Multiscale Difference Feature Enhancement Network for Remote Sensing Change Detection |
| title_fullStr | MDFENet: A Multiscale Difference Feature Enhancement Network for Remote Sensing Change Detection |
| title_full_unstemmed | MDFENet: A Multiscale Difference Feature Enhancement Network for Remote Sensing Change Detection |
| title_short | MDFENet: A Multiscale Difference Feature Enhancement Network for Remote Sensing Change Detection |
| title_sort | mdfenet a multiscale difference feature enhancement network for remote sensing change detection |
| topic | Attention mechanism change detection (CD) convolutional neural networks (CNNs) feature enhancement pseudo changes remote sensing |
| url | https://ieeexplore.ieee.org/document/10078073/ |
| work_keys_str_mv | AT haoli mdfenetamultiscaledifferencefeatureenhancementnetworkforremotesensingchangedetection AT xiaoyongliu mdfenetamultiscaledifferencefeatureenhancementnetworkforremotesensingchangedetection AT huihuili mdfenetamultiscaledifferencefeatureenhancementnetworkforremotesensingchangedetection AT ziyangdong mdfenetamultiscaledifferencefeatureenhancementnetworkforremotesensingchangedetection AT xianglingxiao mdfenetamultiscaledifferencefeatureenhancementnetworkforremotesensingchangedetection |