DAHT-Net: Deformable Attention-Guided Hierarchical Transformer Network Based on Remote Sensing Image Change Detection
Remote sensing image change detection (CD) refers to the automated or semi-automated detection of differences between two remote sensing images taken at different times in the same region. To achieve better global modeling and faster inference, we propose a network architecture containing a hierarch...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10226211/ |
| _version_ | 1797672195978166272 |
|---|---|
| author | Gang Shi Yunfei Mei Xiaoli Wang Qingwen Yang |
| author_facet | Gang Shi Yunfei Mei Xiaoli Wang Qingwen Yang |
| author_sort | Gang Shi |
| collection | DOAJ |
| description | Remote sensing image change detection (CD) refers to the automated or semi-automated detection of differences between two remote sensing images taken at different times in the same region. To achieve better global modeling and faster inference, we propose a network architecture containing a hierarchical swin transformer block and deformable attention transformers crossed for encoding and lightweight MLP decoding to solve the CD task. The deformable attention transformer allows adaptive adjustment of the relationships and weights between feature mappings to effectively combat variations and noise interference in various scenes. The alternating use of swin transformer block and deformable attention transformer ensures the efficiency as well as the flexibility of the model. The lightweight MLP approach provides better ability to extract spatial features and contextual information, as well as faster inference speed. Compared with other methods, our proposed DAHT-Net method improves F1 scores by 0.98 and 2.61 on LEVIR-CD, CDD and two publicly available benchmark datasets, respectively, and performs well on other measures. These experimental results validate that the DAHT-Net network outperforms other comparative methods and highlight its effectiveness in remote sensing image change detection. In summary, our proposed hierarchical deformable attention-guided transformer network model provides a promising solution for remote sensing image change detection with superior performance compared to other state-of-the-art methods. |
| first_indexed | 2024-03-11T21:26:31Z |
| format | Article |
| id | doaj.art-0ca4b08e27ff423e8869c17de418e371 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-11T21:26:31Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-0ca4b08e27ff423e8869c17de418e3712023-09-27T23:00:25ZengIEEEIEEE Access2169-35362023-01-011110303310304310.1109/ACCESS.2023.330764210226211DAHT-Net: Deformable Attention-Guided Hierarchical Transformer Network Based on Remote Sensing Image Change DetectionGang Shi0https://orcid.org/0009-0000-2488-147XYunfei Mei1https://orcid.org/0009-0000-5717-2098Xiaoli Wang2https://orcid.org/0000-0002-1995-1178Qingwen Yang3School of Information Science and Engineering, Xinjiang University, Ürümqi, ChinaSchool of Information Science and Engineering, Xinjiang University, Ürümqi, ChinaSchool of Information Science and Engineering, Xinjiang University, Ürümqi, ChinaSchool of Information Science and Engineering, Xinjiang University, Ürümqi, ChinaRemote sensing image change detection (CD) refers to the automated or semi-automated detection of differences between two remote sensing images taken at different times in the same region. To achieve better global modeling and faster inference, we propose a network architecture containing a hierarchical swin transformer block and deformable attention transformers crossed for encoding and lightweight MLP decoding to solve the CD task. The deformable attention transformer allows adaptive adjustment of the relationships and weights between feature mappings to effectively combat variations and noise interference in various scenes. The alternating use of swin transformer block and deformable attention transformer ensures the efficiency as well as the flexibility of the model. The lightweight MLP approach provides better ability to extract spatial features and contextual information, as well as faster inference speed. Compared with other methods, our proposed DAHT-Net method improves F1 scores by 0.98 and 2.61 on LEVIR-CD, CDD and two publicly available benchmark datasets, respectively, and performs well on other measures. These experimental results validate that the DAHT-Net network outperforms other comparative methods and highlight its effectiveness in remote sensing image change detection. In summary, our proposed hierarchical deformable attention-guided transformer network model provides a promising solution for remote sensing image change detection with superior performance compared to other state-of-the-art methods.https://ieeexplore.ieee.org/document/10226211/Change detectionglobal modelinghierarchical transformerdeformable attention |
| spellingShingle | Gang Shi Yunfei Mei Xiaoli Wang Qingwen Yang DAHT-Net: Deformable Attention-Guided Hierarchical Transformer Network Based on Remote Sensing Image Change Detection IEEE Access Change detection global modeling hierarchical transformer deformable attention |
| title | DAHT-Net: Deformable Attention-Guided Hierarchical Transformer Network Based on Remote Sensing Image Change Detection |
| title_full | DAHT-Net: Deformable Attention-Guided Hierarchical Transformer Network Based on Remote Sensing Image Change Detection |
| title_fullStr | DAHT-Net: Deformable Attention-Guided Hierarchical Transformer Network Based on Remote Sensing Image Change Detection |
| title_full_unstemmed | DAHT-Net: Deformable Attention-Guided Hierarchical Transformer Network Based on Remote Sensing Image Change Detection |
| title_short | DAHT-Net: Deformable Attention-Guided Hierarchical Transformer Network Based on Remote Sensing Image Change Detection |
| title_sort | daht net deformable attention guided hierarchical transformer network based on remote sensing image change detection |
| topic | Change detection global modeling hierarchical transformer deformable attention |
| url | https://ieeexplore.ieee.org/document/10226211/ |
| work_keys_str_mv | AT gangshi dahtnetdeformableattentionguidedhierarchicaltransformernetworkbasedonremotesensingimagechangedetection AT yunfeimei dahtnetdeformableattentionguidedhierarchicaltransformernetworkbasedonremotesensingimagechangedetection AT xiaoliwang dahtnetdeformableattentionguidedhierarchicaltransformernetworkbasedonremotesensingimagechangedetection AT qingwenyang dahtnetdeformableattentionguidedhierarchicaltransformernetworkbasedonremotesensingimagechangedetection |