BUILDING CHANGE DETECTION BY W-SHAPE RESUNET++ NETWORK WITH TRIPLE ATTENTION MECHANISM
Building change detection in high resolution remote sensing images is one of the most important and applied topics in urban management and urban planning. Different environmental illumination conditions and registration problem are the most error resource in the bitemporal images that will cause pse...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2023-01-01
|
| Series: | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| Online Access: | https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLVIII-4-W2-2022/23/2023/isprs-archives-XLVIII-4-W2-2022-23-2023.pdf |
| _version_ | 1797954248209596416 |
|---|---|
| author | A. Eftekhari F. Samadzadegan F. Dadrass Javan F. Dadrass Javan |
| author_facet | A. Eftekhari F. Samadzadegan F. Dadrass Javan F. Dadrass Javan |
| author_sort | A. Eftekhari |
| collection | DOAJ |
| description | Building change detection in high resolution remote sensing images is one of the most important and applied topics in urban management and urban planning. Different environmental illumination conditions and registration problem are the most error resource in the bitemporal images that will cause pseudochanges in results. On the other hand, the use of deep learning technologies especially convolutional neural networks (CNNs) has been successful and considered, but usually causes the loss of shape and detail at the edges. Accordingly, we propose a W-shape ResUnet++ network in which images with different environmental conditions enter the network independently. ResUnet++ is a network with residual blocks, triple attention blocks and Atrous Spatial Pyramidal Pooling. ResUnet++ is used on both sides of the network to extract deeper and discriminator features. This improves the channel and spatial inter-dependencies, while at the same time reducing the computational cost. After that, the Euclidean distance between the features is computed and the deconvolution is done. Also, a dual loss function is designed that used the weighted binary cross entropy to solve the unbalance between the changed and unchanged data in change detection training data and in the second part, we used the mask–boundary consistency constraints that the condition of converging the edges of the training data and the predicted edge in the loss function has been added. We implemented the proposed method on two remote sensing datasets and then compared the results with state-of-the-art methods. The <i>F1</i> score improved 1.52 % and 4.22 % by using the proposed model in the first and second dataset, respectively. |
| first_indexed | 2024-04-10T23:14:39Z |
| format | Article |
| id | doaj.art-a433c705413e4b869f378495f23bfb46 |
| institution | Directory Open Access Journal |
| issn | 1682-1750 2194-9034 |
| language | English |
| last_indexed | 2024-04-10T23:14:39Z |
| publishDate | 2023-01-01 |
| publisher | Copernicus Publications |
| record_format | Article |
| series | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| spelling | doaj.art-a433c705413e4b869f378495f23bfb462023-01-12T21:53:09ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342023-01-01XLVIII-4-W2-2022232910.5194/isprs-archives-XLVIII-4-W2-2022-23-2023BUILDING CHANGE DETECTION BY W-SHAPE RESUNET++ NETWORK WITH TRIPLE ATTENTION MECHANISMA. Eftekhari0F. Samadzadegan1F. Dadrass Javan2F. Dadrass Javan3School of Surveying and Geospatial Engineering, College of Engineering, University of Tehran, Tehran 1439957131, IranSchool of Surveying and Geospatial Engineering, College of Engineering, University of Tehran, Tehran 1439957131, IranSchool of Surveying and Geospatial Engineering, College of Engineering, University of Tehran, Tehran 1439957131, IranFaculty of Geo-Information Science and Earth Observation (ITC), University of Twente, 7522 NB Enschede, the NetherlandsBuilding change detection in high resolution remote sensing images is one of the most important and applied topics in urban management and urban planning. Different environmental illumination conditions and registration problem are the most error resource in the bitemporal images that will cause pseudochanges in results. On the other hand, the use of deep learning technologies especially convolutional neural networks (CNNs) has been successful and considered, but usually causes the loss of shape and detail at the edges. Accordingly, we propose a W-shape ResUnet++ network in which images with different environmental conditions enter the network independently. ResUnet++ is a network with residual blocks, triple attention blocks and Atrous Spatial Pyramidal Pooling. ResUnet++ is used on both sides of the network to extract deeper and discriminator features. This improves the channel and spatial inter-dependencies, while at the same time reducing the computational cost. After that, the Euclidean distance between the features is computed and the deconvolution is done. Also, a dual loss function is designed that used the weighted binary cross entropy to solve the unbalance between the changed and unchanged data in change detection training data and in the second part, we used the mask–boundary consistency constraints that the condition of converging the edges of the training data and the predicted edge in the loss function has been added. We implemented the proposed method on two remote sensing datasets and then compared the results with state-of-the-art methods. The <i>F1</i> score improved 1.52 % and 4.22 % by using the proposed model in the first and second dataset, respectively.https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLVIII-4-W2-2022/23/2023/isprs-archives-XLVIII-4-W2-2022-23-2023.pdf |
| spellingShingle | A. Eftekhari F. Samadzadegan F. Dadrass Javan F. Dadrass Javan BUILDING CHANGE DETECTION BY W-SHAPE RESUNET++ NETWORK WITH TRIPLE ATTENTION MECHANISM The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| title | BUILDING CHANGE DETECTION BY W-SHAPE RESUNET++ NETWORK WITH TRIPLE ATTENTION MECHANISM |
| title_full | BUILDING CHANGE DETECTION BY W-SHAPE RESUNET++ NETWORK WITH TRIPLE ATTENTION MECHANISM |
| title_fullStr | BUILDING CHANGE DETECTION BY W-SHAPE RESUNET++ NETWORK WITH TRIPLE ATTENTION MECHANISM |
| title_full_unstemmed | BUILDING CHANGE DETECTION BY W-SHAPE RESUNET++ NETWORK WITH TRIPLE ATTENTION MECHANISM |
| title_short | BUILDING CHANGE DETECTION BY W-SHAPE RESUNET++ NETWORK WITH TRIPLE ATTENTION MECHANISM |
| title_sort | building change detection by w shape resunet network with triple attention mechanism |
| url | https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLVIII-4-W2-2022/23/2023/isprs-archives-XLVIII-4-W2-2022-23-2023.pdf |
| work_keys_str_mv | AT aeftekhari buildingchangedetectionbywshaperesunetnetworkwithtripleattentionmechanism AT fsamadzadegan buildingchangedetectionbywshaperesunetnetworkwithtripleattentionmechanism AT fdadrassjavan buildingchangedetectionbywshaperesunetnetworkwithtripleattentionmechanism AT fdadrassjavan buildingchangedetectionbywshaperesunetnetworkwithtripleattentionmechanism |