Heterogeneous Images Change Detection Based on Iterative Joint Global–Local Translation
Most heterogeneous change detection methods based on transfer learning may not yield satisfactory results due to the lack of comprehensive utilization of the global and local characteristics of the image. In this article, we propose an unsupervised heterogeneous change detection method based on iter...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2022-01-01
|
Series: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9833278/ |
_version_ | 1811225529524682752 |
---|---|
author | Hao Chen Fachuan He Jinming Liu |
author_facet | Hao Chen Fachuan He Jinming Liu |
author_sort | Hao Chen |
collection | DOAJ |
description | Most heterogeneous change detection methods based on transfer learning may not yield satisfactory results due to the lack of comprehensive utilization of the global and local characteristics of the image. In this article, we propose an unsupervised heterogeneous change detection method based on iterative joint global–local translation (IJGLT). The two heterogeneous images are first segmented into superpixels with the same boundary. Unlike the transfer learning methods for classification tasks that directly reduce the distance of the distribution of all data, we construct a translation function to decrease the difference between unchanged superpixels while increasing the difference of changed superpixels. During the translation process, the overall distribution is constrained using pseudo change labels, and the local manifold preserving is utilized to maintain the spatial structure and local adjacency relationship of superpixels. By comparing the translated superpixels of the heterogeneous images, the change map is obtained and then refined with pseudo change labels taking an iterative approach until convergence. Using the public and self-made optical-SAR heterogeneous datasets with different resolutions, the experimental results demonstrate that IJGLT is superior to several typical comparison methods with a maximum overall accuracy of 0.98 and a kappa coefficient of 0.9. |
first_indexed | 2024-04-12T09:08:47Z |
format | Article |
id | doaj.art-f4528ccf9c924b68aea8c75ed84cd287 |
institution | Directory Open Access Journal |
issn | 2151-1535 |
language | English |
last_indexed | 2024-04-12T09:08:47Z |
publishDate | 2022-01-01 |
publisher | IEEE |
record_format | Article |
series | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
spelling | doaj.art-f4528ccf9c924b68aea8c75ed84cd2872022-12-22T03:39:02ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2151-15352022-01-01159680969810.1109/JSTARS.2022.31922519833278Heterogeneous Images Change Detection Based on Iterative Joint Global–Local TranslationHao Chen0https://orcid.org/0000-0002-1837-3986Fachuan He1https://orcid.org/0000-0001-8220-2877Jinming Liu2School of Electronics and Information Engineering, Harbin Institute of Technology, Harbin, ChinaSchool of Electronics and Information Engineering, Harbin Institute of Technology, Harbin, ChinaInstitute of Defense Engineering, Academy of Military Sciences, Beijing, ChinaMost heterogeneous change detection methods based on transfer learning may not yield satisfactory results due to the lack of comprehensive utilization of the global and local characteristics of the image. In this article, we propose an unsupervised heterogeneous change detection method based on iterative joint global–local translation (IJGLT). The two heterogeneous images are first segmented into superpixels with the same boundary. Unlike the transfer learning methods for classification tasks that directly reduce the distance of the distribution of all data, we construct a translation function to decrease the difference between unchanged superpixels while increasing the difference of changed superpixels. During the translation process, the overall distribution is constrained using pseudo change labels, and the local manifold preserving is utilized to maintain the spatial structure and local adjacency relationship of superpixels. By comparing the translated superpixels of the heterogeneous images, the change map is obtained and then refined with pseudo change labels taking an iterative approach until convergence. Using the public and self-made optical-SAR heterogeneous datasets with different resolutions, the experimental results demonstrate that IJGLT is superior to several typical comparison methods with a maximum overall accuracy of 0.98 and a kappa coefficient of 0.9.https://ieeexplore.ieee.org/document/9833278/Change detection (CD)heterogeneous imagesjoint global–local translationlocal manifold preservingiteration |
spellingShingle | Hao Chen Fachuan He Jinming Liu Heterogeneous Images Change Detection Based on Iterative Joint Global–Local Translation IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Change detection (CD) heterogeneous images joint global–local translation local manifold preserving iteration |
title | Heterogeneous Images Change Detection Based on Iterative Joint Global–Local Translation |
title_full | Heterogeneous Images Change Detection Based on Iterative Joint Global–Local Translation |
title_fullStr | Heterogeneous Images Change Detection Based on Iterative Joint Global–Local Translation |
title_full_unstemmed | Heterogeneous Images Change Detection Based on Iterative Joint Global–Local Translation |
title_short | Heterogeneous Images Change Detection Based on Iterative Joint Global–Local Translation |
title_sort | heterogeneous images change detection based on iterative joint global x2013 local translation |
topic | Change detection (CD) heterogeneous images joint global–local translation local manifold preserving iteration |
url | https://ieeexplore.ieee.org/document/9833278/ |
work_keys_str_mv | AT haochen heterogeneousimageschangedetectionbasedoniterativejointglobalx2013localtranslation AT fachuanhe heterogeneousimageschangedetectionbasedoniterativejointglobalx2013localtranslation AT jinmingliu heterogeneousimageschangedetectionbasedoniterativejointglobalx2013localtranslation |