The application of ResU-net and OBIA for landslide detection from multi-temporal sentinel-2 images

Landslide detection is a hot topic in the remote sensing community, particularly with the current rapid growth in volume (and variety) of Earth observation data and the substantial progress of computer vision. Deep learning algorithms, especially fully convolutional networks (FCNs), and variations l...

Full description

Bibliographic Details
Main Authors: Omid Ghorbanzadeh, Khalil Gholamnia, Pedram Ghamisi
Format: Article
Language:English
Published: Taylor & Francis Group 2022-02-01
Series:Big Earth Data
Subjects:
Online Access:http://dx.doi.org/10.1080/20964471.2022.2031544
_version_ 1818984828004990976
author Omid Ghorbanzadeh
Khalil Gholamnia
Pedram Ghamisi
author_facet Omid Ghorbanzadeh
Khalil Gholamnia
Pedram Ghamisi
author_sort Omid Ghorbanzadeh
collection DOAJ
description Landslide detection is a hot topic in the remote sensing community, particularly with the current rapid growth in volume (and variety) of Earth observation data and the substantial progress of computer vision. Deep learning algorithms, especially fully convolutional networks (FCNs), and variations like the ResU-Net have been used recently as rapid and automatic landslide detection approaches. Although FCNs have shown cutting-edge results in automatic landslide detection, accuracy can be improved by adding prior knowledge through possible frameworks. This study evaluates a rule-based object-based image analysis (OBIA) approach built on probabilities resulting from the ResU-Net model for landslide detection. We train the ResU-Net model using a landslide dataset comprising landslide inventories from various geographic regions, including our study area and test the testing area not used for training. In the OBIA stage, we first calculate land cover and image difference indices for pre-and post-landslide multi-temporal images. Next, we use the generated indices and the resulting ResU-Net probabilities for image segmentation; the extracted landslide object candidates are then optimized using rule-based classification. In the result validation section, the landslide detection of the proposed integration of the ResU-Net with a rule-based classification of OBIA is compared with that of the ResU-Net alone. Our proposed approach improves the mean intersection-over-union of the resulting map from the ResU-Net by more than 22%.
first_indexed 2024-12-20T18:25:12Z
format Article
id doaj.art-eed90fc5fc6d41e39514ac5ea1781d62
institution Directory Open Access Journal
issn 2096-4471
2574-5417
language English
last_indexed 2024-12-20T18:25:12Z
publishDate 2022-02-01
publisher Taylor & Francis Group
record_format Article
series Big Earth Data
spelling doaj.art-eed90fc5fc6d41e39514ac5ea1781d622022-12-21T19:30:12ZengTaylor & Francis GroupBig Earth Data2096-44712574-54172022-02-010012610.1080/20964471.2022.20315442031544The application of ResU-net and OBIA for landslide detection from multi-temporal sentinel-2 imagesOmid Ghorbanzadeh0Khalil Gholamnia1Pedram Ghamisi2Institute of Advanced Research in Artificial Intelligence (IARAI)University of TabrizInstitute of Advanced Research in Artificial Intelligence (IARAI)Landslide detection is a hot topic in the remote sensing community, particularly with the current rapid growth in volume (and variety) of Earth observation data and the substantial progress of computer vision. Deep learning algorithms, especially fully convolutional networks (FCNs), and variations like the ResU-Net have been used recently as rapid and automatic landslide detection approaches. Although FCNs have shown cutting-edge results in automatic landslide detection, accuracy can be improved by adding prior knowledge through possible frameworks. This study evaluates a rule-based object-based image analysis (OBIA) approach built on probabilities resulting from the ResU-Net model for landslide detection. We train the ResU-Net model using a landslide dataset comprising landslide inventories from various geographic regions, including our study area and test the testing area not used for training. In the OBIA stage, we first calculate land cover and image difference indices for pre-and post-landslide multi-temporal images. Next, we use the generated indices and the resulting ResU-Net probabilities for image segmentation; the extracted landslide object candidates are then optimized using rule-based classification. In the result validation section, the landslide detection of the proposed integration of the ResU-Net with a rule-based classification of OBIA is compared with that of the ResU-Net alone. Our proposed approach improves the mean intersection-over-union of the resulting map from the ResU-Net by more than 22%.http://dx.doi.org/10.1080/20964471.2022.2031544deep learning (dl)eastern iburijapaneuropean space agency (esa)fully convolutional networks (fcns)object-based image analysis (obia)rapid landslide mappingresu-netsentinel-2
spellingShingle Omid Ghorbanzadeh
Khalil Gholamnia
Pedram Ghamisi
The application of ResU-net and OBIA for landslide detection from multi-temporal sentinel-2 images
Big Earth Data
deep learning (dl)
eastern iburi
japan
european space agency (esa)
fully convolutional networks (fcns)
object-based image analysis (obia)
rapid landslide mapping
resu-net
sentinel-2
title The application of ResU-net and OBIA for landslide detection from multi-temporal sentinel-2 images
title_full The application of ResU-net and OBIA for landslide detection from multi-temporal sentinel-2 images
title_fullStr The application of ResU-net and OBIA for landslide detection from multi-temporal sentinel-2 images
title_full_unstemmed The application of ResU-net and OBIA for landslide detection from multi-temporal sentinel-2 images
title_short The application of ResU-net and OBIA for landslide detection from multi-temporal sentinel-2 images
title_sort application of resu net and obia for landslide detection from multi temporal sentinel 2 images
topic deep learning (dl)
eastern iburi
japan
european space agency (esa)
fully convolutional networks (fcns)
object-based image analysis (obia)
rapid landslide mapping
resu-net
sentinel-2
url http://dx.doi.org/10.1080/20964471.2022.2031544
work_keys_str_mv AT omidghorbanzadeh theapplicationofresunetandobiaforlandslidedetectionfrommultitemporalsentinel2images
AT khalilgholamnia theapplicationofresunetandobiaforlandslidedetectionfrommultitemporalsentinel2images
AT pedramghamisi theapplicationofresunetandobiaforlandslidedetectionfrommultitemporalsentinel2images
AT omidghorbanzadeh applicationofresunetandobiaforlandslidedetectionfrommultitemporalsentinel2images
AT khalilgholamnia applicationofresunetandobiaforlandslidedetectionfrommultitemporalsentinel2images
AT pedramghamisi applicationofresunetandobiaforlandslidedetectionfrommultitemporalsentinel2images