A feature enhancement framework for landslide detection

Accurate landslide detection is essential for disaster mitigation and relief. In this study, we develop a feature enhancement framework that integrates attention and multiscale mechanisms with U-Net (AMU-Net) for landslide detection. The framework has four steps. First, the attention module in the c...

Full description

Bibliographic Details
Main Authors: Ruilong Wei, Chengming Ye, Tianbo Sui, Huajun Zhang, Yonggang Ge, Yao Li
Format: Article
Language:English
Published: Elsevier 2023-11-01
Series:International Journal of Applied Earth Observations and Geoinformation
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S156984322300345X
_version_ 1797633271607066624
author Ruilong Wei
Chengming Ye
Tianbo Sui
Huajun Zhang
Yonggang Ge
Yao Li
author_facet Ruilong Wei
Chengming Ye
Tianbo Sui
Huajun Zhang
Yonggang Ge
Yao Li
author_sort Ruilong Wei
collection DOAJ
description Accurate landslide detection is essential for disaster mitigation and relief. In this study, we develop a feature enhancement framework that integrates attention and multiscale mechanisms with U-Net (AMU-Net) for landslide detection. The framework has four steps. First, the attention module in the convolutional block enhances the feature response of landslides when extracting high-level feature representations. Second, the multiscale module in skip connection captures more contextual information when concatenating fine and coarse features. Third, the U-Net architecture encodes feature mapping and decodes semantics representations. Fourth, the shifted window was applied to enhance the receptive field of pixels in the prediction process, which reduced the errors of landslide boundaries. Besides, we explored the effect of random split and regional split methods on model training. In the upper reach of the Jinsha River, data on unoccupied aerial vehicle (UAV) images and digital surface model (DSM) were prepared for landslide detection. The design of the framework and experiments considers the disparities in data between UAV and satellite remote sensing. The controlled experiments reported that the mean Intersection over Union (mIoU) for the proposed AMU-Net achieved 0.797, which was over 2% higher than other models. Furthermore, the visualized feature maps revealed that the proposed method can effectively restrain irrelevant feature responses in backgrounds and capture features from various receptive fields. Comparative studies on all the above experiments proved the superiority of the proposed framework for landslide detection.
first_indexed 2024-03-11T11:51:44Z
format Article
id doaj.art-4567271bbc75474caa3d5ddfd8349790
institution Directory Open Access Journal
issn 1569-8432
language English
last_indexed 2024-03-11T11:51:44Z
publishDate 2023-11-01
publisher Elsevier
record_format Article
series International Journal of Applied Earth Observations and Geoinformation
spelling doaj.art-4567271bbc75474caa3d5ddfd83497902023-11-09T04:11:44ZengElsevierInternational Journal of Applied Earth Observations and Geoinformation1569-84322023-11-01124103521A feature enhancement framework for landslide detectionRuilong Wei0Chengming Ye1Tianbo Sui2Huajun Zhang3Yonggang Ge4Yao Li5Key Laboratory of Earth Exploration and Information Technology of Ministry of Education, Chengdu University of Technology, Chengdu, 610059, ChinaKey Laboratory of Earth Exploration and Information Technology of Ministry of Education, Chengdu University of Technology, Chengdu, 610059, China; Corresponding author.Key Laboratory of Earth Exploration and Information Technology of Ministry of Education, Chengdu University of Technology, Chengdu, 610059, ChinaKey Laboratory of Earth Exploration and Information Technology of Ministry of Education, Chengdu University of Technology, Chengdu, 610059, ChinaInstitute of Mountain Hazards and Environment, Chinese Academy of Sciences, Chengdu, 610041, ChinaState Key Laboratory of Hydroscience and Engineering, Tsinghua University, Beijing, 100084, ChinaAccurate landslide detection is essential for disaster mitigation and relief. In this study, we develop a feature enhancement framework that integrates attention and multiscale mechanisms with U-Net (AMU-Net) for landslide detection. The framework has four steps. First, the attention module in the convolutional block enhances the feature response of landslides when extracting high-level feature representations. Second, the multiscale module in skip connection captures more contextual information when concatenating fine and coarse features. Third, the U-Net architecture encodes feature mapping and decodes semantics representations. Fourth, the shifted window was applied to enhance the receptive field of pixels in the prediction process, which reduced the errors of landslide boundaries. Besides, we explored the effect of random split and regional split methods on model training. In the upper reach of the Jinsha River, data on unoccupied aerial vehicle (UAV) images and digital surface model (DSM) were prepared for landslide detection. The design of the framework and experiments considers the disparities in data between UAV and satellite remote sensing. The controlled experiments reported that the mean Intersection over Union (mIoU) for the proposed AMU-Net achieved 0.797, which was over 2% higher than other models. Furthermore, the visualized feature maps revealed that the proposed method can effectively restrain irrelevant feature responses in backgrounds and capture features from various receptive fields. Comparative studies on all the above experiments proved the superiority of the proposed framework for landslide detection.http://www.sciencedirect.com/science/article/pii/S156984322300345XConvolutional neural networkDeep learningLandslide detectionRemote sensing
spellingShingle Ruilong Wei
Chengming Ye
Tianbo Sui
Huajun Zhang
Yonggang Ge
Yao Li
A feature enhancement framework for landslide detection
International Journal of Applied Earth Observations and Geoinformation
Convolutional neural network
Deep learning
Landslide detection
Remote sensing
title A feature enhancement framework for landslide detection
title_full A feature enhancement framework for landslide detection
title_fullStr A feature enhancement framework for landslide detection
title_full_unstemmed A feature enhancement framework for landslide detection
title_short A feature enhancement framework for landslide detection
title_sort feature enhancement framework for landslide detection
topic Convolutional neural network
Deep learning
Landslide detection
Remote sensing
url http://www.sciencedirect.com/science/article/pii/S156984322300345X
work_keys_str_mv AT ruilongwei afeatureenhancementframeworkforlandslidedetection
AT chengmingye afeatureenhancementframeworkforlandslidedetection
AT tianbosui afeatureenhancementframeworkforlandslidedetection
AT huajunzhang afeatureenhancementframeworkforlandslidedetection
AT yonggangge afeatureenhancementframeworkforlandslidedetection
AT yaoli afeatureenhancementframeworkforlandslidedetection
AT ruilongwei featureenhancementframeworkforlandslidedetection
AT chengmingye featureenhancementframeworkforlandslidedetection
AT tianbosui featureenhancementframeworkforlandslidedetection
AT huajunzhang featureenhancementframeworkforlandslidedetection
AT yonggangge featureenhancementframeworkforlandslidedetection
AT yaoli featureenhancementframeworkforlandslidedetection