Lightweight Deep Neural Network Method for Water Body Extraction from High-Resolution Remote Sensing Images with Multisensors

Rapid and accurate extraction of water bodies from high-spatial-resolution remote sensing images is of great value for water resource management, water quality monitoring and natural disaster emergency response. For traditional water body extraction methods, it is difficult to select image texture a...

Full description

Bibliographic Details
Main Authors: Yanjun Wang, Shaochun Li, Yunhao Lin, Mengjie Wang
Format: Article
Language:English
Published: MDPI AG 2021-11-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/21/21/7397
_version_ 1797511752997404672
author Yanjun Wang
Shaochun Li
Yunhao Lin
Mengjie Wang
author_facet Yanjun Wang
Shaochun Li
Yunhao Lin
Mengjie Wang
author_sort Yanjun Wang
collection DOAJ
description Rapid and accurate extraction of water bodies from high-spatial-resolution remote sensing images is of great value for water resource management, water quality monitoring and natural disaster emergency response. For traditional water body extraction methods, it is difficult to select image texture and features, the shadows of buildings and other ground objects are in the same spectrum as water bodies, the existing deep convolutional neural network is difficult to train, the consumption of computing resources is large, and the methods cannot meet real-time requirements. In this paper, a water body extraction method based on lightweight MobileNetV2 is proposed and applied to multisensor high-resolution remote sensing images, such as GF-2, WorldView-2 and UAV orthoimages. This method was validated in two typical complex geographical scenes: water bodies for farmland irrigation, which have a broken shape and long and narrow area and are surrounded by many buildings in towns and villages; and water bodies in mountainous areas, which have undulating topography, vegetation coverage and mountain shadows all over. The results were compared with those of the support vector machine, random forest and U-Net models and also verified by generalization tests and the influence of spatial resolution changes. First, the results show that the F1-score and Kappa coefficients of the MobileNetV2 model extracting water bodies from three different high-resolution images were 0.75 and 0.72 for GF-2, 0.86 and 0.85 for Worldview-2 and 0.98 and 0.98 for UAV, respectively, which are higher than those of traditional machine learning models and U-Net. Second, the training time, number of parameters and calculation amount of the MobileNetV2 model were much lower than those of the U-Net model, which greatly improves the water body extraction efficiency. Third, in other more complex surface areas, the MobileNetV2 model still maintained relatively high accuracy of water body extraction. Finally, we tested the effects of multisensor models and found that training with lower and higher spatial resolution images combined can be beneficial, but that using just lower resolution imagery is ineffective. This study provides a reference for the efficient automation of water body classification and extraction under complex geographical environment conditions and can be extended to water resource investigation, management and planning.
first_indexed 2024-03-10T05:52:28Z
format Article
id doaj.art-f7b0ee7c1ddd40088936faeea54e1c05
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-10T05:52:28Z
publishDate 2021-11-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-f7b0ee7c1ddd40088936faeea54e1c052023-11-22T21:40:58ZengMDPI AGSensors1424-82202021-11-012121739710.3390/s21217397Lightweight Deep Neural Network Method for Water Body Extraction from High-Resolution Remote Sensing Images with MultisensorsYanjun Wang0Shaochun Li1Yunhao Lin2Mengjie Wang3Hunan Provincial Key Laboratory of Geo-Information Engineering in Surveying, Mapping and Remote Sensing, Hunan University of Science and Technology, Xiangtan 411201, ChinaHunan Provincial Key Laboratory of Geo-Information Engineering in Surveying, Mapping and Remote Sensing, Hunan University of Science and Technology, Xiangtan 411201, ChinaHunan Provincial Key Laboratory of Geo-Information Engineering in Surveying, Mapping and Remote Sensing, Hunan University of Science and Technology, Xiangtan 411201, ChinaHunan Provincial Key Laboratory of Geo-Information Engineering in Surveying, Mapping and Remote Sensing, Hunan University of Science and Technology, Xiangtan 411201, ChinaRapid and accurate extraction of water bodies from high-spatial-resolution remote sensing images is of great value for water resource management, water quality monitoring and natural disaster emergency response. For traditional water body extraction methods, it is difficult to select image texture and features, the shadows of buildings and other ground objects are in the same spectrum as water bodies, the existing deep convolutional neural network is difficult to train, the consumption of computing resources is large, and the methods cannot meet real-time requirements. In this paper, a water body extraction method based on lightweight MobileNetV2 is proposed and applied to multisensor high-resolution remote sensing images, such as GF-2, WorldView-2 and UAV orthoimages. This method was validated in two typical complex geographical scenes: water bodies for farmland irrigation, which have a broken shape and long and narrow area and are surrounded by many buildings in towns and villages; and water bodies in mountainous areas, which have undulating topography, vegetation coverage and mountain shadows all over. The results were compared with those of the support vector machine, random forest and U-Net models and also verified by generalization tests and the influence of spatial resolution changes. First, the results show that the F1-score and Kappa coefficients of the MobileNetV2 model extracting water bodies from three different high-resolution images were 0.75 and 0.72 for GF-2, 0.86 and 0.85 for Worldview-2 and 0.98 and 0.98 for UAV, respectively, which are higher than those of traditional machine learning models and U-Net. Second, the training time, number of parameters and calculation amount of the MobileNetV2 model were much lower than those of the U-Net model, which greatly improves the water body extraction efficiency. Third, in other more complex surface areas, the MobileNetV2 model still maintained relatively high accuracy of water body extraction. Finally, we tested the effects of multisensor models and found that training with lower and higher spatial resolution images combined can be beneficial, but that using just lower resolution imagery is ineffective. This study provides a reference for the efficient automation of water body classification and extraction under complex geographical environment conditions and can be extended to water resource investigation, management and planning.https://www.mdpi.com/1424-8220/21/21/7397water body extractionmultisensor high-resolution imagelightweight deep neural networkMobileNetv2deep learning
spellingShingle Yanjun Wang
Shaochun Li
Yunhao Lin
Mengjie Wang
Lightweight Deep Neural Network Method for Water Body Extraction from High-Resolution Remote Sensing Images with Multisensors
Sensors
water body extraction
multisensor high-resolution image
lightweight deep neural network
MobileNetv2
deep learning
title Lightweight Deep Neural Network Method for Water Body Extraction from High-Resolution Remote Sensing Images with Multisensors
title_full Lightweight Deep Neural Network Method for Water Body Extraction from High-Resolution Remote Sensing Images with Multisensors
title_fullStr Lightweight Deep Neural Network Method for Water Body Extraction from High-Resolution Remote Sensing Images with Multisensors
title_full_unstemmed Lightweight Deep Neural Network Method for Water Body Extraction from High-Resolution Remote Sensing Images with Multisensors
title_short Lightweight Deep Neural Network Method for Water Body Extraction from High-Resolution Remote Sensing Images with Multisensors
title_sort lightweight deep neural network method for water body extraction from high resolution remote sensing images with multisensors
topic water body extraction
multisensor high-resolution image
lightweight deep neural network
MobileNetv2
deep learning
url https://www.mdpi.com/1424-8220/21/21/7397
work_keys_str_mv AT yanjunwang lightweightdeepneuralnetworkmethodforwaterbodyextractionfromhighresolutionremotesensingimageswithmultisensors
AT shaochunli lightweightdeepneuralnetworkmethodforwaterbodyextractionfromhighresolutionremotesensingimageswithmultisensors
AT yunhaolin lightweightdeepneuralnetworkmethodforwaterbodyextractionfromhighresolutionremotesensingimageswithmultisensors
AT mengjiewang lightweightdeepneuralnetworkmethodforwaterbodyextractionfromhighresolutionremotesensingimageswithmultisensors