ADAPTATION OF DEEPLAB V3+ FOR DAMAGE DETECTION ON PORT INFRASTRUCTURE IMAGERY

Regular inspection and maintenance of infrastructure facilities are crucial to ensure their functionality and safety for users. However, current inspection methods are labor-intensive and can vary depending on the inspector. To improve this process, modern sensor systems and machine learning algorit...

Full description

Bibliographic Details
Main Authors: M. Scherff, F. Hake, H. Alkhatib
Format: Article
Language:English
Published: Copernicus Publications 2023-04-01
Series:The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Online Access:https://isprs-archives.copernicus.org/articles/XLVIII-M-1-2023/301/2023/isprs-archives-XLVIII-M-1-2023-301-2023.pdf
_version_ 1797842573997375488
author M. Scherff
F. Hake
H. Alkhatib
author_facet M. Scherff
F. Hake
H. Alkhatib
author_sort M. Scherff
collection DOAJ
description Regular inspection and maintenance of infrastructure facilities are crucial to ensure their functionality and safety for users. However, current inspection methods are labor-intensive and can vary depending on the inspector. To improve this process, modern sensor systems and machine learning algorithms can be deployed to detect defects based on rapidly acquired data, resulting in lower downtime. A quality-controlled processing chain allows to provide hence informed uncertainty assessments to inspection operators. In this study, we present several Deeplab V3+ models optimized to predict corroded segments of the quay wall at JadeWeserPort, Germany, which is a dataset from the 3D HydroMapper research project. Our models achieve generally high accuracy in detecting this damage type. Therefore, we examine the use of a Region Growing-based weakly supervised approach to efficiently extend our model to other common types in the future. This approach achieves about 90 % of the results compared to corresponding fully supervised networks, of which a ResNet-50 variant peaks at 55.6 % Intersection-over-Union regarding the test set’s corrosion class.
first_indexed 2024-04-09T16:50:10Z
format Article
id doaj.art-64ee2a74f5ca4fa1b7c867fd54b9a320
institution Directory Open Access Journal
issn 1682-1750
2194-9034
language English
last_indexed 2024-04-09T16:50:10Z
publishDate 2023-04-01
publisher Copernicus Publications
record_format Article
series The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
spelling doaj.art-64ee2a74f5ca4fa1b7c867fd54b9a3202023-04-21T15:20:41ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342023-04-01XLVIII-M-1-202330130810.5194/isprs-archives-XLVIII-M-1-2023-301-2023ADAPTATION OF DEEPLAB V3+ FOR DAMAGE DETECTION ON PORT INFRASTRUCTURE IMAGERYM. Scherff0F. Hake1H. Alkhatib2Geodetic Institute, Leibniz Universität Hannover, GermanyGeodetic Institute, Leibniz Universität Hannover, GermanyGeodetic Institute, Leibniz Universität Hannover, GermanyRegular inspection and maintenance of infrastructure facilities are crucial to ensure their functionality and safety for users. However, current inspection methods are labor-intensive and can vary depending on the inspector. To improve this process, modern sensor systems and machine learning algorithms can be deployed to detect defects based on rapidly acquired data, resulting in lower downtime. A quality-controlled processing chain allows to provide hence informed uncertainty assessments to inspection operators. In this study, we present several Deeplab V3+ models optimized to predict corroded segments of the quay wall at JadeWeserPort, Germany, which is a dataset from the 3D HydroMapper research project. Our models achieve generally high accuracy in detecting this damage type. Therefore, we examine the use of a Region Growing-based weakly supervised approach to efficiently extend our model to other common types in the future. This approach achieves about 90 % of the results compared to corresponding fully supervised networks, of which a ResNet-50 variant peaks at 55.6 % Intersection-over-Union regarding the test set’s corrosion class.https://isprs-archives.copernicus.org/articles/XLVIII-M-1-2023/301/2023/isprs-archives-XLVIII-M-1-2023-301-2023.pdf
spellingShingle M. Scherff
F. Hake
H. Alkhatib
ADAPTATION OF DEEPLAB V3+ FOR DAMAGE DETECTION ON PORT INFRASTRUCTURE IMAGERY
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
title ADAPTATION OF DEEPLAB V3+ FOR DAMAGE DETECTION ON PORT INFRASTRUCTURE IMAGERY
title_full ADAPTATION OF DEEPLAB V3+ FOR DAMAGE DETECTION ON PORT INFRASTRUCTURE IMAGERY
title_fullStr ADAPTATION OF DEEPLAB V3+ FOR DAMAGE DETECTION ON PORT INFRASTRUCTURE IMAGERY
title_full_unstemmed ADAPTATION OF DEEPLAB V3+ FOR DAMAGE DETECTION ON PORT INFRASTRUCTURE IMAGERY
title_short ADAPTATION OF DEEPLAB V3+ FOR DAMAGE DETECTION ON PORT INFRASTRUCTURE IMAGERY
title_sort adaptation of deeplab v3 for damage detection on port infrastructure imagery
url https://isprs-archives.copernicus.org/articles/XLVIII-M-1-2023/301/2023/isprs-archives-XLVIII-M-1-2023-301-2023.pdf
work_keys_str_mv AT mscherff adaptationofdeeplabv3fordamagedetectiononportinfrastructureimagery
AT fhake adaptationofdeeplabv3fordamagedetectiononportinfrastructureimagery
AT halkhatib adaptationofdeeplabv3fordamagedetectiononportinfrastructureimagery