ROAD CONDITION ASSESSMENT FROM AERIAL IMAGERY USING DEEP LEARNING

Terrestrial sensors are commonly used to inspect and document the condition of roads at regular intervals and according to defined rules. For example in Germany, extensive data and information is obtained, which is stored in the Federal Road Information System and made available in particular for de...

Full description

Bibliographic Details
Main Authors: N. Merkle, C. Henry, S. M. Azimi, F. Kurz
Format: Article
Language:English
Published: Copernicus Publications 2022-05-01
Series:ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Online Access:https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/V-2-2022/283/2022/isprs-annals-V-2-2022-283-2022.pdf
_version_ 1818232347592491008
author N. Merkle
C. Henry
S. M. Azimi
F. Kurz
author_facet N. Merkle
C. Henry
S. M. Azimi
F. Kurz
author_sort N. Merkle
collection DOAJ
description Terrestrial sensors are commonly used to inspect and document the condition of roads at regular intervals and according to defined rules. For example in Germany, extensive data and information is obtained, which is stored in the Federal Road Information System and made available in particular for deriving necessary decisions. Transverse and longitudinal evenness, for example, are recorded by vehicles using laser techniques. To detect damage to the road surface, images are captured and recorded using area or line scan cameras. All these methods provide very accurate information about the condition of the road, but are time-consuming and costly. Aerial imagery (e.g. multi- or hyperspectral, SAR) provide an additional possibility for the acquisition of the specific parameters describing the condition of roads, yet a direct transfer from objects extractable from aerial imagery to the required objects or parameters, which determine the condition of the road is difficult and in some cases impossible. In this work, we investigate the transferability of objects commonly used for the terrestrial-based assessment of road surfaces to an aerial image-based assessment. In addition, we generated a suitable dataset and developed a deep learning based image segmentation method capable of extracting two relevant road condition parameters from high-resolution multispectral aerial imagery, namely cracks and working seams. The obtained results show that our models are able to extraction these thin features from aerial images, indicating the possibility of using more automated approaches for road surface condition assessment in the future.
first_indexed 2024-12-12T11:04:51Z
format Article
id doaj.art-bd3c7de2dc784737b7af4dc26702f3ed
institution Directory Open Access Journal
issn 2194-9042
2194-9050
language English
last_indexed 2024-12-12T11:04:51Z
publishDate 2022-05-01
publisher Copernicus Publications
record_format Article
series ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
spelling doaj.art-bd3c7de2dc784737b7af4dc26702f3ed2022-12-22T00:26:26ZengCopernicus PublicationsISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences2194-90422194-90502022-05-01V-2-202228328910.5194/isprs-annals-V-2-2022-283-2022ROAD CONDITION ASSESSMENT FROM AERIAL IMAGERY USING DEEP LEARNINGN. Merkle0C. Henry1S. M. Azimi2F. Kurz3Remote Sensing Technology Institute, German Aerospace Center (DLR), Oberpfaffenhofen, GermanyRemote Sensing Technology Institute, German Aerospace Center (DLR), Oberpfaffenhofen, GermanyRemote Sensing Technology Institute, German Aerospace Center (DLR), Oberpfaffenhofen, GermanyRemote Sensing Technology Institute, German Aerospace Center (DLR), Oberpfaffenhofen, GermanyTerrestrial sensors are commonly used to inspect and document the condition of roads at regular intervals and according to defined rules. For example in Germany, extensive data and information is obtained, which is stored in the Federal Road Information System and made available in particular for deriving necessary decisions. Transverse and longitudinal evenness, for example, are recorded by vehicles using laser techniques. To detect damage to the road surface, images are captured and recorded using area or line scan cameras. All these methods provide very accurate information about the condition of the road, but are time-consuming and costly. Aerial imagery (e.g. multi- or hyperspectral, SAR) provide an additional possibility for the acquisition of the specific parameters describing the condition of roads, yet a direct transfer from objects extractable from aerial imagery to the required objects or parameters, which determine the condition of the road is difficult and in some cases impossible. In this work, we investigate the transferability of objects commonly used for the terrestrial-based assessment of road surfaces to an aerial image-based assessment. In addition, we generated a suitable dataset and developed a deep learning based image segmentation method capable of extracting two relevant road condition parameters from high-resolution multispectral aerial imagery, namely cracks and working seams. The obtained results show that our models are able to extraction these thin features from aerial images, indicating the possibility of using more automated approaches for road surface condition assessment in the future.https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/V-2-2022/283/2022/isprs-annals-V-2-2022-283-2022.pdf
spellingShingle N. Merkle
C. Henry
S. M. Azimi
F. Kurz
ROAD CONDITION ASSESSMENT FROM AERIAL IMAGERY USING DEEP LEARNING
ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
title ROAD CONDITION ASSESSMENT FROM AERIAL IMAGERY USING DEEP LEARNING
title_full ROAD CONDITION ASSESSMENT FROM AERIAL IMAGERY USING DEEP LEARNING
title_fullStr ROAD CONDITION ASSESSMENT FROM AERIAL IMAGERY USING DEEP LEARNING
title_full_unstemmed ROAD CONDITION ASSESSMENT FROM AERIAL IMAGERY USING DEEP LEARNING
title_short ROAD CONDITION ASSESSMENT FROM AERIAL IMAGERY USING DEEP LEARNING
title_sort road condition assessment from aerial imagery using deep learning
url https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/V-2-2022/283/2022/isprs-annals-V-2-2022-283-2022.pdf
work_keys_str_mv AT nmerkle roadconditionassessmentfromaerialimageryusingdeeplearning
AT chenry roadconditionassessmentfromaerialimageryusingdeeplearning
AT smazimi roadconditionassessmentfromaerialimageryusingdeeplearning
AT fkurz roadconditionassessmentfromaerialimageryusingdeeplearning