An Improved Deep Convolutional Neural Network-Based Autonomous Road Inspection Scheme Using Unmanned Aerial Vehicles

Recent advancements in the field of machine learning (ML) provide opportunity to conduct research on autonomous devices for a variety of applications. Intelligent decision-making is a critical task for self-driving systems. An attempt is made in this study to use a deep learning (DL) approach for th...

Full description

Bibliographic Details
Main Authors: Syed-Ali Hassan, Tariq Rahim, Soo-Young Shin
Format: Article
Language:English
Published: MDPI AG 2021-11-01
Series:Electronics
Subjects:
Online Access:https://www.mdpi.com/2079-9292/10/22/2764
_version_ 1797510571518590976
author Syed-Ali Hassan
Tariq Rahim
Soo-Young Shin
author_facet Syed-Ali Hassan
Tariq Rahim
Soo-Young Shin
author_sort Syed-Ali Hassan
collection DOAJ
description Recent advancements in the field of machine learning (ML) provide opportunity to conduct research on autonomous devices for a variety of applications. Intelligent decision-making is a critical task for self-driving systems. An attempt is made in this study to use a deep learning (DL) approach for the early detection of road cracks, potholes, and the yellow lane. The accuracy is not sufficient after training with the default model. To enhance accuracy, a convolutional neural network (CNN) model with 13 convolutional layers, a softmax layer as an output layer, and two fully connected layers (FCN) are constructed. In order to achieve the deeper propagation and to prevent saturation in the training phase, mish activation is employed in the first 12 layers with a rectified linear unit (ReLU) activation function. The upgraded CNN model performs better than the default CNN model in terms of accuracy. For the varied situation, a revised and enriched dataset for road cracks, potholes, and the yellow lane is created. The yellow lane is detected and tracked in order to move the unmanned aerial vehicle (UAV) autonomously by following yellow lane. After identifying a yellow lane, the UAV performs autonomous navigation while concurrently detecting road cracks and potholes using the robot operating system within the UAV. The performance model is benchmarked using performance measures, such as accuracy, sensitivity, <i>F</i>1-<i>score</i>, <i>F</i>2-<i>score</i>, and dice-coefficient, which demonstrate that the suggested technique produces better outcomes.
first_indexed 2024-03-10T05:33:14Z
format Article
id doaj.art-39613531cd9b4d27a2351df1484397b9
institution Directory Open Access Journal
issn 2079-9292
language English
last_indexed 2024-03-10T05:33:14Z
publishDate 2021-11-01
publisher MDPI AG
record_format Article
series Electronics
spelling doaj.art-39613531cd9b4d27a2351df1484397b92023-11-22T23:06:47ZengMDPI AGElectronics2079-92922021-11-011022276410.3390/electronics10222764An Improved Deep Convolutional Neural Network-Based Autonomous Road Inspection Scheme Using Unmanned Aerial VehiclesSyed-Ali Hassan0Tariq Rahim1Soo-Young Shin2Department of IT Convergence Engineering, Kumoh National Institute of Technology, Gumi 39177, Gyeongbuk, KoreaDepartment of IT Convergence Engineering, Kumoh National Institute of Technology, Gumi 39177, Gyeongbuk, KoreaDepartment of IT Convergence Engineering, Kumoh National Institute of Technology, Gumi 39177, Gyeongbuk, KoreaRecent advancements in the field of machine learning (ML) provide opportunity to conduct research on autonomous devices for a variety of applications. Intelligent decision-making is a critical task for self-driving systems. An attempt is made in this study to use a deep learning (DL) approach for the early detection of road cracks, potholes, and the yellow lane. The accuracy is not sufficient after training with the default model. To enhance accuracy, a convolutional neural network (CNN) model with 13 convolutional layers, a softmax layer as an output layer, and two fully connected layers (FCN) are constructed. In order to achieve the deeper propagation and to prevent saturation in the training phase, mish activation is employed in the first 12 layers with a rectified linear unit (ReLU) activation function. The upgraded CNN model performs better than the default CNN model in terms of accuracy. For the varied situation, a revised and enriched dataset for road cracks, potholes, and the yellow lane is created. The yellow lane is detected and tracked in order to move the unmanned aerial vehicle (UAV) autonomously by following yellow lane. After identifying a yellow lane, the UAV performs autonomous navigation while concurrently detecting road cracks and potholes using the robot operating system within the UAV. The performance model is benchmarked using performance measures, such as accuracy, sensitivity, <i>F</i>1-<i>score</i>, <i>F</i>2-<i>score</i>, and dice-coefficient, which demonstrate that the suggested technique produces better outcomes.https://www.mdpi.com/2079-9292/10/22/2764autonomous navigationautonomous road inspectioncomputer visiondronerobotsneural network
spellingShingle Syed-Ali Hassan
Tariq Rahim
Soo-Young Shin
An Improved Deep Convolutional Neural Network-Based Autonomous Road Inspection Scheme Using Unmanned Aerial Vehicles
Electronics
autonomous navigation
autonomous road inspection
computer vision
drone
robots
neural network
title An Improved Deep Convolutional Neural Network-Based Autonomous Road Inspection Scheme Using Unmanned Aerial Vehicles
title_full An Improved Deep Convolutional Neural Network-Based Autonomous Road Inspection Scheme Using Unmanned Aerial Vehicles
title_fullStr An Improved Deep Convolutional Neural Network-Based Autonomous Road Inspection Scheme Using Unmanned Aerial Vehicles
title_full_unstemmed An Improved Deep Convolutional Neural Network-Based Autonomous Road Inspection Scheme Using Unmanned Aerial Vehicles
title_short An Improved Deep Convolutional Neural Network-Based Autonomous Road Inspection Scheme Using Unmanned Aerial Vehicles
title_sort improved deep convolutional neural network based autonomous road inspection scheme using unmanned aerial vehicles
topic autonomous navigation
autonomous road inspection
computer vision
drone
robots
neural network
url https://www.mdpi.com/2079-9292/10/22/2764
work_keys_str_mv AT syedalihassan animproveddeepconvolutionalneuralnetworkbasedautonomousroadinspectionschemeusingunmannedaerialvehicles
AT tariqrahim animproveddeepconvolutionalneuralnetworkbasedautonomousroadinspectionschemeusingunmannedaerialvehicles
AT sooyoungshin animproveddeepconvolutionalneuralnetworkbasedautonomousroadinspectionschemeusingunmannedaerialvehicles
AT syedalihassan improveddeepconvolutionalneuralnetworkbasedautonomousroadinspectionschemeusingunmannedaerialvehicles
AT tariqrahim improveddeepconvolutionalneuralnetworkbasedautonomousroadinspectionschemeusingunmannedaerialvehicles
AT sooyoungshin improveddeepconvolutionalneuralnetworkbasedautonomousroadinspectionschemeusingunmannedaerialvehicles