Road pothole detection from smartphone sensor data using improved LSTM

Road abnormalities can be caused by man-made and natural disasters that affect the safety of drivers and damage vehicles. Therefore, several automatic road monitoring approaches have been proposed to monitor the road surface and detect road abnormalities like potholes. However, low accuracy in detec...

Full description

Bibliographic Details
Main Authors: Singh, Prabhat, Kamal, Ahmed E., Bansal, Abhay, Kumar, Sunil
Format: Article
Language:English
Published: Springer 2024
Subjects:
Online Access:https://repository.londonmet.ac.uk/9899/1/LSTM_Multimedia_2.pdf
_version_ 1824446511886368768
author Singh, Prabhat
Kamal, Ahmed E.
Bansal, Abhay
Kumar, Sunil
author_facet Singh, Prabhat
Kamal, Ahmed E.
Bansal, Abhay
Kumar, Sunil
author_sort Singh, Prabhat
collection LMU
description Road abnormalities can be caused by man-made and natural disasters that affect the safety of drivers and damage vehicles. Therefore, several automatic road monitoring approaches have been proposed to monitor the road surface and detect road abnormalities like potholes. However, low accuracy in detecting the pothole in low-light conditions is taken as the main problem in this work. To address this issue, we presented an Improved Long Short Term Memory model (ILSTM) that combines a three-layer deep LSTM with a One-Dimensional Local Binary Pattern (1D-LBP) layer to detect the presence of potholes during low-light conditions and extract features such as the number of neighbouring samples and pixel values. The proposed strategy collects the pothole data from accelerometer and gyroscope sensor data using a smart phone. This model is used to classify the sensor data and label it either as a pothole or normal. Besides, this makes classification possible and extracts the location of the pothole. Evaluation results demonstrate that the proposed ILSTM approach is also robust to low lighting conditions with a detection accuracy of 99% and requires less execution time in classifying potholes and non-pothole regions on the pothole dataset collected with the help of an accelerometer and a gyroscope.
first_indexed 2025-02-19T01:16:20Z
format Article
id oai:repository.londonmet.ac.uk:9899
institution London Metropolitan University
language English
last_indexed 2025-02-19T01:16:20Z
publishDate 2024
publisher Springer
record_format eprints
spelling oai:repository.londonmet.ac.uk:98992025-01-23T10:27:30Z https://repository.londonmet.ac.uk/9899/ Road pothole detection from smartphone sensor data using improved LSTM Singh, Prabhat Kamal, Ahmed E. Bansal, Abhay Kumar, Sunil 000 Computer science, information & general works 600 Technology 620 Engineering & allied operations Road abnormalities can be caused by man-made and natural disasters that affect the safety of drivers and damage vehicles. Therefore, several automatic road monitoring approaches have been proposed to monitor the road surface and detect road abnormalities like potholes. However, low accuracy in detecting the pothole in low-light conditions is taken as the main problem in this work. To address this issue, we presented an Improved Long Short Term Memory model (ILSTM) that combines a three-layer deep LSTM with a One-Dimensional Local Binary Pattern (1D-LBP) layer to detect the presence of potholes during low-light conditions and extract features such as the number of neighbouring samples and pixel values. The proposed strategy collects the pothole data from accelerometer and gyroscope sensor data using a smart phone. This model is used to classify the sensor data and label it either as a pothole or normal. Besides, this makes classification possible and extracts the location of the pothole. Evaluation results demonstrate that the proposed ILSTM approach is also robust to low lighting conditions with a detection accuracy of 99% and requires less execution time in classifying potholes and non-pothole regions on the pothole dataset collected with the help of an accelerometer and a gyroscope. Springer 2024-03 Article PeerReviewed text en https://repository.londonmet.ac.uk/9899/1/LSTM_Multimedia_2.pdf Singh, Prabhat, Kamal, Ahmed E., Bansal, Abhay and Kumar, Sunil (2024) Road pothole detection from smartphone sensor data using improved LSTM. Multimedia Tools and Applications, 83 (9). pp. 26009-26030. ISSN 1573-7721 https://doi.org/10.1007/s11042-023-16177-0 doi:10.1007/s11042-023-16177-0 doi:10.1007/s11042-023-16177-0
spellingShingle 000 Computer science, information & general works
600 Technology
620 Engineering & allied operations
Singh, Prabhat
Kamal, Ahmed E.
Bansal, Abhay
Kumar, Sunil
Road pothole detection from smartphone sensor data using improved LSTM
title Road pothole detection from smartphone sensor data using improved LSTM
title_full Road pothole detection from smartphone sensor data using improved LSTM
title_fullStr Road pothole detection from smartphone sensor data using improved LSTM
title_full_unstemmed Road pothole detection from smartphone sensor data using improved LSTM
title_short Road pothole detection from smartphone sensor data using improved LSTM
title_sort road pothole detection from smartphone sensor data using improved lstm
topic 000 Computer science, information & general works
600 Technology
620 Engineering & allied operations
url https://repository.londonmet.ac.uk/9899/1/LSTM_Multimedia_2.pdf
work_keys_str_mv AT singhprabhat roadpotholedetectionfromsmartphonesensordatausingimprovedlstm
AT kamalahmede roadpotholedetectionfromsmartphonesensordatausingimprovedlstm
AT bansalabhay roadpotholedetectionfromsmartphonesensordatausingimprovedlstm
AT kumarsunil roadpotholedetectionfromsmartphonesensordatausingimprovedlstm