Acoustic feature analysis for wet and dry road surface classification using two-stream CNN

Road surface wetness affects road safety and is one of the main reasons for weather-related accidents. Study on road surface classification is not only vital for future driverless vehicles but also important to the development of current vehicle active safety systems. In recent years, studies on roa...

Full description

Bibliographic Details
Main Authors: Bahrami, Siavash, Doraisamy, Shyamala, Azman, Azreen, Nasharuddin, Nurul Amelina, Shigang, Yue
Format: Conference or Workshop Item
Language:English
Published: Association for Computing Machinery 2020
Online Access:http://psasir.upm.edu.my/id/eprint/85375/1/Acoustic%20Feature%20Analysis%20for%20Wet%20and%20Dry%20Road%20Surface.pdf
_version_ 1796981605318787072
author Bahrami, Siavash
Doraisamy, Shyamala
Azman, Azreen
Nasharuddin, Nurul Amelina
Shigang, Yue
author_facet Bahrami, Siavash
Doraisamy, Shyamala
Azman, Azreen
Nasharuddin, Nurul Amelina
Shigang, Yue
author_sort Bahrami, Siavash
collection UPM
description Road surface wetness affects road safety and is one of the main reasons for weather-related accidents. Study on road surface classification is not only vital for future driverless vehicles but also important to the development of current vehicle active safety systems. In recent years, studies on road surface wetness classification using acoustic signals have been on the rise. Detection of road surface wetness from acoustic signals involve analysis of signal changes over time and frequency-domain caused by interaction of the tyre and the wet road surface to determine the suitable features. In this paper, two single stream CNN architectures have been investigated. The first architecture uses MFCCs and the other uses temporal and spectral features as the input for road surface wetness detection. A two-stream CNN architecture that merges the MFCCs and spectral feature sets by concatenating the outputs of the two streams is proposed for further improving classification performance of road surface wetness detection. Acoustic signals of wet and dry road surface conditions were recorded with two microphones instrumented on two different cars in a controlled environment. Experimentation and comparative performance evaluations against single stream architectures and the two-stream architecture were performed. Results shows that the accuracy performance of the proposed two-stream CNN architecture is significantly higher compared to single stream CNN for road surface wetness detection.
first_indexed 2024-03-06T10:40:03Z
format Conference or Workshop Item
id upm.eprints-85375
institution Universiti Putra Malaysia
language English
last_indexed 2024-03-06T10:40:03Z
publishDate 2020
publisher Association for Computing Machinery
record_format dspace
spelling upm.eprints-853752021-04-21T02:33:04Z http://psasir.upm.edu.my/id/eprint/85375/ Acoustic feature analysis for wet and dry road surface classification using two-stream CNN Bahrami, Siavash Doraisamy, Shyamala Azman, Azreen Nasharuddin, Nurul Amelina Shigang, Yue Road surface wetness affects road safety and is one of the main reasons for weather-related accidents. Study on road surface classification is not only vital for future driverless vehicles but also important to the development of current vehicle active safety systems. In recent years, studies on road surface wetness classification using acoustic signals have been on the rise. Detection of road surface wetness from acoustic signals involve analysis of signal changes over time and frequency-domain caused by interaction of the tyre and the wet road surface to determine the suitable features. In this paper, two single stream CNN architectures have been investigated. The first architecture uses MFCCs and the other uses temporal and spectral features as the input for road surface wetness detection. A two-stream CNN architecture that merges the MFCCs and spectral feature sets by concatenating the outputs of the two streams is proposed for further improving classification performance of road surface wetness detection. Acoustic signals of wet and dry road surface conditions were recorded with two microphones instrumented on two different cars in a controlled environment. Experimentation and comparative performance evaluations against single stream architectures and the two-stream architecture were performed. Results shows that the accuracy performance of the proposed two-stream CNN architecture is significantly higher compared to single stream CNN for road surface wetness detection. Association for Computing Machinery 2020-12 Conference or Workshop Item PeerReviewed text en http://psasir.upm.edu.my/id/eprint/85375/1/Acoustic%20Feature%20Analysis%20for%20Wet%20and%20Dry%20Road%20Surface.pdf Bahrami, Siavash and Doraisamy, Shyamala and Azman, Azreen and Nasharuddin, Nurul Amelina and Shigang, Yue (2020) Acoustic feature analysis for wet and dry road surface classification using two-stream CNN. In: CSAI 2020: 2020 4th International Conference on Computer Science and Artificial Intelligence, 11-13 Dec. 2020, Zhuhai China. (pp. 194-200). https://dl.acm.org/doi/10.1145/3445815.3445847 10.1145/3445815.3445847
spellingShingle Bahrami, Siavash
Doraisamy, Shyamala
Azman, Azreen
Nasharuddin, Nurul Amelina
Shigang, Yue
Acoustic feature analysis for wet and dry road surface classification using two-stream CNN
title Acoustic feature analysis for wet and dry road surface classification using two-stream CNN
title_full Acoustic feature analysis for wet and dry road surface classification using two-stream CNN
title_fullStr Acoustic feature analysis for wet and dry road surface classification using two-stream CNN
title_full_unstemmed Acoustic feature analysis for wet and dry road surface classification using two-stream CNN
title_short Acoustic feature analysis for wet and dry road surface classification using two-stream CNN
title_sort acoustic feature analysis for wet and dry road surface classification using two stream cnn
url http://psasir.upm.edu.my/id/eprint/85375/1/Acoustic%20Feature%20Analysis%20for%20Wet%20and%20Dry%20Road%20Surface.pdf
work_keys_str_mv AT bahramisiavash acousticfeatureanalysisforwetanddryroadsurfaceclassificationusingtwostreamcnn
AT doraisamyshyamala acousticfeatureanalysisforwetanddryroadsurfaceclassificationusingtwostreamcnn
AT azmanazreen acousticfeatureanalysisforwetanddryroadsurfaceclassificationusingtwostreamcnn
AT nasharuddinnurulamelina acousticfeatureanalysisforwetanddryroadsurfaceclassificationusingtwostreamcnn
AT shigangyue acousticfeatureanalysisforwetanddryroadsurfaceclassificationusingtwostreamcnn