Study on the Evaluation Method of Sound Phase Cloud Maps Based on an Improved YOLOv4 Algorithm
Most sound imaging instruments are currently used as measurement tools which can provide quantitative data, however, a uniform method to directly and comprehensively evaluate the results of combining acoustic and optical images is not available. Therefore, in this study, we define a localization err...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2020-08-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/20/15/4314 |
| _version_ | 1797560458563026944 |
|---|---|
| author | Qinfeng Zhu Huifeng Zheng Yuebing Wang Yonggang Cao Shixu Guo |
| author_facet | Qinfeng Zhu Huifeng Zheng Yuebing Wang Yonggang Cao Shixu Guo |
| author_sort | Qinfeng Zhu |
| collection | DOAJ |
| description | Most sound imaging instruments are currently used as measurement tools which can provide quantitative data, however, a uniform method to directly and comprehensively evaluate the results of combining acoustic and optical images is not available. Therefore, in this study, we define a localization error index for sound imaging instruments, and propose an acoustic phase cloud map evaluation method based on an improved YOLOv4 algorithm to directly and objectively evaluate the sound source localization results of a sound imaging instrument. The evaluation method begins with the image augmentation of acoustic phase cloud maps obtained from the different tests of a sound imaging instrument to produce the dataset required for training the convolutional network. Subsequently, we combine DenseNet with existing clustering algorithms to improve the YOLOv4 algorithm to train the neural network for easier feature extraction. The trained neural network is then used to localize the target sound source and its pseudo-color map in the acoustic phase cloud map to obtain a pixel-level localization error. Finally, a standard chessboard grid is used to obtain the proportional relationship between the size of the acoustic phase cloud map and the actual physical space distance; then, the true lateral and longitudinal positioning error of sound imaging instrument can be obtained. Experimental results show that the mean average precision of the improved YOLOv4 algorithm in acoustic phase cloud map detection is 96.3%, the F1-score is 95.2%, and detection speed is up to 34.6 fps. The improved algorithm can rapidly and accurately determine the positioning error of sound imaging instrument, which can be used to analyze and evaluate the positioning performance of sound imaging instrument. |
| first_indexed | 2024-03-10T18:00:50Z |
| format | Article |
| id | doaj.art-3636f82450394b469f2d64239de6e718 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-10T18:00:50Z |
| publishDate | 2020-08-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-3636f82450394b469f2d64239de6e7182023-11-20T08:51:42ZengMDPI AGSensors1424-82202020-08-012015431410.3390/s20154314Study on the Evaluation Method of Sound Phase Cloud Maps Based on an Improved YOLOv4 AlgorithmQinfeng Zhu0Huifeng Zheng1Yuebing Wang2Yonggang Cao3Shixu Guo4Key Laboratory of Acoustics Research, China Jiliang University, Hangzhou 310018, ChinaKey Laboratory of Acoustics Research, China Jiliang University, Hangzhou 310018, ChinaKey Laboratory of Acoustics Research, China Jiliang University, Hangzhou 310018, ChinaKey Laboratory of Acoustics Research, China Jiliang University, Hangzhou 310018, ChinaKey Laboratory of Acoustics Research, China Jiliang University, Hangzhou 310018, ChinaMost sound imaging instruments are currently used as measurement tools which can provide quantitative data, however, a uniform method to directly and comprehensively evaluate the results of combining acoustic and optical images is not available. Therefore, in this study, we define a localization error index for sound imaging instruments, and propose an acoustic phase cloud map evaluation method based on an improved YOLOv4 algorithm to directly and objectively evaluate the sound source localization results of a sound imaging instrument. The evaluation method begins with the image augmentation of acoustic phase cloud maps obtained from the different tests of a sound imaging instrument to produce the dataset required for training the convolutional network. Subsequently, we combine DenseNet with existing clustering algorithms to improve the YOLOv4 algorithm to train the neural network for easier feature extraction. The trained neural network is then used to localize the target sound source and its pseudo-color map in the acoustic phase cloud map to obtain a pixel-level localization error. Finally, a standard chessboard grid is used to obtain the proportional relationship between the size of the acoustic phase cloud map and the actual physical space distance; then, the true lateral and longitudinal positioning error of sound imaging instrument can be obtained. Experimental results show that the mean average precision of the improved YOLOv4 algorithm in acoustic phase cloud map detection is 96.3%, the F1-score is 95.2%, and detection speed is up to 34.6 fps. The improved algorithm can rapidly and accurately determine the positioning error of sound imaging instrument, which can be used to analyze and evaluate the positioning performance of sound imaging instrument.https://www.mdpi.com/1424-8220/20/15/4314YOLOv4 algorithmsound source localizationsound imaging instrumentpositioning errorDenseNetk-medians++ |
| spellingShingle | Qinfeng Zhu Huifeng Zheng Yuebing Wang Yonggang Cao Shixu Guo Study on the Evaluation Method of Sound Phase Cloud Maps Based on an Improved YOLOv4 Algorithm Sensors YOLOv4 algorithm sound source localization sound imaging instrument positioning error DenseNet k-medians++ |
| title | Study on the Evaluation Method of Sound Phase Cloud Maps Based on an Improved YOLOv4 Algorithm |
| title_full | Study on the Evaluation Method of Sound Phase Cloud Maps Based on an Improved YOLOv4 Algorithm |
| title_fullStr | Study on the Evaluation Method of Sound Phase Cloud Maps Based on an Improved YOLOv4 Algorithm |
| title_full_unstemmed | Study on the Evaluation Method of Sound Phase Cloud Maps Based on an Improved YOLOv4 Algorithm |
| title_short | Study on the Evaluation Method of Sound Phase Cloud Maps Based on an Improved YOLOv4 Algorithm |
| title_sort | study on the evaluation method of sound phase cloud maps based on an improved yolov4 algorithm |
| topic | YOLOv4 algorithm sound source localization sound imaging instrument positioning error DenseNet k-medians++ |
| url | https://www.mdpi.com/1424-8220/20/15/4314 |
| work_keys_str_mv | AT qinfengzhu studyontheevaluationmethodofsoundphasecloudmapsbasedonanimprovedyolov4algorithm AT huifengzheng studyontheevaluationmethodofsoundphasecloudmapsbasedonanimprovedyolov4algorithm AT yuebingwang studyontheevaluationmethodofsoundphasecloudmapsbasedonanimprovedyolov4algorithm AT yonggangcao studyontheevaluationmethodofsoundphasecloudmapsbasedonanimprovedyolov4algorithm AT shixuguo studyontheevaluationmethodofsoundphasecloudmapsbasedonanimprovedyolov4algorithm |