CrackYOLO: Rural Pavement Distress Detection Model with Complex Scenarios
The maintenance level of rural roads is relatively low, and the automated detection of pavement distress is easily affected by the shadows of rows of trees, weeds, soil, and distress object scale disparities; this makes it difficult to accurately evaluate the distress conditions of the pavement. To...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-01-01
|
| Series: | Electronics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2079-9292/13/2/312 |
| _version_ | 1797344204930678784 |
|---|---|
| author | Yuxuan Li Shangyu Sun Weidong Song Jinhe Zhang Qiaoshuang Teng |
| author_facet | Yuxuan Li Shangyu Sun Weidong Song Jinhe Zhang Qiaoshuang Teng |
| author_sort | Yuxuan Li |
| collection | DOAJ |
| description | The maintenance level of rural roads is relatively low, and the automated detection of pavement distress is easily affected by the shadows of rows of trees, weeds, soil, and distress object scale disparities; this makes it difficult to accurately evaluate the distress conditions of the pavement. To solve the above problems, this study specifically designed a target detection network called Crack Convolution (CrackYOLO) for pavement crack extraction on rural roads. CrackYOLO is based on an improved YOLOv5. The shadow created by rows of trees leads to the loss of crack features in the feature extraction and downsampling stages of the network; therefore, CrackConv and Adapt-weight Down Sample (ADSample) were introduced to strengthen the ability to locate and identify cracks. Due to disturbances such as soil and weeds, which cause the extraction of more redundant features, the Channel And Spatial mixed attention mechanism (CAS) was introduced to enhance crack weight. To address the issue of missed detections of fine cracks due to significant scale variations in crack objects in the same image, Multi Scale Convolution (MSConv) and Multi Scale Head (MSHead) were incorporated during the feature fusion and prediction inference stages of the network, thereby improving the multi-scale detection performance. In order to verify the effectiveness of the proposed method, the detection accuracy of CrackYOLO when used on the LNTU_RDD_NC dataset was determined to be 9.99%, 12.79%, and 4.61% higher than that of the current pavement crack detection models YOLO-LWNet, Faster R-CNN, and YOLOv7. At the same time, we compare the above model on public datasets of different scenarios, and the experimental results show that CrackYOLO has the same strong performance in urban roads and other scenarios. |
| first_indexed | 2024-03-08T10:59:00Z |
| format | Article |
| id | doaj.art-35eb78a20f864f0682d94ba1fe930b7f |
| institution | Directory Open Access Journal |
| issn | 2079-9292 |
| language | English |
| last_indexed | 2024-03-08T10:59:00Z |
| publishDate | 2024-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Electronics |
| spelling | doaj.art-35eb78a20f864f0682d94ba1fe930b7f2024-01-26T16:13:28ZengMDPI AGElectronics2079-92922024-01-0113231210.3390/electronics13020312CrackYOLO: Rural Pavement Distress Detection Model with Complex ScenariosYuxuan Li0Shangyu Sun1Weidong Song2Jinhe Zhang3Qiaoshuang Teng4School of Geomatics, Liaoning Technical University, Fuxin 123000, ChinaSchool of Geomatics, Liaoning Technical University, Fuxin 123000, ChinaCollaborative Innovation Institute of Geospatial Information Service, Liaoning Technical University, Fuxin 123000, ChinaSchool of Geomatics, Liaoning Technical University, Fuxin 123000, ChinaSchool of Geomatics, Liaoning Technical University, Fuxin 123000, ChinaThe maintenance level of rural roads is relatively low, and the automated detection of pavement distress is easily affected by the shadows of rows of trees, weeds, soil, and distress object scale disparities; this makes it difficult to accurately evaluate the distress conditions of the pavement. To solve the above problems, this study specifically designed a target detection network called Crack Convolution (CrackYOLO) for pavement crack extraction on rural roads. CrackYOLO is based on an improved YOLOv5. The shadow created by rows of trees leads to the loss of crack features in the feature extraction and downsampling stages of the network; therefore, CrackConv and Adapt-weight Down Sample (ADSample) were introduced to strengthen the ability to locate and identify cracks. Due to disturbances such as soil and weeds, which cause the extraction of more redundant features, the Channel And Spatial mixed attention mechanism (CAS) was introduced to enhance crack weight. To address the issue of missed detections of fine cracks due to significant scale variations in crack objects in the same image, Multi Scale Convolution (MSConv) and Multi Scale Head (MSHead) were incorporated during the feature fusion and prediction inference stages of the network, thereby improving the multi-scale detection performance. In order to verify the effectiveness of the proposed method, the detection accuracy of CrackYOLO when used on the LNTU_RDD_NC dataset was determined to be 9.99%, 12.79%, and 4.61% higher than that of the current pavement crack detection models YOLO-LWNet, Faster R-CNN, and YOLOv7. At the same time, we compare the above model on public datasets of different scenarios, and the experimental results show that CrackYOLO has the same strong performance in urban roads and other scenarios.https://www.mdpi.com/2079-9292/13/2/312crack detectiondeep learningrural roadsmulti-scale featureshybrid attention mechanism |
| spellingShingle | Yuxuan Li Shangyu Sun Weidong Song Jinhe Zhang Qiaoshuang Teng CrackYOLO: Rural Pavement Distress Detection Model with Complex Scenarios Electronics crack detection deep learning rural roads multi-scale features hybrid attention mechanism |
| title | CrackYOLO: Rural Pavement Distress Detection Model with Complex Scenarios |
| title_full | CrackYOLO: Rural Pavement Distress Detection Model with Complex Scenarios |
| title_fullStr | CrackYOLO: Rural Pavement Distress Detection Model with Complex Scenarios |
| title_full_unstemmed | CrackYOLO: Rural Pavement Distress Detection Model with Complex Scenarios |
| title_short | CrackYOLO: Rural Pavement Distress Detection Model with Complex Scenarios |
| title_sort | crackyolo rural pavement distress detection model with complex scenarios |
| topic | crack detection deep learning rural roads multi-scale features hybrid attention mechanism |
| url | https://www.mdpi.com/2079-9292/13/2/312 |
| work_keys_str_mv | AT yuxuanli crackyoloruralpavementdistressdetectionmodelwithcomplexscenarios AT shangyusun crackyoloruralpavementdistressdetectionmodelwithcomplexscenarios AT weidongsong crackyoloruralpavementdistressdetectionmodelwithcomplexscenarios AT jinhezhang crackyoloruralpavementdistressdetectionmodelwithcomplexscenarios AT qiaoshuangteng crackyoloruralpavementdistressdetectionmodelwithcomplexscenarios |