Automatic segmentation of airport pavement damage by AM‐Mask R‐CNN algorithm
Abstract The airport is an important infrastructure for air transport and urban traffic. The airport pavement damage seriously affects the safety of aircraft take‐off and landing. Therefore, the regular detection of airport pavement damage is critical for aircraft take‐off and landing safety. Howeve...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2023-08-01
|
| Series: | Engineering Reports |
| Subjects: | |
| Online Access: | https://doi.org/10.1002/eng2.12628 |
| _version_ | 1797751922239733760 |
|---|---|
| author | Hao Zhang Jiaxiu Dong Ziqiao Gao |
| author_facet | Hao Zhang Jiaxiu Dong Ziqiao Gao |
| author_sort | Hao Zhang |
| collection | DOAJ |
| description | Abstract The airport is an important infrastructure for air transport and urban traffic. The airport pavement damage seriously affects the safety of aircraft take‐off and landing. Therefore, the regular detection of airport pavement damage is critical for aircraft take‐off and landing safety. However, for small target areas, the existing pavement damage detection methods cannot effectively achieve detection. In addition, the airport pavement detection is carried out under low light conditions at night, and the existing detection methods may not be able to accurately detect the damage boundary. To address the above problems, an automatic detection algorithm of Mask R‐CNN algorithm integrating attention mechanism (AM‐Mask R‐CNN) for airport pavement damage is proposed. First, the AM‐Mask R‐CNN is developed based on an improved Mask R‐CNN modified by the feature pyramid (FPN) and the dual attention mechanism are fused to extract subtle features in images. In addition, feature fusion is used. The macroscopic and microscopic features of airport pavement damage are organically combined to improve the segmentation sensitivity of small target areas and dark lighting. The experimental results show that the average F1‐score of the proposed model is 0.9489. In addition, the mean intersection over union for the model proposed is 0.9388. The average segmentation speed can reach 11.8 FPS. Moreover, compared with the traditional threshold segmentation method Fully Convolutional Networks (FCN) and DeepCrack segmentation method, the effectiveness of the proposed method is further proved. |
| first_indexed | 2024-03-12T16:55:41Z |
| format | Article |
| id | doaj.art-73eea057de2d4a4cb53dcf5ba892c2d8 |
| institution | Directory Open Access Journal |
| issn | 2577-8196 |
| language | English |
| last_indexed | 2024-03-12T16:55:41Z |
| publishDate | 2023-08-01 |
| publisher | Wiley |
| record_format | Article |
| series | Engineering Reports |
| spelling | doaj.art-73eea057de2d4a4cb53dcf5ba892c2d82023-08-08T07:41:15ZengWileyEngineering Reports2577-81962023-08-0158n/an/a10.1002/eng2.12628Automatic segmentation of airport pavement damage by AM‐Mask R‐CNN algorithmHao Zhang0Jiaxiu Dong1Ziqiao Gao2College of Architecture and Civil Engineering Xinyang Normal University Henan Xinyang ChinaYellow River Laboratory Zhengzhou University Henan Zhengzhou ChinaYellow River Laboratory Zhengzhou University Henan Zhengzhou ChinaAbstract The airport is an important infrastructure for air transport and urban traffic. The airport pavement damage seriously affects the safety of aircraft take‐off and landing. Therefore, the regular detection of airport pavement damage is critical for aircraft take‐off and landing safety. However, for small target areas, the existing pavement damage detection methods cannot effectively achieve detection. In addition, the airport pavement detection is carried out under low light conditions at night, and the existing detection methods may not be able to accurately detect the damage boundary. To address the above problems, an automatic detection algorithm of Mask R‐CNN algorithm integrating attention mechanism (AM‐Mask R‐CNN) for airport pavement damage is proposed. First, the AM‐Mask R‐CNN is developed based on an improved Mask R‐CNN modified by the feature pyramid (FPN) and the dual attention mechanism are fused to extract subtle features in images. In addition, feature fusion is used. The macroscopic and microscopic features of airport pavement damage are organically combined to improve the segmentation sensitivity of small target areas and dark lighting. The experimental results show that the average F1‐score of the proposed model is 0.9489. In addition, the mean intersection over union for the model proposed is 0.9388. The average segmentation speed can reach 11.8 FPS. Moreover, compared with the traditional threshold segmentation method Fully Convolutional Networks (FCN) and DeepCrack segmentation method, the effectiveness of the proposed method is further proved.https://doi.org/10.1002/eng2.12628airport pavementAM‐mask R‐CNNattention mechanismpavement segmentation |
| spellingShingle | Hao Zhang Jiaxiu Dong Ziqiao Gao Automatic segmentation of airport pavement damage by AM‐Mask R‐CNN algorithm Engineering Reports airport pavement AM‐mask R‐CNN attention mechanism pavement segmentation |
| title | Automatic segmentation of airport pavement damage by AM‐Mask R‐CNN algorithm |
| title_full | Automatic segmentation of airport pavement damage by AM‐Mask R‐CNN algorithm |
| title_fullStr | Automatic segmentation of airport pavement damage by AM‐Mask R‐CNN algorithm |
| title_full_unstemmed | Automatic segmentation of airport pavement damage by AM‐Mask R‐CNN algorithm |
| title_short | Automatic segmentation of airport pavement damage by AM‐Mask R‐CNN algorithm |
| title_sort | automatic segmentation of airport pavement damage by am mask r cnn algorithm |
| topic | airport pavement AM‐mask R‐CNN attention mechanism pavement segmentation |
| url | https://doi.org/10.1002/eng2.12628 |
| work_keys_str_mv | AT haozhang automaticsegmentationofairportpavementdamagebyammaskrcnnalgorithm AT jiaxiudong automaticsegmentationofairportpavementdamagebyammaskrcnnalgorithm AT ziqiaogao automaticsegmentationofairportpavementdamagebyammaskrcnnalgorithm |