Deep Learning-Based Steel Bridge Corrosion Segmentation and Condition Rating Using Mask RCNN and YOLOv8
The application of deep learning (DL) algorithms has become of great interest in recent years due to their superior performance in structural damage identification, including the detection of corrosion. There has been growing interest in the application of convolutional neural networks (CNNs) for co...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-12-01
|
| Series: | Infrastructures |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2412-3811/9/1/3 |
| _version_ | 1827371780705091584 |
|---|---|
| author | Zahra Ameli Shabnam Jafarpoor Nesheli Eric N. Landis |
| author_facet | Zahra Ameli Shabnam Jafarpoor Nesheli Eric N. Landis |
| author_sort | Zahra Ameli |
| collection | DOAJ |
| description | The application of deep learning (DL) algorithms has become of great interest in recent years due to their superior performance in structural damage identification, including the detection of corrosion. There has been growing interest in the application of convolutional neural networks (CNNs) for corrosion detection and classification. However, current approaches primarily involve detecting corrosion within bounding boxes, lacking the segmentation of corrosion with irregular boundary shapes. As a result, it becomes challenging to quantify corrosion areas and severity, which is crucial for engineers to rate the condition of structural elements and assess the performance of infrastructures. Furthermore, training an efficient deep learning model requires a large number of corrosion images and the manual labeling of every single image. This process can be tedious and labor-intensive. In this project, an open-source steel bridge corrosion dataset along with corresponding annotations was generated. This database contains 514 images with various corrosion severity levels, gathered from a variety of steel bridges. A pixel-level annotation was performed according to the Bridge Inspectors Reference Manual (BIRM) and the American Association of State Highway and Transportation Officials (AASHTO) regulations for corrosion condition rating (defect #1000). Two state-of-the-art semantic segmentation algorithms, Mask RCNN and YOLOv8, were trained and validated on the dataset. These trained models were then tested on a set of test images and the results were compared. The trained Mask RCNN and YOLOv8 models demonstrated satisfactory performance in segmenting and rating corrosion, making them suitable for practical applications. |
| first_indexed | 2024-03-08T10:47:27Z |
| format | Article |
| id | doaj.art-b0bf07f8372c462bb4b1d19d9a675b6c |
| institution | Directory Open Access Journal |
| issn | 2412-3811 |
| language | English |
| last_indexed | 2024-03-08T10:47:27Z |
| publishDate | 2023-12-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Infrastructures |
| spelling | doaj.art-b0bf07f8372c462bb4b1d19d9a675b6c2024-01-26T17:03:52ZengMDPI AGInfrastructures2412-38112023-12-0191310.3390/infrastructures9010003Deep Learning-Based Steel Bridge Corrosion Segmentation and Condition Rating Using Mask RCNN and YOLOv8Zahra Ameli0Shabnam Jafarpoor Nesheli1Eric N. Landis2Department of Civil and Environmental Engineering, University of Maine, Orono, ME 04469, USADepartment of Engineering, University of Science and Culture, Tehran 1461968151, IranDepartment of Civil and Environmental Engineering, University of Maine, Orono, ME 04469, USAThe application of deep learning (DL) algorithms has become of great interest in recent years due to their superior performance in structural damage identification, including the detection of corrosion. There has been growing interest in the application of convolutional neural networks (CNNs) for corrosion detection and classification. However, current approaches primarily involve detecting corrosion within bounding boxes, lacking the segmentation of corrosion with irregular boundary shapes. As a result, it becomes challenging to quantify corrosion areas and severity, which is crucial for engineers to rate the condition of structural elements and assess the performance of infrastructures. Furthermore, training an efficient deep learning model requires a large number of corrosion images and the manual labeling of every single image. This process can be tedious and labor-intensive. In this project, an open-source steel bridge corrosion dataset along with corresponding annotations was generated. This database contains 514 images with various corrosion severity levels, gathered from a variety of steel bridges. A pixel-level annotation was performed according to the Bridge Inspectors Reference Manual (BIRM) and the American Association of State Highway and Transportation Officials (AASHTO) regulations for corrosion condition rating (defect #1000). Two state-of-the-art semantic segmentation algorithms, Mask RCNN and YOLOv8, were trained and validated on the dataset. These trained models were then tested on a set of test images and the results were compared. The trained Mask RCNN and YOLOv8 models demonstrated satisfactory performance in segmenting and rating corrosion, making them suitable for practical applications.https://www.mdpi.com/2412-3811/9/1/3deep learninginstance segmentationcorrosion condition ratingbridge inspectionYOLOv8Mask RCNN |
| spellingShingle | Zahra Ameli Shabnam Jafarpoor Nesheli Eric N. Landis Deep Learning-Based Steel Bridge Corrosion Segmentation and Condition Rating Using Mask RCNN and YOLOv8 Infrastructures deep learning instance segmentation corrosion condition rating bridge inspection YOLOv8 Mask RCNN |
| title | Deep Learning-Based Steel Bridge Corrosion Segmentation and Condition Rating Using Mask RCNN and YOLOv8 |
| title_full | Deep Learning-Based Steel Bridge Corrosion Segmentation and Condition Rating Using Mask RCNN and YOLOv8 |
| title_fullStr | Deep Learning-Based Steel Bridge Corrosion Segmentation and Condition Rating Using Mask RCNN and YOLOv8 |
| title_full_unstemmed | Deep Learning-Based Steel Bridge Corrosion Segmentation and Condition Rating Using Mask RCNN and YOLOv8 |
| title_short | Deep Learning-Based Steel Bridge Corrosion Segmentation and Condition Rating Using Mask RCNN and YOLOv8 |
| title_sort | deep learning based steel bridge corrosion segmentation and condition rating using mask rcnn and yolov8 |
| topic | deep learning instance segmentation corrosion condition rating bridge inspection YOLOv8 Mask RCNN |
| url | https://www.mdpi.com/2412-3811/9/1/3 |
| work_keys_str_mv | AT zahraameli deeplearningbasedsteelbridgecorrosionsegmentationandconditionratingusingmaskrcnnandyolov8 AT shabnamjafarpoornesheli deeplearningbasedsteelbridgecorrosionsegmentationandconditionratingusingmaskrcnnandyolov8 AT ericnlandis deeplearningbasedsteelbridgecorrosionsegmentationandconditionratingusingmaskrcnnandyolov8 |