Comparison of the Performance of Artificial Intelligence Models Depending on the Labelled Image by Different User Levels
As reconstruction and redevelopment accelerate, the generation of construction waste increases, and construction waste treatment technology is being developed accordingly, especially using artificial intelligence (AI). The majority of AI research projects fail as a consequence of poor learning data...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-03-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/12/6/3136 |
| _version_ | 1827650052896587776 |
|---|---|
| author | Hyobin Sunwoo Wonjun Choi Seunguk Na Cheekyeong Kim Seokjae Heo |
| author_facet | Hyobin Sunwoo Wonjun Choi Seunguk Na Cheekyeong Kim Seokjae Heo |
| author_sort | Hyobin Sunwoo |
| collection | DOAJ |
| description | As reconstruction and redevelopment accelerate, the generation of construction waste increases, and construction waste treatment technology is being developed accordingly, especially using artificial intelligence (AI). The majority of AI research projects fail as a consequence of poor learning data as opposed to the structure of the AI model. If data pre-processing and labeling, i.e., the processes prior to the training step, are not carried out with development purposes in mind, the desired AI model cannot be obtained. Therefore, in this study, the performance differences of the construction waste recognition model, after data pre-processing and labeling by individuals with different degrees of expertise, were analyzed with the goal of distinguishing construction waste accurately and increasing the recycling rate. According to the experimental results, it was shown that the mean average precision (mAP) of the AI model that trained on the dataset labeled by non-professionals was superior to that labeled by professionals, being 21.75 higher in the box and 26.47 in the mask, on average. This was because it was labeled using a similar method as the Microsoft Common Objects in Context (MS COCO) datasets used for You Only Look at Coefficients (YOLACT), despite them possessing different traits for construction waste. Construction waste is differentiated by texture and color; thus, we augmented the dataset by adding noise (texture) and changing the color to consider these traits. This resulted in a meaningful accuracy being achieved in 25 epochs—two fewer than the unreinforced dataset. In order to develop an AI model that recognizes construction waste, which is an atypical object, it is necessary to develop an explainable AI model, such as a reconstruction AI network, using the model’s feature map or by creating a dataset with weights added to the texture and color of the construction waste. |
| first_indexed | 2024-03-09T20:09:05Z |
| format | Article |
| id | doaj.art-d0a9b65ba5944a31ab505c0d848ce543 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-09T20:09:05Z |
| publishDate | 2022-03-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-d0a9b65ba5944a31ab505c0d848ce5432023-11-24T00:24:18ZengMDPI AGApplied Sciences2076-34172022-03-01126313610.3390/app12063136Comparison of the Performance of Artificial Intelligence Models Depending on the Labelled Image by Different User LevelsHyobin Sunwoo0Wonjun Choi1Seunguk Na2Cheekyeong Kim3Seokjae Heo4Department of Architectural Engineering, College of Engineering, Dankook University, 152 Jukjeon-ro, Yongin-si 16890, KoreaDepartment of Architectural Engineering, College of Engineering, Dankook University, 152 Jukjeon-ro, Yongin-si 16890, KoreaDepartment of Architectural Engineering, College of Engineering, Dankook University, 152 Jukjeon-ro, Yongin-si 16890, KoreaDepartment of Architectural Engineering, College of Engineering, Dankook University, 152 Jukjeon-ro, Yongin-si 16890, KoreaDepartment of Architectural Engineering, College of Engineering, Dankook University, 152 Jukjeon-ro, Yongin-si 16890, KoreaAs reconstruction and redevelopment accelerate, the generation of construction waste increases, and construction waste treatment technology is being developed accordingly, especially using artificial intelligence (AI). The majority of AI research projects fail as a consequence of poor learning data as opposed to the structure of the AI model. If data pre-processing and labeling, i.e., the processes prior to the training step, are not carried out with development purposes in mind, the desired AI model cannot be obtained. Therefore, in this study, the performance differences of the construction waste recognition model, after data pre-processing and labeling by individuals with different degrees of expertise, were analyzed with the goal of distinguishing construction waste accurately and increasing the recycling rate. According to the experimental results, it was shown that the mean average precision (mAP) of the AI model that trained on the dataset labeled by non-professionals was superior to that labeled by professionals, being 21.75 higher in the box and 26.47 in the mask, on average. This was because it was labeled using a similar method as the Microsoft Common Objects in Context (MS COCO) datasets used for You Only Look at Coefficients (YOLACT), despite them possessing different traits for construction waste. Construction waste is differentiated by texture and color; thus, we augmented the dataset by adding noise (texture) and changing the color to consider these traits. This resulted in a meaningful accuracy being achieved in 25 epochs—two fewer than the unreinforced dataset. In order to develop an AI model that recognizes construction waste, which is an atypical object, it is necessary to develop an explainable AI model, such as a reconstruction AI network, using the model’s feature map or by creating a dataset with weights added to the texture and color of the construction waste.https://www.mdpi.com/2076-3417/12/6/3136artificial intelligenceclassificationobject detectioninstance segmentationconstruction wasteYOLACT |
| spellingShingle | Hyobin Sunwoo Wonjun Choi Seunguk Na Cheekyeong Kim Seokjae Heo Comparison of the Performance of Artificial Intelligence Models Depending on the Labelled Image by Different User Levels Applied Sciences artificial intelligence classification object detection instance segmentation construction waste YOLACT |
| title | Comparison of the Performance of Artificial Intelligence Models Depending on the Labelled Image by Different User Levels |
| title_full | Comparison of the Performance of Artificial Intelligence Models Depending on the Labelled Image by Different User Levels |
| title_fullStr | Comparison of the Performance of Artificial Intelligence Models Depending on the Labelled Image by Different User Levels |
| title_full_unstemmed | Comparison of the Performance of Artificial Intelligence Models Depending on the Labelled Image by Different User Levels |
| title_short | Comparison of the Performance of Artificial Intelligence Models Depending on the Labelled Image by Different User Levels |
| title_sort | comparison of the performance of artificial intelligence models depending on the labelled image by different user levels |
| topic | artificial intelligence classification object detection instance segmentation construction waste YOLACT |
| url | https://www.mdpi.com/2076-3417/12/6/3136 |
| work_keys_str_mv | AT hyobinsunwoo comparisonoftheperformanceofartificialintelligencemodelsdependingonthelabelledimagebydifferentuserlevels AT wonjunchoi comparisonoftheperformanceofartificialintelligencemodelsdependingonthelabelledimagebydifferentuserlevels AT seungukna comparisonoftheperformanceofartificialintelligencemodelsdependingonthelabelledimagebydifferentuserlevels AT cheekyeongkim comparisonoftheperformanceofartificialintelligencemodelsdependingonthelabelledimagebydifferentuserlevels AT seokjaeheo comparisonoftheperformanceofartificialintelligencemodelsdependingonthelabelledimagebydifferentuserlevels |