CNN-Based Image Quality Classification Considering Quality Degradation in Bridge Inspection Using an Unmanned Aerial Vehicle

Key information for the maintenance and diagnosis of structures including bridges can be obtained from the processing of digital images acquired by unmanned aerial vehicle (UAV). However, low-quality images caused by various problems such as UAV movement, inspection environment, and camera parameter...

Full description

Bibliographic Details
Main Authors: Gi-Hun Gwon, Jin Hwan Lee, In-Ho Kim, Hyung-Jo Jung
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10021574/
_version_ 1811155652489248768
author Gi-Hun Gwon
Jin Hwan Lee
In-Ho Kim
Hyung-Jo Jung
author_facet Gi-Hun Gwon
Jin Hwan Lee
In-Ho Kim
Hyung-Jo Jung
author_sort Gi-Hun Gwon
collection DOAJ
description Key information for the maintenance and diagnosis of structures including bridges can be obtained from the processing of digital images acquired by unmanned aerial vehicle (UAV). However, low-quality images caused by various problems such as UAV movement, inspection environment, and camera parameters can lead to inappropriate structural evaluation due to the difficulty of digital image processing. Therefore, an appropriate assessment method for image quality considering the deterioration of the inspection image in the structural inspection procedure is required. In this study, a new image quality assessment (IQA) using a convolutional neural network (CNN) is proposed in consideration of various degradation factors that may occur in the structure inspection image. The first stage presents a method to obtain consistent quality against various interference factors of deterioration that may occur in inspection images. Adjusting the camera parameters minimizes the degradation of the inspection image. Subsequently, low- and high-quality images are distinguished according to the proposed image acquisition method. The second stage is the classification of the inspection dataset using the CNN-based image quality classifier model through training of data classified according to their quality. Experimental validation of the proposed method shows that the results are similar to the Human Visual System (HVS), which means subjective quality classification, and that the inspection image can be classified with more accurate and shorter processing time.
first_indexed 2024-04-10T04:37:02Z
format Article
id doaj.art-fd0891669f954f9d860d4cc573d54990
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-04-10T04:37:02Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-fd0891669f954f9d860d4cc573d549902023-03-10T00:00:15ZengIEEEIEEE Access2169-35362023-01-0111220962211310.1109/ACCESS.2023.323820410021574CNN-Based Image Quality Classification Considering Quality Degradation in Bridge Inspection Using an Unmanned Aerial VehicleGi-Hun Gwon0https://orcid.org/0000-0002-6213-5774Jin Hwan Lee1In-Ho Kim2https://orcid.org/0000-0001-5665-9902Hyung-Jo Jung3https://orcid.org/0000-0002-3776-2960Department of Civil and Environmental Engineering, Korea Advanced Institute of Science and Technology, Yuseong-gu, Daejeon, Republic of KoreaDepartment of Civil and Environmental Engineering, Korea Advanced Institute of Science and Technology, Yuseong-gu, Daejeon, Republic of KoreaDepartment of Civil Engineering, Kunsan National University, Gunsan-si, Jeollabuk-do, Republic of KoreaDepartment of Civil and Environmental Engineering, Korea Advanced Institute of Science and Technology, Yuseong-gu, Daejeon, Republic of KoreaKey information for the maintenance and diagnosis of structures including bridges can be obtained from the processing of digital images acquired by unmanned aerial vehicle (UAV). However, low-quality images caused by various problems such as UAV movement, inspection environment, and camera parameters can lead to inappropriate structural evaluation due to the difficulty of digital image processing. Therefore, an appropriate assessment method for image quality considering the deterioration of the inspection image in the structural inspection procedure is required. In this study, a new image quality assessment (IQA) using a convolutional neural network (CNN) is proposed in consideration of various degradation factors that may occur in the structure inspection image. The first stage presents a method to obtain consistent quality against various interference factors of deterioration that may occur in inspection images. Adjusting the camera parameters minimizes the degradation of the inspection image. Subsequently, low- and high-quality images are distinguished according to the proposed image acquisition method. The second stage is the classification of the inspection dataset using the CNN-based image quality classifier model through training of data classified according to their quality. Experimental validation of the proposed method shows that the results are similar to the Human Visual System (HVS), which means subjective quality classification, and that the inspection image can be classified with more accurate and shorter processing time.https://ieeexplore.ieee.org/document/10021574/Convolutional neural networksimage quality classificationbridge inspectionunmanned aerial vehiclemotion blurunderexposure
spellingShingle Gi-Hun Gwon
Jin Hwan Lee
In-Ho Kim
Hyung-Jo Jung
CNN-Based Image Quality Classification Considering Quality Degradation in Bridge Inspection Using an Unmanned Aerial Vehicle
IEEE Access
Convolutional neural networks
image quality classification
bridge inspection
unmanned aerial vehicle
motion blur
underexposure
title CNN-Based Image Quality Classification Considering Quality Degradation in Bridge Inspection Using an Unmanned Aerial Vehicle
title_full CNN-Based Image Quality Classification Considering Quality Degradation in Bridge Inspection Using an Unmanned Aerial Vehicle
title_fullStr CNN-Based Image Quality Classification Considering Quality Degradation in Bridge Inspection Using an Unmanned Aerial Vehicle
title_full_unstemmed CNN-Based Image Quality Classification Considering Quality Degradation in Bridge Inspection Using an Unmanned Aerial Vehicle
title_short CNN-Based Image Quality Classification Considering Quality Degradation in Bridge Inspection Using an Unmanned Aerial Vehicle
title_sort cnn based image quality classification considering quality degradation in bridge inspection using an unmanned aerial vehicle
topic Convolutional neural networks
image quality classification
bridge inspection
unmanned aerial vehicle
motion blur
underexposure
url https://ieeexplore.ieee.org/document/10021574/
work_keys_str_mv AT gihungwon cnnbasedimagequalityclassificationconsideringqualitydegradationinbridgeinspectionusinganunmannedaerialvehicle
AT jinhwanlee cnnbasedimagequalityclassificationconsideringqualitydegradationinbridgeinspectionusinganunmannedaerialvehicle
AT inhokim cnnbasedimagequalityclassificationconsideringqualitydegradationinbridgeinspectionusinganunmannedaerialvehicle
AT hyungjojung cnnbasedimagequalityclassificationconsideringqualitydegradationinbridgeinspectionusinganunmannedaerialvehicle