Recognition of the Shape and Location of Multiple Power Lines Based on Deep Learning With Post-Processing

Power line collisions pose a significant threat to the safety of drones. This is because it is difficult for drone pilots to recognize power lines at long distances, even on sunny days, and power lines are less visible in rainy or foggy weather. Therefore, power line detection is necessary for safe...

Full description

Bibliographic Details
Main Authors: Hyun-Sik Son, Deok-Keun Kim, Seung-Hwan Yang, Young-Kiu Choi
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10145454/
_version_ 1797803124230979584
author Hyun-Sik Son
Deok-Keun Kim
Seung-Hwan Yang
Young-Kiu Choi
author_facet Hyun-Sik Son
Deok-Keun Kim
Seung-Hwan Yang
Young-Kiu Choi
author_sort Hyun-Sik Son
collection DOAJ
description Power line collisions pose a significant threat to the safety of drones. This is because it is difficult for drone pilots to recognize power lines at long distances, even on sunny days, and power lines are less visible in rainy or foggy weather. Therefore, power line detection is necessary for safe drone flight. This article proposes an algorithm that can recognize various shapes and locations of multiple power lines while improving the recognition performance of power lines compared to previous studies. YOLO, a deep learning technology used for object detection, is used to recognize power lines as multiple bounding boxes, and center points of these bounding boxes are sorted and integrated. This algorithm improves the power line detection performance by excluding incorrectly detected power lines and restoring undetected parts of the power lines. The performance of the proposed method was evaluated using the intersection-over-union (IoU) and F1-score, which were 0.674 and 0.528, respectively. This performance was superior to those of U-Net, LaneNet and BiSeNet V2 which are deep learning technologies for segmentation. The proposed method was mounted on the embedded system of the test drone, and tests were conducted indoor and outdoor. Then, the average frames per second (FPS) value was calculated as 10.05. Various shapes and locations of multiple power lines can be recognized in real-time using the power line recognition method proposed in this paper.
first_indexed 2024-03-13T05:16:07Z
format Article
id doaj.art-60e9a09f35ea443c897921fdf3fa11d3
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-03-13T05:16:07Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-60e9a09f35ea443c897921fdf3fa11d32023-06-15T23:00:54ZengIEEEIEEE Access2169-35362023-01-0111578955790410.1109/ACCESS.2023.328361310145454Recognition of the Shape and Location of Multiple Power Lines Based on Deep Learning With Post-ProcessingHyun-Sik Son0https://orcid.org/0000-0003-0409-7391Deok-Keun Kim1https://orcid.org/0000-0002-8354-311XSeung-Hwan Yang2https://orcid.org/0000-0002-1067-7280Young-Kiu Choi3https://orcid.org/0000-0003-3726-6497Department of Electrical and Computer Engineering, Pusan National University, Geumjeong-gu, Busan, Republic of KoreaInterdisciplinary Program in Agricultural and Life Science, Chonnam National University, Buk-gu, Gwangju, Republic of KoreaSmart Agricultural Machinery Research and Development Group, Korea Institute of Industrial Technology, Gimje-si, Jeollabuk-do, Republic of KoreaDepartment of Electrical and Computer Engineering, Pusan National University, Geumjeong-gu, Busan, Republic of KoreaPower line collisions pose a significant threat to the safety of drones. This is because it is difficult for drone pilots to recognize power lines at long distances, even on sunny days, and power lines are less visible in rainy or foggy weather. Therefore, power line detection is necessary for safe drone flight. This article proposes an algorithm that can recognize various shapes and locations of multiple power lines while improving the recognition performance of power lines compared to previous studies. YOLO, a deep learning technology used for object detection, is used to recognize power lines as multiple bounding boxes, and center points of these bounding boxes are sorted and integrated. This algorithm improves the power line detection performance by excluding incorrectly detected power lines and restoring undetected parts of the power lines. The performance of the proposed method was evaluated using the intersection-over-union (IoU) and F1-score, which were 0.674 and 0.528, respectively. This performance was superior to those of U-Net, LaneNet and BiSeNet V2 which are deep learning technologies for segmentation. The proposed method was mounted on the embedded system of the test drone, and tests were conducted indoor and outdoor. Then, the average frames per second (FPS) value was calculated as 10.05. Various shapes and locations of multiple power lines can be recognized in real-time using the power line recognition method proposed in this paper.https://ieeexplore.ieee.org/document/10145454/Power line detectioncontinuous objectsegmentationagricultural spraying droneunmanned aerial vehicle (UAV)
spellingShingle Hyun-Sik Son
Deok-Keun Kim
Seung-Hwan Yang
Young-Kiu Choi
Recognition of the Shape and Location of Multiple Power Lines Based on Deep Learning With Post-Processing
IEEE Access
Power line detection
continuous object
segmentation
agricultural spraying drone
unmanned aerial vehicle (UAV)
title Recognition of the Shape and Location of Multiple Power Lines Based on Deep Learning With Post-Processing
title_full Recognition of the Shape and Location of Multiple Power Lines Based on Deep Learning With Post-Processing
title_fullStr Recognition of the Shape and Location of Multiple Power Lines Based on Deep Learning With Post-Processing
title_full_unstemmed Recognition of the Shape and Location of Multiple Power Lines Based on Deep Learning With Post-Processing
title_short Recognition of the Shape and Location of Multiple Power Lines Based on Deep Learning With Post-Processing
title_sort recognition of the shape and location of multiple power lines based on deep learning with post processing
topic Power line detection
continuous object
segmentation
agricultural spraying drone
unmanned aerial vehicle (UAV)
url https://ieeexplore.ieee.org/document/10145454/
work_keys_str_mv AT hyunsikson recognitionoftheshapeandlocationofmultiplepowerlinesbasedondeeplearningwithpostprocessing
AT deokkeunkim recognitionoftheshapeandlocationofmultiplepowerlinesbasedondeeplearningwithpostprocessing
AT seunghwanyang recognitionoftheshapeandlocationofmultiplepowerlinesbasedondeeplearningwithpostprocessing
AT youngkiuchoi recognitionoftheshapeandlocationofmultiplepowerlinesbasedondeeplearningwithpostprocessing