Using object-oriented coupled deep learning approach for typical object inspection of transmission channel
Traditional methods to inspect transmission line passage are mostly through UAV/helicopters and manual inspection, which are limited in no man's area and large-scale inspection. Satellite remote sensing technology breaks through such limitations and makes it more possible to inspect transmissio...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2023-02-01
|
| Series: | International Journal of Applied Earth Observations and Geoinformation |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S1569843222003259 |
| _version_ | 1828061822449614848 |
|---|---|
| author | Shengtao Wei Meng Luo Liangfeng Zhu Zhi Yang |
| author_facet | Shengtao Wei Meng Luo Liangfeng Zhu Zhi Yang |
| author_sort | Shengtao Wei |
| collection | DOAJ |
| description | Traditional methods to inspect transmission line passage are mostly through UAV/helicopters and manual inspection, which are limited in no man's area and large-scale inspection. Satellite remote sensing technology breaks through such limitations and makes it more possible to inspect transmission line passage on a large scale in the power industry. Therefore, adopting the WorldView-3 satellite image with high resolution as the data source, we propose a typical ground object inspection method based on the object-oriented method coupled with the deep learning method. Firstly, in view of the traditional object-oriented multicategory extraction phenomenon, we use multiscale segmentation technology to construct the typical feature classification rule set and optimize the segmentation threshold. Through prior knowledge and experiments, we explore the best inspection sequence of multicategory typical features. Secondly, we use a fully convolutional neural network to perform end-to-end inspections of typical features. Finally, we propose the combination of the two methods to make it act on an image by comparing the inspection results of each typical ground object category and analyzing the advantages and disadvantages of the above two methods. Based on the principle of optimal inspection sequence, the user flexibly selects target extraction methods and finally the typical ground object inspection results are output end-to-end. The research shows that the coupled method has the highest inspection accuracy. The overall inspection accuracy reaches 93.01%, which is 10.32% and 8.07% higher than that of the object-oriented method and the deep learning method. The Macro-F1 score is 0.8363, which is 0.124 and 0.1532 higher than that of the object-oriented method and the deep learning method. We also choose Lingwu City for a verification experiment. The result shows that the overall inspection accuracy for the new experimental area is 91.25%, and the Macro-F1 score is 0.8948, indicating that the algorithm has versatility. |
| first_indexed | 2024-04-10T22:20:55Z |
| format | Article |
| id | doaj.art-69f14ff97c8f4ffebcdd089264c35ff4 |
| institution | Directory Open Access Journal |
| issn | 1569-8432 |
| language | English |
| last_indexed | 2024-04-10T22:20:55Z |
| publishDate | 2023-02-01 |
| publisher | Elsevier |
| record_format | Article |
| series | International Journal of Applied Earth Observations and Geoinformation |
| spelling | doaj.art-69f14ff97c8f4ffebcdd089264c35ff42023-01-18T04:30:01ZengElsevierInternational Journal of Applied Earth Observations and Geoinformation1569-84322023-02-01116103137Using object-oriented coupled deep learning approach for typical object inspection of transmission channelShengtao Wei0Meng Luo1Liangfeng Zhu2Zhi Yang3Key Laboratory of Geographic Information Science (Ministry of Education), School of Geographic Sciences, East China Normal University, Shanghai 200241, ChinaShanghai Vsat Technology Co., Ltd, Shanghai 200080, ChinaKey Laboratory of Geographic Information Science (Ministry of Education), School of Geographic Sciences, East China Normal University, Shanghai 200241, China; Corresponding author.China Electric Power Research Institute Co., Ltd, Beijing 100000, ChinaTraditional methods to inspect transmission line passage are mostly through UAV/helicopters and manual inspection, which are limited in no man's area and large-scale inspection. Satellite remote sensing technology breaks through such limitations and makes it more possible to inspect transmission line passage on a large scale in the power industry. Therefore, adopting the WorldView-3 satellite image with high resolution as the data source, we propose a typical ground object inspection method based on the object-oriented method coupled with the deep learning method. Firstly, in view of the traditional object-oriented multicategory extraction phenomenon, we use multiscale segmentation technology to construct the typical feature classification rule set and optimize the segmentation threshold. Through prior knowledge and experiments, we explore the best inspection sequence of multicategory typical features. Secondly, we use a fully convolutional neural network to perform end-to-end inspections of typical features. Finally, we propose the combination of the two methods to make it act on an image by comparing the inspection results of each typical ground object category and analyzing the advantages and disadvantages of the above two methods. Based on the principle of optimal inspection sequence, the user flexibly selects target extraction methods and finally the typical ground object inspection results are output end-to-end. The research shows that the coupled method has the highest inspection accuracy. The overall inspection accuracy reaches 93.01%, which is 10.32% and 8.07% higher than that of the object-oriented method and the deep learning method. The Macro-F1 score is 0.8363, which is 0.124 and 0.1532 higher than that of the object-oriented method and the deep learning method. We also choose Lingwu City for a verification experiment. The result shows that the overall inspection accuracy for the new experimental area is 91.25%, and the Macro-F1 score is 0.8948, indicating that the algorithm has versatility.http://www.sciencedirect.com/science/article/pii/S1569843222003259WorldView-3Object-oriented coupled with deep learningTypical feature inspectionTransmission channel |
| spellingShingle | Shengtao Wei Meng Luo Liangfeng Zhu Zhi Yang Using object-oriented coupled deep learning approach for typical object inspection of transmission channel International Journal of Applied Earth Observations and Geoinformation WorldView-3 Object-oriented coupled with deep learning Typical feature inspection Transmission channel |
| title | Using object-oriented coupled deep learning approach for typical object inspection of transmission channel |
| title_full | Using object-oriented coupled deep learning approach for typical object inspection of transmission channel |
| title_fullStr | Using object-oriented coupled deep learning approach for typical object inspection of transmission channel |
| title_full_unstemmed | Using object-oriented coupled deep learning approach for typical object inspection of transmission channel |
| title_short | Using object-oriented coupled deep learning approach for typical object inspection of transmission channel |
| title_sort | using object oriented coupled deep learning approach for typical object inspection of transmission channel |
| topic | WorldView-3 Object-oriented coupled with deep learning Typical feature inspection Transmission channel |
| url | http://www.sciencedirect.com/science/article/pii/S1569843222003259 |
| work_keys_str_mv | AT shengtaowei usingobjectorientedcoupleddeeplearningapproachfortypicalobjectinspectionoftransmissionchannel AT mengluo usingobjectorientedcoupleddeeplearningapproachfortypicalobjectinspectionoftransmissionchannel AT liangfengzhu usingobjectorientedcoupleddeeplearningapproachfortypicalobjectinspectionoftransmissionchannel AT zhiyang usingobjectorientedcoupleddeeplearningapproachfortypicalobjectinspectionoftransmissionchannel |