Defect detection method for key area guided transmission line components based on knowledge distillation
Introduction: The aim of this paper is to address the problem of the limited number of defect images for both metal tools and insulators, as well as the small range of defect features.Methods: A defect detection method for key area-guided transmission line components based on knowledge distillation...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2023-11-01
|
| Series: | Frontiers in Energy Research |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fenrg.2023.1287024/full |
| _version_ | 1797639905465073664 |
|---|---|
| author | Zhenbing Zhao Zhenbing Zhao Zhenbing Zhao Xuechun Lv Xuechun Lv Yue Xi Siyu Miao |
| author_facet | Zhenbing Zhao Zhenbing Zhao Zhenbing Zhao Xuechun Lv Xuechun Lv Yue Xi Siyu Miao |
| author_sort | Zhenbing Zhao |
| collection | DOAJ |
| description | Introduction: The aim of this paper is to address the problem of the limited number of defect images for both metal tools and insulators, as well as the small range of defect features.Methods: A defect detection method for key area-guided transmission line components based on knowledge distillation is proposed. First, the PGW (Prediction-Guided Weighting) module is introduced to improve the foreground target distillation region, and the distillation range is precisely concentrated in the position of the first k feature pixels with the highest quality score in the form of a mask. The feature knowledge of defects of hardware and insulators is used as the focus for the teacher network to guide the student network. Then, the GcBlock module is used to capture the relationship between the target defects of the hardware and the transmission lines in the background, and the overall relationship information of the image is used to promote the students’ network to learn the teacher’s network perception ability of the relationship information. Finally, the classification task mask and regression task mask generated by the PGW module, combined with the overall image relationship loss, form a distillation loss function for network training to improve the accuracy of students’ network detection accuracy.Results and Discussion: The effectiveness of the proposed method is verified by using self-build metal fittings and insulator defect data sets. The experimental results show that the student network mAP_50 (Mean Average Precision at 50) in the Faster R-CNN model with the knowledge distillation algorithm added in this paper increases by 8.44%, and the RetinaNet model increases by 2.6%. The Cascade R-CNN model improved by 5.28%. |
| first_indexed | 2024-03-11T13:24:13Z |
| format | Article |
| id | doaj.art-1e8f2a2d580a40589f5337751472aa9e |
| institution | Directory Open Access Journal |
| issn | 2296-598X |
| language | English |
| last_indexed | 2024-03-11T13:24:13Z |
| publishDate | 2023-11-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Energy Research |
| spelling | doaj.art-1e8f2a2d580a40589f5337751472aa9e2023-11-03T08:41:50ZengFrontiers Media S.A.Frontiers in Energy Research2296-598X2023-11-011110.3389/fenrg.2023.12870241287024Defect detection method for key area guided transmission line components based on knowledge distillationZhenbing Zhao0Zhenbing Zhao1Zhenbing Zhao2Xuechun Lv3Xuechun Lv4Yue Xi5Siyu Miao6School of Electrical and Electronic Engineering, North China Electric Power University, Baoding, ChinaEngineering Research Center of Intelligent Computing for Complex Energy Systems, Ministry of Education, North China Electric Power University, Baoding, ChinaHebei Key Laboratory of Power Internet of Things Technology, North China Electric Power University, Baoding, ChinaSchool of Electrical and Electronic Engineering, North China Electric Power University, Baoding, ChinaInstitute of Electrical Automation, China Nuclear Power Engineering Co., Ltd., Hebei Branch, Shijiazhuang, ChinaSchool of Electrical and Electronic Engineering, North China Electric Power University, Baoding, ChinaSchool of Electrical and Electronic Engineering, North China Electric Power University, Baoding, ChinaIntroduction: The aim of this paper is to address the problem of the limited number of defect images for both metal tools and insulators, as well as the small range of defect features.Methods: A defect detection method for key area-guided transmission line components based on knowledge distillation is proposed. First, the PGW (Prediction-Guided Weighting) module is introduced to improve the foreground target distillation region, and the distillation range is precisely concentrated in the position of the first k feature pixels with the highest quality score in the form of a mask. The feature knowledge of defects of hardware and insulators is used as the focus for the teacher network to guide the student network. Then, the GcBlock module is used to capture the relationship between the target defects of the hardware and the transmission lines in the background, and the overall relationship information of the image is used to promote the students’ network to learn the teacher’s network perception ability of the relationship information. Finally, the classification task mask and regression task mask generated by the PGW module, combined with the overall image relationship loss, form a distillation loss function for network training to improve the accuracy of students’ network detection accuracy.Results and Discussion: The effectiveness of the proposed method is verified by using self-build metal fittings and insulator defect data sets. The experimental results show that the student network mAP_50 (Mean Average Precision at 50) in the Faster R-CNN model with the knowledge distillation algorithm added in this paper increases by 8.44%, and the RetinaNet model increases by 2.6%. The Cascade R-CNN model improved by 5.28%.https://www.frontiersin.org/articles/10.3389/fenrg.2023.1287024/fullknowledge distillationkey region guidancecomponent defectsteacher modelstudent model |
| spellingShingle | Zhenbing Zhao Zhenbing Zhao Zhenbing Zhao Xuechun Lv Xuechun Lv Yue Xi Siyu Miao Defect detection method for key area guided transmission line components based on knowledge distillation Frontiers in Energy Research knowledge distillation key region guidance component defects teacher model student model |
| title | Defect detection method for key area guided transmission line components based on knowledge distillation |
| title_full | Defect detection method for key area guided transmission line components based on knowledge distillation |
| title_fullStr | Defect detection method for key area guided transmission line components based on knowledge distillation |
| title_full_unstemmed | Defect detection method for key area guided transmission line components based on knowledge distillation |
| title_short | Defect detection method for key area guided transmission line components based on knowledge distillation |
| title_sort | defect detection method for key area guided transmission line components based on knowledge distillation |
| topic | knowledge distillation key region guidance component defects teacher model student model |
| url | https://www.frontiersin.org/articles/10.3389/fenrg.2023.1287024/full |
| work_keys_str_mv | AT zhenbingzhao defectdetectionmethodforkeyareaguidedtransmissionlinecomponentsbasedonknowledgedistillation AT zhenbingzhao defectdetectionmethodforkeyareaguidedtransmissionlinecomponentsbasedonknowledgedistillation AT zhenbingzhao defectdetectionmethodforkeyareaguidedtransmissionlinecomponentsbasedonknowledgedistillation AT xuechunlv defectdetectionmethodforkeyareaguidedtransmissionlinecomponentsbasedonknowledgedistillation AT xuechunlv defectdetectionmethodforkeyareaguidedtransmissionlinecomponentsbasedonknowledgedistillation AT yuexi defectdetectionmethodforkeyareaguidedtransmissionlinecomponentsbasedonknowledgedistillation AT siyumiao defectdetectionmethodforkeyareaguidedtransmissionlinecomponentsbasedonknowledgedistillation |