Development of an Accurate and Automated Quality Inspection System for Solder Joints on Aviation Plugs Using Fine-Tuned YOLOv5 Models

The quality inspection of solder joints on aviation plugs is extremely important in modern manufacturing industries. However, this task is still mostly performed by skilled workers after welding operations, posing the problems of subjective judgment and low efficiency. To address these issues, an ac...

Full description

Bibliographic Details
Main Authors: Junwei Sha, Junpu Wang, Huanran Hu, Yongqiang Ye, Guili Xu
Format: Article
Language:English
Published: MDPI AG 2023-04-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/13/9/5290
_version_ 1827743255936106496
author Junwei Sha
Junpu Wang
Huanran Hu
Yongqiang Ye
Guili Xu
author_facet Junwei Sha
Junpu Wang
Huanran Hu
Yongqiang Ye
Guili Xu
author_sort Junwei Sha
collection DOAJ
description The quality inspection of solder joints on aviation plugs is extremely important in modern manufacturing industries. However, this task is still mostly performed by skilled workers after welding operations, posing the problems of subjective judgment and low efficiency. To address these issues, an accurate and automated detection system using fine-tuned YOLOv5 models is developed in this paper. Firstly, we design an intelligent image acquisition system to obtain the high-resolution image of each solder joint automatically. Then, a two-phase approach is proposed for fast and accurate weld quality detection. In the first phase, a fine-tuned YOLOv5 model is applied to extract the region of interest (ROI), i.e., the row of solder joints to be inspected, within the whole image. With the sliding platform, the ROI is automatically moved to the center of the image to enhance its imaging clarity. Subsequently, another fine-tuned YOLOv5 model takes this adjusted ROI as input and realizes quality assessment. Finally, a concise and easy-to-use GUI has been designed and deployed in real production lines. Experimental results in the actual production line show that the proposed method can achieve a detection accuracy of more than 97.5% with a detection speed of about 0.1 s, which meets the needs of actual production
first_indexed 2024-03-11T04:24:54Z
format Article
id doaj.art-289a7ae4582d42eea3ae1eca401f3802
institution Directory Open Access Journal
issn 2076-3417
language English
last_indexed 2024-03-11T04:24:54Z
publishDate 2023-04-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj.art-289a7ae4582d42eea3ae1eca401f38022023-11-17T22:31:58ZengMDPI AGApplied Sciences2076-34172023-04-01139529010.3390/app13095290Development of an Accurate and Automated Quality Inspection System for Solder Joints on Aviation Plugs Using Fine-Tuned YOLOv5 ModelsJunwei Sha0Junpu Wang1Huanran Hu2Yongqiang Ye3Guili Xu4College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, ChinaCollege of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, ChinaCollege of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, ChinaCollege of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, ChinaCollege of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, ChinaThe quality inspection of solder joints on aviation plugs is extremely important in modern manufacturing industries. However, this task is still mostly performed by skilled workers after welding operations, posing the problems of subjective judgment and low efficiency. To address these issues, an accurate and automated detection system using fine-tuned YOLOv5 models is developed in this paper. Firstly, we design an intelligent image acquisition system to obtain the high-resolution image of each solder joint automatically. Then, a two-phase approach is proposed for fast and accurate weld quality detection. In the first phase, a fine-tuned YOLOv5 model is applied to extract the region of interest (ROI), i.e., the row of solder joints to be inspected, within the whole image. With the sliding platform, the ROI is automatically moved to the center of the image to enhance its imaging clarity. Subsequently, another fine-tuned YOLOv5 model takes this adjusted ROI as input and realizes quality assessment. Finally, a concise and easy-to-use GUI has been designed and deployed in real production lines. Experimental results in the actual production line show that the proposed method can achieve a detection accuracy of more than 97.5% with a detection speed of about 0.1 s, which meets the needs of actual productionhttps://www.mdpi.com/2076-3417/13/9/5290quality inspection systemsolder jointsaviation plugsfine-tuned YOLOv5
spellingShingle Junwei Sha
Junpu Wang
Huanran Hu
Yongqiang Ye
Guili Xu
Development of an Accurate and Automated Quality Inspection System for Solder Joints on Aviation Plugs Using Fine-Tuned YOLOv5 Models
Applied Sciences
quality inspection system
solder joints
aviation plugs
fine-tuned YOLOv5
title Development of an Accurate and Automated Quality Inspection System for Solder Joints on Aviation Plugs Using Fine-Tuned YOLOv5 Models
title_full Development of an Accurate and Automated Quality Inspection System for Solder Joints on Aviation Plugs Using Fine-Tuned YOLOv5 Models
title_fullStr Development of an Accurate and Automated Quality Inspection System for Solder Joints on Aviation Plugs Using Fine-Tuned YOLOv5 Models
title_full_unstemmed Development of an Accurate and Automated Quality Inspection System for Solder Joints on Aviation Plugs Using Fine-Tuned YOLOv5 Models
title_short Development of an Accurate and Automated Quality Inspection System for Solder Joints on Aviation Plugs Using Fine-Tuned YOLOv5 Models
title_sort development of an accurate and automated quality inspection system for solder joints on aviation plugs using fine tuned yolov5 models
topic quality inspection system
solder joints
aviation plugs
fine-tuned YOLOv5
url https://www.mdpi.com/2076-3417/13/9/5290
work_keys_str_mv AT junweisha developmentofanaccurateandautomatedqualityinspectionsystemforsolderjointsonaviationplugsusingfinetunedyolov5models
AT junpuwang developmentofanaccurateandautomatedqualityinspectionsystemforsolderjointsonaviationplugsusingfinetunedyolov5models
AT huanranhu developmentofanaccurateandautomatedqualityinspectionsystemforsolderjointsonaviationplugsusingfinetunedyolov5models
AT yongqiangye developmentofanaccurateandautomatedqualityinspectionsystemforsolderjointsonaviationplugsusingfinetunedyolov5models
AT guilixu developmentofanaccurateandautomatedqualityinspectionsystemforsolderjointsonaviationplugsusingfinetunedyolov5models