Product Assembly Assistance System Based on Pick-To-Light and Computer Vision Technology
Product assembly is often one of the last steps in the production process. Product assembly is often carried out by workers (assemblers) rather than robots, as it is generally challenging to adapt automation to any product. When assembling complex products, it can take a long time before the assembl...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-12-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/22/24/9769 |
| _version_ | 1797455303596310528 |
|---|---|
| author | Darko Hercog Primož Bencak Uroš Vincetič Tone Lerher |
| author_facet | Darko Hercog Primož Bencak Uroš Vincetič Tone Lerher |
| author_sort | Darko Hercog |
| collection | DOAJ |
| description | Product assembly is often one of the last steps in the production process. Product assembly is often carried out by workers (assemblers) rather than robots, as it is generally challenging to adapt automation to any product. When assembling complex products, it can take a long time before the assembler masters all the steps and can assemble the product independently. Training time has no added value; therefore, it should be reduced as much as possible. This paper presents a custom-developed system that enables the guided assembly of complex and diverse products using modern technologies. The system is based on pick-to-light (PTL) modules, used primarily in logistics as an additional aid in the order picking process, and Computer Vision technology. The designed system includes a personal computer (PC), several custom-developed PTL modules and a USB camera. The PC with a touchscreen visualizes the assembly process and allows the assembler to interact with the system. The developed PC application guides the operator through the assembly process by showing all the necessary assembly steps and parts. Two-step verification is used to ensure that the correct part is picked out of the bin, first by checking that the correct pushbutton on the PTL module has been pressed and second by using a camera with a Computer Vision algorithm. The paper is supported by a use case demonstrating that the proposed system reduces the assembly time of the used product. The presented solution is scalable and flexible as it can be easily adapted to show the assembly steps of another product. |
| first_indexed | 2024-03-09T15:52:30Z |
| format | Article |
| id | doaj.art-56623d5e94c24562bfac4c249fdfbf6b |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-09T15:52:30Z |
| publishDate | 2022-12-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-56623d5e94c24562bfac4c249fdfbf6b2023-11-24T17:55:01ZengMDPI AGSensors1424-82202022-12-012224976910.3390/s22249769Product Assembly Assistance System Based on Pick-To-Light and Computer Vision TechnologyDarko Hercog0Primož Bencak1Uroš Vincetič2Tone Lerher3Faculty of Electrical Engineering and Computer Science, University of Maribor, Koroška Cesta 46, SI-2000 Maribor, SloveniaFaculty of Logistics, University of Maribor, Mariborska Cesta 7, SI-3000 Celje, SloveniaFaculty of Mechanical Engineering, University of Maribor, Smetanova ulica 17, SI-2000 Maribor, SloveniaFaculty of Mechanical Engineering, University of Maribor, Smetanova ulica 17, SI-2000 Maribor, SloveniaProduct assembly is often one of the last steps in the production process. Product assembly is often carried out by workers (assemblers) rather than robots, as it is generally challenging to adapt automation to any product. When assembling complex products, it can take a long time before the assembler masters all the steps and can assemble the product independently. Training time has no added value; therefore, it should be reduced as much as possible. This paper presents a custom-developed system that enables the guided assembly of complex and diverse products using modern technologies. The system is based on pick-to-light (PTL) modules, used primarily in logistics as an additional aid in the order picking process, and Computer Vision technology. The designed system includes a personal computer (PC), several custom-developed PTL modules and a USB camera. The PC with a touchscreen visualizes the assembly process and allows the assembler to interact with the system. The developed PC application guides the operator through the assembly process by showing all the necessary assembly steps and parts. Two-step verification is used to ensure that the correct part is picked out of the bin, first by checking that the correct pushbutton on the PTL module has been pressed and second by using a camera with a Computer Vision algorithm. The paper is supported by a use case demonstrating that the proposed system reduces the assembly time of the used product. The presented solution is scalable and flexible as it can be easily adapted to show the assembly steps of another product.https://www.mdpi.com/1424-8220/22/24/9769product assemblypick-to-light (PTL)computer visionLabVIEWperformance analysis |
| spellingShingle | Darko Hercog Primož Bencak Uroš Vincetič Tone Lerher Product Assembly Assistance System Based on Pick-To-Light and Computer Vision Technology Sensors product assembly pick-to-light (PTL) computer vision LabVIEW performance analysis |
| title | Product Assembly Assistance System Based on Pick-To-Light and Computer Vision Technology |
| title_full | Product Assembly Assistance System Based on Pick-To-Light and Computer Vision Technology |
| title_fullStr | Product Assembly Assistance System Based on Pick-To-Light and Computer Vision Technology |
| title_full_unstemmed | Product Assembly Assistance System Based on Pick-To-Light and Computer Vision Technology |
| title_short | Product Assembly Assistance System Based on Pick-To-Light and Computer Vision Technology |
| title_sort | product assembly assistance system based on pick to light and computer vision technology |
| topic | product assembly pick-to-light (PTL) computer vision LabVIEW performance analysis |
| url | https://www.mdpi.com/1424-8220/22/24/9769 |
| work_keys_str_mv | AT darkohercog productassemblyassistancesystembasedonpicktolightandcomputervisiontechnology AT primozbencak productassemblyassistancesystembasedonpicktolightandcomputervisiontechnology AT urosvincetic productassemblyassistancesystembasedonpicktolightandcomputervisiontechnology AT tonelerher productassemblyassistancesystembasedonpicktolightandcomputervisiontechnology |