Augmented Reality Maintenance Assistant Using YOLOv5
Maintenance professionals and other technical staff regularly need to learn to identify new parts in car engines and other equipment. The present work proposes a model of a task assistant based on a deep learning neural network. A YOLOv5 network is used for recognizing some of the constituent parts...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-05-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/11/11/4758 |
| _version_ | 1797533044170555392 |
|---|---|
| author | Ana Malta Mateus Mendes Torres Farinha |
| author_facet | Ana Malta Mateus Mendes Torres Farinha |
| author_sort | Ana Malta |
| collection | DOAJ |
| description | Maintenance professionals and other technical staff regularly need to learn to identify new parts in car engines and other equipment. The present work proposes a model of a task assistant based on a deep learning neural network. A YOLOv5 network is used for recognizing some of the constituent parts of an automobile. A dataset of car engine images was created and eight car parts were marked in the images. Then, the neural network was trained to detect each part. The results show that YOLOv5s is able to successfully detect the parts in real time video streams, with high accuracy, thus being useful as an aid to train professionals learning to deal with new equipment using augmented reality. The architecture of an object recognition system using augmented reality glasses is also designed. |
| first_indexed | 2024-03-10T11:09:02Z |
| format | Article |
| id | doaj.art-1c16ecffb64d4afaa35b4d66e384f748 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-10T11:09:02Z |
| publishDate | 2021-05-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-1c16ecffb64d4afaa35b4d66e384f7482023-11-21T20:53:48ZengMDPI AGApplied Sciences2076-34172021-05-011111475810.3390/app11114758Augmented Reality Maintenance Assistant Using YOLOv5Ana Malta0Mateus Mendes1Torres Farinha2Polytechnic of Coimbra, ISEC, 3045-093 Coimbra, PortugalPolytechnic of Coimbra, ISEC, 3045-093 Coimbra, PortugalPolytechnic of Coimbra, ISEC, 3045-093 Coimbra, PortugalMaintenance professionals and other technical staff regularly need to learn to identify new parts in car engines and other equipment. The present work proposes a model of a task assistant based on a deep learning neural network. A YOLOv5 network is used for recognizing some of the constituent parts of an automobile. A dataset of car engine images was created and eight car parts were marked in the images. Then, the neural network was trained to detect each part. The results show that YOLOv5s is able to successfully detect the parts in real time video streams, with high accuracy, thus being useful as an aid to train professionals learning to deal with new equipment using augmented reality. The architecture of an object recognition system using augmented reality glasses is also designed.https://www.mdpi.com/2076-3417/11/11/4758task assistantYOLOv5car engine datasetcar part detectionaugmented reality |
| spellingShingle | Ana Malta Mateus Mendes Torres Farinha Augmented Reality Maintenance Assistant Using YOLOv5 Applied Sciences task assistant YOLOv5 car engine dataset car part detection augmented reality |
| title | Augmented Reality Maintenance Assistant Using YOLOv5 |
| title_full | Augmented Reality Maintenance Assistant Using YOLOv5 |
| title_fullStr | Augmented Reality Maintenance Assistant Using YOLOv5 |
| title_full_unstemmed | Augmented Reality Maintenance Assistant Using YOLOv5 |
| title_short | Augmented Reality Maintenance Assistant Using YOLOv5 |
| title_sort | augmented reality maintenance assistant using yolov5 |
| topic | task assistant YOLOv5 car engine dataset car part detection augmented reality |
| url | https://www.mdpi.com/2076-3417/11/11/4758 |
| work_keys_str_mv | AT anamalta augmentedrealitymaintenanceassistantusingyolov5 AT mateusmendes augmentedrealitymaintenanceassistantusingyolov5 AT torresfarinha augmentedrealitymaintenanceassistantusingyolov5 |