Creating Collaborative Augmented Reality Experiences for Industry 4.0 Training and Assistance Applications: Performance Evaluation in the Shipyard of the Future
Industrial Augmented Reality (IAR) is one of the key technologies pointed out by the Industry 4.0 paradigm as a tool for improving industrial processes and for maximizing worker efficiency. Training and assistance are two of the most popular IAR-enabled applications, since they may significantly fac...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2020-12-01
|
Series: | Applied Sciences |
Subjects: | |
Online Access: | https://www.mdpi.com/2076-3417/10/24/9073 |
_version_ | 1797544231737229312 |
---|---|
author | Aida Vidal-Balea Oscar Blanco-Novoa Paula Fraga-Lamas Miguel Vilar-Montesinos Tiago M. Fernández-Caramés |
author_facet | Aida Vidal-Balea Oscar Blanco-Novoa Paula Fraga-Lamas Miguel Vilar-Montesinos Tiago M. Fernández-Caramés |
author_sort | Aida Vidal-Balea |
collection | DOAJ |
description | Industrial Augmented Reality (IAR) is one of the key technologies pointed out by the Industry 4.0 paradigm as a tool for improving industrial processes and for maximizing worker efficiency. Training and assistance are two of the most popular IAR-enabled applications, since they may significantly facilitate, support, and optimize production and assembly tasks in industrial environments. This article presents an IAR collaborative application developed jointly by Navantia, one of the biggest European shipbuilders, and the University of A Coruña (Spain). The analysis, design, and implementation of such an IAR application are described thoroughly so as to enable future developers to create similar IAR applications. The IAR application is based on the Microsoft HoloLens smart glasses and is able to assist and to guide shipyard operators during their training and in assembly tasks. The proposed IAR application embeds a novel collaborative protocol that allows operators to visualize and interact in a synchronized way with the same virtual content. Thus, all operators that share an IAR experience see each virtual object positioned at the same physical spot and in the same state. The collaborative application is first evaluated and optimized in terms of packet communications delay and anchor transmission latency, and then, its validation in a shipyard workshop by Navantia’s operators is presented. The performance results show fast response times for regular packets (less than 5 ms), low interference rates in the 5 GHz band, and an anchor transmission latency of up to 30 s. Regarding the validation tests, they allow for obtaining useful insights and feedback from the industrial operators, as well as clear guidelines that will help future developers to face the challenges that will arise when creating the next generation of IAR applications. |
first_indexed | 2024-03-10T13:57:29Z |
format | Article |
id | doaj.art-c9b53f51fb954404850138f1be1b5845 |
institution | Directory Open Access Journal |
issn | 2076-3417 |
language | English |
last_indexed | 2024-03-10T13:57:29Z |
publishDate | 2020-12-01 |
publisher | MDPI AG |
record_format | Article |
series | Applied Sciences |
spelling | doaj.art-c9b53f51fb954404850138f1be1b58452023-11-21T01:30:11ZengMDPI AGApplied Sciences2076-34172020-12-011024907310.3390/app10249073Creating Collaborative Augmented Reality Experiences for Industry 4.0 Training and Assistance Applications: Performance Evaluation in the Shipyard of the FutureAida Vidal-Balea0Oscar Blanco-Novoa1Paula Fraga-Lamas2Miguel Vilar-Montesinos3Tiago M. Fernández-Caramés4Department of Computer Engineering, Faculty of Computer Science, Universidade da Coruña, 15071 A Coruña, SpainDepartment of Computer Engineering, Faculty of Computer Science, Universidade da Coruña, 15071 A Coruña, SpainDepartment of Computer Engineering, Faculty of Computer Science, Universidade da Coruña, 15071 A Coruña, SpainNavantia S. A., Astillero de Ferrol, 15403 Ferrol, SpainDepartment of Computer Engineering, Faculty of Computer Science, Universidade da Coruña, 15071 A Coruña, SpainIndustrial Augmented Reality (IAR) is one of the key technologies pointed out by the Industry 4.0 paradigm as a tool for improving industrial processes and for maximizing worker efficiency. Training and assistance are two of the most popular IAR-enabled applications, since they may significantly facilitate, support, and optimize production and assembly tasks in industrial environments. This article presents an IAR collaborative application developed jointly by Navantia, one of the biggest European shipbuilders, and the University of A Coruña (Spain). The analysis, design, and implementation of such an IAR application are described thoroughly so as to enable future developers to create similar IAR applications. The IAR application is based on the Microsoft HoloLens smart glasses and is able to assist and to guide shipyard operators during their training and in assembly tasks. The proposed IAR application embeds a novel collaborative protocol that allows operators to visualize and interact in a synchronized way with the same virtual content. Thus, all operators that share an IAR experience see each virtual object positioned at the same physical spot and in the same state. The collaborative application is first evaluated and optimized in terms of packet communications delay and anchor transmission latency, and then, its validation in a shipyard workshop by Navantia’s operators is presented. The performance results show fast response times for regular packets (less than 5 ms), low interference rates in the 5 GHz band, and an anchor transmission latency of up to 30 s. Regarding the validation tests, they allow for obtaining useful insights and feedback from the industrial operators, as well as clear guidelines that will help future developers to face the challenges that will arise when creating the next generation of IAR applications.https://www.mdpi.com/2076-3417/10/24/9073Industry 4.0augmented realityindustrial augmented realityassistancetrainingcollaborative applications |
spellingShingle | Aida Vidal-Balea Oscar Blanco-Novoa Paula Fraga-Lamas Miguel Vilar-Montesinos Tiago M. Fernández-Caramés Creating Collaborative Augmented Reality Experiences for Industry 4.0 Training and Assistance Applications: Performance Evaluation in the Shipyard of the Future Applied Sciences Industry 4.0 augmented reality industrial augmented reality assistance training collaborative applications |
title | Creating Collaborative Augmented Reality Experiences for Industry 4.0 Training and Assistance Applications: Performance Evaluation in the Shipyard of the Future |
title_full | Creating Collaborative Augmented Reality Experiences for Industry 4.0 Training and Assistance Applications: Performance Evaluation in the Shipyard of the Future |
title_fullStr | Creating Collaborative Augmented Reality Experiences for Industry 4.0 Training and Assistance Applications: Performance Evaluation in the Shipyard of the Future |
title_full_unstemmed | Creating Collaborative Augmented Reality Experiences for Industry 4.0 Training and Assistance Applications: Performance Evaluation in the Shipyard of the Future |
title_short | Creating Collaborative Augmented Reality Experiences for Industry 4.0 Training and Assistance Applications: Performance Evaluation in the Shipyard of the Future |
title_sort | creating collaborative augmented reality experiences for industry 4 0 training and assistance applications performance evaluation in the shipyard of the future |
topic | Industry 4.0 augmented reality industrial augmented reality assistance training collaborative applications |
url | https://www.mdpi.com/2076-3417/10/24/9073 |
work_keys_str_mv | AT aidavidalbalea creatingcollaborativeaugmentedrealityexperiencesforindustry40trainingandassistanceapplicationsperformanceevaluationintheshipyardofthefuture AT oscarblanconovoa creatingcollaborativeaugmentedrealityexperiencesforindustry40trainingandassistanceapplicationsperformanceevaluationintheshipyardofthefuture AT paulafragalamas creatingcollaborativeaugmentedrealityexperiencesforindustry40trainingandassistanceapplicationsperformanceevaluationintheshipyardofthefuture AT miguelvilarmontesinos creatingcollaborativeaugmentedrealityexperiencesforindustry40trainingandassistanceapplicationsperformanceevaluationintheshipyardofthefuture AT tiagomfernandezcarames creatingcollaborativeaugmentedrealityexperiencesforindustry40trainingandassistanceapplicationsperformanceevaluationintheshipyardofthefuture |