Creating Collaborative Augmented Reality Experiences for Industry 4.0 Training and Assistance Applications: Performance Evaluation in the Shipyard of the Future

Industrial Augmented Reality (IAR) is one of the key technologies pointed out by the Industry 4.0 paradigm as a tool for improving industrial processes and for maximizing worker efficiency. Training and assistance are two of the most popular IAR-enabled applications, since they may significantly fac...

Full description

Bibliographic Details
Main Authors: Aida Vidal-Balea, Oscar Blanco-Novoa, Paula Fraga-Lamas, Miguel Vilar-Montesinos, Tiago M. Fernández-Caramés
Format: Article
Language:English
Published: MDPI AG 2020-12-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/10/24/9073
_version_ 1797544231737229312
author Aida Vidal-Balea
Oscar Blanco-Novoa
Paula Fraga-Lamas
Miguel Vilar-Montesinos
Tiago M. Fernández-Caramés
author_facet Aida Vidal-Balea
Oscar Blanco-Novoa
Paula Fraga-Lamas
Miguel Vilar-Montesinos
Tiago M. Fernández-Caramés
author_sort Aida Vidal-Balea
collection DOAJ
description Industrial Augmented Reality (IAR) is one of the key technologies pointed out by the Industry 4.0 paradigm as a tool for improving industrial processes and for maximizing worker efficiency. Training and assistance are two of the most popular IAR-enabled applications, since they may significantly facilitate, support, and optimize production and assembly tasks in industrial environments. This article presents an IAR collaborative application developed jointly by Navantia, one of the biggest European shipbuilders, and the University of A Coruña (Spain). The analysis, design, and implementation of such an IAR application are described thoroughly so as to enable future developers to create similar IAR applications. The IAR application is based on the Microsoft HoloLens smart glasses and is able to assist and to guide shipyard operators during their training and in assembly tasks. The proposed IAR application embeds a novel collaborative protocol that allows operators to visualize and interact in a synchronized way with the same virtual content. Thus, all operators that share an IAR experience see each virtual object positioned at the same physical spot and in the same state. The collaborative application is first evaluated and optimized in terms of packet communications delay and anchor transmission latency, and then, its validation in a shipyard workshop by Navantia’s operators is presented. The performance results show fast response times for regular packets (less than 5 ms), low interference rates in the 5 GHz band, and an anchor transmission latency of up to 30 s. Regarding the validation tests, they allow for obtaining useful insights and feedback from the industrial operators, as well as clear guidelines that will help future developers to face the challenges that will arise when creating the next generation of IAR applications.
first_indexed 2024-03-10T13:57:29Z
format Article
id doaj.art-c9b53f51fb954404850138f1be1b5845
institution Directory Open Access Journal
issn 2076-3417
language English
last_indexed 2024-03-10T13:57:29Z
publishDate 2020-12-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj.art-c9b53f51fb954404850138f1be1b58452023-11-21T01:30:11ZengMDPI AGApplied Sciences2076-34172020-12-011024907310.3390/app10249073Creating Collaborative Augmented Reality Experiences for Industry 4.0 Training and Assistance Applications: Performance Evaluation in the Shipyard of the FutureAida Vidal-Balea0Oscar Blanco-Novoa1Paula Fraga-Lamas2Miguel Vilar-Montesinos3Tiago M. Fernández-Caramés4Department of Computer Engineering, Faculty of Computer Science, Universidade da Coruña, 15071 A Coruña, SpainDepartment of Computer Engineering, Faculty of Computer Science, Universidade da Coruña, 15071 A Coruña, SpainDepartment of Computer Engineering, Faculty of Computer Science, Universidade da Coruña, 15071 A Coruña, SpainNavantia S. A., Astillero de Ferrol, 15403 Ferrol, SpainDepartment of Computer Engineering, Faculty of Computer Science, Universidade da Coruña, 15071 A Coruña, SpainIndustrial Augmented Reality (IAR) is one of the key technologies pointed out by the Industry 4.0 paradigm as a tool for improving industrial processes and for maximizing worker efficiency. Training and assistance are two of the most popular IAR-enabled applications, since they may significantly facilitate, support, and optimize production and assembly tasks in industrial environments. This article presents an IAR collaborative application developed jointly by Navantia, one of the biggest European shipbuilders, and the University of A Coruña (Spain). The analysis, design, and implementation of such an IAR application are described thoroughly so as to enable future developers to create similar IAR applications. The IAR application is based on the Microsoft HoloLens smart glasses and is able to assist and to guide shipyard operators during their training and in assembly tasks. The proposed IAR application embeds a novel collaborative protocol that allows operators to visualize and interact in a synchronized way with the same virtual content. Thus, all operators that share an IAR experience see each virtual object positioned at the same physical spot and in the same state. The collaborative application is first evaluated and optimized in terms of packet communications delay and anchor transmission latency, and then, its validation in a shipyard workshop by Navantia’s operators is presented. The performance results show fast response times for regular packets (less than 5 ms), low interference rates in the 5 GHz band, and an anchor transmission latency of up to 30 s. Regarding the validation tests, they allow for obtaining useful insights and feedback from the industrial operators, as well as clear guidelines that will help future developers to face the challenges that will arise when creating the next generation of IAR applications.https://www.mdpi.com/2076-3417/10/24/9073Industry 4.0augmented realityindustrial augmented realityassistancetrainingcollaborative applications
spellingShingle Aida Vidal-Balea
Oscar Blanco-Novoa
Paula Fraga-Lamas
Miguel Vilar-Montesinos
Tiago M. Fernández-Caramés
Creating Collaborative Augmented Reality Experiences for Industry 4.0 Training and Assistance Applications: Performance Evaluation in the Shipyard of the Future
Applied Sciences
Industry 4.0
augmented reality
industrial augmented reality
assistance
training
collaborative applications
title Creating Collaborative Augmented Reality Experiences for Industry 4.0 Training and Assistance Applications: Performance Evaluation in the Shipyard of the Future
title_full Creating Collaborative Augmented Reality Experiences for Industry 4.0 Training and Assistance Applications: Performance Evaluation in the Shipyard of the Future
title_fullStr Creating Collaborative Augmented Reality Experiences for Industry 4.0 Training and Assistance Applications: Performance Evaluation in the Shipyard of the Future
title_full_unstemmed Creating Collaborative Augmented Reality Experiences for Industry 4.0 Training and Assistance Applications: Performance Evaluation in the Shipyard of the Future
title_short Creating Collaborative Augmented Reality Experiences for Industry 4.0 Training and Assistance Applications: Performance Evaluation in the Shipyard of the Future
title_sort creating collaborative augmented reality experiences for industry 4 0 training and assistance applications performance evaluation in the shipyard of the future
topic Industry 4.0
augmented reality
industrial augmented reality
assistance
training
collaborative applications
url https://www.mdpi.com/2076-3417/10/24/9073
work_keys_str_mv AT aidavidalbalea creatingcollaborativeaugmentedrealityexperiencesforindustry40trainingandassistanceapplicationsperformanceevaluationintheshipyardofthefuture
AT oscarblanconovoa creatingcollaborativeaugmentedrealityexperiencesforindustry40trainingandassistanceapplicationsperformanceevaluationintheshipyardofthefuture
AT paulafragalamas creatingcollaborativeaugmentedrealityexperiencesforindustry40trainingandassistanceapplicationsperformanceevaluationintheshipyardofthefuture
AT miguelvilarmontesinos creatingcollaborativeaugmentedrealityexperiencesforindustry40trainingandassistanceapplicationsperformanceevaluationintheshipyardofthefuture
AT tiagomfernandezcarames creatingcollaborativeaugmentedrealityexperiencesforindustry40trainingandassistanceapplicationsperformanceevaluationintheshipyardofthefuture