Advanced Assistive Maintenance Based on Augmented Reality and 5G Networking

Internet of Things (IoT) applications play a relevant role in today’s industry in sharing diagnostic data with off-site service teams, as well as in enabling reliable predictive maintenance systems. Several interventions scenarios, however, require the physical presence of a human operator: Augmente...

Full description

Bibliographic Details
Main Authors: Sebastiano Verde, Marco Marcon, Simone Milani, Stefano Tubaro
Format: Article
Language:English
Published: MDPI AG 2020-12-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/24/7157
_version_ 1827700124168486912
author Sebastiano Verde
Marco Marcon
Simone Milani
Stefano Tubaro
author_facet Sebastiano Verde
Marco Marcon
Simone Milani
Stefano Tubaro
author_sort Sebastiano Verde
collection DOAJ
description Internet of Things (IoT) applications play a relevant role in today’s industry in sharing diagnostic data with off-site service teams, as well as in enabling reliable predictive maintenance systems. Several interventions scenarios, however, require the physical presence of a human operator: Augmented Reality (AR), together with a broad-band connection, represents a major opportunity to integrate diagnostic data with real-time in-situ acquisitions. Diagnostic information can be shared with remote specialists that are able to monitor and guide maintenance operations from a control room as if they were in place. Furthermore, integrating heterogeneous sensors with AR visualization displays could largely improve operators’ safety in complex and dangerous industrial plants. In this paper, we present a complete setup for a remote assistive maintenance intervention based on 5G networking and tested at a Vodafone Base Transceiver Station (BTS) within the Vodafone 5G Program. Technicians’ safety was improved by means of a lightweight AR Head-Mounted Display (HDM) equipped with a thermal camera and a depth sensor to foresee possible collisions with hot surfaces and dangerous objects, by leveraging the processing power of remote computing paired with the low latency of 5G connection. Field testing confirmed that the proposed approach can be a viable solution for egocentric environment understanding and enables an immersive integration of the obtained augmented data within the real scene.
first_indexed 2024-03-10T14:05:58Z
format Article
id doaj.art-7fd037e919ae42a399dc7feb61bab33e
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-10T14:05:58Z
publishDate 2020-12-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-7fd037e919ae42a399dc7feb61bab33e2023-11-21T00:42:14ZengMDPI AGSensors1424-82202020-12-012024715710.3390/s20247157Advanced Assistive Maintenance Based on Augmented Reality and 5G NetworkingSebastiano Verde0Marco Marcon1Simone Milani2Stefano Tubaro3Department of Information Engineering, University of Padova, 35131 Padua, ItalyDipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano, 20133 Milan, ItalyDepartment of Information Engineering, University of Padova, 35131 Padua, ItalyDipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano, 20133 Milan, ItalyInternet of Things (IoT) applications play a relevant role in today’s industry in sharing diagnostic data with off-site service teams, as well as in enabling reliable predictive maintenance systems. Several interventions scenarios, however, require the physical presence of a human operator: Augmented Reality (AR), together with a broad-band connection, represents a major opportunity to integrate diagnostic data with real-time in-situ acquisitions. Diagnostic information can be shared with remote specialists that are able to monitor and guide maintenance operations from a control room as if they were in place. Furthermore, integrating heterogeneous sensors with AR visualization displays could largely improve operators’ safety in complex and dangerous industrial plants. In this paper, we present a complete setup for a remote assistive maintenance intervention based on 5G networking and tested at a Vodafone Base Transceiver Station (BTS) within the Vodafone 5G Program. Technicians’ safety was improved by means of a lightweight AR Head-Mounted Display (HDM) equipped with a thermal camera and a depth sensor to foresee possible collisions with hot surfaces and dangerous objects, by leveraging the processing power of remote computing paired with the low latency of 5G connection. Field testing confirmed that the proposed approach can be a viable solution for egocentric environment understanding and enables an immersive integration of the obtained augmented data within the real scene.https://www.mdpi.com/1424-8220/20/24/7157augmented reality5G real-time networkingassistive maintenanceedge computer processing
spellingShingle Sebastiano Verde
Marco Marcon
Simone Milani
Stefano Tubaro
Advanced Assistive Maintenance Based on Augmented Reality and 5G Networking
Sensors
augmented reality
5G real-time networking
assistive maintenance
edge computer processing
title Advanced Assistive Maintenance Based on Augmented Reality and 5G Networking
title_full Advanced Assistive Maintenance Based on Augmented Reality and 5G Networking
title_fullStr Advanced Assistive Maintenance Based on Augmented Reality and 5G Networking
title_full_unstemmed Advanced Assistive Maintenance Based on Augmented Reality and 5G Networking
title_short Advanced Assistive Maintenance Based on Augmented Reality and 5G Networking
title_sort advanced assistive maintenance based on augmented reality and 5g networking
topic augmented reality
5G real-time networking
assistive maintenance
edge computer processing
url https://www.mdpi.com/1424-8220/20/24/7157
work_keys_str_mv AT sebastianoverde advancedassistivemaintenancebasedonaugmentedrealityand5gnetworking
AT marcomarcon advancedassistivemaintenancebasedonaugmentedrealityand5gnetworking
AT simonemilani advancedassistivemaintenancebasedonaugmentedrealityand5gnetworking
AT stefanotubaro advancedassistivemaintenancebasedonaugmentedrealityand5gnetworking