Extended Reality Application Framework for a Digital-Twin-Based Smart Crane
Industry 4.0 is moving forward under technology upgrades, utilizing information technology to improve the intelligence of the industry, whereas Industry 5.0 is value-driven, aiming to focus on essential societal needs, values, and responsibility. The manufacturing industry is currently moving toward...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-06-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/12/12/6030 |
| _version_ | 1827662626045296640 |
|---|---|
| author | Chao Yang Xinyi Tu Juuso Autiosalo Riku Ala-Laurinaho Joel Mattila Pauli Salminen Kari Tammi |
| author_facet | Chao Yang Xinyi Tu Juuso Autiosalo Riku Ala-Laurinaho Joel Mattila Pauli Salminen Kari Tammi |
| author_sort | Chao Yang |
| collection | DOAJ |
| description | Industry 4.0 is moving forward under technology upgrades, utilizing information technology to improve the intelligence of the industry, whereas Industry 5.0 is value-driven, aiming to focus on essential societal needs, values, and responsibility. The manufacturing industry is currently moving towards the integration of productivity enhancements and sustainable human employment. Such a transformation has deeply changed the human–machine interaction (HMI), among which digital twin (DT) and extended reality (XR) are two cutting-edge technologies. A manufacturing DT offers an opportunity to simulate, monitor, and optimize the machine. In the meantime, XR empowers HMI in the industrial field. This paper presents an XR application framework for DT-based services within a manufacturing context. This work aims to develop a technological framework to improve the efficiency of the XR application development and the usability of the XR-based HMI systems. We first introduce four layers of the framework, including the perception layer with the physical machine and its ROS-based simulation model, the machine communication layer, the network layer containing three kinds of communication middleware, and the Unity-based service layer creating XR-based digital applications. Subsequently, we conduct the responsiveness test for the framework and describe several XR industrial applications for a DT-based smart crane. Finally, we highlight the research challenges and potential issues that should be further addressed by analyzing the performance of the whole framework. |
| first_indexed | 2024-03-10T00:30:34Z |
| format | Article |
| id | doaj.art-75a45fc6465f4584a84ff7529cf10546 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-10T00:30:34Z |
| publishDate | 2022-06-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-75a45fc6465f4584a84ff7529cf105462023-11-23T15:26:36ZengMDPI AGApplied Sciences2076-34172022-06-011212603010.3390/app12126030Extended Reality Application Framework for a Digital-Twin-Based Smart CraneChao Yang0Xinyi Tu1Juuso Autiosalo2Riku Ala-Laurinaho3Joel Mattila4Pauli Salminen5Kari Tammi6Department of Mechanical Engineering, Aalto University, 02150 Espoo, FinlandDepartment of Mechanical Engineering, Aalto University, 02150 Espoo, FinlandDepartment of Mechanical Engineering, Aalto University, 02150 Espoo, FinlandDepartment of Mechanical Engineering, Aalto University, 02150 Espoo, FinlandDepartment of Mechanical Engineering, Aalto University, 02150 Espoo, FinlandDepartment of Mechanical Engineering, Aalto University, 02150 Espoo, FinlandDepartment of Mechanical Engineering, Aalto University, 02150 Espoo, FinlandIndustry 4.0 is moving forward under technology upgrades, utilizing information technology to improve the intelligence of the industry, whereas Industry 5.0 is value-driven, aiming to focus on essential societal needs, values, and responsibility. The manufacturing industry is currently moving towards the integration of productivity enhancements and sustainable human employment. Such a transformation has deeply changed the human–machine interaction (HMI), among which digital twin (DT) and extended reality (XR) are two cutting-edge technologies. A manufacturing DT offers an opportunity to simulate, monitor, and optimize the machine. In the meantime, XR empowers HMI in the industrial field. This paper presents an XR application framework for DT-based services within a manufacturing context. This work aims to develop a technological framework to improve the efficiency of the XR application development and the usability of the XR-based HMI systems. We first introduce four layers of the framework, including the perception layer with the physical machine and its ROS-based simulation model, the machine communication layer, the network layer containing three kinds of communication middleware, and the Unity-based service layer creating XR-based digital applications. Subsequently, we conduct the responsiveness test for the framework and describe several XR industrial applications for a DT-based smart crane. Finally, we highlight the research challenges and potential issues that should be further addressed by analyzing the performance of the whole framework.https://www.mdpi.com/2076-3417/12/12/6030digital twinextended realityhuman–machine interactionframeworkcrane |
| spellingShingle | Chao Yang Xinyi Tu Juuso Autiosalo Riku Ala-Laurinaho Joel Mattila Pauli Salminen Kari Tammi Extended Reality Application Framework for a Digital-Twin-Based Smart Crane Applied Sciences digital twin extended reality human–machine interaction framework crane |
| title | Extended Reality Application Framework for a Digital-Twin-Based Smart Crane |
| title_full | Extended Reality Application Framework for a Digital-Twin-Based Smart Crane |
| title_fullStr | Extended Reality Application Framework for a Digital-Twin-Based Smart Crane |
| title_full_unstemmed | Extended Reality Application Framework for a Digital-Twin-Based Smart Crane |
| title_short | Extended Reality Application Framework for a Digital-Twin-Based Smart Crane |
| title_sort | extended reality application framework for a digital twin based smart crane |
| topic | digital twin extended reality human–machine interaction framework crane |
| url | https://www.mdpi.com/2076-3417/12/12/6030 |
| work_keys_str_mv | AT chaoyang extendedrealityapplicationframeworkforadigitaltwinbasedsmartcrane AT xinyitu extendedrealityapplicationframeworkforadigitaltwinbasedsmartcrane AT juusoautiosalo extendedrealityapplicationframeworkforadigitaltwinbasedsmartcrane AT rikualalaurinaho extendedrealityapplicationframeworkforadigitaltwinbasedsmartcrane AT joelmattila extendedrealityapplicationframeworkforadigitaltwinbasedsmartcrane AT paulisalminen extendedrealityapplicationframeworkforadigitaltwinbasedsmartcrane AT karitammi extendedrealityapplicationframeworkforadigitaltwinbasedsmartcrane |