A Mixed Reality Interface for a Digital Twin Based Crane
Digital twin technology empowers the digital transformation of the industrial world with an increasing amount of data, which meanwhile creates a challenging context for designing a human–machine interface (HMI) for operating machines. This work aims at creating an HMI for digital twin based services...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-10-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/11/20/9480 |
| _version_ | 1797515453870899200 |
|---|---|
| author | Xinyi Tu Juuso Autiosalo Adnane Jadid Kari Tammi Gudrun Klinker |
| author_facet | Xinyi Tu Juuso Autiosalo Adnane Jadid Kari Tammi Gudrun Klinker |
| author_sort | Xinyi Tu |
| collection | DOAJ |
| description | Digital twin technology empowers the digital transformation of the industrial world with an increasing amount of data, which meanwhile creates a challenging context for designing a human–machine interface (HMI) for operating machines. This work aims at creating an HMI for digital twin based services. With an industrial crane platform as a case study, we presented a mixed reality (MR) application running on a Microsoft HoloLens 1 device. The application, consisting of visualization, interaction, communication, and registration modules, allowed crane operators to both monitor the crane status and control its movement through interactive holograms and bi-directional data communication, with enhanced mobility thanks to spatial registration and tracking of the MR environment. The prototype was quantitatively evaluated regarding the control accuracy in 20 measurements following a step-by-step protocol that we defined to standardize the measurement procedure. The results suggested that the differences between the target and actual positions were within the 10 cm range in three dimensions, which were considered sufficiently small regarding the typical crane operation use case of logistics purposes and could be improved with the adoption of robust registration and tracking techniques in our future work. |
| first_indexed | 2024-03-10T06:45:42Z |
| format | Article |
| id | doaj.art-cee92a04a2bb44c5824c8e664a1c56d4 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-10T06:45:42Z |
| publishDate | 2021-10-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-cee92a04a2bb44c5824c8e664a1c56d42023-11-22T17:19:18ZengMDPI AGApplied Sciences2076-34172021-10-011120948010.3390/app11209480A Mixed Reality Interface for a Digital Twin Based CraneXinyi Tu0Juuso Autiosalo1Adnane Jadid2Kari Tammi3Gudrun Klinker4Department of Mechanical Engineering, Aalto University, 02150 Espoo, FinlandDepartment of Mechanical Engineering, Aalto University, 02150 Espoo, FinlandForschungsgruppe Augmented Reality (FAR), Technical University of Munich, D-85748 Garching, GermanyDepartment of Mechanical Engineering, Aalto University, 02150 Espoo, FinlandForschungsgruppe Augmented Reality (FAR), Technical University of Munich, D-85748 Garching, GermanyDigital twin technology empowers the digital transformation of the industrial world with an increasing amount of data, which meanwhile creates a challenging context for designing a human–machine interface (HMI) for operating machines. This work aims at creating an HMI for digital twin based services. With an industrial crane platform as a case study, we presented a mixed reality (MR) application running on a Microsoft HoloLens 1 device. The application, consisting of visualization, interaction, communication, and registration modules, allowed crane operators to both monitor the crane status and control its movement through interactive holograms and bi-directional data communication, with enhanced mobility thanks to spatial registration and tracking of the MR environment. The prototype was quantitatively evaluated regarding the control accuracy in 20 measurements following a step-by-step protocol that we defined to standardize the measurement procedure. The results suggested that the differences between the target and actual positions were within the 10 cm range in three dimensions, which were considered sufficiently small regarding the typical crane operation use case of logistics purposes and could be improved with the adoption of robust registration and tracking techniques in our future work.https://www.mdpi.com/2076-3417/11/20/9480mixed realityaugmented realitydigital twinsMicrosoft HoloLensindustrial craneshuman–machine interface |
| spellingShingle | Xinyi Tu Juuso Autiosalo Adnane Jadid Kari Tammi Gudrun Klinker A Mixed Reality Interface for a Digital Twin Based Crane Applied Sciences mixed reality augmented reality digital twins Microsoft HoloLens industrial cranes human–machine interface |
| title | A Mixed Reality Interface for a Digital Twin Based Crane |
| title_full | A Mixed Reality Interface for a Digital Twin Based Crane |
| title_fullStr | A Mixed Reality Interface for a Digital Twin Based Crane |
| title_full_unstemmed | A Mixed Reality Interface for a Digital Twin Based Crane |
| title_short | A Mixed Reality Interface for a Digital Twin Based Crane |
| title_sort | mixed reality interface for a digital twin based crane |
| topic | mixed reality augmented reality digital twins Microsoft HoloLens industrial cranes human–machine interface |
| url | https://www.mdpi.com/2076-3417/11/20/9480 |
| work_keys_str_mv | AT xinyitu amixedrealityinterfaceforadigitaltwinbasedcrane AT juusoautiosalo amixedrealityinterfaceforadigitaltwinbasedcrane AT adnanejadid amixedrealityinterfaceforadigitaltwinbasedcrane AT karitammi amixedrealityinterfaceforadigitaltwinbasedcrane AT gudrunklinker amixedrealityinterfaceforadigitaltwinbasedcrane AT xinyitu mixedrealityinterfaceforadigitaltwinbasedcrane AT juusoautiosalo mixedrealityinterfaceforadigitaltwinbasedcrane AT adnanejadid mixedrealityinterfaceforadigitaltwinbasedcrane AT karitammi mixedrealityinterfaceforadigitaltwinbasedcrane AT gudrunklinker mixedrealityinterfaceforadigitaltwinbasedcrane |