UUX Evaluation of a Digitally Advanced Human–Machine Interface for Excavators
With the evaluation of a next-generation human–machine interface (HMI) concept for excavators, this study aims to discuss the HMI quality measurement based on usability and user experience (UUX) metrics. Regarding the digital transformation of construction sites, future work environments will have t...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2020-08-01
|
Series: | Multimodal Technologies and Interaction |
Subjects: | |
Online Access: | https://www.mdpi.com/2414-4088/4/3/57 |
_version_ | 1827708680929280000 |
---|---|
author | Sebastian Lorenz Jens R. Helmert Ruben Anders Christian Wölfel Jens Krzywinski |
author_facet | Sebastian Lorenz Jens R. Helmert Ruben Anders Christian Wölfel Jens Krzywinski |
author_sort | Sebastian Lorenz |
collection | DOAJ |
description | With the evaluation of a next-generation human–machine interface (HMI) concept for excavators, this study aims to discuss the HMI quality measurement based on usability and user experience (UUX) metrics. Regarding the digital transformation of construction sites, future work environments will have to be capable of presenting various complex visual data and enabling efficient and safe interactivity while working. The evaluated HMI focused on introducing a touch display-based interface, providing advanced operation functions and different interaction modalities. The assessment of UUX should show whether the novel HMI can be utilised to perform typical tasks (usability) and how it is accepted and assessed in terms of non-instrumental qualities (user experience, UX). Using the collected data, this article also aims to contribute to the general discussion about the role of UX beyond usability in industrial applications and deepen the understanding of non-instrumental qualities when it comes to user-oriented process and machine design. The exploratory study examines insights into the application of elaborated UUX measuring tools like the User Experience Questionnaire (UEQ) on the interaction with industrial goods accompanied by their rating with other tools, namely System Usability Scale (SUS), Intuitive Interaction Questionnaire (INTUI) and the National Aeronautics and Space Administration (NASA) Task Load Index (NASA-TLX). Four goals are pursued in this study. The first goal is to compare in-depth two different ways of interaction with the novel HMI—namely one by a control pad on the right joystick and one by touch. Therefore, a sample of 17 subjects in total was split into two groups and differences in UUX measures were tested. Secondly, the performances of both groups were tested over the course of trials to investigate possible differences in detail. The third goal is to interpret measures of usability and user experience against existing benchmark values. Fourth and finally, we use the data gathered to analyse correlations between measures of UUX. The results of our study show that the different ways of interaction did not impact any of the measures taken. In terms of detailed performance analysis, both groups yielded differences in terms of time per action, but not between the groups. The comparison of UUX measures with benchmark values yielded mixed results. The UUX measures show some relevant significant correlations. The participants mostly reported enjoying the use of the HMI concept, but several practical issues (e.g., efficiency) still need to be overcome. Once again, the study confirms the urge of user inclusion in product development. Especially in the course of digitalisation, as big scale advancements of systems and user interfaces bring uncertainty for many manufacturers regarding whether or how a feature should be integrated. |
first_indexed | 2024-03-10T17:07:59Z |
format | Article |
id | doaj.art-88a1d53a4aeb4a7ab0deb4e9dda7da02 |
institution | Directory Open Access Journal |
issn | 2414-4088 |
language | English |
last_indexed | 2024-03-10T17:07:59Z |
publishDate | 2020-08-01 |
publisher | MDPI AG |
record_format | Article |
series | Multimodal Technologies and Interaction |
spelling | doaj.art-88a1d53a4aeb4a7ab0deb4e9dda7da022023-11-20T10:45:07ZengMDPI AGMultimodal Technologies and Interaction2414-40882020-08-01435710.3390/mti4030057UUX Evaluation of a Digitally Advanced Human–Machine Interface for ExcavatorsSebastian Lorenz0Jens R. Helmert1Ruben Anders2Christian Wölfel3Jens Krzywinski4Industrial Design Engineering, Technische Universität Dresden, 01069 Dresden, GermanyEngineering Psychology and Applied Cognitive Research, Technische Universität Dresden, 01069 Dresden, GermanyIndependent Researcher, Görlitzer Straße 42, 01099 Dresden, GermanyIndustrial Design Engineering, Technische Universität Dresden, 01069 Dresden, GermanyIndustrial Design Engineering, Technische Universität Dresden, 01069 Dresden, GermanyWith the evaluation of a next-generation human–machine interface (HMI) concept for excavators, this study aims to discuss the HMI quality measurement based on usability and user experience (UUX) metrics. Regarding the digital transformation of construction sites, future work environments will have to be capable of presenting various complex visual data and enabling efficient and safe interactivity while working. The evaluated HMI focused on introducing a touch display-based interface, providing advanced operation functions and different interaction modalities. The assessment of UUX should show whether the novel HMI can be utilised to perform typical tasks (usability) and how it is accepted and assessed in terms of non-instrumental qualities (user experience, UX). Using the collected data, this article also aims to contribute to the general discussion about the role of UX beyond usability in industrial applications and deepen the understanding of non-instrumental qualities when it comes to user-oriented process and machine design. The exploratory study examines insights into the application of elaborated UUX measuring tools like the User Experience Questionnaire (UEQ) on the interaction with industrial goods accompanied by their rating with other tools, namely System Usability Scale (SUS), Intuitive Interaction Questionnaire (INTUI) and the National Aeronautics and Space Administration (NASA) Task Load Index (NASA-TLX). Four goals are pursued in this study. The first goal is to compare in-depth two different ways of interaction with the novel HMI—namely one by a control pad on the right joystick and one by touch. Therefore, a sample of 17 subjects in total was split into two groups and differences in UUX measures were tested. Secondly, the performances of both groups were tested over the course of trials to investigate possible differences in detail. The third goal is to interpret measures of usability and user experience against existing benchmark values. Fourth and finally, we use the data gathered to analyse correlations between measures of UUX. The results of our study show that the different ways of interaction did not impact any of the measures taken. In terms of detailed performance analysis, both groups yielded differences in terms of time per action, but not between the groups. The comparison of UUX measures with benchmark values yielded mixed results. The UUX measures show some relevant significant correlations. The participants mostly reported enjoying the use of the HMI concept, but several practical issues (e.g., efficiency) still need to be overcome. Once again, the study confirms the urge of user inclusion in product development. Especially in the course of digitalisation, as big scale advancements of systems and user interfaces bring uncertainty for many manufacturers regarding whether or how a feature should be integrated.https://www.mdpi.com/2414-4088/4/3/57user experienceusabilityindustrial applicationsman-machine interfacesadaptive interactionintuitivity |
spellingShingle | Sebastian Lorenz Jens R. Helmert Ruben Anders Christian Wölfel Jens Krzywinski UUX Evaluation of a Digitally Advanced Human–Machine Interface for Excavators Multimodal Technologies and Interaction user experience usability industrial applications man-machine interfaces adaptive interaction intuitivity |
title | UUX Evaluation of a Digitally Advanced Human–Machine Interface for Excavators |
title_full | UUX Evaluation of a Digitally Advanced Human–Machine Interface for Excavators |
title_fullStr | UUX Evaluation of a Digitally Advanced Human–Machine Interface for Excavators |
title_full_unstemmed | UUX Evaluation of a Digitally Advanced Human–Machine Interface for Excavators |
title_short | UUX Evaluation of a Digitally Advanced Human–Machine Interface for Excavators |
title_sort | uux evaluation of a digitally advanced human machine interface for excavators |
topic | user experience usability industrial applications man-machine interfaces adaptive interaction intuitivity |
url | https://www.mdpi.com/2414-4088/4/3/57 |
work_keys_str_mv | AT sebastianlorenz uuxevaluationofadigitallyadvancedhumanmachineinterfaceforexcavators AT jensrhelmert uuxevaluationofadigitallyadvancedhumanmachineinterfaceforexcavators AT rubenanders uuxevaluationofadigitallyadvancedhumanmachineinterfaceforexcavators AT christianwolfel uuxevaluationofadigitallyadvancedhumanmachineinterfaceforexcavators AT jenskrzywinski uuxevaluationofadigitallyadvancedhumanmachineinterfaceforexcavators |