Impact of Industrial Noise on Speech Interaction Performance and User Acceptance when Using the MS HoloLens 2
Even though assistance systems offer more potential due to the increasing maturity of the inherent technologies, Automatic Speech Recognition faces distinctive challenges in the industrial context. Speech recognition enables immersive assistance systems to handle inputs and commands hands-free durin...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-01-01
|
| Series: | Multimodal Technologies and Interaction |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2414-4088/8/2/8 |
| _version_ | 1797297343021711360 |
|---|---|
| author | Maximilian Rosilius Martin Spiertz Benedikt Wirsing Manuel Geuen Volker Bräutigam Bernd Ludwig |
| author_facet | Maximilian Rosilius Martin Spiertz Benedikt Wirsing Manuel Geuen Volker Bräutigam Bernd Ludwig |
| author_sort | Maximilian Rosilius |
| collection | DOAJ |
| description | Even though assistance systems offer more potential due to the increasing maturity of the inherent technologies, Automatic Speech Recognition faces distinctive challenges in the industrial context. Speech recognition enables immersive assistance systems to handle inputs and commands hands-free during two-handed operative jobs. The results of the conducted study (with <i>n</i> = 22 participants) based on the counterbalanced within-subject design demonstrated the performance (word error rate and information transfer rate) of the HMD HoloLens 2 as a function of the sound pressure level of industrial noise. The negative influence of industrial noise was higher on the word error rate of dictation than on the information transfer rate of the speech command. Contrary to expectations, no statistically significant difference in performance was found between the stationary and non-stationary noise. Furthermore, this study confirmed the hypothesis that user acceptance was negatively influenced by erroneous speech interactions. Furthermore, the erroneous speech interaction had no statistically significant influence on the workload or physiological parameters (skin conductance level and heart rate). It can be summarized that Automatic Speech Recognition is not yet a capable interaction paradigm in an industrial context. |
| first_indexed | 2024-03-07T22:19:13Z |
| format | Article |
| id | doaj.art-88bd1cf9dd2d4074a9eaa85dc60be0c5 |
| institution | Directory Open Access Journal |
| issn | 2414-4088 |
| language | English |
| last_indexed | 2024-03-07T22:19:13Z |
| publishDate | 2024-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Multimodal Technologies and Interaction |
| spelling | doaj.art-88bd1cf9dd2d4074a9eaa85dc60be0c52024-02-23T15:29:19ZengMDPI AGMultimodal Technologies and Interaction2414-40882024-01-0182810.3390/mti8020008Impact of Industrial Noise on Speech Interaction Performance and User Acceptance when Using the MS HoloLens 2Maximilian Rosilius0Martin Spiertz1Benedikt Wirsing2Manuel Geuen3Volker Bräutigam4Bernd Ludwig5Institute Digital Engineering, Technical University of Applied Sciences Würzburg-Schweinfurt, 97070 Würzburg, GermanyInstitute Digital Engineering, Technical University of Applied Sciences Würzburg-Schweinfurt, 97070 Würzburg, GermanyInstitute Digital Engineering, Technical University of Applied Sciences Würzburg-Schweinfurt, 97070 Würzburg, GermanyDepartment of Community Health, Bochum University of Applied Sciences, 44801 Bochum, GermanyInstitute Digital Engineering, Technical University of Applied Sciences Würzburg-Schweinfurt, 97070 Würzburg, GermanyDepartment of Information Science, University of Regensburg, 93053 Regensburg, GermanyEven though assistance systems offer more potential due to the increasing maturity of the inherent technologies, Automatic Speech Recognition faces distinctive challenges in the industrial context. Speech recognition enables immersive assistance systems to handle inputs and commands hands-free during two-handed operative jobs. The results of the conducted study (with <i>n</i> = 22 participants) based on the counterbalanced within-subject design demonstrated the performance (word error rate and information transfer rate) of the HMD HoloLens 2 as a function of the sound pressure level of industrial noise. The negative influence of industrial noise was higher on the word error rate of dictation than on the information transfer rate of the speech command. Contrary to expectations, no statistically significant difference in performance was found between the stationary and non-stationary noise. Furthermore, this study confirmed the hypothesis that user acceptance was negatively influenced by erroneous speech interactions. Furthermore, the erroneous speech interaction had no statistically significant influence on the workload or physiological parameters (skin conductance level and heart rate). It can be summarized that Automatic Speech Recognition is not yet a capable interaction paradigm in an industrial context.https://www.mdpi.com/2414-4088/8/2/8error casehuman–machine interactionperformancetechnology acceptancespeech recognitionindustrial noise |
| spellingShingle | Maximilian Rosilius Martin Spiertz Benedikt Wirsing Manuel Geuen Volker Bräutigam Bernd Ludwig Impact of Industrial Noise on Speech Interaction Performance and User Acceptance when Using the MS HoloLens 2 Multimodal Technologies and Interaction error case human–machine interaction performance technology acceptance speech recognition industrial noise |
| title | Impact of Industrial Noise on Speech Interaction Performance and User Acceptance when Using the MS HoloLens 2 |
| title_full | Impact of Industrial Noise on Speech Interaction Performance and User Acceptance when Using the MS HoloLens 2 |
| title_fullStr | Impact of Industrial Noise on Speech Interaction Performance and User Acceptance when Using the MS HoloLens 2 |
| title_full_unstemmed | Impact of Industrial Noise on Speech Interaction Performance and User Acceptance when Using the MS HoloLens 2 |
| title_short | Impact of Industrial Noise on Speech Interaction Performance and User Acceptance when Using the MS HoloLens 2 |
| title_sort | impact of industrial noise on speech interaction performance and user acceptance when using the ms hololens 2 |
| topic | error case human–machine interaction performance technology acceptance speech recognition industrial noise |
| url | https://www.mdpi.com/2414-4088/8/2/8 |
| work_keys_str_mv | AT maximilianrosilius impactofindustrialnoiseonspeechinteractionperformanceanduseracceptancewhenusingthemshololens2 AT martinspiertz impactofindustrialnoiseonspeechinteractionperformanceanduseracceptancewhenusingthemshololens2 AT benediktwirsing impactofindustrialnoiseonspeechinteractionperformanceanduseracceptancewhenusingthemshololens2 AT manuelgeuen impactofindustrialnoiseonspeechinteractionperformanceanduseracceptancewhenusingthemshololens2 AT volkerbrautigam impactofindustrialnoiseonspeechinteractionperformanceanduseracceptancewhenusingthemshololens2 AT berndludwig impactofindustrialnoiseonspeechinteractionperformanceanduseracceptancewhenusingthemshololens2 |