3D Space Layout Design of Holographic Command Cabin Information Display in Mixed Reality Environment Based on HoloLens 2

After the command and control information of the command and control cabin is displayed in the form of mixed reality, the large amount of real-time information and static information contained in it will form a dynamic situation that changes all the time. This brings a great burden to the system ope...

Full description

Bibliographic Details
Main Authors: Wei Wang, Xuefeng Hong, Sina Dang, Ning Xu, Jue Qu
Format: Article
Language:English
Published: MDPI AG 2022-07-01
Series:Brain Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3425/12/8/971
_version_ 1797439222187032576
author Wei Wang
Xuefeng Hong
Sina Dang
Ning Xu
Jue Qu
author_facet Wei Wang
Xuefeng Hong
Sina Dang
Ning Xu
Jue Qu
author_sort Wei Wang
collection DOAJ
description After the command and control information of the command and control cabin is displayed in the form of mixed reality, the large amount of real-time information and static information contained in it will form a dynamic situation that changes all the time. This brings a great burden to the system operator’s cognition, decision-making and operation. In order to solve this problem, this paper studies the three-dimensional spatial layout of holographic command cabin information display in a mixed reality environment. A total of 15 people participated in the experiment, of which 10 were the subjects of the experiment and 5 were the staff of the auxiliary experiment. Ten subjects used the HoloLens 2 generation to conduct visual characteristics and cognitive load experiments and collected and analyzed the subjects’ task completion time, error rate, eye movement and EEG and subjective evaluation data. Through the analysis of experimental data, the laws of visual and cognitive features of three-dimensional space in a mixed reality environment can be obtained. This paper systematically explores the effects of three key attributes: depth distance, information layer number and target relative position depth distance of information distribution in a 3D space, on visual search performance and on cognitive load. The experimental results showed that the optimal depth distance range for information display in the mixed reality environment is: the best depth distance for operation interactions (0.6 m~1.0 m), the best depth distance for accurate identification (2.4 m~2.8 m) and the overall situational awareness best-in-class depth distance (3.4 m~3.6 m). Under a certain angle of view, the number of information layers in the space is as small as possible, and the number of information layers should not exceed five at most. The relative position depth distance between the information layers in space ranges from 0.2 m to 0.35 m. Based on this theory, information layout in a 3D space can achieve a faster and more accurate visual search in a mixed reality environment and effectively reduce the cognitive load.
first_indexed 2024-03-09T11:48:36Z
format Article
id doaj.art-9b1317b5296742639bc0d6405dcb0980
institution Directory Open Access Journal
issn 2076-3425
language English
last_indexed 2024-03-09T11:48:36Z
publishDate 2022-07-01
publisher MDPI AG
record_format Article
series Brain Sciences
spelling doaj.art-9b1317b5296742639bc0d6405dcb09802023-11-30T23:17:36ZengMDPI AGBrain Sciences2076-34252022-07-0112897110.3390/brainsci120809713D Space Layout Design of Holographic Command Cabin Information Display in Mixed Reality Environment Based on HoloLens 2Wei Wang0Xuefeng Hong1Sina Dang2Ning Xu3Jue Qu4Air and Missile Defense College, Air Force Engineering University, Xi’an 710051, ChinaAir and Missile Defense College, Air Force Engineering University, Xi’an 710051, ChinaAir and Missile Defense College, Air Force Engineering University, Xi’an 710051, ChinaAir and Missile Defense College, Air Force Engineering University, Xi’an 710051, ChinaAir and Missile Defense College, Air Force Engineering University, Xi’an 710051, ChinaAfter the command and control information of the command and control cabin is displayed in the form of mixed reality, the large amount of real-time information and static information contained in it will form a dynamic situation that changes all the time. This brings a great burden to the system operator’s cognition, decision-making and operation. In order to solve this problem, this paper studies the three-dimensional spatial layout of holographic command cabin information display in a mixed reality environment. A total of 15 people participated in the experiment, of which 10 were the subjects of the experiment and 5 were the staff of the auxiliary experiment. Ten subjects used the HoloLens 2 generation to conduct visual characteristics and cognitive load experiments and collected and analyzed the subjects’ task completion time, error rate, eye movement and EEG and subjective evaluation data. Through the analysis of experimental data, the laws of visual and cognitive features of three-dimensional space in a mixed reality environment can be obtained. This paper systematically explores the effects of three key attributes: depth distance, information layer number and target relative position depth distance of information distribution in a 3D space, on visual search performance and on cognitive load. The experimental results showed that the optimal depth distance range for information display in the mixed reality environment is: the best depth distance for operation interactions (0.6 m~1.0 m), the best depth distance for accurate identification (2.4 m~2.8 m) and the overall situational awareness best-in-class depth distance (3.4 m~3.6 m). Under a certain angle of view, the number of information layers in the space is as small as possible, and the number of information layers should not exceed five at most. The relative position depth distance between the information layers in space ranges from 0.2 m to 0.35 m. Based on this theory, information layout in a 3D space can achieve a faster and more accurate visual search in a mixed reality environment and effectively reduce the cognitive load.https://www.mdpi.com/2076-3425/12/8/971ergonomicsmixed reality3D space layoutvisual featuresEEG
spellingShingle Wei Wang
Xuefeng Hong
Sina Dang
Ning Xu
Jue Qu
3D Space Layout Design of Holographic Command Cabin Information Display in Mixed Reality Environment Based on HoloLens 2
Brain Sciences
ergonomics
mixed reality
3D space layout
visual features
EEG
title 3D Space Layout Design of Holographic Command Cabin Information Display in Mixed Reality Environment Based on HoloLens 2
title_full 3D Space Layout Design of Holographic Command Cabin Information Display in Mixed Reality Environment Based on HoloLens 2
title_fullStr 3D Space Layout Design of Holographic Command Cabin Information Display in Mixed Reality Environment Based on HoloLens 2
title_full_unstemmed 3D Space Layout Design of Holographic Command Cabin Information Display in Mixed Reality Environment Based on HoloLens 2
title_short 3D Space Layout Design of Holographic Command Cabin Information Display in Mixed Reality Environment Based on HoloLens 2
title_sort 3d space layout design of holographic command cabin information display in mixed reality environment based on hololens 2
topic ergonomics
mixed reality
3D space layout
visual features
EEG
url https://www.mdpi.com/2076-3425/12/8/971
work_keys_str_mv AT weiwang 3dspacelayoutdesignofholographiccommandcabininformationdisplayinmixedrealityenvironmentbasedonhololens2
AT xuefenghong 3dspacelayoutdesignofholographiccommandcabininformationdisplayinmixedrealityenvironmentbasedonhololens2
AT sinadang 3dspacelayoutdesignofholographiccommandcabininformationdisplayinmixedrealityenvironmentbasedonhololens2
AT ningxu 3dspacelayoutdesignofholographiccommandcabininformationdisplayinmixedrealityenvironmentbasedonhololens2
AT juequ 3dspacelayoutdesignofholographiccommandcabininformationdisplayinmixedrealityenvironmentbasedonhololens2