Analyzing Visual Attention of People with Intellectual Disabilities during Virtual Reality-Based Job Training

Virtual reality (VR) has proven an effective means of job training for people with intellectual disabilities who may experience difficulties in learning. However, it is unlikely for them to successfully complete a certain task using only VR-based job training contents without receiving supplemental...

Full description

Bibliographic Details
Main Authors: Sungjin Hong, Heesook Shin, Younhee Gil, Junghee Jo
Format: Article
Language:English
Published: MDPI AG 2021-07-01
Series:Electronics
Subjects:
Online Access:https://www.mdpi.com/2079-9292/10/14/1652
_version_ 1797527302702104576
author Sungjin Hong
Heesook Shin
Younhee Gil
Junghee Jo
author_facet Sungjin Hong
Heesook Shin
Younhee Gil
Junghee Jo
author_sort Sungjin Hong
collection DOAJ
description Virtual reality (VR) has proven an effective means of job training for people with intellectual disabilities who may experience difficulties in learning. However, it is unlikely for them to successfully complete a certain task using only VR-based job training contents without receiving supplemental help from others. Accordingly, to increase the effectiveness of virtual job training for people with intellectual disabilities in training situations in which they may experience difficulty and become unable to proceed further, the contents of the training program need to automatically identify such moments and provide support so that they may correctly perform the task. To identity the moment of intervention, we conducted an experiment (<i>n</i> = 21) to collect eye tracking data of people with intellectual disabilities while performing VR-based barista training. We measured eye scanning patterns to identify any difference between people with intellectual disabilities who complete a given step independently and those who request intervention. We found that the information about the types of fixated objects did not help to identify any difference, but the information about eye transition, eye movements between two different areas of interest, was useful in identifying the difference. Our findings provide implications for identifying the moment of intervention for people with intellectual disabilities.
first_indexed 2024-03-10T09:41:01Z
format Article
id doaj.art-4c6ecd64839f43ad92300932ec1b7106
institution Directory Open Access Journal
issn 2079-9292
language English
last_indexed 2024-03-10T09:41:01Z
publishDate 2021-07-01
publisher MDPI AG
record_format Article
series Electronics
spelling doaj.art-4c6ecd64839f43ad92300932ec1b71062023-11-22T03:37:53ZengMDPI AGElectronics2079-92922021-07-011014165210.3390/electronics10141652Analyzing Visual Attention of People with Intellectual Disabilities during Virtual Reality-Based Job TrainingSungjin Hong0Heesook Shin1Younhee Gil2Junghee Jo3Intelligent Knowledge Content Research Section, Communication & Media Research Laboratory, Electronics and Telecommunications Research Institute, Daejeon 34129, KoreaIntelligent Knowledge Content Research Section, Communication & Media Research Laboratory, Electronics and Telecommunications Research Institute, Daejeon 34129, KoreaIntelligent Knowledge Content Research Section, Communication & Media Research Laboratory, Electronics and Telecommunications Research Institute, Daejeon 34129, KoreaDepartment of Computer Education, Busan National University of Education, Busan 47503, KoreaVirtual reality (VR) has proven an effective means of job training for people with intellectual disabilities who may experience difficulties in learning. However, it is unlikely for them to successfully complete a certain task using only VR-based job training contents without receiving supplemental help from others. Accordingly, to increase the effectiveness of virtual job training for people with intellectual disabilities in training situations in which they may experience difficulty and become unable to proceed further, the contents of the training program need to automatically identify such moments and provide support so that they may correctly perform the task. To identity the moment of intervention, we conducted an experiment (<i>n</i> = 21) to collect eye tracking data of people with intellectual disabilities while performing VR-based barista training. We measured eye scanning patterns to identify any difference between people with intellectual disabilities who complete a given step independently and those who request intervention. We found that the information about the types of fixated objects did not help to identify any difference, but the information about eye transition, eye movements between two different areas of interest, was useful in identifying the difference. Our findings provide implications for identifying the moment of intervention for people with intellectual disabilities.https://www.mdpi.com/2079-9292/10/14/1652virtual realityintellectual disabilitiesbehavior analysisvisualizationjob trainingeye tracking
spellingShingle Sungjin Hong
Heesook Shin
Younhee Gil
Junghee Jo
Analyzing Visual Attention of People with Intellectual Disabilities during Virtual Reality-Based Job Training
Electronics
virtual reality
intellectual disabilities
behavior analysis
visualization
job training
eye tracking
title Analyzing Visual Attention of People with Intellectual Disabilities during Virtual Reality-Based Job Training
title_full Analyzing Visual Attention of People with Intellectual Disabilities during Virtual Reality-Based Job Training
title_fullStr Analyzing Visual Attention of People with Intellectual Disabilities during Virtual Reality-Based Job Training
title_full_unstemmed Analyzing Visual Attention of People with Intellectual Disabilities during Virtual Reality-Based Job Training
title_short Analyzing Visual Attention of People with Intellectual Disabilities during Virtual Reality-Based Job Training
title_sort analyzing visual attention of people with intellectual disabilities during virtual reality based job training
topic virtual reality
intellectual disabilities
behavior analysis
visualization
job training
eye tracking
url https://www.mdpi.com/2079-9292/10/14/1652
work_keys_str_mv AT sungjinhong analyzingvisualattentionofpeoplewithintellectualdisabilitiesduringvirtualrealitybasedjobtraining
AT heesookshin analyzingvisualattentionofpeoplewithintellectualdisabilitiesduringvirtualrealitybasedjobtraining
AT younheegil analyzingvisualattentionofpeoplewithintellectualdisabilitiesduringvirtualrealitybasedjobtraining
AT jungheejo analyzingvisualattentionofpeoplewithintellectualdisabilitiesduringvirtualrealitybasedjobtraining