A Review of the Use of Gaze and Pupil Metrics to Assess Mental Workload in Gamified and Simulated Sensorimotor Tasks

Gaze and pupil metrics are used to represent higher cognitive processes in a variety of contexts. One growing area of research is the real-time assessment of workload and corresponding effort in gamified or simulated cognitive and motor tasks, which will be reviewed in this paper. While some measure...

Full description

Bibliographic Details
Main Authors: Holly Gorin, Jigna Patel, Qinyin Qiu, Alma Merians, Sergei Adamovich, Gerard Fluet
Format: Article
Language:English
Published: MDPI AG 2024-03-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/24/6/1759
_version_ 1797239361781104640
author Holly Gorin
Jigna Patel
Qinyin Qiu
Alma Merians
Sergei Adamovich
Gerard Fluet
author_facet Holly Gorin
Jigna Patel
Qinyin Qiu
Alma Merians
Sergei Adamovich
Gerard Fluet
author_sort Holly Gorin
collection DOAJ
description Gaze and pupil metrics are used to represent higher cognitive processes in a variety of contexts. One growing area of research is the real-time assessment of workload and corresponding effort in gamified or simulated cognitive and motor tasks, which will be reviewed in this paper. While some measurements are consistent across studies, others vary and are likely dependent on the nature of the effort required by the task and the resulting changes in arousal. Pupil diameter is shown to consistently increase with task effort and arousal; however, the valence of arousal must be considered. In many cases, measures of pupil diameter were sensitive to both excessive and insufficient challenge. Overall, it is evident that gaze and pupil metrics are valuable to assess the cognitive state during gamified and simulated tasks, and further research is indicated regarding their use in clinical populations in rehabilitation to inform optimally engaging interventions.
first_indexed 2024-04-24T17:50:19Z
format Article
id doaj.art-3834042d3266404fb0f391a2ef296dca
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-04-24T17:50:19Z
publishDate 2024-03-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-3834042d3266404fb0f391a2ef296dca2024-03-27T14:03:41ZengMDPI AGSensors1424-82202024-03-01246175910.3390/s24061759A Review of the Use of Gaze and Pupil Metrics to Assess Mental Workload in Gamified and Simulated Sensorimotor TasksHolly Gorin0Jigna Patel1Qinyin Qiu2Alma Merians3Sergei Adamovich4Gerard Fluet5Rehabilitation and Movement Sciences Department, Rutgers School of Health Professions, Newark, NJ 07107, USARehabilitation and Movement Sciences Department, Rutgers School of Health Professions, Newark, NJ 07107, USARehabilitation and Movement Sciences Department, Rutgers School of Health Professions, Newark, NJ 07107, USARehabilitation and Movement Sciences Department, Rutgers School of Health Professions, Newark, NJ 07107, USARehabilitation and Movement Sciences Department, Rutgers School of Health Professions, Newark, NJ 07107, USARehabilitation and Movement Sciences Department, Rutgers School of Health Professions, Newark, NJ 07107, USAGaze and pupil metrics are used to represent higher cognitive processes in a variety of contexts. One growing area of research is the real-time assessment of workload and corresponding effort in gamified or simulated cognitive and motor tasks, which will be reviewed in this paper. While some measurements are consistent across studies, others vary and are likely dependent on the nature of the effort required by the task and the resulting changes in arousal. Pupil diameter is shown to consistently increase with task effort and arousal; however, the valence of arousal must be considered. In many cases, measures of pupil diameter were sensitive to both excessive and insufficient challenge. Overall, it is evident that gaze and pupil metrics are valuable to assess the cognitive state during gamified and simulated tasks, and further research is indicated regarding their use in clinical populations in rehabilitation to inform optimally engaging interventions.https://www.mdpi.com/1424-8220/24/6/1759cognitive workloadcognitive effortoculometricspupillometry
spellingShingle Holly Gorin
Jigna Patel
Qinyin Qiu
Alma Merians
Sergei Adamovich
Gerard Fluet
A Review of the Use of Gaze and Pupil Metrics to Assess Mental Workload in Gamified and Simulated Sensorimotor Tasks
Sensors
cognitive workload
cognitive effort
oculometrics
pupillometry
title A Review of the Use of Gaze and Pupil Metrics to Assess Mental Workload in Gamified and Simulated Sensorimotor Tasks
title_full A Review of the Use of Gaze and Pupil Metrics to Assess Mental Workload in Gamified and Simulated Sensorimotor Tasks
title_fullStr A Review of the Use of Gaze and Pupil Metrics to Assess Mental Workload in Gamified and Simulated Sensorimotor Tasks
title_full_unstemmed A Review of the Use of Gaze and Pupil Metrics to Assess Mental Workload in Gamified and Simulated Sensorimotor Tasks
title_short A Review of the Use of Gaze and Pupil Metrics to Assess Mental Workload in Gamified and Simulated Sensorimotor Tasks
title_sort review of the use of gaze and pupil metrics to assess mental workload in gamified and simulated sensorimotor tasks
topic cognitive workload
cognitive effort
oculometrics
pupillometry
url https://www.mdpi.com/1424-8220/24/6/1759
work_keys_str_mv AT hollygorin areviewoftheuseofgazeandpupilmetricstoassessmentalworkloadingamifiedandsimulatedsensorimotortasks
AT jignapatel areviewoftheuseofgazeandpupilmetricstoassessmentalworkloadingamifiedandsimulatedsensorimotortasks
AT qinyinqiu areviewoftheuseofgazeandpupilmetricstoassessmentalworkloadingamifiedandsimulatedsensorimotortasks
AT almamerians areviewoftheuseofgazeandpupilmetricstoassessmentalworkloadingamifiedandsimulatedsensorimotortasks
AT sergeiadamovich areviewoftheuseofgazeandpupilmetricstoassessmentalworkloadingamifiedandsimulatedsensorimotortasks
AT gerardfluet areviewoftheuseofgazeandpupilmetricstoassessmentalworkloadingamifiedandsimulatedsensorimotortasks
AT hollygorin reviewoftheuseofgazeandpupilmetricstoassessmentalworkloadingamifiedandsimulatedsensorimotortasks
AT jignapatel reviewoftheuseofgazeandpupilmetricstoassessmentalworkloadingamifiedandsimulatedsensorimotortasks
AT qinyinqiu reviewoftheuseofgazeandpupilmetricstoassessmentalworkloadingamifiedandsimulatedsensorimotortasks
AT almamerians reviewoftheuseofgazeandpupilmetricstoassessmentalworkloadingamifiedandsimulatedsensorimotortasks
AT sergeiadamovich reviewoftheuseofgazeandpupilmetricstoassessmentalworkloadingamifiedandsimulatedsensorimotortasks
AT gerardfluet reviewoftheuseofgazeandpupilmetricstoassessmentalworkloadingamifiedandsimulatedsensorimotortasks