Building a decoder of perceptual decisions from microsaccades and pupil size

Many studies have reported neural correlates of visual awareness across several brain regions, including the sensory, parietal, and frontal areas. In most of these studies, participants were instructed to explicitly report their perceptual experience through a button press or verbal report. It is co...

Full description

Bibliographic Details
Main Authors: Ryohei Nakayama, Jean-Baptiste Bardin, Ai Koizumi, Isamu Motoyoshi, Kaoru Amano
Format: Article
Language:English
Published: Frontiers Media S.A. 2022-09-01
Series:Frontiers in Psychology
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fpsyg.2022.942859/full
_version_ 1828147959627251712
author Ryohei Nakayama
Ryohei Nakayama
Jean-Baptiste Bardin
Jean-Baptiste Bardin
Ai Koizumi
Ai Koizumi
Isamu Motoyoshi
Kaoru Amano
Kaoru Amano
author_facet Ryohei Nakayama
Ryohei Nakayama
Jean-Baptiste Bardin
Jean-Baptiste Bardin
Ai Koizumi
Ai Koizumi
Isamu Motoyoshi
Kaoru Amano
Kaoru Amano
author_sort Ryohei Nakayama
collection DOAJ
description Many studies have reported neural correlates of visual awareness across several brain regions, including the sensory, parietal, and frontal areas. In most of these studies, participants were instructed to explicitly report their perceptual experience through a button press or verbal report. It is conceivable, however, that explicit reporting itself may trigger specific neural responses that can confound the direct examination of the neural correlates of visual awareness. This suggests the need to assess visual awareness without explicit reporting. One way to achieve this is to develop a technique to predict the visual awareness of participants based on their peripheral responses. Here, we used eye movements and pupil sizes to decode trial-by-trial changes in the awareness of a stimulus whose visibility was deteriorated due to adaptation-induced blindness (AIB). In the experiment, participants judged whether they perceived a target stimulus and rated the confidence they had in their perceptual judgment, while their eye movements and pupil sizes were recorded. We found that not only perceptual decision but also perceptual confidence can be separately decoded from the eye movement and pupil size. We discuss the potential of this technique with regard to assessing visual awareness in future neuroimaging experiments.
first_indexed 2024-04-11T21:08:00Z
format Article
id doaj.art-8848665bb8c34490983f2f9ccc8cfbb5
institution Directory Open Access Journal
issn 1664-1078
language English
last_indexed 2024-04-11T21:08:00Z
publishDate 2022-09-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Psychology
spelling doaj.art-8848665bb8c34490983f2f9ccc8cfbb52022-12-22T04:03:11ZengFrontiers Media S.A.Frontiers in Psychology1664-10782022-09-011310.3389/fpsyg.2022.942859942859Building a decoder of perceptual decisions from microsaccades and pupil sizeRyohei Nakayama0Ryohei Nakayama1Jean-Baptiste Bardin2Jean-Baptiste Bardin3Ai Koizumi4Ai Koizumi5Isamu Motoyoshi6Kaoru Amano7Kaoru Amano8Department of Psychology, The University of Tokyo, Tokyo, JapanCenter for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology, Osaka, JapanCenter for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology, Osaka, JapanÉcole Polytechnique Fédérale de Lausanne, Lausanne, SwitzerlandCenter for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology, Osaka, JapanSony Computer Science Laboratories, Inc., Tokyo, JapanDepartment of Life Sciences, The University of Tokyo, Tokyo, JapanCenter for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology, Osaka, JapanGraduate School of Information Science and Technology, The University of Tokyo, Tokyo, JapanMany studies have reported neural correlates of visual awareness across several brain regions, including the sensory, parietal, and frontal areas. In most of these studies, participants were instructed to explicitly report their perceptual experience through a button press or verbal report. It is conceivable, however, that explicit reporting itself may trigger specific neural responses that can confound the direct examination of the neural correlates of visual awareness. This suggests the need to assess visual awareness without explicit reporting. One way to achieve this is to develop a technique to predict the visual awareness of participants based on their peripheral responses. Here, we used eye movements and pupil sizes to decode trial-by-trial changes in the awareness of a stimulus whose visibility was deteriorated due to adaptation-induced blindness (AIB). In the experiment, participants judged whether they perceived a target stimulus and rated the confidence they had in their perceptual judgment, while their eye movements and pupil sizes were recorded. We found that not only perceptual decision but also perceptual confidence can be separately decoded from the eye movement and pupil size. We discuss the potential of this technique with regard to assessing visual awareness in future neuroimaging experiments.https://www.frontiersin.org/articles/10.3389/fpsyg.2022.942859/fullvisual awarenessadaptation-induced blindnessclassifiermicrosaccadepupil size
spellingShingle Ryohei Nakayama
Ryohei Nakayama
Jean-Baptiste Bardin
Jean-Baptiste Bardin
Ai Koizumi
Ai Koizumi
Isamu Motoyoshi
Kaoru Amano
Kaoru Amano
Building a decoder of perceptual decisions from microsaccades and pupil size
Frontiers in Psychology
visual awareness
adaptation-induced blindness
classifier
microsaccade
pupil size
title Building a decoder of perceptual decisions from microsaccades and pupil size
title_full Building a decoder of perceptual decisions from microsaccades and pupil size
title_fullStr Building a decoder of perceptual decisions from microsaccades and pupil size
title_full_unstemmed Building a decoder of perceptual decisions from microsaccades and pupil size
title_short Building a decoder of perceptual decisions from microsaccades and pupil size
title_sort building a decoder of perceptual decisions from microsaccades and pupil size
topic visual awareness
adaptation-induced blindness
classifier
microsaccade
pupil size
url https://www.frontiersin.org/articles/10.3389/fpsyg.2022.942859/full
work_keys_str_mv AT ryoheinakayama buildingadecoderofperceptualdecisionsfrommicrosaccadesandpupilsize
AT ryoheinakayama buildingadecoderofperceptualdecisionsfrommicrosaccadesandpupilsize
AT jeanbaptistebardin buildingadecoderofperceptualdecisionsfrommicrosaccadesandpupilsize
AT jeanbaptistebardin buildingadecoderofperceptualdecisionsfrommicrosaccadesandpupilsize
AT aikoizumi buildingadecoderofperceptualdecisionsfrommicrosaccadesandpupilsize
AT aikoizumi buildingadecoderofperceptualdecisionsfrommicrosaccadesandpupilsize
AT isamumotoyoshi buildingadecoderofperceptualdecisionsfrommicrosaccadesandpupilsize
AT kaoruamano buildingadecoderofperceptualdecisionsfrommicrosaccadesandpupilsize
AT kaoruamano buildingadecoderofperceptualdecisionsfrommicrosaccadesandpupilsize