Evaluation of the Correlation between Gaze Avoidance and Schizophrenia Psychopathology with Deep Learning-based Emotional Recognition

Introduction Direct gaze is the most important mediator of social interaction and communication. Existing studies have evaluated eye movements of patients with schizophrenia by presenting stimuli using photographs or pre-recorded videos, but few directly investigated gaze avoidance in real-world si...

Full description

Bibliographic Details
Main Authors: H.S. Choi, D.-U. Jung, D.-W. Jeon, S.-J. Kim, J.-J. Moon
Format: Article
Language:English
Published: Cambridge University Press 2022-06-01
Series:European Psychiatry
Subjects:
Online Access:https://www.cambridge.org/core/product/identifier/S0924933822008033/type/journal_article
_version_ 1827754462333108224
author H.S. Choi
D.-U. Jung
D.-W. Jeon
S.-J. Kim
J.-J. Moon
author_facet H.S. Choi
D.-U. Jung
D.-W. Jeon
S.-J. Kim
J.-J. Moon
author_sort H.S. Choi
collection DOAJ
description Introduction Direct gaze is the most important mediator of social interaction and communication. Existing studies have evaluated eye movements of patients with schizophrenia by presenting stimuli using photographs or pre-recorded videos, but few directly investigated gaze avoidance in real-world situations. Objectives To investigate the correlation between gaze avoidance and psychopathology in patients with schizophrenia through eye movement measurements in real-life interpersonal situations. Methods We enrolled 52 clinically stable patients with schizophrenia. Psychopathology was evaluated using the Positive and Negative Syndrome Scale (PANSS), Hamilton Depression Rating Scale, and Hamilton Anxiety Rating Scale. After presenting a visual stimulus, eye movements were measured with Tobii Pro Wearable Glasses 2, and deep learning-based emotional recognition using the residual masking network was used for neutral stimulus verification. Statistical analyses were performed using Pearson’s correlation and regression analyses. Results Data of 45 participants with verified stimulus neutrality by deep learning image recognition were used for analysis. The first dwelling time was negatively correlated with the PANSS positive syndrome subscale (p=0.028), general psychopathology subscale (p=0.008), total score (p=0.008), 5-factor positive symptoms (p=0.035), and 5-factor depression/anxiety symptoms (p=0.008). The baseline-area of interest (AOI) pupil diameter change was positively correlated with PANSS 5-factor positive symptom scores (p=0.039). After adjusting for additional variables, the same items had a significant effect on the first dwelling time and baseline-AOI pupil diameter change. Conclusions Psychopathology, particularly positive symptoms, was associated with gaze avoidance and pupil diameter in patients with schizophrenia. Evaluating the characteristics of eye movements in patients with schizophrenia will enable better understanding of their symptoms. Disclosure No significant relationships.
first_indexed 2024-03-11T07:49:28Z
format Article
id doaj.art-929f747b9acb40f9acfda5980427c881
institution Directory Open Access Journal
issn 0924-9338
1778-3585
language English
last_indexed 2024-03-11T07:49:28Z
publishDate 2022-06-01
publisher Cambridge University Press
record_format Article
series European Psychiatry
spelling doaj.art-929f747b9acb40f9acfda5980427c8812023-11-17T05:06:58ZengCambridge University PressEuropean Psychiatry0924-93381778-35852022-06-0165S315S31510.1192/j.eurpsy.2022.803Evaluation of the Correlation between Gaze Avoidance and Schizophrenia Psychopathology with Deep Learning-based Emotional RecognitionH.S. Choi0D.-U. Jung1D.-W. Jeon2S.-J. Kim3J.-J. Moon4Inje University Busan Paik Hospital, Psychiatry, Busan, Korea, Republic ofInje University Busan Paik Hospital, Psychiatry, Busan, Korea, Republic ofInje University Busan Paik Hospital, Psychiatry, Busan, Korea, Republic ofInje University Busan Paik Hospital, Psychiatry, Busan, Korea, Republic ofInje University Busan Paik Hospital, Psychiatry, Busan, Korea, Republic of Introduction Direct gaze is the most important mediator of social interaction and communication. Existing studies have evaluated eye movements of patients with schizophrenia by presenting stimuli using photographs or pre-recorded videos, but few directly investigated gaze avoidance in real-world situations. Objectives To investigate the correlation between gaze avoidance and psychopathology in patients with schizophrenia through eye movement measurements in real-life interpersonal situations. Methods We enrolled 52 clinically stable patients with schizophrenia. Psychopathology was evaluated using the Positive and Negative Syndrome Scale (PANSS), Hamilton Depression Rating Scale, and Hamilton Anxiety Rating Scale. After presenting a visual stimulus, eye movements were measured with Tobii Pro Wearable Glasses 2, and deep learning-based emotional recognition using the residual masking network was used for neutral stimulus verification. Statistical analyses were performed using Pearson’s correlation and regression analyses. Results Data of 45 participants with verified stimulus neutrality by deep learning image recognition were used for analysis. The first dwelling time was negatively correlated with the PANSS positive syndrome subscale (p=0.028), general psychopathology subscale (p=0.008), total score (p=0.008), 5-factor positive symptoms (p=0.035), and 5-factor depression/anxiety symptoms (p=0.008). The baseline-area of interest (AOI) pupil diameter change was positively correlated with PANSS 5-factor positive symptom scores (p=0.039). After adjusting for additional variables, the same items had a significant effect on the first dwelling time and baseline-AOI pupil diameter change. Conclusions Psychopathology, particularly positive symptoms, was associated with gaze avoidance and pupil diameter in patients with schizophrenia. Evaluating the characteristics of eye movements in patients with schizophrenia will enable better understanding of their symptoms. Disclosure No significant relationships. https://www.cambridge.org/core/product/identifier/S0924933822008033/type/journal_articlePsychopathologyeye trackingschizophréniagaze avoidance
spellingShingle H.S. Choi
D.-U. Jung
D.-W. Jeon
S.-J. Kim
J.-J. Moon
Evaluation of the Correlation between Gaze Avoidance and Schizophrenia Psychopathology with Deep Learning-based Emotional Recognition
European Psychiatry
Psychopathology
eye tracking
schizophrénia
gaze avoidance
title Evaluation of the Correlation between Gaze Avoidance and Schizophrenia Psychopathology with Deep Learning-based Emotional Recognition
title_full Evaluation of the Correlation between Gaze Avoidance and Schizophrenia Psychopathology with Deep Learning-based Emotional Recognition
title_fullStr Evaluation of the Correlation between Gaze Avoidance and Schizophrenia Psychopathology with Deep Learning-based Emotional Recognition
title_full_unstemmed Evaluation of the Correlation between Gaze Avoidance and Schizophrenia Psychopathology with Deep Learning-based Emotional Recognition
title_short Evaluation of the Correlation between Gaze Avoidance and Schizophrenia Psychopathology with Deep Learning-based Emotional Recognition
title_sort evaluation of the correlation between gaze avoidance and schizophrenia psychopathology with deep learning based emotional recognition
topic Psychopathology
eye tracking
schizophrénia
gaze avoidance
url https://www.cambridge.org/core/product/identifier/S0924933822008033/type/journal_article
work_keys_str_mv AT hschoi evaluationofthecorrelationbetweengazeavoidanceandschizophreniapsychopathologywithdeeplearningbasedemotionalrecognition
AT dujung evaluationofthecorrelationbetweengazeavoidanceandschizophreniapsychopathologywithdeeplearningbasedemotionalrecognition
AT dwjeon evaluationofthecorrelationbetweengazeavoidanceandschizophreniapsychopathologywithdeeplearningbasedemotionalrecognition
AT sjkim evaluationofthecorrelationbetweengazeavoidanceandschizophreniapsychopathologywithdeeplearningbasedemotionalrecognition
AT jjmoon evaluationofthecorrelationbetweengazeavoidanceandschizophreniapsychopathologywithdeeplearningbasedemotionalrecognition