Quantifying dynamic facial expressions under naturalistic conditions

Facial affect is expressed dynamically – a giggle, grimace, or an agitated frown. However, the characterisation of human affect has relied almost exclusively on static images. This approach cannot capture the nuances of human communication or support the naturalistic assessment of affective disorder...

Full description

Bibliographic Details
Main Authors: Jayson Jeganathan, Megan Campbell, Matthew Hyett, Gordon Parker, Michael Breakspear
Format: Article
Language:English
Published: eLife Sciences Publications Ltd 2022-08-01
Series:eLife
Subjects:
Online Access:https://elifesciences.org/articles/79581
Description
Summary:Facial affect is expressed dynamically – a giggle, grimace, or an agitated frown. However, the characterisation of human affect has relied almost exclusively on static images. This approach cannot capture the nuances of human communication or support the naturalistic assessment of affective disorders. Using the latest in machine vision and systems modelling, we studied dynamic facial expressions of people viewing emotionally salient film clips. We found that the apparent complexity of dynamic facial expressions can be captured by a small number of simple spatiotemporal states – composites of distinct facial actions, each expressed with a unique spectral fingerprint. Sequential expression of these states is common across individuals viewing the same film stimuli but varies in those with the melancholic subtype of major depressive disorder. This approach provides a platform for translational research, capturing dynamic facial expressions under naturalistic conditions and enabling new quantitative tools for the study of affective disorders and related mental illnesses.
ISSN:2050-084X