FaceSync: Open source framework for recording facial expressions with head-mounted cameras [version 1; peer review: 2 approved]

Advances in computer vision and machine learning algorithms have enabled researchers to extract facial expression data from face video recordings with greater ease and speed than standard manual coding methods, which has led to a dramatic increase in the pace of facial expression research. However,...

Full description

Bibliographic Details
Main Authors: Jin Hyun Cheong, Sawyer Brooks, Luke J. Chang
Format: Article
Language:English
Published: F1000 Research Ltd 2019-05-01
Series:F1000Research
Online Access:https://f1000research.com/articles/8-702/v1
_version_ 1828375622670352384
author Jin Hyun Cheong
Sawyer Brooks
Luke J. Chang
author_facet Jin Hyun Cheong
Sawyer Brooks
Luke J. Chang
author_sort Jin Hyun Cheong
collection DOAJ
description Advances in computer vision and machine learning algorithms have enabled researchers to extract facial expression data from face video recordings with greater ease and speed than standard manual coding methods, which has led to a dramatic increase in the pace of facial expression research. However, there are many limitations in recording facial expressions in laboratory settings.  Conventional video recording setups using webcams, tripod-mounted cameras, or pan-tilt-zoom cameras require making compromises between cost, reliability, and flexibility. As an alternative, we propose the use of a mobile head-mounted camera that can be easily constructed from our open-source instructions and blueprints at a fraction of the cost of conventional setups. The head-mounted camera framework is supported by the open source Python toolbox FaceSync, which provides an automated method for synchronizing videos. We provide four proof-of-concept studies demonstrating the benefits of this recording system in reliably measuring and analyzing facial expressions in diverse experimental setups, including group interaction experiments.
first_indexed 2024-04-14T07:49:04Z
format Article
id doaj.art-a3d2bdffcaed42d3b61290a935ccb745
institution Directory Open Access Journal
issn 2046-1402
language English
last_indexed 2024-04-14T07:49:04Z
publishDate 2019-05-01
publisher F1000 Research Ltd
record_format Article
series F1000Research
spelling doaj.art-a3d2bdffcaed42d3b61290a935ccb7452022-12-22T02:05:14ZengF1000 Research LtdF1000Research2046-14022019-05-01810.12688/f1000research.18187.119894FaceSync: Open source framework for recording facial expressions with head-mounted cameras [version 1; peer review: 2 approved]Jin Hyun Cheong0Sawyer Brooks1Luke J. Chang2Psychological and Brain Sciences, Dartmouth College, Hanover, NH, 03755, USADepartment of Neuroscience, Oberlin College, Oberlin, Ohio, 44074, USAPsychological and Brain Sciences, Dartmouth College, Hanover, NH, 03755, USAAdvances in computer vision and machine learning algorithms have enabled researchers to extract facial expression data from face video recordings with greater ease and speed than standard manual coding methods, which has led to a dramatic increase in the pace of facial expression research. However, there are many limitations in recording facial expressions in laboratory settings.  Conventional video recording setups using webcams, tripod-mounted cameras, or pan-tilt-zoom cameras require making compromises between cost, reliability, and flexibility. As an alternative, we propose the use of a mobile head-mounted camera that can be easily constructed from our open-source instructions and blueprints at a fraction of the cost of conventional setups. The head-mounted camera framework is supported by the open source Python toolbox FaceSync, which provides an automated method for synchronizing videos. We provide four proof-of-concept studies demonstrating the benefits of this recording system in reliably measuring and analyzing facial expressions in diverse experimental setups, including group interaction experiments.https://f1000research.com/articles/8-702/v1
spellingShingle Jin Hyun Cheong
Sawyer Brooks
Luke J. Chang
FaceSync: Open source framework for recording facial expressions with head-mounted cameras [version 1; peer review: 2 approved]
F1000Research
title FaceSync: Open source framework for recording facial expressions with head-mounted cameras [version 1; peer review: 2 approved]
title_full FaceSync: Open source framework for recording facial expressions with head-mounted cameras [version 1; peer review: 2 approved]
title_fullStr FaceSync: Open source framework for recording facial expressions with head-mounted cameras [version 1; peer review: 2 approved]
title_full_unstemmed FaceSync: Open source framework for recording facial expressions with head-mounted cameras [version 1; peer review: 2 approved]
title_short FaceSync: Open source framework for recording facial expressions with head-mounted cameras [version 1; peer review: 2 approved]
title_sort facesync open source framework for recording facial expressions with head mounted cameras version 1 peer review 2 approved
url https://f1000research.com/articles/8-702/v1
work_keys_str_mv AT jinhyuncheong facesyncopensourceframeworkforrecordingfacialexpressionswithheadmountedcamerasversion1peerreview2approved
AT sawyerbrooks facesyncopensourceframeworkforrecordingfacialexpressionswithheadmountedcamerasversion1peerreview2approved
AT lukejchang facesyncopensourceframeworkforrecordingfacialexpressionswithheadmountedcamerasversion1peerreview2approved