FaceSync: Open source framework for recording facial expressions with head-mounted cameras [version 1; peer review: 2 approved]
Advances in computer vision and machine learning algorithms have enabled researchers to extract facial expression data from face video recordings with greater ease and speed than standard manual coding methods, which has led to a dramatic increase in the pace of facial expression research. However,...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
F1000 Research Ltd
2019-05-01
|
Series: | F1000Research |
Online Access: | https://f1000research.com/articles/8-702/v1 |
_version_ | 1828375622670352384 |
---|---|
author | Jin Hyun Cheong Sawyer Brooks Luke J. Chang |
author_facet | Jin Hyun Cheong Sawyer Brooks Luke J. Chang |
author_sort | Jin Hyun Cheong |
collection | DOAJ |
description | Advances in computer vision and machine learning algorithms have enabled researchers to extract facial expression data from face video recordings with greater ease and speed than standard manual coding methods, which has led to a dramatic increase in the pace of facial expression research. However, there are many limitations in recording facial expressions in laboratory settings. Conventional video recording setups using webcams, tripod-mounted cameras, or pan-tilt-zoom cameras require making compromises between cost, reliability, and flexibility. As an alternative, we propose the use of a mobile head-mounted camera that can be easily constructed from our open-source instructions and blueprints at a fraction of the cost of conventional setups. The head-mounted camera framework is supported by the open source Python toolbox FaceSync, which provides an automated method for synchronizing videos. We provide four proof-of-concept studies demonstrating the benefits of this recording system in reliably measuring and analyzing facial expressions in diverse experimental setups, including group interaction experiments. |
first_indexed | 2024-04-14T07:49:04Z |
format | Article |
id | doaj.art-a3d2bdffcaed42d3b61290a935ccb745 |
institution | Directory Open Access Journal |
issn | 2046-1402 |
language | English |
last_indexed | 2024-04-14T07:49:04Z |
publishDate | 2019-05-01 |
publisher | F1000 Research Ltd |
record_format | Article |
series | F1000Research |
spelling | doaj.art-a3d2bdffcaed42d3b61290a935ccb7452022-12-22T02:05:14ZengF1000 Research LtdF1000Research2046-14022019-05-01810.12688/f1000research.18187.119894FaceSync: Open source framework for recording facial expressions with head-mounted cameras [version 1; peer review: 2 approved]Jin Hyun Cheong0Sawyer Brooks1Luke J. Chang2Psychological and Brain Sciences, Dartmouth College, Hanover, NH, 03755, USADepartment of Neuroscience, Oberlin College, Oberlin, Ohio, 44074, USAPsychological and Brain Sciences, Dartmouth College, Hanover, NH, 03755, USAAdvances in computer vision and machine learning algorithms have enabled researchers to extract facial expression data from face video recordings with greater ease and speed than standard manual coding methods, which has led to a dramatic increase in the pace of facial expression research. However, there are many limitations in recording facial expressions in laboratory settings. Conventional video recording setups using webcams, tripod-mounted cameras, or pan-tilt-zoom cameras require making compromises between cost, reliability, and flexibility. As an alternative, we propose the use of a mobile head-mounted camera that can be easily constructed from our open-source instructions and blueprints at a fraction of the cost of conventional setups. The head-mounted camera framework is supported by the open source Python toolbox FaceSync, which provides an automated method for synchronizing videos. We provide four proof-of-concept studies demonstrating the benefits of this recording system in reliably measuring and analyzing facial expressions in diverse experimental setups, including group interaction experiments.https://f1000research.com/articles/8-702/v1 |
spellingShingle | Jin Hyun Cheong Sawyer Brooks Luke J. Chang FaceSync: Open source framework for recording facial expressions with head-mounted cameras [version 1; peer review: 2 approved] F1000Research |
title | FaceSync: Open source framework for recording facial expressions with head-mounted cameras [version 1; peer review: 2 approved] |
title_full | FaceSync: Open source framework for recording facial expressions with head-mounted cameras [version 1; peer review: 2 approved] |
title_fullStr | FaceSync: Open source framework for recording facial expressions with head-mounted cameras [version 1; peer review: 2 approved] |
title_full_unstemmed | FaceSync: Open source framework for recording facial expressions with head-mounted cameras [version 1; peer review: 2 approved] |
title_short | FaceSync: Open source framework for recording facial expressions with head-mounted cameras [version 1; peer review: 2 approved] |
title_sort | facesync open source framework for recording facial expressions with head mounted cameras version 1 peer review 2 approved |
url | https://f1000research.com/articles/8-702/v1 |
work_keys_str_mv | AT jinhyuncheong facesyncopensourceframeworkforrecordingfacialexpressionswithheadmountedcamerasversion1peerreview2approved AT sawyerbrooks facesyncopensourceframeworkforrecordingfacialexpressionswithheadmountedcamerasversion1peerreview2approved AT lukejchang facesyncopensourceframeworkforrecordingfacialexpressionswithheadmountedcamerasversion1peerreview2approved |