Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects
Abstract Facial infra-red imaging (IRI) is a contact-free technique complimenting the traditional psychophysiological measures to characterize physiological profile. However, its full potential in affective research is arguably unmet due to the analytical challenges it poses. Here we acquired facial...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2021-06-01
|
| Series: | Scientific Reports |
| Online Access: | https://doi.org/10.1038/s41598-021-91578-5 |
| _version_ | 1818718704201891840 |
|---|---|
| author | Saurabh Sonkusare Michael Breakspear Tianji Pang Vinh Thai Nguyen Sascha Frydman Christine Cong Guo Matthew J. Aburn |
| author_facet | Saurabh Sonkusare Michael Breakspear Tianji Pang Vinh Thai Nguyen Sascha Frydman Christine Cong Guo Matthew J. Aburn |
| author_sort | Saurabh Sonkusare |
| collection | DOAJ |
| description | Abstract Facial infra-red imaging (IRI) is a contact-free technique complimenting the traditional psychophysiological measures to characterize physiological profile. However, its full potential in affective research is arguably unmet due to the analytical challenges it poses. Here we acquired facial IRI data, facial expressions and traditional physiological recordings (heart rate and skin conductance) from healthy human subjects whilst they viewed a 20-min-long unedited emotional movie. We present a novel application of motion correction and the results of spatial independent component analysis of the thermal data. Three distinct spatial components are recovered associated with the nose, the cheeks and respiration. We first benchmark this methodology against a traditional nose-tip region-of-interest based technique showing an expected similarity of signals extracted by these methods. We then show significant correlation of all the physiological responses across subjects, including the thermal signals, suggesting common dynamic shifts in emotional state induced by the movie. In sum, this study introduces an innovative approach to analyse facial IRI data and highlights the potential of thermal imaging to robustly capture emotion-related changes induced by ecological stimuli. |
| first_indexed | 2024-12-17T19:55:16Z |
| format | Article |
| id | doaj.art-82f0b2c375ca459fa9ad58d3a446054b |
| institution | Directory Open Access Journal |
| issn | 2045-2322 |
| language | English |
| last_indexed | 2024-12-17T19:55:16Z |
| publishDate | 2021-06-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Scientific Reports |
| spelling | doaj.art-82f0b2c375ca459fa9ad58d3a446054b2022-12-21T21:34:37ZengNature PortfolioScientific Reports2045-23222021-06-0111111210.1038/s41598-021-91578-5Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjectsSaurabh Sonkusare0Michael Breakspear1Tianji Pang2Vinh Thai Nguyen3Sascha Frydman4Christine Cong Guo5Matthew J. Aburn6QIMR Berghofer Medical Research InstituteQIMR Berghofer Medical Research InstituteQIMR Berghofer Medical Research InstituteQIMR Berghofer Medical Research InstituteQIMR Berghofer Medical Research InstituteQIMR Berghofer Medical Research InstituteQIMR Berghofer Medical Research InstituteAbstract Facial infra-red imaging (IRI) is a contact-free technique complimenting the traditional psychophysiological measures to characterize physiological profile. However, its full potential in affective research is arguably unmet due to the analytical challenges it poses. Here we acquired facial IRI data, facial expressions and traditional physiological recordings (heart rate and skin conductance) from healthy human subjects whilst they viewed a 20-min-long unedited emotional movie. We present a novel application of motion correction and the results of spatial independent component analysis of the thermal data. Three distinct spatial components are recovered associated with the nose, the cheeks and respiration. We first benchmark this methodology against a traditional nose-tip region-of-interest based technique showing an expected similarity of signals extracted by these methods. We then show significant correlation of all the physiological responses across subjects, including the thermal signals, suggesting common dynamic shifts in emotional state induced by the movie. In sum, this study introduces an innovative approach to analyse facial IRI data and highlights the potential of thermal imaging to robustly capture emotion-related changes induced by ecological stimuli.https://doi.org/10.1038/s41598-021-91578-5 |
| spellingShingle | Saurabh Sonkusare Michael Breakspear Tianji Pang Vinh Thai Nguyen Sascha Frydman Christine Cong Guo Matthew J. Aburn Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects Scientific Reports |
| title | Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects |
| title_full | Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects |
| title_fullStr | Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects |
| title_full_unstemmed | Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects |
| title_short | Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects |
| title_sort | data driven analysis of facial thermal responses and multimodal physiological consistency among subjects |
| url | https://doi.org/10.1038/s41598-021-91578-5 |
| work_keys_str_mv | AT saurabhsonkusare datadrivenanalysisoffacialthermalresponsesandmultimodalphysiologicalconsistencyamongsubjects AT michaelbreakspear datadrivenanalysisoffacialthermalresponsesandmultimodalphysiologicalconsistencyamongsubjects AT tianjipang datadrivenanalysisoffacialthermalresponsesandmultimodalphysiologicalconsistencyamongsubjects AT vinhthainguyen datadrivenanalysisoffacialthermalresponsesandmultimodalphysiologicalconsistencyamongsubjects AT saschafrydman datadrivenanalysisoffacialthermalresponsesandmultimodalphysiologicalconsistencyamongsubjects AT christinecongguo datadrivenanalysisoffacialthermalresponsesandmultimodalphysiologicalconsistencyamongsubjects AT matthewjaburn datadrivenanalysisoffacialthermalresponsesandmultimodalphysiologicalconsistencyamongsubjects |