Thermal Infrared Imaging-Based Affective Computing and Its Application to Facilitate Human Robot Interaction: A Review

Over recent years, robots are increasingly being employed in several aspects of modern society. Among others, social robots have the potential to benefit education, healthcare, and tourism. To achieve this purpose, robots should be able to engage humans, recognize users’ emotions, and to some extent...

Full description

Bibliographic Details
Main Authors: Chiara Filippini, David Perpetuini, Daniela Cardone, Antonio Maria Chiarelli, Arcangelo Merla
Format: Article
Language:English
Published: MDPI AG 2020-04-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/10/8/2924
_version_ 1827718093863911424
author Chiara Filippini
David Perpetuini
Daniela Cardone
Antonio Maria Chiarelli
Arcangelo Merla
author_facet Chiara Filippini
David Perpetuini
Daniela Cardone
Antonio Maria Chiarelli
Arcangelo Merla
author_sort Chiara Filippini
collection DOAJ
description Over recent years, robots are increasingly being employed in several aspects of modern society. Among others, social robots have the potential to benefit education, healthcare, and tourism. To achieve this purpose, robots should be able to engage humans, recognize users’ emotions, and to some extent properly react and "behave" in a natural interaction. Most robotics applications primarily use visual information for emotion recognition, which is often based on facial expressions. However, the display of emotional states through facial expression is inherently a voluntary controlled process that is typical of human–human interaction. In fact, humans have not yet learned to use this channel when communicating with a robotic technology. Hence, there is an urgent need to exploit emotion information channels not directly controlled by humans, such as those that can be ascribed to physiological modulations. Thermal infrared imaging-based affective computing has the potential to be the solution to such an issue. It is a validated technology that allows the non-obtrusive monitoring of physiological parameters and from which it might be possible to infer affective states. This review is aimed to outline the advantages and the current research challenges of thermal imaging-based affective computing for human–robot interaction.
first_indexed 2024-03-10T20:16:34Z
format Article
id doaj.art-9a5a354bff3d458f93608604536a10fb
institution Directory Open Access Journal
issn 2076-3417
language English
last_indexed 2024-03-10T20:16:34Z
publishDate 2020-04-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj.art-9a5a354bff3d458f93608604536a10fb2023-11-19T22:30:09ZengMDPI AGApplied Sciences2076-34172020-04-01108292410.3390/app10082924Thermal Infrared Imaging-Based Affective Computing and Its Application to Facilitate Human Robot Interaction: A ReviewChiara Filippini0David Perpetuini1Daniela Cardone2Antonio Maria Chiarelli3Arcangelo Merla4Department of Neuroscience and Imaging, Institute for Advanced Biomedical Technologies, University G. D’Annunzio of Chieti-Pescara, Via Luigi Polacchi 13, 66100 Chieti, ItalyDepartment of Neuroscience and Imaging, Institute for Advanced Biomedical Technologies, University G. D’Annunzio of Chieti-Pescara, Via Luigi Polacchi 13, 66100 Chieti, ItalyDepartment of Neuroscience and Imaging, Institute for Advanced Biomedical Technologies, University G. D’Annunzio of Chieti-Pescara, Via Luigi Polacchi 13, 66100 Chieti, ItalyDepartment of Neuroscience and Imaging, Institute for Advanced Biomedical Technologies, University G. D’Annunzio of Chieti-Pescara, Via Luigi Polacchi 13, 66100 Chieti, ItalyDepartment of Neuroscience and Imaging, Institute for Advanced Biomedical Technologies, University G. D’Annunzio of Chieti-Pescara, Via Luigi Polacchi 13, 66100 Chieti, ItalyOver recent years, robots are increasingly being employed in several aspects of modern society. Among others, social robots have the potential to benefit education, healthcare, and tourism. To achieve this purpose, robots should be able to engage humans, recognize users’ emotions, and to some extent properly react and "behave" in a natural interaction. Most robotics applications primarily use visual information for emotion recognition, which is often based on facial expressions. However, the display of emotional states through facial expression is inherently a voluntary controlled process that is typical of human–human interaction. In fact, humans have not yet learned to use this channel when communicating with a robotic technology. Hence, there is an urgent need to exploit emotion information channels not directly controlled by humans, such as those that can be ascribed to physiological modulations. Thermal infrared imaging-based affective computing has the potential to be the solution to such an issue. It is a validated technology that allows the non-obtrusive monitoring of physiological parameters and from which it might be possible to infer affective states. This review is aimed to outline the advantages and the current research challenges of thermal imaging-based affective computing for human–robot interaction.https://www.mdpi.com/2076-3417/10/8/2924human–robot interactionthermal IR imagingaffective computingsocial robotsemotion recognition
spellingShingle Chiara Filippini
David Perpetuini
Daniela Cardone
Antonio Maria Chiarelli
Arcangelo Merla
Thermal Infrared Imaging-Based Affective Computing and Its Application to Facilitate Human Robot Interaction: A Review
Applied Sciences
human–robot interaction
thermal IR imaging
affective computing
social robots
emotion recognition
title Thermal Infrared Imaging-Based Affective Computing and Its Application to Facilitate Human Robot Interaction: A Review
title_full Thermal Infrared Imaging-Based Affective Computing and Its Application to Facilitate Human Robot Interaction: A Review
title_fullStr Thermal Infrared Imaging-Based Affective Computing and Its Application to Facilitate Human Robot Interaction: A Review
title_full_unstemmed Thermal Infrared Imaging-Based Affective Computing and Its Application to Facilitate Human Robot Interaction: A Review
title_short Thermal Infrared Imaging-Based Affective Computing and Its Application to Facilitate Human Robot Interaction: A Review
title_sort thermal infrared imaging based affective computing and its application to facilitate human robot interaction a review
topic human–robot interaction
thermal IR imaging
affective computing
social robots
emotion recognition
url https://www.mdpi.com/2076-3417/10/8/2924
work_keys_str_mv AT chiarafilippini thermalinfraredimagingbasedaffectivecomputinganditsapplicationtofacilitatehumanrobotinteractionareview
AT davidperpetuini thermalinfraredimagingbasedaffectivecomputinganditsapplicationtofacilitatehumanrobotinteractionareview
AT danielacardone thermalinfraredimagingbasedaffectivecomputinganditsapplicationtofacilitatehumanrobotinteractionareview
AT antoniomariachiarelli thermalinfraredimagingbasedaffectivecomputinganditsapplicationtofacilitatehumanrobotinteractionareview
AT arcangelomerla thermalinfraredimagingbasedaffectivecomputinganditsapplicationtofacilitatehumanrobotinteractionareview