Evaluation of Fear Using Nonintrusive Measurement of Multimodal Sensors

Most previous research into emotion recognition used either a single modality or multiple modalities of physiological signal. However, the former method allows for limited enhancement of accuracy, and the latter has the disadvantages that its performance can be affected by head or body movements. Fu...

Full description

Bibliographic Details
Main Authors: Jong-Suk Choi, Jae Won Bang, Hwan Heo, Kang Ryoung Park
Format: Article
Language:English
Published: MDPI AG 2015-07-01
Series:Sensors
Subjects:
Online Access:http://www.mdpi.com/1424-8220/15/7/17507
Description
Summary:Most previous research into emotion recognition used either a single modality or multiple modalities of physiological signal. However, the former method allows for limited enhancement of accuracy, and the latter has the disadvantages that its performance can be affected by head or body movements. Further, the latter causes inconvenience to the user due to the sensors attached to the body. Among various emotions, the accurate evaluation of fear is crucial in many applications, such as criminal psychology, intelligent surveillance systems and the objective evaluation of horror movies. Therefore, we propose a new method for evaluating fear based on nonintrusive measurements obtained using multiple sensors. Experimental results based on the t-test, the effect size and the sum of all of the correlation values with other modalities showed that facial temperature and subjective evaluation are more reliable than electroencephalogram (EEG) and eye blinking rate for the evaluation of fear.
ISSN:1424-8220