Facial Emotion Recognition: A Survey and Real-World User Experiences in Mixed Reality

Extensive possibilities of applications have made emotion recognition ineluctable and challenging in the field of computer science. The use of non-verbal cues such as gestures, body movement, and facial expressions convey the feeling and the feedback to the user. This discipline of Human–Computer In...

Full description

Bibliographic Details
Main Authors: Dhwani Mehta, Mohammad Faridul Haque Siddiqui, Ahmad Y. Javaid
Format: Article
Language:English
Published: MDPI AG 2018-02-01
Series:Sensors
Subjects:
Online Access:http://www.mdpi.com/1424-8220/18/2/416
_version_ 1798043228527656960
author Dhwani Mehta
Mohammad Faridul Haque Siddiqui
Ahmad Y. Javaid
author_facet Dhwani Mehta
Mohammad Faridul Haque Siddiqui
Ahmad Y. Javaid
author_sort Dhwani Mehta
collection DOAJ
description Extensive possibilities of applications have made emotion recognition ineluctable and challenging in the field of computer science. The use of non-verbal cues such as gestures, body movement, and facial expressions convey the feeling and the feedback to the user. This discipline of Human–Computer Interaction places reliance on the algorithmic robustness and the sensitivity of the sensor to ameliorate the recognition. Sensors play a significant role in accurate detection by providing a very high-quality input, hence increasing the efficiency and the reliability of the system. Automatic recognition of human emotions would help in teaching social intelligence in the machines. This paper presents a brief study of the various approaches and the techniques of emotion recognition. The survey covers a succinct review of the databases that are considered as data sets for algorithms detecting the emotions by facial expressions. Later, mixed reality device Microsoft HoloLens (MHL) is introduced for observing emotion recognition in Augmented Reality (AR). A brief introduction of its sensors, their application in emotion recognition and some preliminary results of emotion recognition using MHL are presented. The paper then concludes by comparing results of emotion recognition by the MHL and a regular webcam.
first_indexed 2024-04-11T22:46:27Z
format Article
id doaj.art-a46a9b426aa64a5d89f5d85c9ba56648
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-04-11T22:46:27Z
publishDate 2018-02-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-a46a9b426aa64a5d89f5d85c9ba566482022-12-22T03:58:44ZengMDPI AGSensors1424-82202018-02-0118241610.3390/s18020416s18020416Facial Emotion Recognition: A Survey and Real-World User Experiences in Mixed RealityDhwani Mehta0Mohammad Faridul Haque Siddiqui1Ahmad Y. Javaid2EECS Department, The University of Toledo, Toledo, OH 43606, USAEECS Department, The University of Toledo, Toledo, OH 43606, USAEECS Department, The University of Toledo, Toledo, OH 43606, USAExtensive possibilities of applications have made emotion recognition ineluctable and challenging in the field of computer science. The use of non-verbal cues such as gestures, body movement, and facial expressions convey the feeling and the feedback to the user. This discipline of Human–Computer Interaction places reliance on the algorithmic robustness and the sensitivity of the sensor to ameliorate the recognition. Sensors play a significant role in accurate detection by providing a very high-quality input, hence increasing the efficiency and the reliability of the system. Automatic recognition of human emotions would help in teaching social intelligence in the machines. This paper presents a brief study of the various approaches and the techniques of emotion recognition. The survey covers a succinct review of the databases that are considered as data sets for algorithms detecting the emotions by facial expressions. Later, mixed reality device Microsoft HoloLens (MHL) is introduced for observing emotion recognition in Augmented Reality (AR). A brief introduction of its sensors, their application in emotion recognition and some preliminary results of emotion recognition using MHL are presented. The paper then concludes by comparing results of emotion recognition by the MHL and a regular webcam.http://www.mdpi.com/1424-8220/18/2/416facial expressionsemotion recognitionintelligenceaugmented realityaffectMicrosoft HoloLenshuman–computer interactionsensors
spellingShingle Dhwani Mehta
Mohammad Faridul Haque Siddiqui
Ahmad Y. Javaid
Facial Emotion Recognition: A Survey and Real-World User Experiences in Mixed Reality
Sensors
facial expressions
emotion recognition
intelligence
augmented reality
affect
Microsoft HoloLens
human–computer interaction
sensors
title Facial Emotion Recognition: A Survey and Real-World User Experiences in Mixed Reality
title_full Facial Emotion Recognition: A Survey and Real-World User Experiences in Mixed Reality
title_fullStr Facial Emotion Recognition: A Survey and Real-World User Experiences in Mixed Reality
title_full_unstemmed Facial Emotion Recognition: A Survey and Real-World User Experiences in Mixed Reality
title_short Facial Emotion Recognition: A Survey and Real-World User Experiences in Mixed Reality
title_sort facial emotion recognition a survey and real world user experiences in mixed reality
topic facial expressions
emotion recognition
intelligence
augmented reality
affect
Microsoft HoloLens
human–computer interaction
sensors
url http://www.mdpi.com/1424-8220/18/2/416
work_keys_str_mv AT dhwanimehta facialemotionrecognitionasurveyandrealworlduserexperiencesinmixedreality
AT mohammadfaridulhaquesiddiqui facialemotionrecognitionasurveyandrealworlduserexperiencesinmixedreality
AT ahmadyjavaid facialemotionrecognitionasurveyandrealworlduserexperiencesinmixedreality