Facial Expression Recognition by Regional Weighting with Approximated Q-Learning

Several facial expression recognition methods cluster facial elements according to similarity and weight them considering the importance of each element in classification. However, these methods are limited by the pre-definitions of units restricting modification of the structure during optimization...

Full description

Bibliographic Details
Main Authors: Seong-Gi Oh, TaeYong Kim
Format: Article
Language:English
Published: MDPI AG 2020-02-01
Series:Symmetry
Subjects:
Online Access:https://www.mdpi.com/2073-8994/12/2/319
_version_ 1811306797299924992
author Seong-Gi Oh
TaeYong Kim
author_facet Seong-Gi Oh
TaeYong Kim
author_sort Seong-Gi Oh
collection DOAJ
description Several facial expression recognition methods cluster facial elements according to similarity and weight them considering the importance of each element in classification. However, these methods are limited by the pre-definitions of units restricting modification of the structure during optimization. This study proposes a modified support vector machine classifier called Grid Map, which is combined with reinforcement learning to improve the classification accuracy. To optimize training, the input image size is normalized according to the cascade rules of a pre-processing detector, and the regional weights are assigned by an adaptive cell size that divides each region of the image using bounding grids. Reducing the size of the bounding grid reduces the area used for feature extraction, allowing more detailed weighted features to be extracted. Error-correcting output codes with a histogram of gradient is selected as the classification method via an experiment to determine the optimal feature and classifier selection. The proposed method is formulated into a decision process and solved via Q-learning. To classify seven emotions, the proposed method exhibits accuracies of 96.36% and 98.47% for four databases and Extended Cohn-−Kanade Dataset (CK+), respectively. Compared to the basic method exhibiting a similar accuracy, the proposed method requires 68.81% fewer features and only 66.33% of the processing time.
first_indexed 2024-04-13T08:52:10Z
format Article
id doaj.art-4ed0677235314f2e8e14aeda07ae790c
institution Directory Open Access Journal
issn 2073-8994
language English
last_indexed 2024-04-13T08:52:10Z
publishDate 2020-02-01
publisher MDPI AG
record_format Article
series Symmetry
spelling doaj.art-4ed0677235314f2e8e14aeda07ae790c2022-12-22T02:53:27ZengMDPI AGSymmetry2073-89942020-02-0112231910.3390/sym12020319sym12020319Facial Expression Recognition by Regional Weighting with Approximated Q-LearningSeong-Gi Oh0TaeYong Kim1Department of Advanced Imaging Science, Chung-Ang University, Seoul 156-756, KoreaDepartment of Advanced Imaging Science, Chung-Ang University, Seoul 156-756, KoreaSeveral facial expression recognition methods cluster facial elements according to similarity and weight them considering the importance of each element in classification. However, these methods are limited by the pre-definitions of units restricting modification of the structure during optimization. This study proposes a modified support vector machine classifier called Grid Map, which is combined with reinforcement learning to improve the classification accuracy. To optimize training, the input image size is normalized according to the cascade rules of a pre-processing detector, and the regional weights are assigned by an adaptive cell size that divides each region of the image using bounding grids. Reducing the size of the bounding grid reduces the area used for feature extraction, allowing more detailed weighted features to be extracted. Error-correcting output codes with a histogram of gradient is selected as the classification method via an experiment to determine the optimal feature and classifier selection. The proposed method is formulated into a decision process and solved via Q-learning. To classify seven emotions, the proposed method exhibits accuracies of 96.36% and 98.47% for four databases and Extended Cohn-−Kanade Dataset (CK+), respectively. Compared to the basic method exhibiting a similar accuracy, the proposed method requires 68.81% fewer features and only 66.33% of the processing time.https://www.mdpi.com/2073-8994/12/2/319facial expression recognitionfeature extractionmachine learningclassificationreinforcement learning
spellingShingle Seong-Gi Oh
TaeYong Kim
Facial Expression Recognition by Regional Weighting with Approximated Q-Learning
Symmetry
facial expression recognition
feature extraction
machine learning
classification
reinforcement learning
title Facial Expression Recognition by Regional Weighting with Approximated Q-Learning
title_full Facial Expression Recognition by Regional Weighting with Approximated Q-Learning
title_fullStr Facial Expression Recognition by Regional Weighting with Approximated Q-Learning
title_full_unstemmed Facial Expression Recognition by Regional Weighting with Approximated Q-Learning
title_short Facial Expression Recognition by Regional Weighting with Approximated Q-Learning
title_sort facial expression recognition by regional weighting with approximated q learning
topic facial expression recognition
feature extraction
machine learning
classification
reinforcement learning
url https://www.mdpi.com/2073-8994/12/2/319
work_keys_str_mv AT seonggioh facialexpressionrecognitionbyregionalweightingwithapproximatedqlearning
AT taeyongkim facialexpressionrecognitionbyregionalweightingwithapproximatedqlearning