Facial expression recognition using singular values and wavelet‐based LGC‐HD operator

Abstract Facial expression recognition (FER) is a significant research area in the human–computer interaction. The performance of FER systems depends on an efficient feature extraction method. This research work proposes a robust method for feature extraction using local gradient coding based on hor...

Full description

Bibliographic Details
Main Authors: Durga G. Rao Kola, Srinivas K. Samayamantula
Format: Article
Language:English
Published: Hindawi-IET 2021-03-01
Series:IET Biometrics
Subjects:
Online Access:https://doi.org/10.1049/bme2.12012
_version_ 1797429455009873920
author Durga G. Rao Kola
Srinivas K. Samayamantula
author_facet Durga G. Rao Kola
Srinivas K. Samayamantula
author_sort Durga G. Rao Kola
collection DOAJ
description Abstract Facial expression recognition (FER) is a significant research area in the human–computer interaction. The performance of FER systems depends on an efficient feature extraction method. This research work proposes a robust method for feature extraction using local gradient coding based on horizontal and diagonal (LGC‐HD) operator, wavelet transform and singular values. The proposed framework consists of three steps in feature extraction. First, the wavelet transform is applied on facial images and features are extracted by applying the LGC‐HD operator on low–low bands at different levels of decomposition. Second, the singular values of the facial image are calculated by applying singular value decomposition and these are used as features. Third, the features from the previous two steps are concatenated to obtain the final feature for FER systems. The proposed method combines the two advantages: (1) the integration of wavelet transform and LGC‐HD operator provides discriminating and robust features. (2) The singular values are not sensitive to grey scale changes caused by the noise. After obtaining the features, the support vector machine is used for expression recognition. Extensive experimentation on Japanese Female Facial Expression database, Cohn–Kanade, FEI face and facial expression research group databases achieves good recognition rates of 84.2%, 92.3%, 98.2% and 97.9%, respectively.
first_indexed 2024-03-09T09:13:24Z
format Article
id doaj.art-eff17d57060e464197904db732b032a5
institution Directory Open Access Journal
issn 2047-4938
2047-4946
language English
last_indexed 2024-03-09T09:13:24Z
publishDate 2021-03-01
publisher Hindawi-IET
record_format Article
series IET Biometrics
spelling doaj.art-eff17d57060e464197904db732b032a52023-12-02T08:07:42ZengHindawi-IETIET Biometrics2047-49382047-49462021-03-0110220721810.1049/bme2.12012Facial expression recognition using singular values and wavelet‐based LGC‐HD operatorDurga G. Rao Kola0Srinivas K. Samayamantula1Department of ECE UCEK JNTUK Kakinada IndiaDepartment of ECE UCEK JNTUK Kakinada IndiaAbstract Facial expression recognition (FER) is a significant research area in the human–computer interaction. The performance of FER systems depends on an efficient feature extraction method. This research work proposes a robust method for feature extraction using local gradient coding based on horizontal and diagonal (LGC‐HD) operator, wavelet transform and singular values. The proposed framework consists of three steps in feature extraction. First, the wavelet transform is applied on facial images and features are extracted by applying the LGC‐HD operator on low–low bands at different levels of decomposition. Second, the singular values of the facial image are calculated by applying singular value decomposition and these are used as features. Third, the features from the previous two steps are concatenated to obtain the final feature for FER systems. The proposed method combines the two advantages: (1) the integration of wavelet transform and LGC‐HD operator provides discriminating and robust features. (2) The singular values are not sensitive to grey scale changes caused by the noise. After obtaining the features, the support vector machine is used for expression recognition. Extensive experimentation on Japanese Female Facial Expression database, Cohn–Kanade, FEI face and facial expression research group databases achieves good recognition rates of 84.2%, 92.3%, 98.2% and 97.9%, respectively.https://doi.org/10.1049/bme2.12012emotion recognitionface recognitionfeature extractionsingular value decompositionsupport vector machineswavelet transforms
spellingShingle Durga G. Rao Kola
Srinivas K. Samayamantula
Facial expression recognition using singular values and wavelet‐based LGC‐HD operator
IET Biometrics
emotion recognition
face recognition
feature extraction
singular value decomposition
support vector machines
wavelet transforms
title Facial expression recognition using singular values and wavelet‐based LGC‐HD operator
title_full Facial expression recognition using singular values and wavelet‐based LGC‐HD operator
title_fullStr Facial expression recognition using singular values and wavelet‐based LGC‐HD operator
title_full_unstemmed Facial expression recognition using singular values and wavelet‐based LGC‐HD operator
title_short Facial expression recognition using singular values and wavelet‐based LGC‐HD operator
title_sort facial expression recognition using singular values and wavelet based lgc hd operator
topic emotion recognition
face recognition
feature extraction
singular value decomposition
support vector machines
wavelet transforms
url https://doi.org/10.1049/bme2.12012
work_keys_str_mv AT durgagraokola facialexpressionrecognitionusingsingularvaluesandwaveletbasedlgchdoperator
AT srinivasksamayamantula facialexpressionrecognitionusingsingularvaluesandwaveletbasedlgchdoperator