Facial Expression Recognition Using Fusion Features Based on Center-Symmetric Local Octonary Pattern

A local feature descriptor has gained a lot of interest in many applications, such as image retrieval, texture classification, and face recognition. This paper proposes a novel local feature descriptor: center-symmetric local octonary pattern (CS-LOP) for facial expression recognition. A CS-LOP oper...

Full description

Bibliographic Details
Main Authors: Min Hu, Yaqin Zheng, Chunjian Yang, Xiaohua Wang, Lei He, Fuji Ren
Format: Article
Language:English
Published: IEEE 2019-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8643861/
_version_ 1819120397933608960
author Min Hu
Yaqin Zheng
Chunjian Yang
Xiaohua Wang
Lei He
Fuji Ren
author_facet Min Hu
Yaqin Zheng
Chunjian Yang
Xiaohua Wang
Lei He
Fuji Ren
author_sort Min Hu
collection DOAJ
description A local feature descriptor has gained a lot of interest in many applications, such as image retrieval, texture classification, and face recognition. This paper proposes a novel local feature descriptor: center-symmetric local octonary pattern (CS-LOP) for facial expression recognition. A CS-LOP operator not only considers the difference of the gray value between central pixels and neighboring pixels in all eight directions but also compares the gray value of four pairs of center-symmetric pixels. Besides, this paper used the CS-LOP to extract diverse features from the preprocessed facial image, the feature map of gradient magnitude, and the feature map of Gabor, and also to make extracted features more abundant and detailed. To evaluate the performance of the proposed method, experiments on JAFFE and CK facial expression datasets demonstrate that the proposed method outperforms the method using the individual descriptor. Compared with other state-of-the-art methods, our approach improves the overall recognition accuracy.
first_indexed 2024-12-22T06:20:01Z
format Article
id doaj.art-97ecd30dc76d42fb9244f9b0089e4874
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-22T06:20:01Z
publishDate 2019-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-97ecd30dc76d42fb9244f9b0089e48742022-12-21T18:35:59ZengIEEEIEEE Access2169-35362019-01-017298822989010.1109/ACCESS.2019.28990248643861Facial Expression Recognition Using Fusion Features Based on Center-Symmetric Local Octonary PatternMin Hu0Yaqin Zheng1https://orcid.org/0000-0003-1605-3986Chunjian Yang2Xiaohua Wang3Lei He4Fuji Ren5School of Computer and Information, Anhui Province Key Laboratory of Affective Computing and Advanced Intelligent Machine, Hefei University of Technology, Hefei, ChinaSchool of Computer and Information, Anhui Province Key Laboratory of Affective Computing and Advanced Intelligent Machine, Hefei University of Technology, Hefei, ChinaSchool of Computer and Information, Anhui Province Key Laboratory of Affective Computing and Advanced Intelligent Machine, Hefei University of Technology, Hefei, ChinaSchool of Computer and Information, Anhui Province Key Laboratory of Affective Computing and Advanced Intelligent Machine, Hefei University of Technology, Hefei, ChinaSchool of Mathematics, Hefei University of Technology, Hefei, ChinaSchool of Computer and Information, Anhui Province Key Laboratory of Affective Computing and Advanced Intelligent Machine, Hefei University of Technology, Hefei, ChinaA local feature descriptor has gained a lot of interest in many applications, such as image retrieval, texture classification, and face recognition. This paper proposes a novel local feature descriptor: center-symmetric local octonary pattern (CS-LOP) for facial expression recognition. A CS-LOP operator not only considers the difference of the gray value between central pixels and neighboring pixels in all eight directions but also compares the gray value of four pairs of center-symmetric pixels. Besides, this paper used the CS-LOP to extract diverse features from the preprocessed facial image, the feature map of gradient magnitude, and the feature map of Gabor, and also to make extracted features more abundant and detailed. To evaluate the performance of the proposed method, experiments on JAFFE and CK facial expression datasets demonstrate that the proposed method outperforms the method using the individual descriptor. Compared with other state-of-the-art methods, our approach improves the overall recognition accuracy.https://ieeexplore.ieee.org/document/8643861/Facial expression recognitionfeature extractioncenter-symmetric local octonary patternfeature fusion
spellingShingle Min Hu
Yaqin Zheng
Chunjian Yang
Xiaohua Wang
Lei He
Fuji Ren
Facial Expression Recognition Using Fusion Features Based on Center-Symmetric Local Octonary Pattern
IEEE Access
Facial expression recognition
feature extraction
center-symmetric local octonary pattern
feature fusion
title Facial Expression Recognition Using Fusion Features Based on Center-Symmetric Local Octonary Pattern
title_full Facial Expression Recognition Using Fusion Features Based on Center-Symmetric Local Octonary Pattern
title_fullStr Facial Expression Recognition Using Fusion Features Based on Center-Symmetric Local Octonary Pattern
title_full_unstemmed Facial Expression Recognition Using Fusion Features Based on Center-Symmetric Local Octonary Pattern
title_short Facial Expression Recognition Using Fusion Features Based on Center-Symmetric Local Octonary Pattern
title_sort facial expression recognition using fusion features based on center symmetric local octonary pattern
topic Facial expression recognition
feature extraction
center-symmetric local octonary pattern
feature fusion
url https://ieeexplore.ieee.org/document/8643861/
work_keys_str_mv AT minhu facialexpressionrecognitionusingfusionfeaturesbasedoncentersymmetriclocaloctonarypattern
AT yaqinzheng facialexpressionrecognitionusingfusionfeaturesbasedoncentersymmetriclocaloctonarypattern
AT chunjianyang facialexpressionrecognitionusingfusionfeaturesbasedoncentersymmetriclocaloctonarypattern
AT xiaohuawang facialexpressionrecognitionusingfusionfeaturesbasedoncentersymmetriclocaloctonarypattern
AT leihe facialexpressionrecognitionusingfusionfeaturesbasedoncentersymmetriclocaloctonarypattern
AT fujiren facialexpressionrecognitionusingfusionfeaturesbasedoncentersymmetriclocaloctonarypattern