Classroom Micro-Expression Recognition Algorithms Based on Multi-Feature Fusion

The extraction of facial features is the key to micro-expression recognition. This paper puts forward a micro-expression recognition algorithm through multi-feature fusion. In this algorithm, the change of local binary pattern (LBP) feature distribution is correlated with projection error. For fast...

Full description

Bibliographic Details
Main Authors: Lidan Mao, Ning Wang, Lei Wang, Yu Chen
Format: Article
Language:English
Published: IEEE 2019-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8716671/
_version_ 1819276296258060288
author Lidan Mao
Ning Wang
Lei Wang
Yu Chen
author_facet Lidan Mao
Ning Wang
Lei Wang
Yu Chen
author_sort Lidan Mao
collection DOAJ
description The extraction of facial features is the key to micro-expression recognition. This paper puts forward a micro-expression recognition algorithm through multi-feature fusion. In this algorithm, the change of local binary pattern (LBP) feature distribution is correlated with projection error. For fast and accurate detection, the research data were all extracted from professional facial expression databases, the images had basically the same positions in each expression library, and the pure face image was acquired through manual segmentation from the selected expression library. Through comparison and its application in an intelligent classroom environment, it is proved that the proposed algorithm clearly outperforms the original LBP algorithm. The proposed method can be extended to other image recognition and classification problems.
first_indexed 2024-12-23T23:37:58Z
format Article
id doaj.art-a1134c86e2c644a9b418db2e0c6d3861
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-23T23:37:58Z
publishDate 2019-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-a1134c86e2c644a9b418db2e0c6d38612022-12-21T17:25:50ZengIEEEIEEE Access2169-35362019-01-017649786498310.1109/ACCESS.2019.29172308716671Classroom Micro-Expression Recognition Algorithms Based on Multi-Feature FusionLidan Mao0https://orcid.org/0000-0002-3234-1999Ning Wang1Lei Wang2Yu Chen3College of Foreign Languages, Hebei Agricultural University, Baoding, ChinaCollege of Foreign Languages, Hebei Agricultural University, Baoding, ChinaPhysical Education Department, Hebei Agricultural University, Baoding, ChinaHebei Software Institute, Baoding, ChinaThe extraction of facial features is the key to micro-expression recognition. This paper puts forward a micro-expression recognition algorithm through multi-feature fusion. In this algorithm, the change of local binary pattern (LBP) feature distribution is correlated with projection error. For fast and accurate detection, the research data were all extracted from professional facial expression databases, the images had basically the same positions in each expression library, and the pure face image was acquired through manual segmentation from the selected expression library. Through comparison and its application in an intelligent classroom environment, it is proved that the proposed algorithm clearly outperforms the original LBP algorithm. The proposed method can be extended to other image recognition and classification problems.https://ieeexplore.ieee.org/document/8716671/Classroom micro-expression recognitionprojection errormulti-feature fusionlocal binary pattern (LBP)
spellingShingle Lidan Mao
Ning Wang
Lei Wang
Yu Chen
Classroom Micro-Expression Recognition Algorithms Based on Multi-Feature Fusion
IEEE Access
Classroom micro-expression recognition
projection error
multi-feature fusion
local binary pattern (LBP)
title Classroom Micro-Expression Recognition Algorithms Based on Multi-Feature Fusion
title_full Classroom Micro-Expression Recognition Algorithms Based on Multi-Feature Fusion
title_fullStr Classroom Micro-Expression Recognition Algorithms Based on Multi-Feature Fusion
title_full_unstemmed Classroom Micro-Expression Recognition Algorithms Based on Multi-Feature Fusion
title_short Classroom Micro-Expression Recognition Algorithms Based on Multi-Feature Fusion
title_sort classroom micro expression recognition algorithms based on multi feature fusion
topic Classroom micro-expression recognition
projection error
multi-feature fusion
local binary pattern (LBP)
url https://ieeexplore.ieee.org/document/8716671/
work_keys_str_mv AT lidanmao classroommicroexpressionrecognitionalgorithmsbasedonmultifeaturefusion
AT ningwang classroommicroexpressionrecognitionalgorithmsbasedonmultifeaturefusion
AT leiwang classroommicroexpressionrecognitionalgorithmsbasedonmultifeaturefusion
AT yuchen classroommicroexpressionrecognitionalgorithmsbasedonmultifeaturefusion