A Novel Facial Expression Intelligent Recognition Method Using Improved Convolutional Neural Network
Human facial expression is the core carrier of feedback. Facial expression recognition(FER) has been introduced into mickle fields, such as auxiliary medical care, safe driving, marketing assistance, distance education. However, in the real production process, facial expression image samples collect...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2020-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9043527/ |
| _version_ | 1828890748877012992 |
|---|---|
| author | Min Shi Lijun Xu Xiang Chen |
| author_facet | Min Shi Lijun Xu Xiang Chen |
| author_sort | Min Shi |
| collection | DOAJ |
| description | Human facial expression is the core carrier of feedback. Facial expression recognition(FER) has been introduced into mickle fields, such as auxiliary medical care, safe driving, marketing assistance, distance education. However, in the real production process, facial expression image samples collected in different scenarios have problems such as complex backgrounds, which causes the FER model to train very slowly, low recognition rate, and insufficient generalization, so it cannot meet the actual production requirements. As the originator of the clustering algorithm, fuzzy C-means clustering(FCM) algorithm has stable performance and good results. It is applied to the convolutional layer of a convolutional neural network(CNN) to obtain a convolution kernel with an initial value, so as to extract the expression image features in the training set and the test set. This can solve the problem of random initialization of the convolution kernel. Based on the CNN, this paper introduces FCM to optimize the feature extraction (FE) capability of the model, and proposes a novel FER algorithm using an improved CNN(F-CNN). Because traditional CNN has problems such as irrational layer settings and too many parameters. The proposed F-CNN first adjusts the CNN network structure to improve the nonlinear expression ability of CNN. Then, replace the Softmax classifier that comes with CNN with a support vector machine (SVM) to improve the model's classification ability. The comparison experiments with other models show that the improved model improve the FER rate. The introduced FCM algorithm can effectively improve the model's FE performance and shorten the time of F-CNN during training. On the whole, F-CNN has reference value. |
| first_indexed | 2024-12-13T13:05:43Z |
| format | Article |
| id | doaj.art-9a8eeb80c9944b7b87aecc603ad3ec33 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-13T13:05:43Z |
| publishDate | 2020-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-9a8eeb80c9944b7b87aecc603ad3ec332022-12-21T23:44:51ZengIEEEIEEE Access2169-35362020-01-018576065761410.1109/ACCESS.2020.29822869043527A Novel Facial Expression Intelligent Recognition Method Using Improved Convolutional Neural NetworkMin Shi0https://orcid.org/0000-0003-1604-1459Lijun Xu1https://orcid.org/0000-0002-1311-2170Xiang Chen2https://orcid.org/0000-0001-5682-9879School of Art and Design, Fuzhou University of International Studies and Trade, Fuzhou, ChinaInstitute of Art and Design, Nanjing Institute of Technology, Nanjing, ChinaSchool of Design, Jiangnan University, Wuxi, ChinaHuman facial expression is the core carrier of feedback. Facial expression recognition(FER) has been introduced into mickle fields, such as auxiliary medical care, safe driving, marketing assistance, distance education. However, in the real production process, facial expression image samples collected in different scenarios have problems such as complex backgrounds, which causes the FER model to train very slowly, low recognition rate, and insufficient generalization, so it cannot meet the actual production requirements. As the originator of the clustering algorithm, fuzzy C-means clustering(FCM) algorithm has stable performance and good results. It is applied to the convolutional layer of a convolutional neural network(CNN) to obtain a convolution kernel with an initial value, so as to extract the expression image features in the training set and the test set. This can solve the problem of random initialization of the convolution kernel. Based on the CNN, this paper introduces FCM to optimize the feature extraction (FE) capability of the model, and proposes a novel FER algorithm using an improved CNN(F-CNN). Because traditional CNN has problems such as irrational layer settings and too many parameters. The proposed F-CNN first adjusts the CNN network structure to improve the nonlinear expression ability of CNN. Then, replace the Softmax classifier that comes with CNN with a support vector machine (SVM) to improve the model's classification ability. The comparison experiments with other models show that the improved model improve the FER rate. The introduced FCM algorithm can effectively improve the model's FE performance and shorten the time of F-CNN during training. On the whole, F-CNN has reference value.https://ieeexplore.ieee.org/document/9043527/Facial expression recognitionconvolutional neural networkfuzzy C-means clusteringsupport vector machineintelligent processing |
| spellingShingle | Min Shi Lijun Xu Xiang Chen A Novel Facial Expression Intelligent Recognition Method Using Improved Convolutional Neural Network IEEE Access Facial expression recognition convolutional neural network fuzzy C-means clustering support vector machine intelligent processing |
| title | A Novel Facial Expression Intelligent Recognition Method Using Improved Convolutional Neural Network |
| title_full | A Novel Facial Expression Intelligent Recognition Method Using Improved Convolutional Neural Network |
| title_fullStr | A Novel Facial Expression Intelligent Recognition Method Using Improved Convolutional Neural Network |
| title_full_unstemmed | A Novel Facial Expression Intelligent Recognition Method Using Improved Convolutional Neural Network |
| title_short | A Novel Facial Expression Intelligent Recognition Method Using Improved Convolutional Neural Network |
| title_sort | novel facial expression intelligent recognition method using improved convolutional neural network |
| topic | Facial expression recognition convolutional neural network fuzzy C-means clustering support vector machine intelligent processing |
| url | https://ieeexplore.ieee.org/document/9043527/ |
| work_keys_str_mv | AT minshi anovelfacialexpressionintelligentrecognitionmethodusingimprovedconvolutionalneuralnetwork AT lijunxu anovelfacialexpressionintelligentrecognitionmethodusingimprovedconvolutionalneuralnetwork AT xiangchen anovelfacialexpressionintelligentrecognitionmethodusingimprovedconvolutionalneuralnetwork AT minshi novelfacialexpressionintelligentrecognitionmethodusingimprovedconvolutionalneuralnetwork AT lijunxu novelfacialexpressionintelligentrecognitionmethodusingimprovedconvolutionalneuralnetwork AT xiangchen novelfacialexpressionintelligentrecognitionmethodusingimprovedconvolutionalneuralnetwork |