Pet dog facial expression recognition based on convolutional neural network and improved whale optimization algorithm

Abstract Pet dogs are our good friends. Realizing the dog’s emotions through the dog's facial expressions is beneficial to the harmonious coexistence between human beings and pet dogs. This paper describes a study on dog facial expression recognition using convolutional neural network (CNN), wh...

Full description

Bibliographic Details
Main Authors: Yan Mao, Yaqian Liu
Format: Article
Language:English
Published: Nature Portfolio 2023-02-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-023-30442-0
_version_ 1797864660520665088
author Yan Mao
Yaqian Liu
author_facet Yan Mao
Yaqian Liu
author_sort Yan Mao
collection DOAJ
description Abstract Pet dogs are our good friends. Realizing the dog’s emotions through the dog's facial expressions is beneficial to the harmonious coexistence between human beings and pet dogs. This paper describes a study on dog facial expression recognition using convolutional neural network (CNN), which is a representative algorithm model of deep learning. Parameter settings have a profound impact on the performance of a CNN model, improper parameter setting will make the model exposes several shortcomings, such as slow learning speed, easy to fall into local optimal solution, etc. In response to these shortcomings and improve the accuracy of recognition, a novel CNN model based on the improved whale optimization algorithm (IWOA) called IWOA–CNN is applied to complete this recognition task. Unlike human face recognition, a dedicated face detector in Dlib toolkit is utilized to recognize the facial region, and the captured facial images are augmented to build an expression dataset. The random dropout layer and L2 regularization are introduced into the network to reduce the number of transmission parameters of network and avoid over fitting. The IWOA optimizes the keep probability of the dropout layer, the parameter λ of L2 regularization and the dynamic learning rate of gradient descent optimizer. Carry out a comparative experiment of IWOA–CNN, Support Vector Machine, LeNet-5 and other classifiers for facial expression recognition, its results demonstrate that the IWOA–CNN has better recognition effect in facial expression recognition and also explain the efficiency of the swarm intelligence algorithm in dealing with model parameter optimization.
first_indexed 2024-04-09T22:56:43Z
format Article
id doaj.art-d5d73def199941758ce9a125ee732d3f
institution Directory Open Access Journal
issn 2045-2322
language English
last_indexed 2024-04-09T22:56:43Z
publishDate 2023-02-01
publisher Nature Portfolio
record_format Article
series Scientific Reports
spelling doaj.art-d5d73def199941758ce9a125ee732d3f2023-03-22T11:16:58ZengNature PortfolioScientific Reports2045-23222023-02-0113112010.1038/s41598-023-30442-0Pet dog facial expression recognition based on convolutional neural network and improved whale optimization algorithmYan Mao0Yaqian Liu1College of Information Engineering, Tongji UniversityCollege of Animal Science and Technology, Shandong Agricultural UniversityAbstract Pet dogs are our good friends. Realizing the dog’s emotions through the dog's facial expressions is beneficial to the harmonious coexistence between human beings and pet dogs. This paper describes a study on dog facial expression recognition using convolutional neural network (CNN), which is a representative algorithm model of deep learning. Parameter settings have a profound impact on the performance of a CNN model, improper parameter setting will make the model exposes several shortcomings, such as slow learning speed, easy to fall into local optimal solution, etc. In response to these shortcomings and improve the accuracy of recognition, a novel CNN model based on the improved whale optimization algorithm (IWOA) called IWOA–CNN is applied to complete this recognition task. Unlike human face recognition, a dedicated face detector in Dlib toolkit is utilized to recognize the facial region, and the captured facial images are augmented to build an expression dataset. The random dropout layer and L2 regularization are introduced into the network to reduce the number of transmission parameters of network and avoid over fitting. The IWOA optimizes the keep probability of the dropout layer, the parameter λ of L2 regularization and the dynamic learning rate of gradient descent optimizer. Carry out a comparative experiment of IWOA–CNN, Support Vector Machine, LeNet-5 and other classifiers for facial expression recognition, its results demonstrate that the IWOA–CNN has better recognition effect in facial expression recognition and also explain the efficiency of the swarm intelligence algorithm in dealing with model parameter optimization.https://doi.org/10.1038/s41598-023-30442-0
spellingShingle Yan Mao
Yaqian Liu
Pet dog facial expression recognition based on convolutional neural network and improved whale optimization algorithm
Scientific Reports
title Pet dog facial expression recognition based on convolutional neural network and improved whale optimization algorithm
title_full Pet dog facial expression recognition based on convolutional neural network and improved whale optimization algorithm
title_fullStr Pet dog facial expression recognition based on convolutional neural network and improved whale optimization algorithm
title_full_unstemmed Pet dog facial expression recognition based on convolutional neural network and improved whale optimization algorithm
title_short Pet dog facial expression recognition based on convolutional neural network and improved whale optimization algorithm
title_sort pet dog facial expression recognition based on convolutional neural network and improved whale optimization algorithm
url https://doi.org/10.1038/s41598-023-30442-0
work_keys_str_mv AT yanmao petdogfacialexpressionrecognitionbasedonconvolutionalneuralnetworkandimprovedwhaleoptimizationalgorithm
AT yaqianliu petdogfacialexpressionrecognitionbasedonconvolutionalneuralnetworkandimprovedwhaleoptimizationalgorithm