Bioinspired Image Processing Enabled Facial Emotion Recognition Using Equilibrium Optimizer With a Hybrid Deep Learning Model
Owing to the unpredictable nature of human facial expression, Facial emotion recognition (FER) from facial images becomes a tedious process. FER is a field within artificial intelligence (AI) and computer vision (CV) that concentrates on developing algorithms and technologies to interpret and analyz...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2024-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10415427/ |
| _version_ | 1797305334483648512 |
|---|---|
| author | Ahmad A. Alzahrani |
| author_facet | Ahmad A. Alzahrani |
| author_sort | Ahmad A. Alzahrani |
| collection | DOAJ |
| description | Owing to the unpredictable nature of human facial expression, Facial emotion recognition (FER) from facial images becomes a tedious process. FER is a field within artificial intelligence (AI) and computer vision (CV) that concentrates on developing algorithms and technologies to interpret and analyze emotional expressions shown on human faces. The major intention of this area of research is to enable computers and machines to automatically classify and detect emotions, including sadness, happiness, anger, etc., based on facial expressions and cues. Deep learning (DL) systems namely recurrent neural network (RNN) and convolutional neural network (CNN) can be used for the task of automatically classifying and detecting emotions from human facial expressions. Furthermore, Bioinspired Image Processing Enabled FER combines principles from biological systems with image processing techniques to better the robustness and accuracy of FER. This technique is inspired by natural processes to enhance the interpretation and understanding of human emotion conveyed by facial expressions. This study designs a new Bioinspired Image Processing Enabled Facial Emotion Recognition using an Equilibrium Optimizer with Hybrid Deep Learning (BIPFER-EOHDL) model. The primary objectives of the BIPFER-EOHDL technique lie in the effectual and automated identification of facial expressions using a hyperparameter-tuned DL algorithm. In the presented BIPFER-EOHDL technique, the median filtering (MF) approach can be applied for image pre-processing. Besides, the BIPFER-EOHDL method applies the EfficientNetB7 model for the process of feature extraction. Meanwhile, the hyperparameter selection of the EfficientNetB7 model takes place by the use of the EO algorithm. Finally, the multi-head attention bi-directional long short-term memory (MA-BLSTM) model is exploited for the recognition and classification of facial emotions. A wide-ranging simulation analysis was performed to validate the higher FER outcomes of the BIPFER-EOHDL methodology. The simulation results stated that the BIPFER-EOHDL technique accomplishes better FER results than other recent approaches. |
| first_indexed | 2024-03-08T00:25:24Z |
| format | Article |
| id | doaj.art-f920ed06c93a428ba48765a2aaadabb7 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-08T00:25:24Z |
| publishDate | 2024-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-f920ed06c93a428ba48765a2aaadabb72024-02-16T00:01:30ZengIEEEIEEE Access2169-35362024-01-0112222192222910.1109/ACCESS.2024.335943610415427Bioinspired Image Processing Enabled Facial Emotion Recognition Using Equilibrium Optimizer With a Hybrid Deep Learning ModelAhmad A. Alzahrani0https://orcid.org/0000-0002-8081-6530Information Technology Department, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah, Saudi ArabiaOwing to the unpredictable nature of human facial expression, Facial emotion recognition (FER) from facial images becomes a tedious process. FER is a field within artificial intelligence (AI) and computer vision (CV) that concentrates on developing algorithms and technologies to interpret and analyze emotional expressions shown on human faces. The major intention of this area of research is to enable computers and machines to automatically classify and detect emotions, including sadness, happiness, anger, etc., based on facial expressions and cues. Deep learning (DL) systems namely recurrent neural network (RNN) and convolutional neural network (CNN) can be used for the task of automatically classifying and detecting emotions from human facial expressions. Furthermore, Bioinspired Image Processing Enabled FER combines principles from biological systems with image processing techniques to better the robustness and accuracy of FER. This technique is inspired by natural processes to enhance the interpretation and understanding of human emotion conveyed by facial expressions. This study designs a new Bioinspired Image Processing Enabled Facial Emotion Recognition using an Equilibrium Optimizer with Hybrid Deep Learning (BIPFER-EOHDL) model. The primary objectives of the BIPFER-EOHDL technique lie in the effectual and automated identification of facial expressions using a hyperparameter-tuned DL algorithm. In the presented BIPFER-EOHDL technique, the median filtering (MF) approach can be applied for image pre-processing. Besides, the BIPFER-EOHDL method applies the EfficientNetB7 model for the process of feature extraction. Meanwhile, the hyperparameter selection of the EfficientNetB7 model takes place by the use of the EO algorithm. Finally, the multi-head attention bi-directional long short-term memory (MA-BLSTM) model is exploited for the recognition and classification of facial emotions. A wide-ranging simulation analysis was performed to validate the higher FER outcomes of the BIPFER-EOHDL methodology. The simulation results stated that the BIPFER-EOHDL technique accomplishes better FER results than other recent approaches.https://ieeexplore.ieee.org/document/10415427/Non-verbal communicationfacial emotion recognitiondeep learningequilibrium optimizerartificial intelligence |
| spellingShingle | Ahmad A. Alzahrani Bioinspired Image Processing Enabled Facial Emotion Recognition Using Equilibrium Optimizer With a Hybrid Deep Learning Model IEEE Access Non-verbal communication facial emotion recognition deep learning equilibrium optimizer artificial intelligence |
| title | Bioinspired Image Processing Enabled Facial Emotion Recognition Using Equilibrium Optimizer With a Hybrid Deep Learning Model |
| title_full | Bioinspired Image Processing Enabled Facial Emotion Recognition Using Equilibrium Optimizer With a Hybrid Deep Learning Model |
| title_fullStr | Bioinspired Image Processing Enabled Facial Emotion Recognition Using Equilibrium Optimizer With a Hybrid Deep Learning Model |
| title_full_unstemmed | Bioinspired Image Processing Enabled Facial Emotion Recognition Using Equilibrium Optimizer With a Hybrid Deep Learning Model |
| title_short | Bioinspired Image Processing Enabled Facial Emotion Recognition Using Equilibrium Optimizer With a Hybrid Deep Learning Model |
| title_sort | bioinspired image processing enabled facial emotion recognition using equilibrium optimizer with a hybrid deep learning model |
| topic | Non-verbal communication facial emotion recognition deep learning equilibrium optimizer artificial intelligence |
| url | https://ieeexplore.ieee.org/document/10415427/ |
| work_keys_str_mv | AT ahmadaalzahrani bioinspiredimageprocessingenabledfacialemotionrecognitionusingequilibriumoptimizerwithahybriddeeplearningmodel |