Emotion Recognition in Complex Classroom Scenes Based on Improved Convolutional Block Attention Module Algorithm
This study provides a deep learning-based intelligent recognition technology for student facial expressions in the classroom. This technology realizes the recognition of students’ facial expressions and provides a practical approach for classroom assessment and teacher improvement of teac...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10347023/ |
| _version_ | 1797376379823587328 |
|---|---|
| author | Li Li Dengfeng Yao |
| author_facet | Li Li Dengfeng Yao |
| author_sort | Li Li |
| collection | DOAJ |
| description | This study provides a deep learning-based intelligent recognition technology for student facial expressions in the classroom. This technology realizes the recognition of students’ facial expressions and provides a practical approach for classroom assessment and teacher improvement of teaching methods toward achieving smart education. An improved hybrid attention mechanism is designed for the student classroom. The facial expression recognition model addresses issues of instability in the recognition process of student facial expressions in the classroom, the high redundancy of parameters in traditional convolutional neural networks, and the long training time and slow convergence prone to overfitting. In the image modality data, this study proposes a hybrid attention mechanism in the deep neural network model before feature fusion to extract network features with stronger representational capability, enhance the prediction performance of deep neural networks, and improve the interpretability of the model. The improved hybrid attention mechanism is introduced into the deep neural network by modifying the convolutional block attention module with shortcut connections, deepening the network depth of the attention module and enabling it to learn the weight information among feature channels and spatial regions effectively. The proposed student facial expression recognition model achieves an accuracy of 88.71% on the publicly available RAF-DB dataset and an accuracy of 86.14% on the self-collected real classroom teaching video dataset. The proposed technology can be applied in the education field to evaluate student engagement automatically, provide personalized teaching guidance and learning analytics for teachers, and promote the development of intelligent education. |
| first_indexed | 2024-03-08T19:37:42Z |
| format | Article |
| id | doaj.art-d534e120417d4cfeb56e257db41c8d2f |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-08T19:37:42Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-d534e120417d4cfeb56e257db41c8d2f2023-12-26T00:06:03ZengIEEEIEEE Access2169-35362023-01-011114305014305910.1109/ACCESS.2023.334051010347023Emotion Recognition in Complex Classroom Scenes Based on Improved Convolutional Block Attention Module AlgorithmLi Li0https://orcid.org/0009-0003-4791-3114Dengfeng Yao1https://orcid.org/0000-0003-3079-3227Beijing Key Laboratory of Information Service Engineering, Beijing Union University, Beijing, ChinaBeijing Key Laboratory of Information Service Engineering, Beijing Union University, Beijing, ChinaThis study provides a deep learning-based intelligent recognition technology for student facial expressions in the classroom. This technology realizes the recognition of students’ facial expressions and provides a practical approach for classroom assessment and teacher improvement of teaching methods toward achieving smart education. An improved hybrid attention mechanism is designed for the student classroom. The facial expression recognition model addresses issues of instability in the recognition process of student facial expressions in the classroom, the high redundancy of parameters in traditional convolutional neural networks, and the long training time and slow convergence prone to overfitting. In the image modality data, this study proposes a hybrid attention mechanism in the deep neural network model before feature fusion to extract network features with stronger representational capability, enhance the prediction performance of deep neural networks, and improve the interpretability of the model. The improved hybrid attention mechanism is introduced into the deep neural network by modifying the convolutional block attention module with shortcut connections, deepening the network depth of the attention module and enabling it to learn the weight information among feature channels and spatial regions effectively. The proposed student facial expression recognition model achieves an accuracy of 88.71% on the publicly available RAF-DB dataset and an accuracy of 86.14% on the self-collected real classroom teaching video dataset. The proposed technology can be applied in the education field to evaluate student engagement automatically, provide personalized teaching guidance and learning analytics for teachers, and promote the development of intelligent education.https://ieeexplore.ieee.org/document/10347023/Attention mechanismdeep learningDenseNetfacial expression recognitionclassroom student expressions |
| spellingShingle | Li Li Dengfeng Yao Emotion Recognition in Complex Classroom Scenes Based on Improved Convolutional Block Attention Module Algorithm IEEE Access Attention mechanism deep learning DenseNet facial expression recognition classroom student expressions |
| title | Emotion Recognition in Complex Classroom Scenes Based on Improved Convolutional Block Attention Module Algorithm |
| title_full | Emotion Recognition in Complex Classroom Scenes Based on Improved Convolutional Block Attention Module Algorithm |
| title_fullStr | Emotion Recognition in Complex Classroom Scenes Based on Improved Convolutional Block Attention Module Algorithm |
| title_full_unstemmed | Emotion Recognition in Complex Classroom Scenes Based on Improved Convolutional Block Attention Module Algorithm |
| title_short | Emotion Recognition in Complex Classroom Scenes Based on Improved Convolutional Block Attention Module Algorithm |
| title_sort | emotion recognition in complex classroom scenes based on improved convolutional block attention module algorithm |
| topic | Attention mechanism deep learning DenseNet facial expression recognition classroom student expressions |
| url | https://ieeexplore.ieee.org/document/10347023/ |
| work_keys_str_mv | AT lili emotionrecognitionincomplexclassroomscenesbasedonimprovedconvolutionalblockattentionmodulealgorithm AT dengfengyao emotionrecognitionincomplexclassroomscenesbasedonimprovedconvolutionalblockattentionmodulealgorithm |