Algorithm development for recognizing human emotions using a convolutional neural network based on audio data
Objectives. This article provides a description and experience of creating the algorithm for recognizing the emotional state of the subject.Methods. Image processing methods are used.Results. The proposed algorithm makes it possible to recognize the emotional states of the subject on the basis of an...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | Russian |
| Published: |
The United Institute of Informatics Problems of the National Academy of Sciences of Belarus
2022-12-01
|
| Series: | Informatika |
| Subjects: | |
| Online Access: | https://inf.grid.by/jour/article/view/1211 |
| _version_ | 1797877179582775296 |
|---|---|
| author | V. V. Semenuk M. V. Skladchikov |
| author_facet | V. V. Semenuk M. V. Skladchikov |
| author_sort | V. V. Semenuk |
| collection | DOAJ |
| description | Objectives. This article provides a description and experience of creating the algorithm for recognizing the emotional state of the subject.Methods. Image processing methods are used.Results. The proposed algorithm makes it possible to recognize the emotional states of the subject on the basis of an audio data set. It was possible to improve the accuracy of the algorithm by changing the data set supplied to the input of the neural network.The stages of training convolutional neural network on a pre-prepared set of audio data are described, and the structure of the algorithm is described. To validate the neural network different set of audio data, not participating in the training, was selected. As a result of the study, graphs were constructed demonstrating the accuracy of the proposed method.After receiving the initial data of the study, the analysis of the possibilities for improving the algorithm in terms of ergonomics and accuracy of operation was also carried out. The strategy was developed to achieve a better result and obtain a more accurate algorithm. Based on the conclusions presented in the article, the rationale for choosing the representation of the data set and the software package necessary for the implementation of the software part of the algorithm is given.Conclusion. The proposed algorithm has a high accuracy of operation and does not require large computational costs. |
| first_indexed | 2024-04-10T02:14:09Z |
| format | Article |
| id | doaj.art-977534435cd549e69daad59c7bc66c6e |
| institution | Directory Open Access Journal |
| issn | 1816-0301 |
| language | Russian |
| last_indexed | 2024-04-10T02:14:09Z |
| publishDate | 2022-12-01 |
| publisher | The United Institute of Informatics Problems of the National Academy of Sciences of Belarus |
| record_format | Article |
| series | Informatika |
| spelling | doaj.art-977534435cd549e69daad59c7bc66c6e2023-03-13T08:32:25ZrusThe United Institute of Informatics Problems of the National Academy of Sciences of BelarusInformatika1816-03012022-12-01194536810.37661/1816-0301-2022-19-4-53-681015Algorithm development for recognizing human emotions using a convolutional neural network based on audio dataV. V. Semenuk0M. V. Skladchikov1Donetsk Technical School of Industrial Automation after A. V. ZakharchenkoDonetsk Technical School of Industrial Automation after A. V. ZakharchenkoObjectives. This article provides a description and experience of creating the algorithm for recognizing the emotional state of the subject.Methods. Image processing methods are used.Results. The proposed algorithm makes it possible to recognize the emotional states of the subject on the basis of an audio data set. It was possible to improve the accuracy of the algorithm by changing the data set supplied to the input of the neural network.The stages of training convolutional neural network on a pre-prepared set of audio data are described, and the structure of the algorithm is described. To validate the neural network different set of audio data, not participating in the training, was selected. As a result of the study, graphs were constructed demonstrating the accuracy of the proposed method.After receiving the initial data of the study, the analysis of the possibilities for improving the algorithm in terms of ergonomics and accuracy of operation was also carried out. The strategy was developed to achieve a better result and obtain a more accurate algorithm. Based on the conclusions presented in the article, the rationale for choosing the representation of the data set and the software package necessary for the implementation of the software part of the algorithm is given.Conclusion. The proposed algorithm has a high accuracy of operation and does not require large computational costs.https://inf.grid.by/jour/article/view/1211neural networkhuman emotion recognitionconvolutional neural networksound fingerprintingtensоrflow software librarykeras neural network librarymatlab software package |
| spellingShingle | V. V. Semenuk M. V. Skladchikov Algorithm development for recognizing human emotions using a convolutional neural network based on audio data Informatika neural network human emotion recognition convolutional neural network sound fingerprinting tensоrflow software library keras neural network library matlab software package |
| title | Algorithm development for recognizing human emotions using a convolutional neural network based on audio data |
| title_full | Algorithm development for recognizing human emotions using a convolutional neural network based on audio data |
| title_fullStr | Algorithm development for recognizing human emotions using a convolutional neural network based on audio data |
| title_full_unstemmed | Algorithm development for recognizing human emotions using a convolutional neural network based on audio data |
| title_short | Algorithm development for recognizing human emotions using a convolutional neural network based on audio data |
| title_sort | algorithm development for recognizing human emotions using a convolutional neural network based on audio data |
| topic | neural network human emotion recognition convolutional neural network sound fingerprinting tensоrflow software library keras neural network library matlab software package |
| url | https://inf.grid.by/jour/article/view/1211 |
| work_keys_str_mv | AT vvsemenuk algorithmdevelopmentforrecognizinghumanemotionsusingaconvolutionalneuralnetworkbasedonaudiodata AT mvskladchikov algorithmdevelopmentforrecognizinghumanemotionsusingaconvolutionalneuralnetworkbasedonaudiodata |