Enhancing Human-Computer Interaction through Emotion Recognition in Real-Life Speech

Extracting the data from real-life speech and recognizing emotions from them is one of the challenging tasks. This has gained popularity over the past few years. The goal of this study is to have a direct human-computer interaction (HCI) to determine the person’s condition or emotion through analyzi...

Full description

Bibliographic Details
Main Authors: Eshwari Rao K P, Anjan S, Nagabhushan T N, Kirill Krinkin, Yulia Schichkina
Format: Article
Language:English
Published: FRUCT 2023-05-01
Series:Proceedings of the XXth Conference of Open Innovations Association FRUCT
Subjects:
Online Access:https://www.fruct.org/publications/volume-33/acm33/files/zzAnj.pdf
_version_ 1797807517652221952
author Eshwari Rao K P
Anjan S
Nagabhushan T N
Kirill Krinkin
Yulia Schichkina
author_facet Eshwari Rao K P
Anjan S
Nagabhushan T N
Kirill Krinkin
Yulia Schichkina
author_sort Eshwari Rao K P
collection DOAJ
description Extracting the data from real-life speech and recognizing emotions from them is one of the challenging tasks. This has gained popularity over the past few years. The goal of this study is to have a direct human-computer interaction (HCI) to determine the person’s condition or emotion through analyzing voice. The main purpose of this study is to extract emotion from the recorded audio as well as from the analysis of text extracted from the audio which is integrated together in a precise manner. The multimodal integration of speech and text gives good results by observing the emotional state of a person. Machine learning and deep learning algorithms are used to determine the emotional state of a person. The result of this study shows the accuracy around 62%.
first_indexed 2024-03-13T06:23:45Z
format Article
id doaj.art-6974cb850b5040f0b9becc40c183d7c4
institution Directory Open Access Journal
issn 2305-7254
2343-0737
language English
last_indexed 2024-03-13T06:23:45Z
publishDate 2023-05-01
publisher FRUCT
record_format Article
series Proceedings of the XXth Conference of Open Innovations Association FRUCT
spelling doaj.art-6974cb850b5040f0b9becc40c183d7c42023-06-09T11:41:51ZengFRUCTProceedings of the XXth Conference of Open Innovations Association FRUCT2305-72542343-07372023-05-0133241541710.5281/zenodo.8005393Enhancing Human-Computer Interaction through Emotion Recognition in Real-Life SpeechEshwari Rao K P0Anjan S1Nagabhushan T N2Kirill Krinkin3Yulia Schichkina4NANAEast West Group of Institutionskrinkin.comETUExtracting the data from real-life speech and recognizing emotions from them is one of the challenging tasks. This has gained popularity over the past few years. The goal of this study is to have a direct human-computer interaction (HCI) to determine the person’s condition or emotion through analyzing voice. The main purpose of this study is to extract emotion from the recorded audio as well as from the analysis of text extracted from the audio which is integrated together in a precise manner. The multimodal integration of speech and text gives good results by observing the emotional state of a person. Machine learning and deep learning algorithms are used to determine the emotional state of a person. The result of this study shows the accuracy around 62%.https://www.fruct.org/publications/volume-33/acm33/files/zzAnj.pdfspeech emotion recognitionnatural language processingmachine learning
spellingShingle Eshwari Rao K P
Anjan S
Nagabhushan T N
Kirill Krinkin
Yulia Schichkina
Enhancing Human-Computer Interaction through Emotion Recognition in Real-Life Speech
Proceedings of the XXth Conference of Open Innovations Association FRUCT
speech emotion recognition
natural language processing
machine learning
title Enhancing Human-Computer Interaction through Emotion Recognition in Real-Life Speech
title_full Enhancing Human-Computer Interaction through Emotion Recognition in Real-Life Speech
title_fullStr Enhancing Human-Computer Interaction through Emotion Recognition in Real-Life Speech
title_full_unstemmed Enhancing Human-Computer Interaction through Emotion Recognition in Real-Life Speech
title_short Enhancing Human-Computer Interaction through Emotion Recognition in Real-Life Speech
title_sort enhancing human computer interaction through emotion recognition in real life speech
topic speech emotion recognition
natural language processing
machine learning
url https://www.fruct.org/publications/volume-33/acm33/files/zzAnj.pdf
work_keys_str_mv AT eshwariraokp enhancinghumancomputerinteractionthroughemotionrecognitioninreallifespeech
AT anjans enhancinghumancomputerinteractionthroughemotionrecognitioninreallifespeech
AT nagabhushantn enhancinghumancomputerinteractionthroughemotionrecognitioninreallifespeech
AT kirillkrinkin enhancinghumancomputerinteractionthroughemotionrecognitioninreallifespeech
AT yuliaschichkina enhancinghumancomputerinteractionthroughemotionrecognitioninreallifespeech