Correlation between Human Emotion and Temporal·Spatial Contexts by Analyzing Environmental Factors
In this paper, we propose a method for extracting emotional factors through audiovisual quantitative feature analysis from images of the surrounding environment. Nine features were extracted such as time complexity, spatial complexity (horizontal and vertical), color components (hue and saturation),...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2022-06-01
|
Series: | Future Internet |
Subjects: | |
Online Access: | https://www.mdpi.com/1999-5903/14/7/203 |
_version_ | 1797406338082406400 |
---|---|
author | Minwoo Park Euichul Lee |
author_facet | Minwoo Park Euichul Lee |
author_sort | Minwoo Park |
collection | DOAJ |
description | In this paper, we propose a method for extracting emotional factors through audiovisual quantitative feature analysis from images of the surrounding environment. Nine features were extracted such as time complexity, spatial complexity (horizontal and vertical), color components (hue and saturation), intensity, contrast, sound amplitude, and sound frequency. These nine features were used to infer “pleasant-unpleasant” and “arousal-relaxation” scores through two support vector regressions. First, the inference accuracy for each of the nine features was calculated as a hit ratio to check the distinguishing power of the features. Next, the difference between the position in the two-dimensional emotional plane inferred through SVR and the ground truth determined subjectively by the subject was examined. As a result of the experiment, it was confirmed that the time-complexity feature had the best classification performance, and it was confirmed that the emotion inferred through SVR can be valid when the two-dimensional emotional plane is divided into 3 × 3. |
first_indexed | 2024-03-09T03:24:56Z |
format | Article |
id | doaj.art-e8d29cee3cef4b9cbca01b4f9925cb34 |
institution | Directory Open Access Journal |
issn | 1999-5903 |
language | English |
last_indexed | 2024-03-09T03:24:56Z |
publishDate | 2022-06-01 |
publisher | MDPI AG |
record_format | Article |
series | Future Internet |
spelling | doaj.art-e8d29cee3cef4b9cbca01b4f9925cb342023-12-03T15:04:33ZengMDPI AGFuture Internet1999-59032022-06-0114720310.3390/fi14070203Correlation between Human Emotion and Temporal·Spatial Contexts by Analyzing Environmental FactorsMinwoo Park0Euichul Lee1Department of Computer Science, Graduate School, Sangmyung University, Hongjimun 2-gil 20, Jongro-gu, Seoul 03016, KoreaDepartment of Human-Centered Artificial Intelligence, Sangmyung University, Hongjimun 2-gil 20, Jongro-gu, Seoul 03016, KoreaIn this paper, we propose a method for extracting emotional factors through audiovisual quantitative feature analysis from images of the surrounding environment. Nine features were extracted such as time complexity, spatial complexity (horizontal and vertical), color components (hue and saturation), intensity, contrast, sound amplitude, and sound frequency. These nine features were used to infer “pleasant-unpleasant” and “arousal-relaxation” scores through two support vector regressions. First, the inference accuracy for each of the nine features was calculated as a hit ratio to check the distinguishing power of the features. Next, the difference between the position in the two-dimensional emotional plane inferred through SVR and the ground truth determined subjectively by the subject was examined. As a result of the experiment, it was confirmed that the time-complexity feature had the best classification performance, and it was confirmed that the emotion inferred through SVR can be valid when the two-dimensional emotional plane is divided into 3 × 3.https://www.mdpi.com/1999-5903/14/7/203surrounding environment videotemporal spatial contextscolor componentssoundhuman emotion |
spellingShingle | Minwoo Park Euichul Lee Correlation between Human Emotion and Temporal·Spatial Contexts by Analyzing Environmental Factors Future Internet surrounding environment video temporal spatial contexts color components sound human emotion |
title | Correlation between Human Emotion and Temporal·Spatial Contexts by Analyzing Environmental Factors |
title_full | Correlation between Human Emotion and Temporal·Spatial Contexts by Analyzing Environmental Factors |
title_fullStr | Correlation between Human Emotion and Temporal·Spatial Contexts by Analyzing Environmental Factors |
title_full_unstemmed | Correlation between Human Emotion and Temporal·Spatial Contexts by Analyzing Environmental Factors |
title_short | Correlation between Human Emotion and Temporal·Spatial Contexts by Analyzing Environmental Factors |
title_sort | correlation between human emotion and temporal·spatial contexts by analyzing environmental factors |
topic | surrounding environment video temporal spatial contexts color components sound human emotion |
url | https://www.mdpi.com/1999-5903/14/7/203 |
work_keys_str_mv | AT minwoopark correlationbetweenhumanemotionandtemporalspatialcontextsbyanalyzingenvironmentalfactors AT euichullee correlationbetweenhumanemotionandtemporalspatialcontextsbyanalyzingenvironmentalfactors |