Correlation between Human Emotion and Temporal·Spatial Contexts by Analyzing Environmental Factors

In this paper, we propose a method for extracting emotional factors through audiovisual quantitative feature analysis from images of the surrounding environment. Nine features were extracted such as time complexity, spatial complexity (horizontal and vertical), color components (hue and saturation),...

Full description

Bibliographic Details
Main Authors: Minwoo Park, Euichul Lee
Format: Article
Language:English
Published: MDPI AG 2022-06-01
Series:Future Internet
Subjects:
Online Access:https://www.mdpi.com/1999-5903/14/7/203
_version_ 1797406338082406400
author Minwoo Park
Euichul Lee
author_facet Minwoo Park
Euichul Lee
author_sort Minwoo Park
collection DOAJ
description In this paper, we propose a method for extracting emotional factors through audiovisual quantitative feature analysis from images of the surrounding environment. Nine features were extracted such as time complexity, spatial complexity (horizontal and vertical), color components (hue and saturation), intensity, contrast, sound amplitude, and sound frequency. These nine features were used to infer “pleasant-unpleasant” and “arousal-relaxation” scores through two support vector regressions. First, the inference accuracy for each of the nine features was calculated as a hit ratio to check the distinguishing power of the features. Next, the difference between the position in the two-dimensional emotional plane inferred through SVR and the ground truth determined subjectively by the subject was examined. As a result of the experiment, it was confirmed that the time-complexity feature had the best classification performance, and it was confirmed that the emotion inferred through SVR can be valid when the two-dimensional emotional plane is divided into 3 × 3.
first_indexed 2024-03-09T03:24:56Z
format Article
id doaj.art-e8d29cee3cef4b9cbca01b4f9925cb34
institution Directory Open Access Journal
issn 1999-5903
language English
last_indexed 2024-03-09T03:24:56Z
publishDate 2022-06-01
publisher MDPI AG
record_format Article
series Future Internet
spelling doaj.art-e8d29cee3cef4b9cbca01b4f9925cb342023-12-03T15:04:33ZengMDPI AGFuture Internet1999-59032022-06-0114720310.3390/fi14070203Correlation between Human Emotion and Temporal·Spatial Contexts by Analyzing Environmental FactorsMinwoo Park0Euichul Lee1Department of Computer Science, Graduate School, Sangmyung University, Hongjimun 2-gil 20, Jongro-gu, Seoul 03016, KoreaDepartment of Human-Centered Artificial Intelligence, Sangmyung University, Hongjimun 2-gil 20, Jongro-gu, Seoul 03016, KoreaIn this paper, we propose a method for extracting emotional factors through audiovisual quantitative feature analysis from images of the surrounding environment. Nine features were extracted such as time complexity, spatial complexity (horizontal and vertical), color components (hue and saturation), intensity, contrast, sound amplitude, and sound frequency. These nine features were used to infer “pleasant-unpleasant” and “arousal-relaxation” scores through two support vector regressions. First, the inference accuracy for each of the nine features was calculated as a hit ratio to check the distinguishing power of the features. Next, the difference between the position in the two-dimensional emotional plane inferred through SVR and the ground truth determined subjectively by the subject was examined. As a result of the experiment, it was confirmed that the time-complexity feature had the best classification performance, and it was confirmed that the emotion inferred through SVR can be valid when the two-dimensional emotional plane is divided into 3 × 3.https://www.mdpi.com/1999-5903/14/7/203surrounding environment videotemporal spatial contextscolor componentssoundhuman emotion
spellingShingle Minwoo Park
Euichul Lee
Correlation between Human Emotion and Temporal·Spatial Contexts by Analyzing Environmental Factors
Future Internet
surrounding environment video
temporal spatial contexts
color components
sound
human emotion
title Correlation between Human Emotion and Temporal·Spatial Contexts by Analyzing Environmental Factors
title_full Correlation between Human Emotion and Temporal·Spatial Contexts by Analyzing Environmental Factors
title_fullStr Correlation between Human Emotion and Temporal·Spatial Contexts by Analyzing Environmental Factors
title_full_unstemmed Correlation between Human Emotion and Temporal·Spatial Contexts by Analyzing Environmental Factors
title_short Correlation between Human Emotion and Temporal·Spatial Contexts by Analyzing Environmental Factors
title_sort correlation between human emotion and temporal·spatial contexts by analyzing environmental factors
topic surrounding environment video
temporal spatial contexts
color components
sound
human emotion
url https://www.mdpi.com/1999-5903/14/7/203
work_keys_str_mv AT minwoopark correlationbetweenhumanemotionandtemporalspatialcontextsbyanalyzingenvironmentalfactors
AT euichullee correlationbetweenhumanemotionandtemporalspatialcontextsbyanalyzingenvironmentalfactors