Four-Class Emotion Classification using Electrocardiography (ECG) in Virtual Reality (VR)

The main objective of this paper is to investigate if ECG signals can be utilized to classify emotions based on Russell's four-class circumplex emotion model in a VR environment using SVM classifiers. Electrocardiogram (ECG) signals were collected with a medical-grade wearable heart rate monito...

Full description

Bibliographic Details
Main Authors: Aaron Frederick Bulagang, James Mountstephens, Jason Teo
Format: Article
Language:English
English
Published: 2020
Online Access:https://eprints.ums.edu.my/id/eprint/25647/1/Four-Class%20Emotion%20Classification%20using%20Electrocardiography%20%28ECG%29%20in%20Virtual%20Reality%20%28VR%292.pdf
https://eprints.ums.edu.my/id/eprint/25647/2/Four-Class%20Emotion%20Classification%20using%20Electrocardiography%20%28ECG%29%20in%20Virtual%20Reality%20%28VR%291.pdf
_version_ 1796910398862000128
author Aaron Frederick Bulagang
James Mountstephens
Jason Teo
author_facet Aaron Frederick Bulagang
James Mountstephens
Jason Teo
author_sort Aaron Frederick Bulagang
collection UMS
description The main objective of this paper is to investigate if ECG signals can be utilized to classify emotions based on Russell's four-class circumplex emotion model in a VR environment using SVM classifiers. Electrocardiogram (ECG) signals were collected with a medical-grade wearable heart rate monitor from Empatica (E4 Wristband) and Empatica Realtime Monitor application during this research. ECG was employed as the tool to capture the test subjects’ physiological signals via their heart rate. A preliminary experiment was conducted using a heart rate monitor to gain ECG signal, and a VR Headset for subjects to view 360 degrees video stimuli. A total of 5 subjects participated in this experiment. Data from the 5 subjects were then processed with R Studio using SVM classifier. The data was classified into four distinct emotion classes using both inter-subject classification and intra-subject classification approaches, with inter-subject classification yielding an accuracy of 48% while intrasubject classification ranges from 50% to 74%. These results demonstrate the potential of using ECG as a promising sensor modality for four-class emotion classification in virtual reality using wearable technology.
first_indexed 2024-03-06T03:03:52Z
format Article
id ums.eprints-25647
institution Universiti Malaysia Sabah
language English
English
last_indexed 2024-03-06T03:03:52Z
publishDate 2020
record_format dspace
spelling ums.eprints-256472021-01-06T00:38:33Z https://eprints.ums.edu.my/id/eprint/25647/ Four-Class Emotion Classification using Electrocardiography (ECG) in Virtual Reality (VR) Aaron Frederick Bulagang James Mountstephens Jason Teo The main objective of this paper is to investigate if ECG signals can be utilized to classify emotions based on Russell's four-class circumplex emotion model in a VR environment using SVM classifiers. Electrocardiogram (ECG) signals were collected with a medical-grade wearable heart rate monitor from Empatica (E4 Wristband) and Empatica Realtime Monitor application during this research. ECG was employed as the tool to capture the test subjects’ physiological signals via their heart rate. A preliminary experiment was conducted using a heart rate monitor to gain ECG signal, and a VR Headset for subjects to view 360 degrees video stimuli. A total of 5 subjects participated in this experiment. Data from the 5 subjects were then processed with R Studio using SVM classifier. The data was classified into four distinct emotion classes using both inter-subject classification and intra-subject classification approaches, with inter-subject classification yielding an accuracy of 48% while intrasubject classification ranges from 50% to 74%. These results demonstrate the potential of using ECG as a promising sensor modality for four-class emotion classification in virtual reality using wearable technology. 2020 Article PeerReviewed text en https://eprints.ums.edu.my/id/eprint/25647/1/Four-Class%20Emotion%20Classification%20using%20Electrocardiography%20%28ECG%29%20in%20Virtual%20Reality%20%28VR%292.pdf text en https://eprints.ums.edu.my/id/eprint/25647/2/Four-Class%20Emotion%20Classification%20using%20Electrocardiography%20%28ECG%29%20in%20Virtual%20Reality%20%28VR%291.pdf Aaron Frederick Bulagang and James Mountstephens and Jason Teo (2020) Four-Class Emotion Classification using Electrocardiography (ECG) in Virtual Reality (VR). International Journal of Advanced Science and Technology, 29 (6). pp. 1523-1529.
spellingShingle Aaron Frederick Bulagang
James Mountstephens
Jason Teo
Four-Class Emotion Classification using Electrocardiography (ECG) in Virtual Reality (VR)
title Four-Class Emotion Classification using Electrocardiography (ECG) in Virtual Reality (VR)
title_full Four-Class Emotion Classification using Electrocardiography (ECG) in Virtual Reality (VR)
title_fullStr Four-Class Emotion Classification using Electrocardiography (ECG) in Virtual Reality (VR)
title_full_unstemmed Four-Class Emotion Classification using Electrocardiography (ECG) in Virtual Reality (VR)
title_short Four-Class Emotion Classification using Electrocardiography (ECG) in Virtual Reality (VR)
title_sort four class emotion classification using electrocardiography ecg in virtual reality vr
url https://eprints.ums.edu.my/id/eprint/25647/1/Four-Class%20Emotion%20Classification%20using%20Electrocardiography%20%28ECG%29%20in%20Virtual%20Reality%20%28VR%292.pdf
https://eprints.ums.edu.my/id/eprint/25647/2/Four-Class%20Emotion%20Classification%20using%20Electrocardiography%20%28ECG%29%20in%20Virtual%20Reality%20%28VR%291.pdf
work_keys_str_mv AT aaronfrederickbulagang fourclassemotionclassificationusingelectrocardiographyecginvirtualrealityvr
AT jamesmountstephens fourclassemotionclassificationusingelectrocardiographyecginvirtualrealityvr
AT jasonteo fourclassemotionclassificationusingelectrocardiographyecginvirtualrealityvr