Asian Affective and Emotional State (A2ES) Dataset of ECG and PPG for Affective Computing Research

Affective computing focuses on instilling emotion awareness in machines. This area has attracted many researchers globally. However, the lack of an affective database based on physiological signals from the Asian continent has been reported. This is an important issue for ensuring inclusiveness and...

Full description

Bibliographic Details
Main Authors: Nor Azlina Ab. Aziz, Tawsif K., Sharifah Noor Masidayu Sayed Ismail, Muhammad Anas Hasnul, Kamarulzaman Ab. Aziz, Siti Zainab Ibrahim, Azlan Abd. Aziz, J. Emerson Raja
Format: Article
Language:English
Published: MDPI AG 2023-02-01
Series:Algorithms
Subjects:
Online Access:https://www.mdpi.com/1999-4893/16/3/130
_version_ 1797613965752139776
author Nor Azlina Ab. Aziz
Tawsif K.
Sharifah Noor Masidayu Sayed Ismail
Muhammad Anas Hasnul
Kamarulzaman Ab. Aziz
Siti Zainab Ibrahim
Azlan Abd. Aziz
J. Emerson Raja
author_facet Nor Azlina Ab. Aziz
Tawsif K.
Sharifah Noor Masidayu Sayed Ismail
Muhammad Anas Hasnul
Kamarulzaman Ab. Aziz
Siti Zainab Ibrahim
Azlan Abd. Aziz
J. Emerson Raja
author_sort Nor Azlina Ab. Aziz
collection DOAJ
description Affective computing focuses on instilling emotion awareness in machines. This area has attracted many researchers globally. However, the lack of an affective database based on physiological signals from the Asian continent has been reported. This is an important issue for ensuring inclusiveness and avoiding bias in this field. This paper introduces an emotion recognition database, the Asian Affective and Emotional State (A2ES) dataset, for affective computing research. The database comprises electrocardiogram (ECG) and photoplethysmography (PPG) recordings from 47 Asian participants of various ethnicities. The subjects were exposed to 25 carefully selected audio–visual stimuli to elicit specific targeted emotions. An analysis of the participants’ self-assessment and a list of the 25 stimuli utilised are also presented in this work. Emotion recognition systems are built using ECG and PPG data; five machine learning algorithms: support vector machine (SVM), k-nearest neighbour (KNN), naive Bayes (NB), decision tree (DT), and random forest (RF); and deep learning techniques. The performance of the systems built are presented and compared. The SVM was found to be the best learning algorithm for the ECG data, while RF was the best for the PPG data. The proposed database is available to other researchers.
first_indexed 2024-03-11T07:02:58Z
format Article
id doaj.art-df1c12f9f1494b1f879af4eb21c506bd
institution Directory Open Access Journal
issn 1999-4893
language English
last_indexed 2024-03-11T07:02:58Z
publishDate 2023-02-01
publisher MDPI AG
record_format Article
series Algorithms
spelling doaj.art-df1c12f9f1494b1f879af4eb21c506bd2023-11-17T09:08:56ZengMDPI AGAlgorithms1999-48932023-02-0116313010.3390/a16030130Asian Affective and Emotional State (A2ES) Dataset of ECG and PPG for Affective Computing ResearchNor Azlina Ab. Aziz0Tawsif K.1Sharifah Noor Masidayu Sayed Ismail2Muhammad Anas Hasnul3Kamarulzaman Ab. Aziz4Siti Zainab Ibrahim5Azlan Abd. Aziz6J. Emerson Raja7Faculty of Engineering & Technology, Multimedia University, Bukit Beruang 75450, Melaka, MalaysiaFaculty of Engineering & Technology, Multimedia University, Bukit Beruang 75450, Melaka, MalaysiaFaculty of Information Science & Technology, Multimedia University, Bukit Beruang 75450, Melaka, MalaysiaFaculty of Engineering & Technology, Multimedia University, Bukit Beruang 75450, Melaka, MalaysiaFaculty of Business, Multimedia University, Bukit Beruang 75450, Melaka, MalaysiaSchool of Computing and Informatics, Albukhary International University, Jalan Tun Abdul Razak, Alor Setar 05200, Kedah, MalaysiaFaculty of Engineering & Technology, Multimedia University, Bukit Beruang 75450, Melaka, MalaysiaFaculty of Engineering & Technology, Multimedia University, Bukit Beruang 75450, Melaka, MalaysiaAffective computing focuses on instilling emotion awareness in machines. This area has attracted many researchers globally. However, the lack of an affective database based on physiological signals from the Asian continent has been reported. This is an important issue for ensuring inclusiveness and avoiding bias in this field. This paper introduces an emotion recognition database, the Asian Affective and Emotional State (A2ES) dataset, for affective computing research. The database comprises electrocardiogram (ECG) and photoplethysmography (PPG) recordings from 47 Asian participants of various ethnicities. The subjects were exposed to 25 carefully selected audio–visual stimuli to elicit specific targeted emotions. An analysis of the participants’ self-assessment and a list of the 25 stimuli utilised are also presented in this work. Emotion recognition systems are built using ECG and PPG data; five machine learning algorithms: support vector machine (SVM), k-nearest neighbour (KNN), naive Bayes (NB), decision tree (DT), and random forest (RF); and deep learning techniques. The performance of the systems built are presented and compared. The SVM was found to be the best learning algorithm for the ECG data, while RF was the best for the PPG data. The proposed database is available to other researchers.https://www.mdpi.com/1999-4893/16/3/130affective computingemotion recognition systemphysiological signals
spellingShingle Nor Azlina Ab. Aziz
Tawsif K.
Sharifah Noor Masidayu Sayed Ismail
Muhammad Anas Hasnul
Kamarulzaman Ab. Aziz
Siti Zainab Ibrahim
Azlan Abd. Aziz
J. Emerson Raja
Asian Affective and Emotional State (A2ES) Dataset of ECG and PPG for Affective Computing Research
Algorithms
affective computing
emotion recognition system
physiological signals
title Asian Affective and Emotional State (A2ES) Dataset of ECG and PPG for Affective Computing Research
title_full Asian Affective and Emotional State (A2ES) Dataset of ECG and PPG for Affective Computing Research
title_fullStr Asian Affective and Emotional State (A2ES) Dataset of ECG and PPG for Affective Computing Research
title_full_unstemmed Asian Affective and Emotional State (A2ES) Dataset of ECG and PPG for Affective Computing Research
title_short Asian Affective and Emotional State (A2ES) Dataset of ECG and PPG for Affective Computing Research
title_sort asian affective and emotional state a2es dataset of ecg and ppg for affective computing research
topic affective computing
emotion recognition system
physiological signals
url https://www.mdpi.com/1999-4893/16/3/130
work_keys_str_mv AT norazlinaabaziz asianaffectiveandemotionalstatea2esdatasetofecgandppgforaffectivecomputingresearch
AT tawsifk asianaffectiveandemotionalstatea2esdatasetofecgandppgforaffectivecomputingresearch
AT sharifahnoormasidayusayedismail asianaffectiveandemotionalstatea2esdatasetofecgandppgforaffectivecomputingresearch
AT muhammadanashasnul asianaffectiveandemotionalstatea2esdatasetofecgandppgforaffectivecomputingresearch
AT kamarulzamanabaziz asianaffectiveandemotionalstatea2esdatasetofecgandppgforaffectivecomputingresearch
AT sitizainabibrahim asianaffectiveandemotionalstatea2esdatasetofecgandppgforaffectivecomputingresearch
AT azlanabdaziz asianaffectiveandemotionalstatea2esdatasetofecgandppgforaffectivecomputingresearch
AT jemersonraja asianaffectiveandemotionalstatea2esdatasetofecgandppgforaffectivecomputingresearch